Someone will probably beat me to this while i'm typing this in
It's a male Eastern Spinebill of the group Long-Billed Honeyeaters so i guess that makes your guess spot on.
I am surprised at just how many varieties of honeyeater Australia has. My book of Aussie birds lists quite a few more than most other species.
He looks cute next to those two flowers, that i assume he was feeding on.