I was given a booster seat for my baby when he was still young, so I just used that at first, instead of buying a high chair. He liked it fine, and he was ok to sit in it and everything, but for my taste, it was too low and my back ached when I fed him.
After a short stint with one of those large, padded fancy seats, which was awful to clean, I went and bought the white IKEA one. It's great. Easy to clean, they can sit well, and very cheap.
I'll go back to the booster later, but now at 18 months, he's still happy in his high chair.
So, if only for the height, I would say that high chairs are better for younger babies.