You aren't supposed to. But many mums and dads have been guilty of such a crime. For us, it was just easier way to get around HK when we first moved here. Bub was about 10 kgs. And his dad took him everywhere in the Baby Bjorn.
So, if you're planning a one off lengthy use of the BB, don't worry about it.