The jockey club runs public riding schools in Pokfulam and Tuen Mun. I think there are very long waiting lists for the school in Pokfulam. But not for the one at Tuen Mun. You can find their details on the internet.
There are also a few private riding schools in HK, based mainly in the NT- I read about them in Inside DB but forgot to keep the details.