If they were born in HK and raised there, they would call themselves a HKer (香港人) from Hong Kong. It's highly unlikely they would say they are from 'China' because in their eyes China is Mainland China (大陆/中国) and there is negativity associated with it.
Confusingly, my friends whose parents are from Hong Kong and were born in the UK identify themselves as 'British Born Chinese' rather than 'British Born HKer'.
I use Cantonese or English when in Hong Kong. Speaking Mandarin there, when you look East Asian, is just asking for trouble if you are in wrong part of town.
- a state (the PRC) - an ethnic group (Han) - a culture
The government of the PRC will gladly conflate those things serves their interests.
Most people in Hongkong would definitely identify as culturally and ethnically Chinese. That third item is ... a point of contention. I expect the situation in Taiwan is similar.
On the other side, it is possible to be nationally Chinese but neither culturally nor ethnically so -- see the Tibetans or Uighur for examples.
I suppose it's not surprising when someone's when someone adopts their parents' culture etc. despite being born abroad (e.g. self-describing as Indian without being a citizen/born there) - so makes sense, I just hadn't realised.