Kowloon and Hong Kong Island. The Star Ferry is a great time piece, agreed. However I don't consider Victoria Peak, hiking trails, buses wrapped in advertisements or bilingual signage to be examples that project a sense of history. Yes there is still the odd colonial building but they are pretty exceptional.
But perhaps nothing says "history" quite like that most every day item: money. Back in the 1800s, banks issued money. Nowadays the State issues money, but HK notes are still issued by three banks (albeit with strict supervision of the State), which have their names on them. Personally, I find the ones from the Hong Kong and Shanghai Banking Company to be the most attractive. The coins bear more than a passing resemblance to British coinage, too.
I think Hong Kong is a great example of history being integrated into the culture.