Here in the UK there was a period when the Union Jack was hijacked by the far right (notably the British National Party and the National Front). They made prominent use of the flag in everything they did, so people avoided displaying it in other contexts because doing so would be seen as a coded statement of support for the far right.