I don't think this is true. India was colonized, and it had very comparable technology - perhaps 50 or 100 years behind. There are cases of very primative people being colonised of course, but often the capabilities of other civilisations are minimised in our history - for example north american natives are seen as hunter gatherers whereas there was extensive farming and land exploitation in many places in the USA - along with pottery and settled living.
We have hands-on experience as a species with technologically primitive societies being discovered by technologically advanced societies and going on to influence language and philosophy.
Given this, I don't think it's a given that an advanced alien race would look at us as not worth their time.
Looking back historically, many of the European powers of the 1500s-1800s were literally millennia ahead of the people they colonised in terms of technological prowess.
In spite of this, indigenous ideas, beliefs and culture still had an influence on the Europeans (and if it weren't for the attitudes of the time that influence would be much greater and we'd be all the better for it).
I wouldn't be surprised if Aliens with advanced technology discovering Earth found the same thing.