That's why you get certain allowances of how much you are allowed to bring back with you - say up to 200 cartons of cigarettes are free to bring over and that's clearly not something that you brought with you.
> Other goods (including perfume, coffee, tea, electronic devices etc.)(a) - Up to a value of €430 for air and sea travellers
Of course things you owned, left the country and are returning with are exempt.
Import Duties apply to items purchased while outside the country and that you are returning with.
If you were away long enough to establish residency, there are usually exemptions to items of personal property you are bring back with you.
The duty-free allowance is different for every country, but in Germany for example it is around 450€ per person (the exact number escapes me). Any goods you return with in excess of that amount is subject to duty.. Some items you return with are always subject to duties.
In Germany for example, they very much will check for this and enforce it.
If you travel to the USA for a week and buy something, that's subject to import duty.