You’re right, a relatively large influx of foreign workers of any skill level is harmful to all people, but especially the local people if it causes a reduction in wages.

If the cost of goods increases, it won’t likely be severe since it serves the entire population while only a small percentage of the population produce the goods. Also changing prices affects demand independently from cost of production.