Most people are not forced to have lunch with their colleagues, a lot of people enjoy doing so however.

I always went out by myself when I wanted to eat alone, or sat at my desk with headphones in watching Youtube and eating.

You can communicate with people to help them understand you'd like your break to be a solitary one.