I my experience having lunch with colleagues helps to get to know your co-workers. Which in turn helps to work better with them. Usually they do not become my friends. It is still a professional relationship.

I am curious: Are you going out for lunch alone? Or are you not going out for lunch at all? Or don't you have a lunch break?