The biggest correlation on success later in life is how wealthy your parents are. Chances are you would be living in a safer neighborhood with better role models and exposed to more opportunities for further success, while being relatively insulated from opportunities for self-destruction.

College functions to get you out of your class bubble and expose other opportunities that you wouldn't otherwise have living at home. You play college right like many do, you advance up that economic ladder, and in the process set up your future kids for trivially easy success.