That's not what would happen. What would happen is that rich kids would get to go to college no matter how prepared they were or what major they chose, and poor kids who prepared well and chose useful majors would not be able to afford it.
Look at any first-world country that has kept college education affordable and you will see that they are essentially propping it up as a social welfare program, capping tuition, and giving universities tons of money. No country has kept college education affordable through any other method.
That's also the way it used to work at state universities in the United States, and that's why kids were able to work summer jobs to cover tuition.
If you take away the loans without also significantly increasing funding for higher education, college will not become affordable again.
A young person with no income but good academics and a plan to study something with good employment prospects would still be a good candidate for at least some amount of credit.
Another side effect would be that with a drop in people going to college, employers would be forced to drop the "college degree required" from the vast number of jobs that really do not require a college education of any kind.