One truth is that customers tend to refer customers like them. Easy to work with customers, that pay on time, tend to refer others that do the same.
I spent almost all of my years working with wonderful people.
And because they are good clients the established consultants will move the heavens to keep them happy.
And because they are established consultants they can take a loss on a project and still be around for the next one in two years.
I hang out on /r/freelance and it's all too common that new freelancers are frustrated because they thought that now they'd just be free to "practice their craft" but they have no interest in all the other minutiae that's required.
OP: the best advice I can offer is to ask yourself if you want to run a business. Because that's what it is. Not programming, not coding, not design (although you will do those things). You have to realize that you are running a small business and it would be best if you understand that right out the gate and it's something that you will enjoy.
But still it's a less exclusive situation and maybe not worth it if you really are attached to a single client.
If you can find good clients, contracting can be great, but bad clients can be a real drag: it’s easier to quit a job than it is to fire a client.
I’d recommend giving it a go, but don’t expect it to be better, just different. Personally, on balance, I prefer it and don’t plan to go back to full time… but it’s often just as defeating.
(Regarding how easy it is, it’s very easy, anybody who can get a full time job can do contracting, software engineering contracting is in high demand, always.)