I'd go for a few agency jobs for a 2-6 month stint, be nice to people and spend your time working with them not alongside them and gain some reputation. After a couple of positions, return work is usually possible. Then general staff turnover in tech companies will propagate your reputation as well. The first 2 years is the most difficult.
I'm going to add this as well: never work hard. Work out how not to work hard. Life is about what you do when you're not working for me at least.
> are building contacts and getting out of the agency system as soon as possible.
I know, but how do you do that? Right now I am working for home and remotely collaborating with a friend in a product, but the VC path is also hard :(