If you really want to go with the startup, I recommend offering to pay back the money the tech company is spending on doing your visa transfer. This might keep a thin bridge alive between the two of you. Also, make sure the startup knows what is involved in doing a visa transfer, GC after that etc. Good luck!