Vultr is at $2.50 a month for 512mb ram which is plenty for a side project. As for your tech stack you'd use Linux of course but as for programming language it's your preference.

I think my current favorite stack would be node + mongo + vue for a side project. Sure people hate mongo for big projects, but it's just so stinking convenient.