Would the default route table do that job? Subnets would be associated with that if they weren't explicitly assigned to another route table, right?

Yes. But i prefer to create my own. Create a riutetable, call it “public” using a tag, attach the internetgateway and attach all public subnets, add a default route that points to the internetgateway and you’re done