> I'd feel bad, but they were better off and didn't mind (at least they said they didn't mind)

They didn't mind. It feels very good to do something nice for a friend. If it didn't, they wouldn't keep inviting you.