I have very very little experience with electrical engineering (I'm in the Lego mindset of I plug things in according to things I find online until they work), but is there something I should be using instead with 120V ~3-5 A loads?
Relays are great though for motor controllers, especially when you need higher amperages (and don't want the huge expense a mosfet solution can sometimes bring); an h-bridge is very simple to build, and tying an n-channel mosfet (of appropriate amperage capability) on the low-side between the relay(s) and ground, and you get easy PWM control (just don't switch the relay while PWM'ing of course).
Paying a premium for a new part with predictable characteristics isn't always a mistake.
Another problem is if you use one to switch from say an antenna to a dummy load, you might find that you are leaking quite a bit of power onto the supposedly disconnected antenna link. RF is tricky, especially at higher power levels.
One trick you can use is to use only single contact relays and to bend open the contacts as far as they will go as long as they reliably close again when the relay is energized.
That way you minimize capacitive coupling between the contacts. DC relays are your best bet for a starting point because they already have larger gaps than most AC relays (to inhibit arcing).