That's not to say that LOR is impossible with a smaller payload. Saturn V enabled a large, complex, redundant set of vehicles. The never successfully launched Soviet N1/L3 with half the TLI payload also used LOR but with much lighter vehicles and a smaller crew.