All you're doing by running without swap is pessimizing yourself.
I can't follow your reasoning. On the one hand you want the fastest access, on the other you advocate for high swappiness.
I think you should want swappiness=0, then the swap device can be whatever: it will be hardly ever used.
Which, in turn, is slower than not swapping at all. To avoid swapping unless absolutely needed, you set swappiness to 0. On the opposite side, to swap as soon as the kernel sees an opportunity, you tune swappiness to 200.
https://wiki.archlinux.org/title/Swap#Swappiness
"There is a common misconception that swappiness affects the memory threshold or prevents using swap space, but it only affects the preference for freeing up file pages over swap."
As I understand it, Linux does not preemptively evict idle pages, only as a response to memory pressure.
If you need it, it allows you to choose what to kill or gives you time to save.
It also allows you to utilize your available memory better (which didn't matter for a long time, fair enough but it matters on cloud were memory was always expensive and it might matter today again).
Plenty of things are loaded into memroy and are never touched again. Plenty of daemons doing something in the background but just not eveyr second of it.
You are not running a real time system with calculated memory usage. You run a bunch of random stuff.