From the above GitHub repository, the following is a really fascinating page on experiments on fitting various smaller LLM's into various resource constrained hardware profiles, that is, information-wise (and keep in mind, I haven't tried all of the techniques), it seems like the best resource for this, that I've seen on the Internet thus far:

https://github.com/hyperionaidev/smolmaxxing/blob/main/EXPER...