Thanks for the reply and the recommendations! I will see if my machine can handle some of the quantized 30B models.

I'm slightly confused about your comment about llama.cpp vs oobabooga. Doesn't text-generation-webui use llama.cpp underneath?

Also, huge thanks for the point towards https://rentry.org/lmg_models. That's an invaluable resource.