Maybe a solid use case for local models are they're optimized for consumer hardware-- someone clever could preserve as much context as possible between requests