News for hackers. Stuff that matters.

A comment on Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python. Parent comment

Re:Show HN: MonkeyPatch – Cheap, fast and predictable LLM fu... by javidlakha on Wednesday November 15, 2023 @04:10PM (#38282532)
How much control do I have over this process? I might not want this to be abstracted.
[ Parent | on HN ]
Re:Show HN: MonkeyPatch – Cheap, fast and predictable LLM fu... by JackHopkins on Wednesday November 15, 2023 @05:22PM (#38283440)
Currently the distillation happens automatically in the background for all functions but we're aiming to implement ways for the user to be able to turn it off if they wish to keep using the teacher models. Good to know that this'd be a wanted feature!
[ Parent | on HN ]