Re:Small offline large language model – TinyChatEngine from MIT
by j-bos on Monday December 18, 2023 @08:40AM
(#38682290)
I'm curious, what do you use these small LLMs for, like can you give some examples of (not too) personal uses cases from the past month?
[ Parent
| on HN ]
Re:Small offline large language model – TinyChatEngine from MIT
by SOLAR_FIELDS on Monday December 18, 2023 @10:28AM
(#38683718)
My understanding (I haven’t used a fine tuned one) is that you can use one that you fine tune yourself for narrow automation tasks. Kind of like a superpowered script. From my llama 2 7b experiments I have not gotten great results out of the non fine tuned versions of the model for coding tasks. I haven’t tried code llama yet.