Are you using ollama? Devs said there was a bug that occurs when context is full, they're working on it.
Re:Phi-3 Technical Report
by Grimblewald on Monday May 06, 2024 @07:47AM
(#40273498)
That would do it, I am indeed.
"using the following documentation to guide you {api documentation}, edit this code {relevant code}, with the following objective: Replace uses of {old API calls} in {some function} with with relevant functions from the supplied documentation"
It mostly works, but if the context is a little to long, sometimes it will just spam the same umlaut or number (always umlaut's or numbers) over and over for example. Perhaps some fine-tuning of parameters like temp. or repetition penalty might fix it, time will tell.