News for hackers. Stuff that matters.
Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by MuffinFlavored on Sunday August 13, 2023 @07:31PM (#37115692)
can I fine tune it on like 2,000 repos at a corporation (code based) and have it understand the architecture?
Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by smoldesu on Sunday August 13, 2023 @08:43PM (#37116188)
I don't think you can do that with any AI models. It almost feels like a fundamental misrepresentation of how they work.

You could fine-tune a conversational AI on your codebase, but without loading said codebase into it's context it is "flying blind" so-to-speak. It doesn't understand the data structure of your code, the relation between files and probably doesn't confidently understand the architecture of your system. Without portions of your codebase loaded into the 'memory' of your model, all that your finetuning can do is replicate characteristics of your code.

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by mycall on Sunday August 13, 2023 @10:31PM (#37116821)
TypeChat-like things might provide the interface control for future context driven architectures, being some type of catalysis. Using the self-reflective modeling is a form of contextual insight.