News for hackers. Stuff that matters.

worldofideas123

I was referring to the prolog programming language. What would happen if we replace the rationale with a concrete program in prolog: Example tag = daughter(X), rationale = father(_,X),female(X); mother(_,X),female(X).
(1) This is like a new prolog in which the rules are linguistic rules (rationales), and the distilling step-by-step is a way of learning the rules. Call the new prolog lprorat (learning programming with rationales).

(2) Hypothesis: The success of distilling chain of thought learning is that it provides a pseudo large context window. The input pair (label,rationale) allows the student LLM mimic a large context window (the context window of a human agent that informs the system by providing the rationale data). So it reduces the embedding distance between words for which entailment is difficult to obtain with short context windows.

(3) The above hypothesis or explanation suggests to perform the training process in two phases: in the first phrase a smaller model is used as a teacher, this allow the learning model to connect d-distant words, in the second phrase the training process continue with new data using the rationale provided by a stronger larger LLM. In the first phase the learning system learn to infer d-distant word relations, in the second phase it is prepared to connect (2*d)-distant word because it have developed the necessary skills in the first phase.

This multi-phase approach could be tailored using three meta-parameters: the number of teachers, the relative power of each LLM teacher, and the percentage of data in the training set for each teacher.

(4) I would like that they would release for free the LLM that they have developed, those small but powerful LLM can provide individuals users to introduce themselves in the SOTA realm.

Edited: grammar and clarifying the ideas.

Re: on Wednesday May 03, 2023 @07:31AM (#35801049)
The aware demostration
I think a way of avoiding hallucinations is using the same LLM with different values of the temperature parameter. Hallucinations, by their own nature, are prone to have great variance, so a change in temperature implies a big change in the story of facts inferred by the LLM, so it seems a main way of fighting hallucinations is checking coherence of the LLM using different values of temperature. So the probability of hallucinations is just the d(story)/d(temperature). This suggest to investigate how the embedding distance of small episodes change with temperature.
Re:Inflection AI launches pi chatbot on Tuesday May 02, 2023 @04:37PM (#35793838)
it would be interesting to have more information about the LLM that Inflection is using, for example number of parameters.
Re: on Tuesday May 02, 2023 @10:19AM (#35787840)
The Aware Reasoning Project main task is the creation of agents based on LLM to perform a goal using tools, memory, task decomposition and analysis. In this first video the author gives an example of the alpha version of this project. The main insight is that the communication among the agents shows the progress towards the goal. In subsequent videos the optimized use of resources will be shown and how the system is able to continue developing the infrastructure that allow it to attack the main goal in such a way that each agents has a clear function in the system and the information gathered is well propagated through the network of agents, directors and managers. Special care is dedicated to design sub-goals so that their results can be checked easily and when it is possible modified so to align with the main goal.