News for hackers. Stuff that matters.
Re:Training LLMs to Reason in a Continuous Latent Space by soulofmischief on Tuesday December 10, 2024 @02:22PM (#42380388)
Useful information about conceptual relationships and procedure can be captured in the LM head, so there is also potential lossiness when short-circuiting it.

There are no comments on this comment yet.