News for hackers. Stuff that matters.
Re:Hertz-dev, the first open-source base model for conversat... by hunter2_ on Monday November 04, 2024 @02:08AM (#42039246)
I assume this mirroring is due to symmetry being more typical than not among the training data, and if instead trained with contrived diversity (e.g., males only conversing with females) then the output of the base model would follow suit without pulling any levers?

It's interesting to think about what complete diversity (i.e., no tendencies toward homogeneous conversation partners whatsoever among training data) would yield, given that it's trying to deliver whatever is most probable.

There are no comments on this comment yet.