News for hackers. Stuff that matters.
Re:AI and the Problem of Knowledge Collapse by jacobr1 on Friday April 05, 2024 @06:15PM (#39947921)
Or introduce more noise or seeding to get more interesting responses. The `temperature` settings don't really satisfy this right now. I would like some determinism - but seeded randomly - so I can get similar responses if I like what is produced. Likewise some kind of metadata or explicability that allowed us to take a known style or featurespace of the model, perhaps from hand prompting, and then reuse-it with some degree is modification and maybe even combination from others would be very helpful. The work around adding model weights from fine-tuned seems directionally what I'm talking about, though that isn't the form I'd want to expose to users.

There are no comments on this comment yet.