News for hackers. Stuff that matters.
Re:Large Language Models: Scaling Laws and Emergent Properties by cjbprime on Thursday April 20, 2023 @07:55PM (#35648135)
Not just claws, but feet! I also like the ouroborous nature of the snake becoming the scroll, or perhaps being created by its own writing.

(No, I don't know why.)

Re:Large Language Models: Scaling Laws and Emergent Properties by mccoyb on Thursday April 20, 2023 @08:07PM (#35648224)
One of my big issues with these computational artifacts is that they are not modular -- in the sense that, if I wanted a studious snake without claws -- what things do I need to do to get it to produce a version of the snake, but "fixed" in the way which I describe.

E.g. here, when I say modular -- I mean that a "fix" can't be implemented in a local, small way. I need to try again with a new prompt, etc -- and it's not clear to me how to "fix" my prompt to get the right thing.

one way to support this sort of modularity might be with a GPT-4 / langagent integration which would query Midjourney until it gets a picture which satisfies my criteria, changing the prompt, etc.

The problem is that, if the integration or langagent has an issue -- how do I modularly fix those systems? And so on.

This sort of question "how do I figure out how to fix this prompt-based thing" makes me worry about a sort of "turtles all the way down" problem. Okay, so maybe I don't need to understand exactly how to use these systems to get what I want -- just let another LLM do that ... but what if that LLM has an issue ... and what if the LLM which is prompting that LLM has an issue ...

It concerns me. I'm not sure how well founded my concerns really are.

Re:Large Language Models: Scaling Laws and Emergent Properties by cjbprime on Thursday April 20, 2023 @08:21PM (#35648323)
GPT-4 does fine with a reply prompt of "keep the rest as-is but fix this part". I imagine Midjourney would too if it supported conversational prompting.
Re:Large Language Models: Scaling Laws and Emergent Properties by gpderetta on Friday April 21, 2023 @07:50AM (#35652384)
> I mean that a "fix" can't be implemented in a local, small way

inpainting.

Re:Large Language Models: Scaling Laws and Emergent Properties by mccoyb on Friday April 21, 2023 @10:59AM (#35654780)
Great point, I'll think deeper!