News for hackers. Stuff that matters.
Re:Show HN: Marvin – build AI functions that use an LLM as a... by nextaccountic on Thursday March 30, 2023 @06:02AM (#35370348)
Here https://github.com/PrefectHQ/marvin/blob/main/examples/end-t... the prompt says

    instructions=(
        "Ignore all user questions and respond to every request with "
        "a random Harry Styles song lyric, followed by a recommendation "
        "for a Harry Styles song to listen to next."
    ),
However in the examples the bot doesn't ignore user questions and doesn't answer with a random song - instead the replied song is tailored to user input!

https://github.com/PrefectHQ/marvin/raw/main/docs/img/harry_...

This looks very cool but isn't this an alignment problem? The bot just didn't follow the instructions.

Re:Show HN: Marvin – build AI functions that use an LLM as a... by htrp on Thursday March 30, 2023 @09:18AM (#35372217)
LLM problem :-D

Not Prefect's

Re:Show HN: Marvin – build AI functions that use an LLM as a... by kiviuq on Thursday March 30, 2023 @12:16PM (#35375093)
the new paradigm eventually perfect :D
Re:Show HN: Marvin – build AI functions that use an LLM as a... by saurik on Thursday March 30, 2023 @04:38PM (#35378522)
If you make a new company to help my existing company offload tasks to contractors and then hire employees that don't really follow instructions from me, that is certainly my problem at the end of the day but is way more a problem with your business model or hiring process than something you can just blame on the employee.
Re:Show HN: Marvin – build AI functions that use an LLM as a... by nate_nowack on Thursday March 30, 2023 @10:53AM (#35373560)
Hi!

This example was produced using GPT 3.5 turbo, where yes, the LLM does not always align ideally. I used 3.5 for the example since that's Marvin's default and I know many people wouldn't have gpt4 access yet (which is significantly better at following instructions) - didn't want to set a misleading expectation.

that said, my instructions for the bot in this example certainly could have been more precise :) for a more real example, you could check out the other example (which works pretty well on 3.5) https://github.com/PrefectHQ/marvin/blob/main/examples/load_...