News for hackers. Stuff that matters.
Re:Bard generates clean JSON only if you threaten to take a ... by speedgoose on Tuesday May 16, 2023 @01:07PM (#35964735)
It shouldn't be too hard to filter such prompt engineering hacks from the futur training datasets.
Re:Bard generates clean JSON only if you threaten to take a ... by catchnear4321 on Tuesday May 16, 2023 @03:35PM (#35966643)
a lot of things shouldn’t be hard.

a lot of things are harder than they look.

Re:Bard generates clean JSON only if you threaten to take a ... by speedgoose on Wednesday May 17, 2023 @03:10AM (#35972150)
True. But this one I’m very confident I can do it myself and I’m not even an expert in the field.
Re:Bard generates clean JSON only if you threaten to take a ... by catchnear4321 on Wednesday May 17, 2023 @08:54AM (#35974588)
ok then. do it and post it to HN. put it up for scrutiny and testing.

i’m very confident someone can prove you wrong, without being an expert in the field.

Re:Bard generates clean JSON only if you threaten to take a ... by speedgoose on Wednesday May 17, 2023 @09:54AM (#35975243)
I would start by creating a dataset of such prompt hacks. A lot of them are already on GitHub, Reddit, and HN.

To get even more of them I could consider gamification. This game is a good example: https://gandalf.lakera.ai/

Once I get a descent dataset, I could use it to finetune a LLM to do classification. Or play with embeddings and cosine similarity and similar.

I could also use LLMs to extend the training dataset, and have some human feedback.

It’s maybe not the best strategy and I’m sure someone else can do it better but I don’t think it’s wrong.

Re:Bard generates clean JSON only if you threaten to take a ... by catchnear4321 on Wednesday May 17, 2023 @01:03PM (#35978192)
so, to summarize, you think it is easy, and you think you have an approach that would lead to a viable solution.

while interesting, your napkin math isn’t convincing.

Re:Bard generates clean JSON only if you threaten to take a ... by speedgoose on Wednesday May 17, 2023 @01:26PM (#35978508)
I’m sorry I didn’t convince you.
Re:Bard generates clean JSON only if you threaten to take a ... by catchnear4321 on Wednesday May 17, 2023 @07:06PM (#35982358)
it’s ok. you still could, if you build it.

anything less is banter.