Re:Bard generates clean JSON only if you threaten to take a ...
by speedgoose on Tuesday May 16, 2023 @01:07PM
(#35964735)
It shouldn't be too hard to filter such prompt engineering hacks from the futur training datasets.
[ Parent
| on HN ]
Re:Bard generates clean JSON only if you threaten to take a ...
by catchnear4321 on Tuesday May 16, 2023 @03:35PM
(#35966643)
a lot of things shouldn’t be hard.
a lot of things are harder than they look.
Re:Bard generates clean JSON only if you threaten to take a ...
by speedgoose on Wednesday May 17, 2023 @03:10AM
(#35972150)
True. But this one I’m very confident I can do it myself and I’m not even an expert in the field.
Re:Bard generates clean JSON only if you threaten to take a ...
by catchnear4321 on Wednesday May 17, 2023 @08:54AM
(#35974588)
ok then. do it and post it to HN. put it up for scrutiny and testing.
i’m very confident someone can prove you wrong, without being an expert in the field.
Re:Bard generates clean JSON only if you threaten to take a ...
by speedgoose on Wednesday May 17, 2023 @09:54AM
(#35975243)
I would start by creating a dataset of such prompt hacks. A lot of them are already on GitHub, Reddit, and HN.
To get even more of them I could consider gamification. This game is a good example: https://gandalf.lakera.ai/
Once I get a descent dataset, I could use it to finetune a LLM to do classification. Or play with embeddings and cosine similarity and similar.
I could also use LLMs to extend the training dataset, and have some human feedback.
It’s maybe not the best strategy and I’m sure someone else can do it better but I don’t think it’s wrong.
Re:Bard generates clean JSON only if you threaten to take a ...
by catchnear4321 on Wednesday May 17, 2023 @01:03PM
(#35978192)
so, to summarize, you think it is easy, and you think you have an approach that would lead to a viable solution.
while interesting, your napkin math isn’t convincing.
Re:Bard generates clean JSON only if you threaten to take a ...
by speedgoose on Wednesday May 17, 2023 @01:26PM
(#35978508)
I’m sorry I didn’t convince you.
Re:Bard generates clean JSON only if you threaten to take a ...
by catchnear4321 on Wednesday May 17, 2023 @07:06PM
(#35982358)
it’s ok. you still could, if you build it.
anything less is banter.