News for hackers. Stuff that matters.
Re:Why does no one measure prompt velocity by fwesss on Thursday September 21, 2023 @12:23PM (#37599974)
I'm curious about LangSmith's 'dynamic datasets'. How does it ensure data integrity, especially when rapidly iterating on AI models?
Re:Why does no one measure prompt velocity by thepaulthomson on Thursday September 21, 2023 @12:31PM (#37600095)
From the docs it looks like they're fairly explicit with respecting env states for each dataset. I'm not sure how/where contamination would even occur to be honest - regardless of model used.