News for hackers. Stuff that matters.
Re:Benchmarking LLM social skills with an elimination game by DeborahEmeni_ on Monday April 07, 2025 @03:28PM (#43614974)
Really cool setup! Curious how much of the performance here could vary depending on whether the model runs in a hosted environment vs local. Would love to see benchmarks that also track how cloud-based eval platforms (with potential rate limits, context resets, or system messages) might affect things like memory or secret-keeping over multiple rounds.

There are no comments on this comment yet.