News for hackers. Stuff that matters.

A comment on Benchmarking retrieval for agents on messy real-world company knowledge.

Re:Benchmarking retrieval for agents on messy real-world com... by emil_sorensen on Friday October 02, 2026 @01:17PM (#49936026)
OP/founder of kapa (YCS23) here. Happy to answer any questions :)
[ Parent | on HN ]
Re:Benchmarking retrieval for agents on messy real-world com... by polotics on Friday October 02, 2026 @01:59PM (#49936555)
ok I bite!

What is your opinion of:

- BEAM

- MemEval

- MemoryArena

- any other you can find on eg. HuggingFace

How much value do you see in Karpathy's gist on the Episodic/Procedural/Semantic split (aka. btw. Doxa/Koine/Gnosis) If you do see value what parts of your design matches?

As you are using real company data, will you at least make one step towards reproducibility by publishing some extraction pipeline so other companies can run their own comparison?

[ Parent | on HN ]