News for hackers. Stuff that matters.

A comment on GeneGPT, a tool-augmented LLM for bioinformatics.

Re:GeneGPT, a tool-augmented LLM for bioinformatics by sourabh03agr on Monday February 12, 2024 @07:37PM (#39352704)
Nice work! I see you have an evaluation module - what all are you evaluating for? Primarily Question-answer accuracy via Exact Match?
[ Parent | on HN ]
Re:GeneGPT, a tool-augmented LLM for bioinformatics by jadynqa on Monday February 12, 2024 @10:43PM (#39354082)
Yes. Answering information-seeking questions that would require using Bioinformatics tools (database utilities, BLAST, etc). The evaluation metric is mainly EM.
[ Parent | on HN ]