Re:Oracle of Zotero: LLM QA of Your Research Library
by Loic on Monday November 27, 2023 @01:53AM
(#38429047)
Maybe a stupid question, but how are equations handled in the parsing of a paper? Are local runable LLM capable of proposing model equations like programming code? I have seen that GPT4 can, so just wondering if equations are "treated" like normal computer code. My Zotero papers are equations heavy.
[ Parent
| on HN ]
Re:Oracle of Zotero: LLM QA of Your Research Library
by Clueed on Monday November 27, 2023 @02:56AM
(#38429366)
I've looked into the available options of parsing PDFs, including pypdf, which is what is being used here, a while ago and it's not good. While I haven't testing equations specifically, it think it's fair so assume that the results will be subpar especially complex ones.
I guess, this could be an application of the agent model. I've seen multiple LLMs recently trained specifically on LateX parsing. One model would recognize from the parsed PDF garbage that there is probably an equation there and call a different want to parse it.
Re:Oracle of Zotero: LLM QA of Your Research Library
by Loic on Monday November 27, 2023 @06:42AM
(#38431145)
Thank you for the idea to recognize the garbage to then use a different flow for the image of the equation from the pdf. Still left with an image to LaTeX problem, but maybe the state of the art has improved in the past years.