Re:Ingesting PDFs and why Gemini 2.0 changes everything
by otoburb on Wednesday February 05, 2025 @02:36PM
(#42953909)
>>I've been fighting trying to chunk SEC filings properly, specifically surrounding the strange and inconsistent tabular formats present in company filings.
For this specific use case you can also try edgartools[1] which is a library that was relatively recently released that ingests SEC submissions and filings. They don't use OCR but (from what I can tell) directly parse the XBRL documents submitted by companies and stored in EDGAR, if they exist.
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by faxmeyourcode on Wednesday February 05, 2025 @06:00PM
(#42956604)
I'll definitely be looking into this, thanks for the recommendation! Been playing around with it this afternoon and it's very promising.
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by anirudhb99 on Wednesday February 05, 2025 @02:49PM
(#42954096)
(from the gemini team) we're working on it! semantic chunking & extraction will definitely be possible in the coming months.
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by barrenko on Wednesday February 05, 2025 @02:42PM
(#42953991)
If you'd kindly tl;dr the chunking strategies you have tried and what works best, I'd love to hear.
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by jgalt212 on Wednesday February 05, 2025 @03:15PM
(#42954491)
isn't everyone on iXBRL now? Or are you struggling with historical filings?
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by faxmeyourcode on Wednesday February 05, 2025 @05:31PM
(#42956278)
XBRL is what I'm using currently, but it's still kind of a mess (maybe I'm just bad at it) for some of the non-standard information that isn't properly tagged.
This is giving me hope that it's possible.