News for hackers. Stuff that matters.

potamides

We have some rough ideas to support multiple "backends" depending on the input, so that could definitely happen. That being said, tools like LaTeX-OCR [1] already claim to (at least partially) support this.

[1] https://github.com/lukas-blecher/LaTeX-OCR

The use cases we see are (i) assisting researchers in creating scientific figures from scratch (sketching them om paper is usually easy but actually developing them can be daunting), and (ii) enabling semantic edits to existing figures stored in lower-level formats by synthesizing high-level graphics programs that generate them.

Show HN: Synthesize TikZ Graphics Programs for Scientific Figures and Sketches

https://github.com/potamides/DeTikZify

Creating high-quality scientific figures can be time-consuming and challenging, even though sketching ideas on paper is relatively easy. Furthermore, recreating existing figures that are not stored in formats preserving semantic information is equally complex. To tackle this problem, we introduce DeTikZify, a novel multimodal language model that automatically synthesizes scientific figures as...

( Read More... | 12 comments | 28 points | on HN )