Show HN: Interactive Graph by LLM (GPT-4o)

Re:Show HN: Interactive Graph by LLM (GPT-4o) by TOMDM on Sunday May 19, 2024 @06:23AM (#40405834)

This is pretty cool, it's snappy, it seems to work, but there's no way I trust it without a way to check the LLM's work.

[ Parent | on HN ]

Re:Show HN: Interactive Graph by LLM (GPT-4o) by ipieter on Sunday May 19, 2024 @06:44AM (#40405925)

Yeah I just tried it with numbers I knew a bit and it seems totally made up. The generated chart showed a linear downwards trend while in reality there isn't one and the numbers seem way off.

[ Parent | on HN ]

Re:Show HN: Interactive Graph by LLM (GPT-4o) by mritchie712 on Sunday May 19, 2024 @08:20AM (#40406445)

This is a great point. It's easy to spin up an LLM data analysis demo, but it's really hard to trust the outputs.

I think we've (https://www.definite.app/) done a decent job here. Once the LLM generates results, you can inspect the query all the way back to the source (SQL).

https://www.youtube.com/watch?v=Nu2Tal3hm7s

[ Parent | on HN ]

Re:Show HN: Interactive Graph by LLM (GPT-4o) by caoxhua on Sunday May 19, 2024 @02:36PM (#40408846)

Unless it's very "public common", otherwise, the numbers can be used for trustworthy work. In general, I think this is just for "fun play" most of the time.

[ Parent | on HN ]