Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by nick_rocks on Wednesday February 14, 2024 @02:19PM
(#39373943)
What do you mean by complex SQL? How complex?
[ Parent
| on HN ]
Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by edmundsauto on Wednesday February 14, 2024 @04:28PM
(#39375699)
I've been playing w/ this product self-hosted for a few weeks. It can join across multiple tables, windowing functions. I haven't tried self-joins yet, nor I have put much effort into tuning w/ Golden SQL or other documentation.
I would put this at the skill level of a junior data engineer. It's pretty impressive.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by aazo11 on Wednesday February 14, 2024 @07:18PM
(#39377484)
Glad you have been liking it. Feel free to reach out at amir (at) dataherald.com if you need any additional help setting up.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by aazo11 on Wednesday February 14, 2024 @02:34PM
(#39374109)
For large databases, LLMs do not perform well if you pass the entire schema (either run into context window issues or confuse the LLM with too much info). There is a schema linking step that identifies the relevant schema and only passes that. The schema linking is also done in the fine-tuning process.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by deely3 on Wednesday February 14, 2024 @04:05PM
(#39375339)
Good, but.. What do you mean by complex SQL? How complex?
Re:Show HN: Natural Language to SQL "Text-to-SQL" API
by aazo11 on Wednesday February 14, 2024 @04:26PM
(#39375654)
The largest we have successfully deployed is on the OSQuery schema https://osquery.io/ which is 277 tables and lots of business context (malwares, vulnerabilities, Windows registry keys, etc).