News for hackers. Stuff that matters.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API by nick_rocks on Wednesday February 14, 2024 @02:19PM (#39373943)
What do you mean by complex SQL? How complex?
Re:Show HN: Natural Language to SQL "Text-to-SQL" API by edmundsauto on Wednesday February 14, 2024 @04:28PM (#39375699)
I've been playing w/ this product self-hosted for a few weeks. It can join across multiple tables, windowing functions. I haven't tried self-joins yet, nor I have put much effort into tuning w/ Golden SQL or other documentation.

I would put this at the skill level of a junior data engineer. It's pretty impressive.

Re:Show HN: Natural Language to SQL "Text-to-SQL" API by aazo11 on Wednesday February 14, 2024 @07:18PM (#39377484)
Glad you have been liking it. Feel free to reach out at amir (at) dataherald.com if you need any additional help setting up.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API by aazo11 on Wednesday February 14, 2024 @02:34PM (#39374109)
For large databases, LLMs do not perform well if you pass the entire schema (either run into context window issues or confuse the LLM with too much info). There is a schema linking step that identifies the relevant schema and only passes that. The schema linking is also done in the fine-tuning process.
Re:Show HN: Natural Language to SQL "Text-to-SQL" API by deely3 on Wednesday February 14, 2024 @04:05PM (#39375339)
Good, but.. What do you mean by complex SQL? How complex?
Re:Show HN: Natural Language to SQL "Text-to-SQL" API by aazo11 on Wednesday February 14, 2024 @04:26PM (#39375654)
The largest we have successfully deployed is on the OSQuery schema https://osquery.io/ which is 277 tables and lots of business context (malwares, vulnerabilities, Windows registry keys, etc).