News for hackers. Stuff that matters.
Re:Vanna.ai: Chat with your SQL database by kulikalov on Sunday January 14, 2024 @05:43PM (#38995193)
While I recognize the efforts in developing natural language to SQL translation systems, I remain skeptical. The core of my concern lies in the inherent nature of natural language and these models, which are approximative and lack precision. SQL databases, on the other hand, are built to handle precise, accurate information in most cases. Introducing an approximative layer, such as a language model, into a system that relies on precision could potentially create more problems than it solves, leading me to question the productivity of these endeavors in effectively addressing real-world needs.
Re:Vanna.ai: Chat with your SQL database by thom on Sunday January 14, 2024 @07:27PM (#38995964)
The key here is to always have some structured intermediate layer that can allow people to evaluate what it is the system thinks they're asking, short of the full complexity of SQL. You'll need something like this for disambiguation anyway - are "Jon Favreau movies" movies starring or directed by Jon Favreau? Or do you mean the other Jon Favreau? Don't one-shot anything important end to end from language. Use language to guide users towards unambiguous and easy to reason about compositions of smaller abstractions.
Re:Vanna.ai: Chat with your SQL database by totalhack on Sunday January 14, 2024 @09:51PM (#38996945)
I think AI to direct SQL will have use cases, but I personally have found it more of a fun toy than anything close to the main way I would interact with my data, at least in the course of running a business.

I am a fan of a semantic layer (I made an open source one but there are others out there), and think having AI talk to a semantic layer has potential. Though TBH a good UI over a semantic layer is so easy it makes the natural language approach moot.

https://github.com/totalhack/zillion

Re:Vanna.ai: Chat with your SQL database by pietz on Sunday January 14, 2024 @06:01PM (#38995336)
I think you have a point. I also think people who share this mindset and keep sticking with it will have a tough future.

The technical benefits and potentials clearly outshine the problems and challenges. That's also true in this example. You just have to let go of some principles that were helpful in the past but aren't anymore.

Re:Vanna.ai: Chat with your SQL database by kulikalov on Sunday January 14, 2024 @06:04PM (#38995363)
What technical benefits?
Re:Vanna.ai: Chat with your SQL database by pietz on Sunday January 14, 2024 @06:40PM (#38995631)
A translation engine between natural language and SQL means that everyone can communicate with a SQL database now. That's huge. Soon also DB people will use it to get the response for complex questions and queries. It's just more natural and way faster.

With technology like this, there is little reason to even know SQL anymore as the average developer. Just like today, the average developer doesn't know how databases work because the cloud takes care of it. We're moving up on the abstraction ladder and tomorrow all you need to know for SQL is to ask the right question.

Re:Vanna.ai: Chat with your SQL database by bamboozled on Sunday January 14, 2024 @06:44PM (#38995666)
What’s funny is SQL was supposed to be the natural language everyone uses to communicate with. Few bothered to learn it.
Re:Vanna.ai: Chat with your SQL database by spennant on Sunday January 14, 2024 @07:29PM (#38995969)
"Few"? I guess I must be one of the olds.
Re:Vanna.ai: Chat with your SQL database by bamboozled on Sunday January 14, 2024 @09:40PM (#38996875)
Are you a “business person” or analyst ?
Re:Vanna.ai: Chat with your SQL database by macNchz on Sunday January 14, 2024 @09:34PM (#38996831)
Lots of average developers these days do not (or just barely) know SQL, and it shows when the ORM generates some nonsense and nobody can figure out why the app is suddenly two orders of magnitude slower.
Re:Vanna.ai: Chat with your SQL database by totalhack on Sunday January 14, 2024 @10:01PM (#38997008)
This somewhat already exists in the form of semantic layers, which if done well can handle many of the queries necessary in the course of business without business users needing to know any SQL. There will still be cases where you need direct SQL, and AI tools can help the development process there at a minimum.
Re:Vanna.ai: Chat with your SQL database by pietz on Monday January 15, 2024 @03:30AM (#38998570)
Yes, there will be cases where you need SQL knowledge. There will also always be cases where knowing exactly how a database works under the hood is necessary. I think this is somewhat of a weak argument because you can always construct an example of how something may be helpful for a small group of people.

The relevant question is: How many people who work with databases need to have a lot of experience with SQL? My argument is that while the answer today is "most," the answer in a couple of years might be "very few."

Re:Vanna.ai: Chat with your SQL database by totalhack on Monday January 15, 2024 @06:57AM (#38999822)
Sure, AI will assist more and more in the cases where people must write SQL or manage a database, perhaps to the point you suggest.

But my point was actually that more people think they need to know SQL today than is actually the case. Excluding people that manage databases or cases that go direct to SQL for things like complex ETL, your average business user / marketer / etc should not be asked to write SQL or have to ask someone else to write SQL for them. Use a semantic layer instead with a UI on top and it's almost as easy as natural language.

Here is a example of one I made below, but there are others out there with more support. At my company, and the last few I've worked for, we use this approach for ~all day to day querying and a chunk of backend SQL replacement.

https://github.com/totalhack/zillion

Re:Vanna.ai: Chat with your SQL database by chrisjh on Sunday January 14, 2024 @11:06PM (#38997341)
I have similar thoughts on this - so few members of a team actually know what the underlying data model looks like. Gets even harder when you start trying to query across your database(s) + external sources like analytics/event systems. Natural language lets the whole team peel away at the black box of data and helps build common ground on which to improve products. I already mentioned it in another part of this thread so I won't spam my project but would love to get your feedback on my natural language to SQL tool if you're interested.
Re:Vanna.ai: Chat with your SQL database by bamboozled on Sunday January 14, 2024 @06:19PM (#38995471)
Your project manager can be an expert with SQL now too…and the novelty factor is high because using makes it feel like you’re in a “sci-fi” movie?
Re:Vanna.ai: Chat with your SQL database by samstave on Sunday January 14, 2024 @05:57PM (#38995304)
Reverse idea:

Use this to POPULATE sql based on captured NLP "surveillance" -- for example, build a DB of things I say as my thing listens to me, and categorize things, topics, place, people etc mentioned.

Keep count of experiencing the same things....

When I say I need to "buy thing" build table of frequency for "buy thing" etc...

Effectively - query anything you've said to Alexa and be able to map behaviors/habits/people/things...

If I say - Bob's phone number is BLAH. It add's bob+# to my "random people I met today table" with a note of "we met at the dog park"

Narrate yourself into something journaled.

Makes it easy to name a trip "Hike Mount Tam" then log all that - then have it create a link in the table to the pics folder on your SpaceDrive9000.ai and then you have a full narration with links to the pics that you take.

Re:Vanna.ai: Chat with your SQL database by kulikalov on Sunday January 14, 2024 @06:06PM (#38995385)
You are describing use case for a vector database
Re:Vanna.ai: Chat with your SQL database by samstave on Sunday January 14, 2024 @06:11PM (#38995429)
So you wouldnt be able to pull out specific phrases and store them in a typical RDBMS?