Re:Show HN: Vanna AI – Open-Sourced Text-to-SQL in Python
by zainhoda on Saturday September 09, 2023 @08:59AM
(#37444833)
It probably could but it would require adjusting the prompt. You’d have to override the generate_prompt function and tell it that you’re using a variant of SQL and describe the differences.
[ Parent
| on HN ]
Re:Show HN: Vanna AI – Open-Sourced Text-to-SQL in Python
by crazy_marksman on Sunday September 10, 2023 @12:22PM
(#37457342)
Is there a token limit for the train step? Like length of documentation, number of example SQL queries?
Re:Show HN: Vanna AI – Open-Sourced Text-to-SQL in Python
by zainhoda on Monday September 11, 2023 @10:01AM
(#37467409)
There isn't technically a limit on the storage side but it's generally better if you keep documentation to a manageable length.
You call vn.train(sql=...) on each individual SQL statement that you have.
What'll happen under the hood is the package will use the 10 most relevant SQL statement examples, 10 most relevant pieces of documentation, and 10 most relevant DDL statements.
If using 10 examples exceeds the (approximate) token limit for the model, it'll pare down to a smaller number that'll fit into the context limit.