News for hackers. Stuff that matters.
Re:Show HN: Natural-SQL-7B, a strong text-to-SQL model by xfalcox on Monday February 05, 2024 @10:43AM (#39262312)
Context is 4096? My app db DDL is 19877 tokens (using Llama2 tokenizer) long, so that means we need to do a RAG for handling the DDL prompt injection.

A model like this with a 32k long seq_len, like Mixtral, would be a killer for me.

Re:Show HN: Natural-SQL-7B, a strong text-to-SQL model by thecalebf on Monday February 05, 2024 @10:48AM (#39262364)
Great call out. Will definitely focus on that in the next iteration!