News for hackers. Stuff that matters.
Re:Show HN: Semantic Grep – A Word2Vec-powered search tool by throwawaydummy on Saturday July 27, 2024 @06:44PM (#41089866)
I wanna meet the person who greps die, kick the bucket and buy the farm lol

Are models like mistral there yet in terms of token per second generation to run a grep over millions of files?

Re:Show HN: Semantic Grep – A Word2Vec-powered search tool by ignoramous on Saturday July 27, 2024 @07:24PM (#41090084)
Mistral has published large language models, not embedding models? sgrep uses Google's Word2Vec to generate embeddings of the corpus and perform similarity searches on it, given a user query.
Re:Show HN: Semantic Grep – A Word2Vec-powered search tool by throwawaydummy on Saturday July 27, 2024 @07:36PM (#41090155)
No I got that I asked because wouldn’t embedding generated by fine tuned transformer based LLMs be more context aware? Idk much about the internals so apologies if this was a dumb thing to say
Re:Show HN: Semantic Grep – A Word2Vec-powered search tool by ignoramous on Sunday July 28, 2024 @11:14AM (#41093763)
embeddings come in handy to augment LLMs [0], but as you suspect, some try LLMs themselves as an outright embedding model with varying degrees of success: https://www.reddit.com/r/LocalLLaMA/comments/12y3stx/embeddi... / https://huggingface.co/spaces/mteb/leaderboard

[0] https://simonwillison.net/2023/Oct/23/embeddings/