News for hackers. Stuff that matters.
Re:Embeddings are a good starting point for the AI curious a... by bryantwolf on Wednesday April 17, 2024 @03:20PM (#40069022)
Yeah, these can be cute, but they're not ideal. I think the user feedback mechanism could help naturally align this over time, but it would also be gameable. It's all interesting stuff
Re:Embeddings are a good starting point for the AI curious a... by jonnycoder on Wednesday April 17, 2024 @04:43PM (#40069857)
As the op, you can do both semantic search (embedding) and keyword search. Some RAG techniques call out using both for better results. Nice product by the way!
Re:Embeddings are a good starting point for the AI curious a... by bryantwolf on Wednesday April 17, 2024 @07:48PM (#40071378)
Hybrid searches are great, though I'm not sure they would help here. Neither 'crown' nor 'ruler' would come back from a text search for 'king,' right?

I bet if we put a better description into the embedding for 'ruler,' we'd avoid this. Something like "a straight strip or cylinder of plastic, wood, metal, or other rigid material, typically marked at regular intervals, to draw straight lines or measure distances." (stolen from a Google search). We might be able to ask a language model to look at the icon and give a good description we can put into the embedding.