News for hackers. Stuff that matters.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @10:14AM (#34218725)
My name is Yuval I've been a software engineer for a few years now,

A few weeks ago I was scrolling through confluence pages trying to find ssh connection details to our jenkins integration machine for 40 minutes straight, later I discovered my co-worker slack'ed me the ssh connection string two months ago.

A week later I started working on haystack - a search engine for workplace apps.. It enables you to search slack, confluence, jira, teams, sharepoint, github, and email in one place.

It supports natural language queries so a query like: "how to connect to integ2 machine?" yields:

  ssh -i private.pem [email protected]
Privacy?

haystack stores user data locally, it has a completely client-side version, and a self-hosted docker container version - I didn't want to deal with security compliance headaches caused from storing user data in the cloud + I don’t want your internal docs/messages.

I Rolled it out to my co-workers a week ago and they thought it's a hit, so I'm planning on releasing it publicly on March 2023.

Early access

If you want to try it out before March 2023 - Available here <https://haystack.it>

Re:Show HN: I built haystack – workplace search engine for devs by amai on Monday January 02, 2023 @11:28AM (#34219755)
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @11:28AM (#34219761)
haystack.it!
Re:Show HN: I built haystack – workplace search engine for devs by metaphor on Monday January 02, 2023 @09:10PM (#34226668)
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @04:40AM (#34229622)
Forgive me if I don't understand, but I don't think there's a problem with multiple companies using the same common noun as the base for their domain.

Let the best product be remembered for the name.

Re:Show HN: I built haystack – workplace search engine for devs by metaphor on Tuesday January 03, 2023 @05:58AM (#34230040)
Certainly not, presuming it doesn't escalate to the level of trademark/service mark infringement (to be fair, IANAL). Just a risk consideration...your product, your call.

But I think there's value in at least recognizing that the namespace is quite crowded given the collisions that two interweb randoms were able to identify in short order.

Re:Show HN: I built haystack – workplace search engine for devs by sz4kerto on Monday January 02, 2023 @09:52PM (#34226963)
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @04:37AM (#34229607)
Not really, gethaystack searches your tabs
Re:Show HN: I built haystack – workplace search engine for devs by alexfrdmn on Tuesday January 03, 2023 @05:19AM (#34229834)
Their beta seems so
Re:Show HN: I built haystack – workplace search engine for devs by mattl on Monday January 02, 2023 @10:26PM (#34227210)
Hey.com was haystack.com in development I think
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @12:21PM (#34220597)
I’m adding some technical details!

Haystack runs entirely client sided in the browser, so it has a unique tech-stack:

Storage

using IndexDB, haystack stores user indexes locally, + a compressed 90mb NLP model (t5-small) is stored.

Indexing

Locally in the browser, using a t5-small bi-encoder, and some parsing of documents happens in wasm.

Search

Query converted to embedding, then searched over index, atlast results are reranked with a t5-small based cross encoder, and top results go through a seq-to-seq transformer to produce a nice consise textual answer.

Re:Show HN: I built haystack – workplace search engine for devs by bsima on Monday January 02, 2023 @09:28PM (#34226789)
Very cool tech stack. How do you run t5-small in the browser?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:06AM (#34228300)
I load the 90mb model into memory from IndexDB, and then some rust code compiled down to WASM does calculations with the model.
Re:Show HN: I built haystack – workplace search engine for devs by mdmglr on Monday January 02, 2023 @01:23PM (#34221547)
Does the app need to be open in the browser for the indexer to run?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @04:26PM (#34223886)
Yes. You can also download the extension to index continuously
Re:Show HN: I built haystack – workplace search engine for devs by newman314 on Monday January 02, 2023 @07:03PM (#34225565)
Here's a slightly different use case. I want something that can index all open tabs in the browser so that I do not have to leave hundreds of tabs open.
Re:Show HN: I built haystack – workplace search engine for devs by gamegoblin on Monday January 02, 2023 @07:25PM (#34225769)
There are semantic embeddings libraries that are fast enough to run on entire webpages in ~hundreds of millis or low single digit seconds. I've been thinking a lot recently about making a browser plugin that simply does semantic embedding on a paragraph level of every web page I ever visit, and store it in a vector database.

This would enable querying my little private search engine like "the HN story a few weeks ago that talked about ancient greek mining techniques" or "the reddit comment that had an analysis comparing Orwell's 1984 to the bible".

For those not familiar, semantic embeddings take a chunk of text and embed it in a high dimensional vector space (~hundreds of dimensions) where semantically similar texts are closer together.

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:28PM (#34225807)
Very good explaination!

hundred of millis is what I experienced.

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:07PM (#34225590)
That’s extremely interesting, I would argue that the reason for keeping tabs open varies, but is something along the lines of: re-reaching the page in the tab is too slow
Re:Show HN: I built haystack – workplace search engine for devs by newman314 on Monday January 02, 2023 @07:49PM (#34226020)
More specifically, I do a lot of context switching and still try to maintain a reasonable amount of open tabs.

The problem that I have is that I can't remember days/months later if something I read is in an open tab or closed a while ago resulting in some frantic searches.

Re:Show HN: I built haystack – workplace search engine for devs by d4rkp4ttern on Tuesday January 03, 2023 @06:52AM (#34230361)
Tab grouping is one way to tame the madness. I’ve tried it with the default tab groups feature in Chrome but keep loosing the groupings whenever I restart chrome. Anyone know a better grouping extension?
Re:Show HN: I built haystack – workplace search engine for devs by alexfrdmn on Tuesday January 03, 2023 @05:22AM (#34229853)
Re:Show HN: I built haystack – workplace search engine for devs by raghavkhanna on Monday January 02, 2023 @07:08PM (#34225607)
Does the index contain only info I have access to? How is authentication for all the knowledge sources handled?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:11PM (#34225628)
In the setup process you sign in via SSO to all integrations, the token is saved in local storage. That token is used for indexing, and so if you don’t have access to info, the index doesn’t have access.
Re:Show HN: I built haystack – workplace search engine for devs by pabue on Monday January 02, 2023 @07:16PM (#34225677)
Interesting idea and approach!

Just a thought on the design: I really feel like the gold gradients make the whole site feel 'cheap', not trustworthy and not very 'professional'. Actually makes me not want to use it. Replacing them with a simple warm yellow improves this a lot. That might be just me, but maybe it's something for you to consider.

Good luck!

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:18PM (#34225697)
Not a designer, I appreciate this advice immensely, I’ll try!
Re:Show HN: I built haystack – workplace search engine for devs by Winsaucerer on Monday January 02, 2023 @09:51PM (#34226958)
Yep, specifically it looks to me like the kind of styling for a gambling or raffle website.
Re:Show HN: I built haystack – workplace search engine for devs by askiiart on Tuesday January 03, 2023 @12:11AM (#34227948)
Or one of those pamphlets that come with packages from random companies on Amazon that tries to show how it's high quality.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:13AM (#34228356)
Note taken lol wow
Re:Show HN: I built haystack – workplace search engine for devs by MH15 on Tuesday January 03, 2023 @11:50AM (#34233947)
Honestly it's not that bad. For someone who's not a designer it looks rather polished.
Re:Show HN: I built haystack – workplace search engine for devs by Jeff_Brown on Monday January 02, 2023 @07:23PM (#34225752)
What determines relevance? It must do something other than page rank. Will it recognize synonyms and more subtle kinds of nearness in word-space?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:26PM (#34225779)
Actually, the page rank is really based on semantic similarity and relevance of the matched paragraph.

Which under the hood is based of a t5 encoder

Re:Show HN: I built haystack – workplace search engine for devs by petra on Monday January 02, 2023 @10:25PM (#34227200)
Does it work well for question answering from books ?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:08AM (#34228320)
The tricky part is to understand which parts are you indexing, paragraph vs. sentences vs. pages.

But yeah

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:38PM (#34225917)
Makes me wonder, what kind of information sources do you use at work?

Slack, teams, confluence or notion? airtable? jira?

Re:Show HN: I built haystack – workplace search engine for devs by challenger-derp on Monday January 02, 2023 @07:39PM (#34225921)
Can see how this has potential. I've worked on a similar thing at work and there are some nuances as to the level the embedding is performed at (e.g. sentence level) and the kinds of queries that your search engine will be good at (i.e. good ranking of results). Also, depending on how heterogenous the data is, other factors (dated-ness, colleague whose writing/instructions/tutorials you prefer) can also be incorporated into the ranking algorithm.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:41PM (#34225943)
You hit the nail on it’s head, some of these is something I’m dealing with right now (i.e dates)
Re:Show HN: I built haystack – workplace search engine for devs by Game_Ender on Monday January 02, 2023 @07:44PM (#34225966)
How do you compare to Glean? https://www.glean.com/

Not affiliated but just a happy user of their product it searches slack, confluence, jira, gmail, gdrive, github and source code all at once. With extras like Go links, verification, and some knowledge base features.

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Monday January 02, 2023 @07:46PM (#34225988)
open & free for self hosted version, current alpha version is client side (runs in the browser).
Re:Show HN: I built haystack – workplace search engine for devs by esperent on Tuesday January 03, 2023 @10:43AM (#34232869)
By open do you mean open source?
Re:Show HN: I built haystack – workplace search engine for devs by bluedevilzn on Monday January 02, 2023 @10:50PM (#34227399)
How much does glean cost?
Re:Show HN: I built haystack – workplace search engine for devs by thyrox on Monday January 02, 2023 @08:12PM (#34226208)
Unless there is some way to try it this post may be against Show HN guidelines specifically:

> Show HN is for something you've made that other people can play with. HN users can try it out, give you feedback, and ask questions in the thread.

> Off topic: Those can't be tried out, so can't be Show HNs. Make a regular submission instead.

I'd suggest you change the title asap.

(1) https://news.ycombinator.com/showhn.html

Re:Show HN: I built haystack – workplace search engine for devs by mdaniel on Monday January 02, 2023 @10:30PM (#34227237)
I seriously hope they don't submit this thing every 5 days until March https://news.ycombinator.com/item?id=34161085
Re:Show HN: I built haystack – workplace search engine for devs by eru on Monday January 02, 2023 @10:40PM (#34227313)
Well, at least it got new text in the submission!
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:05AM (#34228288)
Hi, didn’t intend to repost this, it’s just that HN is hard to figure out.

And most first posts don’t get the intended traction for various reasons (too long, bad wording, unclear).

reposting and changing the post is totally allowed :)

Re:Show HN: I built haystack – workplace search engine for devs by eru on Tuesday January 03, 2023 @02:23AM (#34228805)
Oh, I meant that in the spirit of encouraging a reworked text!
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @02:40AM (#34228892)
Sorry didn’t assume otherwise, replied accidentally to the wrong thread
Re:Show HN: I built haystack – workplace search engine for devs by fzliu on Monday January 02, 2023 @08:14PM (#34226225)
As someone who uses a multitude of workplace apps myself, this is amazing. What kind of model are you using, and do you have plans to provide a service based off this?

Good stuff!

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:11AM (#34228342)
I’m using a fine-tuned t5-small model, I fune-tuned it for two tasks, question answering from a paragraph, and highlighting relevant text of search results.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:12AM (#34228349)
I’m planning on releasing an open source version of this.

But also have paid features that managers would like to use.

Re:Show HN: I built haystack – workplace search engine for devs by wilg on Monday January 02, 2023 @08:18PM (#34226261)
Sounds like a Searchable Library of All Corporate Knowledge
Re:Show HN: I built haystack – workplace search engine for devs by jitl on Monday January 02, 2023 @08:20PM (#34226275)
This is awesome! Is any of it open-source? I’d love to learn more about how the LLM works in the browser.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @11:09AM (#34233265)
It will be very soon https://github.com/haystackoss/haystack

some rust code that compiles to WASM loads LLM from memory, and uses custom transformer.py like rust alternative we wrote.

Re:Show HN: I built haystack – workplace search engine for devs by twobitshifter on Monday January 02, 2023 @09:18PM (#34226724)
How long does the initial indexing take?
Re:Show HN: I built haystack – workplace search engine for devs by VectorLock on Monday January 02, 2023 @10:32PM (#34227257)
Seems quite skinny on info about indexing. It nabs your login and stores tokens to the sites you want to index then... does it just spend CPU days running in your browser downloading and indexing all that data? How much storage do you need locally to index what can potentially be massive amounts of data in most corporate information sources?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Wednesday January 04, 2023 @07:07AM (#34244596)
gb's of storage, potentially 10+ for very large datasets.

Minutes, not days. Very big data sets might take 30+ minutes (or even a couple of hours), but usefulness starts in the first few minutes (because of the priority algorithm)

Re:Show HN: I built haystack – workplace search engine for devs by derekhingeveld on Tuesday January 03, 2023 @01:03AM (#34228270)
Really looking forward to trying out your app, it looks amazing.
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @01:12AM (#34228353)
Thanks
Re:Show HN: I built haystack – workplace search engine for devs by anonymous344 on Tuesday January 03, 2023 @02:57AM (#34228984)
where does this exactly store the data? and is it manageable?
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Wednesday January 04, 2023 @07:07AM (#34244602)
It stores it in browser local storage using IndexDB, if you have access to years of documents, it might take up to 10+gb of persistant storage.
Re:Show HN: I built haystack – workplace search engine for devs by rco8786 on Tuesday January 03, 2023 @01:34PM (#34235709)
> Browser based LLM

Very cool - any more info on that?

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Tuesday January 03, 2023 @05:59PM (#34239364)
Same bundle of weights but is being run by some rust code that is compiled down to WebAssembly.
Re:Show HN: I built haystack – workplace search engine for devs by mrmacha on Wednesday January 04, 2023 @05:25AM (#34244021)
Awesome idea and interesting approach!

I am wondering how the search latentcy will be with your approach, especially for cases with more than a few hundreds documents. Do you have any insights about that?

Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Wednesday January 04, 2023 @07:05AM (#34244586)
Actually a few hundred documents is really no biggy, my current benchmarks is in the range of <250ms (instant feeling) for hundreds of thousands of paragraphs.

I'm testing this on a large knowledge base.

Re:Show HN: I built haystack – workplace search engine for devs by XCSme on Wednesday January 04, 2023 @10:47AM (#34246926)
Why does your emoji (exploding head) on your landing page lead to an external page describing that emoji? https://emojipedia.org/exploding-head/
Re:Show HN: I built haystack – workplace search engine for devs by yuvalsteuer on Wednesday January 04, 2023 @12:11PM (#34248314)
Haha I copied it from that page, hilliarious!

I'll keep it haha

Re:Show HN: I built haystack – workplace search engine for devs by XCSme on Wednesday January 04, 2023 @10:48AM (#34246941)
Interesting product, you should list all the integrations on the landing page.
Re:Show HN: I built haystack – workplace search engine for devs by DarrenDev on Wednesday January 04, 2023 @02:20PM (#34250095)
Knowledge base for dev teams -- a problem we all have.

I almost built a potential solution to this problem years ago but backed out. I'd love to see a solution that sticks, and to be wrong about this, but it feels very much like a Tarpit problem to me:

https://www.youtube.com/watch?v=GMIawSAygO4