gmarland

Thanks for checking out fruitstand! I was recently working on a project that involved doing intent detection/entity extraction using an LLM. I was asked how we could make it so that the model could be changed/upgraded in the future without impacting the function. After a bit of thinking, this is what I came up with.

For anyone who is interested in how this works, it's pretty straightforward. The baseline creates an embedding for the outputted phrase and stores it in the json file. The test then runs the same phrase through the tested llm/model and the embeds the results.

The results of the baseline and the test are then compared with a cosine similarity so determine the similarity.

It was a pretty fun library to write!

the non http traffic is really really powerful. I feel like currently lohost is limited in serving static content too. its definitely something I would like to improve on in the future!

thanks!! haha that definitely does seem like a weakness I need to patch :)

I can definitely see why you would say that! ngrok uses tunnels to connect to your computer, this uses websockets to load and serve the requested documents.

The reason for this is that I wanted this to be a distributed solution. You can shard up the different routes across as many computers as you like and the front end will route and patchwork it together at the front end.

Along with that you can run the client over any number of computers and they will act as backups for eachother. So, if you turn off one computer, one of the others will pick up the slack.

I'm not super familar with ngrok, but if it does all that then I guess, beyond the technology, there isn't a massive amount of difference :)

Thanks!!! It's been an itch in the back of my brain for some time now!

That's also good to know! I'll try and put together a Linux installer too :)

This was a project I worked on over the Christmas break. It may not come through in the video but this is serving the webite straight from your computer, not backdoor uploading files.

Here's a video showing it in action: https://youtu.be/DaK4d4Belwk

It's really just a fun project I wrote to see if it was possible.

wow, duh, i guess this shows how you can get into a headspace of trying to solve something that's already been solved :)

This project was gnawing at me for a while. I'm really looking for feedback. Perhaps it's not even a good thing to do?

That's definitely something I can do easily enough. Maybe make the rotation axis configurable

I was hoping to get some feedback on where this is going, if it's at all compelling or what people would like to see. This is definitely version 0.1.

Thank you for your comment and I agree, the landing page needs some serious work. I wasn't sure if I was addressing a problem other people felt too.

So Just in case it doesn't come across. You log to the sawmill library which then posts to a rest api. sawmill the groups similar error logs into work items and alerts the team to new or previously thought fixed issues. The tickets can then be worked on and closed when fixed.

It's trying to wrap some intelligence around the logs that you receive from an application.

Any thoughts on the concept or problems would be greatly appreciated!

If you need any help setting it up/compiling please let me know. I'd be happy to get you going with it.