JacobJack

GFA Basic !… So many memories are coming back to me.

Thank you for your responses. They've been very helpful. I'm going to test the llama.cpp binaries directly. That seems to me to be the closest to what Ollama is trying to achieve, after all.

> And the comparisons in this post are not going to be running some 2.58-bit-gguf-in-ollama with a couple test prompts.

Genuine question : is there something fundamentally wrong with Ollama ?

I use Ollama because it is easy to set up and manage (and also because VLLM is not super Windows friendly).

I thought the main advantage of VLLM was better concurrency management (better batching).

But if the quality of the interference itself is an issue, then maybe I should reconsider my choice.

This page is a little older, but it offers the same kind of service and allows you to save in svg format : https://www.samcodes.co.uk/project/geometrize-haxe-web/

I'd really like to be able to use this 3B model on my little 4GB GPU card! It looks very capable for a reasonable weight. Maybe one day on HhuggingFace

Indeed... Today, Chrome simply removed uBlock Origin (and Redirector, which I use regularly in development). That's the last straw... Besides, I don't see how I can surf the web these days without uBlock Origin.

It's a way of using the English term "chat" while using the typically French article "Le". It reminds me of old American cartoons that abused the article "Le" to emphasize the French aspect of a character or place. The Mistral products "La Plateforme" and "Le Chat" follow this principle.

Yes... So many memories of the 90's are coming back to me all of a sudden. I spent months on Soundtracker/Protracker, literally.

After all, art may only be a matter of consensus.

No disqus account. So I’ll express myself here... MDN is an invaluable source of information. Very clear, comprehensive articles with intuitive examples. The web needs that.

Same here... Opera sets itself as default browser without any action/prompt whatever. It also adds the Opera icon in the task bar without asking anything. Red line crossed. Next step is probably to uninstall competitors ?

We do, actually... "Hundreds of millions of CAPTCHAs are solved by people every day. reCAPTCHA makes positive use of this human effort by channeling the time spent solving CAPTCHAs into digitizing text, annotating images, building machine learning datasets. This in turn helps preserve books, improve maps, and solve hard AI problems."

https://developers.google.com/recaptcha/

Such a vague patent shouldn't have been accepted in the first place. It's essentially an idea with no specific details. How long before we get a patent on "Something that serves a purpose of any kind" ?

http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=H...