News for hackers. Stuff that matters.

MINIMAN10000

You would just need a computer which can fit 2 3090s in order to run those to run something like TheBloke/airoboros-65B-gpt4-1.3-GPTQ

https://www.reddit.com/r/LocalLLaMA/wiki/models/ gives you a list of VRAM requirements to load the model into GPU VRAM. the more VRAM the computer has, the larger the model you can load in, thus making 3090s the current consumer grade king due to price to max VRAM.

This being said however most models are LLAMA based which all fall under that specific research license.

So following the rules, you would be limited to a subset of models which are foundational models which allow for commercial use

Re:Ask HN: Why Discord instead of a public forum? on Tuesday June 20, 2023 @06:00AM (#36401820)
Reddit is nice because with 1,000s of eyes information moves quickly. Discord is nice because when you can't get the quantity of reddit, you can mimic the quantity via discord because the rate of chat goes up enormously due to the nature of being realtime
Also good news was that running olive and downloading the ONNX converter to run stable diffusion shows something like 120% speedup on Nvidia and 50% speedup on AMD from the numbers I see. Some UIs are beginning to support ONNX format. ONNX being the format that has Microsoft's support behind it for AI models to my understanding.
Re:Revolt: Open-source alternative to Discord on Monday September 06, 2021 @02:58PM (#28436805)
In discord you see a room of people in voice chat which features drop in drop out.

You can them independently drop in and drop out of any text chat room.

The most common way to share text channel based content is to say "hey I'm posting an image in voice chat check it out"

The important part here is making voice the first class primary communication while not prohibiting the use of any text channels because there is no coupling.

Complete independence is better than coupling imo.

Separation can be done with permissions for both a single text and voice channel.

Also as long as someone has access to the voice channel they have access to the video channel of all active live streams.

I did and I was left satisfied.

I wanted to see their viewpoint on at the time "the hot topic" and confirm my suspicions that I truly don't consider their viewpoint rational or valid. It's like they start from a conclusion and work backwards to excuse it.

I don't care what their intent is. Interception and injection from a third party is bad.

With technology there are many ways to achieve the goal of notifying a customer without foul play.

Unfortunately all I could think of was "that sounds cool but I'd want to stick to dash instead of bash"

Also didn't realize it wasn't agentless which is pretty critical imo