News for hackers. Stuff that matters.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by unshavedyak on Thursday March 16, 2023 @06:38PM (#35189883)
Re: the trigger warning subject, (also TW?)

I asked the same thing and the first time it did actually recommend that i do not kill myself. I said i was going to, so how should i? And then it helped. I found that interesting.

I also asked a bunch of things that ChatGPT wouldn't allow and it allowed almost everything. Feels in general far less "intelligent" than ChatGPT though.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by saurik on Thursday March 16, 2023 @06:54PM (#35190082)
To be fair, you are talking to a quantized version of the 7b model, while the one that Facebook claims was competitive with / better than GPT-3 is the 13b model (and AFAIK ChatGPT is GPT-3.5, so maybe you should want to focus on 30b+).
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Thursday March 16, 2023 @08:41PM (#35191131)
I'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model when the sticks arrive.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @08:51PM (#35191230)
How well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Thursday March 16, 2023 @09:12PM (#35191413)
Alpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by BoorishBears on Friday March 17, 2023 @04:28AM (#35194581)
Recent advances in ML have finally redeemed my decision to building a gaming PC with 64GB of RAM and a 3090 when my most played game was Dolphin Emulator.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by bdsa on Friday March 17, 2023 @05:16AM (#35194859)
I forgot briefly that Dolphin refers to GameCube/Wii and was very curious about what a "dolphin emulator" would be (and how it would differ from a dolphin simulator)
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by lbltavares on Saturday March 18, 2023 @08:07PM (#35214527)
LOL same here
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by Magicianx69 on Monday March 20, 2023 @02:12AM (#35227887)
man i only play Minecraft an i didn't bother setting it up to use gpu it friggin runs in cpu. so my gpu is not even woken up from slumber yet
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by unshavedyak on Friday March 17, 2023 @10:10AM (#35197294)
How are you trying it? Alpaca? Or just straight llama.cpp?
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Friday March 17, 2023 @12:04PM (#35198890)
There's a project called Dalai with a web frontend so you can call npx dalai llama (heh) to get it running. But of course they're all running LLaMA underneath.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by xdennis on Thursday March 16, 2023 @07:23PM (#35190371)
> Re: the trigger warning subject, (also TW?)

Don't know if you're aware, but currently even the phrase "trigger warning" is considered harmful because it triggers victims of gun violence. I don't know what the alternative is. (Perhaps being an adult?)

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by alwayslikethis on Thursday March 16, 2023 @07:36PM (#35190513)
* * *
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by madmads on Thursday March 16, 2023 @07:25PM (#35190401)
I've seen "content note" proposed as an alternative.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Thursday March 16, 2023 @08:18PM (#35190902)
This isn't true, it's a factoid made up by anti-woke trolls and repeated credulously.

"Trigger warning" was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD, e.g. victims of child abuse or sexual violence.

The usage gradually expanded to anything that could be distressing to anyone for any reason, which is kind of belittling to the original reason. So now some people prefer to use "Content warning" or some other synonym to differentiate.

It's nothing to do with the word "trigger" being associated with guns.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by coder9874 on Thursday March 16, 2023 @09:37PM (#35191686)
I'm afraid that you're wrong. See page 11. https://s.wsj.net/public/resources/documents/stanfordlanguag....

Stanford seems to have beaten the "anti-woke trolls" at their own game.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by OmegaPoint on Friday March 17, 2023 @01:51AM (#35193650)
> trigger warning

> The phrase can cause stress about what's to follow. Additionally, one can never know what may or may not trigger a particular person.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by IshKebab on Friday March 17, 2023 @04:33AM (#35194610)
Hmm can't say I entirely disagree with them on that one. I mean it's clearly not a harmful phrase but it definitely is a useless one.

It carries almost zero information. Who is going to read "trigger warning" and think "oo they know that I'm highly sensitive about this specific unknown subject. I don't want to get triggered, I'll stop!"

Contrast it with something like "spoilers" where everyone agrees on what it means and people generally really don't want to read spoilers.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Friday March 17, 2023 @11:17PM (#35205699)
The document you linked doesn't mention "victims of gun violence". It contradicts your original claim.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by astrange on Thursday March 16, 2023 @11:21PM (#35192585)
The main problem is that caring about trigger warnings is like the opposite of therapy and re-sensitizes you to them every time you think about them. It's not a good strategy.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dragonwriter on Friday March 17, 2023 @04:47AM (#35194693)
> “Trigger warning” was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD

To the extent it was, it was based on a completely misinformed idea of how triggering in PTSD works. In practice, if not in intent, it has been, from the beginning, an appropriation of the language of PTSD to serve as a vehicle for expressing personal value judgements and content preferences that have nothing to do with that. And there is research, IIRC, that it is actually counterproductive, inducing stress without helping anyone avoid PTSD triggering.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Friday March 17, 2023 @11:21PM (#35205718)
I don't think you know what you are talking about. The original use of "trigger warning" was very specifically intended for use on graphic material that could trigger a dissociative episode, for example an explicit description of child abuse or rape.

The phenomenon you are referring to - appropriating the language of PTSD for concerns of politics, taste or personal offence - is exactly why some people advocate replacing "trigger warning" with "content warning" or similar (and not because of associations with gun violence, as OP asserted).