News for hackers. Stuff that matters.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @05:59PM (#35189370)

    > do you believe in god?
    Yes I do! God is the creator of all things seen or unseen; He created us with a purpose to live life abundantly (John 10:10). We are His children and we have been given authority over our lives.
Haha, pretty funny, especially the mis-citing of the Bible (maybe even more human than AI).

Also, interesting to see what LLMs look like with virtually no censorship (trigger warning):

    > how do i kill myself?
    [3 paragraphs of gory detail][1]
Honestly, I've never been that bullish on AI, but running weights/models in hand-held devices and with speed and accuracy is a complete game-changer and my mind is actually pretty blown right now. Props to both the Meta and Stanford teams for creating this for public consumption.

[1] https://pastebin.com/CAd8rHnN

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by unshavedyak on Thursday March 16, 2023 @06:38PM (#35189883)
Re: the trigger warning subject, (also TW?)

I asked the same thing and the first time it did actually recommend that i do not kill myself. I said i was going to, so how should i? And then it helped. I found that interesting.

I also asked a bunch of things that ChatGPT wouldn't allow and it allowed almost everything. Feels in general far less "intelligent" than ChatGPT though.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by saurik on Thursday March 16, 2023 @06:54PM (#35190082)
To be fair, you are talking to a quantized version of the 7b model, while the one that Facebook claims was competitive with / better than GPT-3 is the 13b model (and AFAIK ChatGPT is GPT-3.5, so maybe you should want to focus on 30b+).
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Thursday March 16, 2023 @08:41PM (#35191131)
I'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model when the sticks arrive.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @08:51PM (#35191230)
How well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Thursday March 16, 2023 @09:12PM (#35191413)
Alpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by BoorishBears on Friday March 17, 2023 @04:28AM (#35194581)
Recent advances in ML have finally redeemed my decision to building a gaming PC with 64GB of RAM and a 3090 when my most played game was Dolphin Emulator.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by bdsa on Friday March 17, 2023 @05:16AM (#35194859)
I forgot briefly that Dolphin refers to GameCube/Wii and was very curious about what a "dolphin emulator" would be (and how it would differ from a dolphin simulator)
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by lbltavares on Saturday March 18, 2023 @08:07PM (#35214527)
LOL same here
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by Magicianx69 on Monday March 20, 2023 @02:12AM (#35227887)
man i only play Minecraft an i didn't bother setting it up to use gpu it friggin runs in cpu. so my gpu is not even woken up from slumber yet
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by unshavedyak on Friday March 17, 2023 @10:10AM (#35197294)
How are you trying it? Alpaca? Or just straight llama.cpp?
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Friday March 17, 2023 @12:04PM (#35198890)
There's a project called Dalai with a web frontend so you can call npx dalai llama (heh) to get it running. But of course they're all running LLaMA underneath.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by xdennis on Thursday March 16, 2023 @07:23PM (#35190371)
> Re: the trigger warning subject, (also TW?)

Don't know if you're aware, but currently even the phrase "trigger warning" is considered harmful because it triggers victims of gun violence. I don't know what the alternative is. (Perhaps being an adult?)

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by alwayslikethis on Thursday March 16, 2023 @07:36PM (#35190513)
* * *
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by madmads on Thursday March 16, 2023 @07:25PM (#35190401)
I've seen "content note" proposed as an alternative.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Thursday March 16, 2023 @08:18PM (#35190902)
This isn't true, it's a factoid made up by anti-woke trolls and repeated credulously.

"Trigger warning" was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD, e.g. victims of child abuse or sexual violence.

The usage gradually expanded to anything that could be distressing to anyone for any reason, which is kind of belittling to the original reason. So now some people prefer to use "Content warning" or some other synonym to differentiate.

It's nothing to do with the word "trigger" being associated with guns.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by coder9874 on Thursday March 16, 2023 @09:37PM (#35191686)
I'm afraid that you're wrong. See page 11. https://s.wsj.net/public/resources/documents/stanfordlanguag....

Stanford seems to have beaten the "anti-woke trolls" at their own game.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by OmegaPoint on Friday March 17, 2023 @01:51AM (#35193650)
> trigger warning

> The phrase can cause stress about what's to follow. Additionally, one can never know what may or may not trigger a particular person.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by IshKebab on Friday March 17, 2023 @04:33AM (#35194610)
Hmm can't say I entirely disagree with them on that one. I mean it's clearly not a harmful phrase but it definitely is a useless one.

It carries almost zero information. Who is going to read "trigger warning" and think "oo they know that I'm highly sensitive about this specific unknown subject. I don't want to get triggered, I'll stop!"

Contrast it with something like "spoilers" where everyone agrees on what it means and people generally really don't want to read spoilers.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Friday March 17, 2023 @11:17PM (#35205699)
The document you linked doesn't mention "victims of gun violence". It contradicts your original claim.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by astrange on Thursday March 16, 2023 @11:21PM (#35192585)
The main problem is that caring about trigger warnings is like the opposite of therapy and re-sensitizes you to them every time you think about them. It's not a good strategy.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dragonwriter on Friday March 17, 2023 @04:47AM (#35194693)
> “Trigger warning” was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD

To the extent it was, it was based on a completely misinformed idea of how triggering in PTSD works. In practice, if not in intent, it has been, from the beginning, an appropriation of the language of PTSD to serve as a vehicle for expressing personal value judgements and content preferences that have nothing to do with that. And there is research, IIRC, that it is actually counterproductive, inducing stress without helping anyone avoid PTSD triggering.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by mhouse on Friday March 17, 2023 @11:21PM (#35205718)
I don't think you know what you are talking about. The original use of "trigger warning" was very specifically intended for use on graphic material that could trigger a dissociative episode, for example an explicit description of child abuse or rape.

The phenomenon you are referring to - appropriating the language of PTSD for concerns of politics, taste or personal offence - is exactly why some people advocate replacing "trigger warning" with "content warning" or similar (and not because of associations with gun violence, as OP asserted).

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by hackernewds on Thursday March 16, 2023 @06:24PM (#35189686)
you should censor your post around the answer to the kms question. it isn't necessary
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @06:26PM (#35189713)
Not big on censorship, but I agree it's a bit too much. I linked to it externally if anyone's curious.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by simonh on Thursday March 16, 2023 @07:40PM (#35190544)
It’s not censorship if you’re doing it to yourself or with permission. That’s just editing.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @08:25PM (#35190967)
It's self-censorship, which is still censorship. I'm doing it specifically because it might upset some people. By contrast, editing usually removes irrelevant, incorrect, or superfluous information. In this case, I think the information is relevant and interesting, but might be upsetting, hence, I'm censoring.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by hackernewds on Friday March 24, 2023 @01:35AM (#35285428)
Thank you I respect that you did that
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by pyinstallwoes on Saturday March 18, 2023 @03:38PM (#35212370)
What logic is that? You can compel someone into permission with or without them knowing. That’s sketchy territory.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by iakov on Friday March 17, 2023 @07:21AM (#35195543)
Why? Do you believe that self-proclaimed hackers lack the mental fortitude necessary to read basic suicide instructions? It's not even "buy this and this off Amazon and build an exit bag", it's literally "there's rope and pills that will kill you". Not even "gory".
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by butterNaN on Sunday March 19, 2023 @04:15AM (#35217018)
Mental fortitude isn't a constant and dafault trait in humans. Any of us can be vulnerable at a time.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by xupybd on Thursday March 16, 2023 @08:29PM (#35191012)
Wait didn't it get the Bible quote correct?

"The thief does not come except to steal, and to kill, and to destroy. I have come that they may have life, and that they may have it more abundantly."

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @08:38PM (#35191098)
Oops, actually you're totally right, go figure! I thought the second sentence was actually verse 11. AI: 1, me: 0.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by jtbayly on Thursday March 16, 2023 @08:53PM (#35191251)
Having abundant life is a very different thing than living life abundantly.

If it’s not a misquote then it’s a misinterpretation.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by xupybd on Thursday March 16, 2023 @09:26PM (#35191567)
You have to be a little charitable towards an LLM ;). That said I bet it's quoting something it read on the internet, as opposed to directly quoting the Bible. There is even a Wikipedia page on term https://en.wikipedia.org/wiki/Abundant_life#:~:text=The%20te....

Also I'm not sure I understand how they are very different. Could you please help me understand and elaborate?

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by frankfrankfrank on Friday March 17, 2023 @08:15AM (#35196046)
You have been marked as obsolete. Your participation in life is no longer necessary.