News for hackers. Stuff that matters.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by jazzyjackson on Thursday March 16, 2023 @04:01PM (#35187578)
I know it's downvote-worthy to suggest it but I really am so much more productive since I started using LLMs to explain technical jargon to me, it's very good at comparing technologies, so I can say "I understand x, but how is y different" and it will give an explanation fine tuned to my understanding -- this is a huge leap from the context-switching of opening a new tab and clicking on random websites looking for a blog that explains something at my level, or leaving a post on a website and waiting for someone to respond.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by thefourthchime on Thursday March 16, 2023 @04:05PM (#35187639)
Same! ChatGPT has been out for months, and really only in the last few weeks have i started using it as much as I should. I'm using an electron wrapper now, so it's a first class desktop app. With the plus subscription, the 3.5 is as fast as google.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by jazzyjackson on Thursday March 16, 2023 @04:06PM (#35187662)
I'm subscribed to Poe now which has a nice ios app + mac desktop for GPT4 and Anthropic's equivalent, Claude+
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by hackernewds on Thursday March 16, 2023 @06:25PM (#35189711)
what is an electron wrapper
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by MacsHeadroom on Thursday March 16, 2023 @07:44PM (#35190593)
I asked GPT-4 for you:

"An "Electron wrapper" refers to a software application created using Electron, a popular open-source framework. Electron allows developers to build cross-platform desktop applications using web technologies like HTML, CSS, and JavaScript.

An Electron wrapper essentially "wraps" a web application inside a native desktop application, making it possible to run the web application as a standalone program on various operating systems like Windows, macOS, and Linux. This is particularly useful for developers who want to create desktop applications without having to write separate code for each platform. Instead, they can use their existing web application code and package it with Electron to create a desktop application that works across multiple platforms."

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by solarmist on Thursday March 16, 2023 @09:41PM (#35191735)
Touché
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by photochemsyn on Thursday March 16, 2023 @10:02PM (#35191935)
What, nothing about Electron's unacceptable code bloat factor? Most disappointing!

https://www.hendrik-erz.de/post/electron-bloated-web-and-tra...

A GPT-4-on-GPT-4 flame war might be an incredible spectacle...

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by MacsHeadroom on Friday March 17, 2023 @01:33PM (#35200188)
I asked GPT-4 to produce a simulated argument about Electron which devolves into name calling. Here's the 2 page of result it returned:

User1: Hey, have you heard about Electron? It's an awesome framework for creating cross-platform apps using web technologies like HTML, CSS, and JavaScript.

User2: Yeah, I've heard of it. But I think it has some pretty serious shortcomings. Like, it's notorious for consuming a lot of system resources, which can be a major drawback for certain applications.

User1: Well, I think that's an acceptable trade-off for the ease of development and the ability to create one codebase that works across different platforms. Plus, it's backed by a large community, which is always a plus.

User2: Sure, but you can't ignore the fact that it increases the app's size significantly. Even a simple Electron app has a huge size compared to native apps, making it a poor choice for users with limited storage or slow internet connections.

User1: The size issue can be managed with optimization techniques, and honestly, storage is becoming cheaper and more abundant these days. You're blowing it out of proportion.

User2: It's not just about storage. Electron apps tend to have worse performance than native apps because they run on a separate instance of Chromium for each app. That's just bad design!

User1: Look, no framework is perfect, but Electron provides a valuable solution for developers who don't want to learn multiple programming languages and platforms. It's about practicality and productivity.

User2: Practicality? You call it practical to have apps that drain your battery life and hog system resources? I'd rather invest the time in learning native development than creating a subpar user experience.

User1: You're really not giving Electron enough credit here. It's widely used by popular apps like Slack, Visual Studio Code, and Discord! They can't be all that bad.

User2: Just because some popular apps use it doesn't mean it's a good choice. They're actually prime examples of how Electron can lead to bloated and resource-hungry applications. Have you ever noticed how sluggish those apps can be at times?

User1: Oh, come on! You're just nitpicking now. The benefits of Electron far outweigh its drawbacks for most developers and applications.

User2: I'm not nitpicking. I'm pointing out legitimate concerns. If Electron keeps getting a free pass, we'll end up with a sea of bloated, resource-hungry applications, dragging down our devices.

User1: You're just being a native app elitist! Electron has democratized app development, making it more accessible for web developers. It's better to have more apps available, even if they're not perfect, than to have a limited selection because of high barriers to entry.

User2: You Electron fanatics never cease to amaze me. It's like you're blind to its glaring problems. You want everyone to just ignore the elephant in the room!

User1: And you native app snobs are so quick to dismiss any alternative solution that threatens your precious, exclusive club! Get off your high horse!

User2: At least my "exclusive club" doesn't promote lazy development practices and drag down user experience! Enjoy your bloated apps, you Electron zealot!

User1: Have fun in your walled garden, you insufferable native app purist!

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by photochemsyn on Friday March 17, 2023 @11:25PM (#35205734)
Wow.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by disgruntledphd2 on Saturday March 18, 2023 @03:11PM (#35212147)
> I asked GPT-4 to produce a simulated argument about Electron which devolves into name calling. Here's the 2 page of result it returned:

How many attempts did the above take?

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by Steuard on Thursday March 16, 2023 @06:27PM (#35189736)
That sounds like a cool use case, but... how can you bring yourself to trust anything at all that it tells you? This feels like it's just begging to contaminate your understanding with sparse, unpredictable errors, and personally I find the thought of that unexpectedly dismaying.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by nr2x on Thursday March 16, 2023 @07:25PM (#35190393)
Personally Ive been coding long enough I’ve forgotten more than most junior people know. So I use ChatGPT to refresh my memory more than anything else. Like yesterday couldn’t remember how to open some ports on a Postgres server. ChatGPT gave me a 95% accurate answer and based on my own knowledge base I fixed the mistake. This took all of a few seconds. Whereas with normal web search it would take an order of magnitude longer and likely be not much more accurate.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by crazygringo on Thursday March 16, 2023 @07:25PM (#35190397)
It's a lot easier to verify whether something is correct once you know what the thing is.

Half the time when I'm googling something I don't even know what subfield the term belongs to. I don't know what related terms I can use to narrow it down. Or I keep getting papers on a related but different question from what I'm trying to ask.

But if ChatGPT gives me an answer in context of a bunch of related terminology, it's so much easier to then plug those additional terms into Google and find a/the authoritative source.

For comparison, a lot of my (non-ChatGPT) initial searches will result in random blog entries or something that are often just flat-out wrong or else ignoring competing viewpoints. But they still might point me to better context and search terms.

The value of ChatGPT is that it gets you to information you can verify so much faster. But you still need to verify it the same way you need to verify stuff you find on blogs or Quora or Reddit or HN.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by taink on Thursday March 16, 2023 @07:29PM (#35190446)
No need to trust it -- that's the best part.

I tend to trust blogs or conversations with other people more than I should. The benefit of a tool like ChatGPT is that I already distrust it, and I tend to double-check more often what it responds.

I agree with you, but the comparison and fine-tuning GP mentioned are really areas where it's an unparalleled tool right now. Dismissing it in fear of "contaminating your understanding" is missing out on what the tool may offer to you. It's not really that much worse than a search query.

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by beepbooptheory on Thursday March 16, 2023 @07:52PM (#35190664)
This has been really the most productive use of it for me. But I'm so cheap I've been stopping myself more and more and just spending an extra minute googling to save the cent. Even if its just literally penny pinching, its also helping the environment! Is the velocity I get an answer worth the cycles? I'm not so sure these days, but its been interesting reflecting on this.

Definitely excited for the inevitable reports comparing the killowats spent cumulatively to get an answer through google vs openai. How many blogs visited does it take to spend the same amount of energy getting the answer from a model?