News for hackers. Stuff that matters.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by etaioinshrdlu on Sunday January 07, 2024 @10:06PM (#38907780)
Does Apple enforce strict safety and content rules on these types of apps?
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by winstonschen on Sunday January 07, 2024 @11:25PM (#38908260)
This app got through review pretty easily, especially since I flagged potentially offensive content which makes it age 12+. In comparison to social media these apps are positively angelic.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by Dig1t on Sunday January 07, 2024 @10:39PM (#38907965)
What does that mean exactly? Like your phone won’t print text that says something offensive?
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by alchemist1e9 on Sunday January 07, 2024 @10:52PM (#38908049)
Most likely they don’t even know what it means they just repeat the propaganda because everyone cool keeps saying it. Because you know LLMs are dangerous and so is all AI it needs safeguards. Whatever that means.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by valianteffort on Sunday January 07, 2024 @11:11PM (#38908178)
What the hell are you on about? Apple has rules and guidelines on (user) generated content, GP was asking whether it applied here.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by alchemist1e9 on Monday January 08, 2024 @12:06AM (#38908503)
Understood but at some point it becomes the responsibility of the user of the hammer if they use it in an attack or hurt someone else or themselves with it. LLMs are LLMs anyone who is using it who doesn’t understand it is language model and is a machine and how at the high level it works, probably shouldn’t use it, and it shouldn’t be Apple’s responsibility to keep hammers out of the hands of everyone due to the few who can’t hit a nail and stub their thumb.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by freedomben on Monday January 08, 2024 @08:25AM (#38911578)
Apple forcefully takes on that responsibility, and their customers love it (as clearly evidenced by their domination of the market). If you don't want a hammer that gets reviewed and screened by Apple before you can use it, then you're on the wrong platform.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by alchemist1e9 on Monday January 08, 2024 @09:38AM (#38912520)
Yeah that’s fine. But we still don’t have any tangible specifics in regards to what Apple needs to be reviewing for a locally hosted LLM. What can possibly be the criteria?

Probably an alternative version of this app or a similar app can provide an option to load your own models. Is that a problem for Apple to allow?

What I have found in my personal (and perhaps biased and anecdotal experience) is that there is a large cadre of LLM and AI hating people who inevitably start rambling about (a) safety and (b) copyright violations. Which I find reflect more about their mental model of the world and less about reality, in that they tends to be statists and collectivists that want a central authority to “protect” them. Which obviously get’s under my skin as that unfortunately mass instinct is what enabled big government, mass surveillance, and totalitarianism. Just my 2 cents, which undoubtedly many on HN may disagree with, and that’s fine, especially as I’m actually very interested in hearing more specifics from the AI safeguards crowd as admittedly perhaps I’m missing something terrible about this new hammer that has been invented, a hammer I find to be incredibly useful for nailing in all sorts of ways.

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by freedomben on Monday January 08, 2024 @12:33PM (#38915319)
Couldn't agree more.

I'm not sure how Apple could make an explicit policy for this. My theory is that they won't, but rather are going to roll out their own LLM that run locally and is optimized for on-device hardware, which non-Apple code will not be able to use. This won't make all the LLMs go away, but it will make running very unattractive since they'll be battery hungry and slow compared to the official app.

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by valianteffort on Monday January 08, 2024 @09:37AM (#38912498)
I wouldn't say "love it" as much as I would say "don't know" or "don't care".

Your average person doesn't spend a second thinking about Apple's app store policies. In fact most people don't even install new apps unless absolutely necessary.

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by etaioinshrdlu on Sunday January 07, 2024 @11:10PM (#38908166)
I'm concerned Apple won't approve your app for the App store if your chat app says something offensive.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by wahnfrieden on Sunday January 07, 2024 @11:27PM (#38908270)
No, just age ratings