News for hackers. Stuff that matters.

A comment on Ask HN: Is anyone doing anything cool with tiny language models?.

Re:Ask HN: Is anyone doing anything cool with tiny language ... by Evidlo on Tuesday January 21, 2025 @07:00PM (#42786869)
I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman.

http://files.widloski.com/image10%20(1).png

http://files.widloski.com/image11.png

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by celestialcheese on Tuesday January 21, 2025 @07:31PM (#42787151)
Given the source, I'm skeptical it's not just a troll, but found this explanation [0] plausible as to why those vague spam text exists. If true, this trolling helps the spammers warm those phone numbers up.

0 - https://x.com/nikitabier/status/1867029883387580571

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by stogot on Tuesday January 21, 2025 @08:16PM (#42787482)
Why does STOP work here?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by celestialcheese on Tuesday January 21, 2025 @08:21PM (#42787538)
https://x.com/nikitabier/status/1867069169256308766

Again, no clue if this is true, but it seems plausible.

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by inerte on Tuesday January 21, 2025 @08:22PM (#42787551)
Carriers and SMS service providers (like Twillio) obey that, no matter what service is behind.

There are stories of people replying STOP to spam, then never getting a legit SMS because the number was re-used by another service. That's because it's being blocked between the spammer and the phone.

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by yawgmoth on Wednesday January 22, 2025 @08:15AM (#42792455)
STOP works thanks to the Telephone Consumer Protection Act (“TCPA”), which offers consumers spam protections and senders a framework on how to behave.

(Edit: It's relevant that STOP didn't come from the TCPA itself, but definitely has teeth due to it)

https://www.infobip.com/blog/a-guide-to-global-sms-complianc...

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by RVuRnvbM2e on Tuesday January 21, 2025 @07:04PM (#42786904)
This is fantastic. How have your hooked up a mobile number to the llm?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by Evidlo on Tuesday January 21, 2025 @07:15PM (#42786993)
Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by dkga on Tuesday January 21, 2025 @07:59PM (#42787356)
Yes, I'd be interested in that!
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by deadbabe on Tuesday January 21, 2025 @07:31PM (#42787153)
I’d love to see that. Could you simulate iMessage?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by Evidlo on Tuesday January 21, 2025 @07:55PM (#42787315)
If you mean hook this into iMessage, I don't know. I'm willing to bet it's way harder though because Apple
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by dambi0 on Wednesday January 22, 2025 @03:23AM (#42790394)
If you are willing to use Apple Shortcuts on iOS it’s pretty easy to add something that will be trigged when a message is received and can call out to a service or even use SSH to do something with the contents, including replying
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by great_psy on Tuesday January 21, 2025 @08:33PM (#42787660)
Yes it’s possible, but it’s not something you can easily scale.

I had a similar project a few years back that used OSX automations and Shortcuts and Python to send a message everyday to a friend. It required you to be signed in to iMessage on your MacBook.

Than was a send operation, the reading of replies is not something I implemented, but I know there is a file somewhere that holds a history of your recent iMessages. So you would have to parse it on file update and that should give you the read operation so you can have a conversation.

Very doable in a few hours unless something dramatic changed with how the messages apps works within the last few years.

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by dewey on Wednesday January 22, 2025 @06:05AM (#42791450)
They are all in a SQLite db on your disk.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by potamic on Wednesday January 22, 2025 @06:32AM (#42791613)
Why MQTT over HTTP for a low volume, small scale integration?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by c0wb0yc0d3r on Wednesday January 22, 2025 @09:00AM (#42792901)
I’m not OP, but I would hazard a guess that those are the tools that OP has at hand.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by sainib on Wednesday January 22, 2025 @06:50AM (#42791742)
Interested for sure.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by SuperHeavy256 on Wednesday January 22, 2025 @09:56AM (#42793477)
I am so SO interested, please make a Show HN
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by Evidlo on Wednesday January 22, 2025 @02:28PM (#42796544)
https://news.ycombinator.com/item?id=42796496
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by gaudystead on Wednesday January 22, 2025 @02:41PM (#42796687)
Sweeeeet, thank you! :)
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by spiritplumber on Tuesday January 21, 2025 @07:11PM (#42786967)
For something similar with FB chat, I use Selenium and run it on the same box that the llm is running on. Using multiple personalities is really cool though. I should update mine likewise!
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by zx8080 on Tuesday January 21, 2025 @07:12PM (#42786974)
Cool! Do you consider the risk of unintentional (and until some moment, an unknown) subscription to some paid SMS service and how do you mitigate it?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by Evidlo on Tuesday January 21, 2025 @07:18PM (#42787017)
I have to whitelist a conversation before the LLM can respond.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by thecosmicfrog on Tuesday January 21, 2025 @07:41PM (#42787231)
Please tell me you have a blog/archive of these somewhere. This was such a joy to read!
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by blackeyeblitzar on Tuesday January 21, 2025 @08:46PM (#42787781)
You realize this is going to cause carriers to allow the number to send more spam, because it looks like engagement. The best thing to do is to report the offending message to 7726 (SPAM) so the carrier can take action. You can also file complaints at the FTC and FCC websites, but that takes a bit more effort.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by thegabriele on Wednesday January 22, 2025 @03:25AM (#42790409)
Yes, the very last thing to do is respond to spam (calls, email, text...) and inform that you are eligible to more solicitation.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by metadat on Wednesday January 22, 2025 @12:42AM (#42789419)
I love this, more please!!!
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by merpkz on Wednesday January 22, 2025 @01:55AM (#42789860)
Calling Jessica an old chap is quite a giveaway that it's a bot xD Nice idea indeed, but I have a feeling that it's just two LLMs now conversing with each other.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by hackergirl88 on Wednesday January 22, 2025 @11:42AM (#42794672)
Where was this during the election
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by lacoolj on Wednesday January 22, 2025 @01:07PM (#42795730)
Most spam are just verifying you exist as a person, then from there you become an actual "target" if you respond.

This feels like an in-between that both wastes their time and adds you to extra lists.

Send the results somewhere! Not sure if "law enforcement" is applicable (as in, would be able/willing to act on the info) but if so, that's a great use of this data :)

[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by bripkens on Wednesday January 22, 2025 @01:14PM (#42795824)
You should put all these interactions on the web. For education purposes ofc.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by potatoman22 on Wednesday January 22, 2025 @01:41PM (#42796084)
You probably just get more spam texts since you're replying. Maybe that's a good thing tbh
[ Parent | on HN ]