Re:Ask HN: What have you built with LLMs?
by geor9e on Monday February 05, 2024 @07:21PM
(#39269114)
My "stack" is just Apple Shortcuts making HTTP POST API calls to OpenAI, which does stuff in MacOS via BetterTouchTool. I trigger each by hotkey or typing a few letter into Spotlight (with Alfred). One transcribes and summarizes whatever youtube URL is highlighted. One does grammar and style correction of whatever is highlighted (and replaces it). One simply replaces the Dictate key with OpenAI Whisper but otherwise works exactly the same as voice typing. It's just way more accurate. One replaces the magnifying glass key to have a voice conversation with ChatGPT (using Microsoft voice synthesis). The built in prompt keeps it's answers short and conversational. It's like asking Siri something, but much better. One simply reduces the highlighted text by ~50% by rewriting it shorter, for when I have typed too much. One gives the key points of whatever article is in the foreground tab, so I know what I'm about to read. One outputs purely code, for example I use my voice to say "javascript alert saying blah" and alert("blah"); will appear at my cursor. Of course, it's usually more complex boilerplate stuff, but it helps speed up my coding. Every time I find myself using an LLM repeatedly for something, I make it into a little Apple Shortcut to streamline it into my workflow, as if it were a built in MacOS feature.
[ Parent
| on HN ]
Re:Ask HN: What have you built with LLMs?
by tomcam on Monday February 05, 2024 @08:39PM
(#39269708)
You beast! They all sound awesome!
Re:Ask HN: What have you built with LLMs?
by clapslock on Tuesday February 06, 2024 @06:21AM
(#39273130)
Could you please share the prompt for the grammar and style correction shortcut? I've just started using it for the same purpose, but I haven't been able to find a prompt that yields consistent results. Sometimes, ChatGPT completely changes the style of my text.
Re:Ask HN: What have you built with LLMs?
by geor9e on Tuesday February 06, 2024 @08:55PM
(#39283532)
I use role: system, temperature 0.7, prompt: Fix the spelling, grammar, punctuation, order, and sentence structure. It's does sometimes change the style too much, but not often enough to annoy me into fiddling with it.
Re:Ask HN: What have you built with LLMs?
by lemming on Tuesday February 06, 2024 @06:22AM
(#39273136)
These sound amazing, if you don’t mind sharing somehow, I’d love to see how these work. I’ve never used shortcuts, but I think you’ve inspired me to try.
Re:Ask HN: What have you built with LLMs?
by geor9e on Tuesday February 06, 2024 @09:06PM
(#39283604)
I put couple screenshots here https://news.ycombinator.com/item?id=39283515 to show the API call part. The rest is just whatever you want it to feed into in Shortcuts. For launching a shortcut on keydown, and clicking out of it on keyup, I used BetterTouchTool like this https://i.imgur.com/sqJ7cOc.png
Re:Ask HN: What have you built with LLMs?
by mpalmer on Tuesday February 06, 2024 @09:34AM
(#39274597)
I have looking for a way to do "push to record audio" (instead of Mac's dictate) for ages, thanks for the push to look at Shortcuts!
Are you using the "Record Audio" action or something else? Ideally the shortcut would stop listening after a pause like the native Dictate feature does it. At a minimum Record Audio seems to require hitting spacebar to stop - not great but not terrible.
Re:Ask HN: What have you built with LLMs?
by geor9e on Tuesday February 06, 2024 @07:36PM
(#39282983)
Yes, "Record audio". BetterTouchTool launches the shortcut on keydown, then clicks the Stop button on keyup.
Re:Ask HN: What have you built with LLMs?
by alizbazar on Tuesday February 06, 2024 @12:19PM
(#39277212)
Would love to learn more details about your setup! I use BetterTouchTool, too and wonder how to make use of it + shortcuts + the API
Re:Ask HN: What have you built with LLMs?
by geor9e on Tuesday February 06, 2024 @08:52PM
(#39283515)
You might want BetterTouchTool too, since it adds things like cut and paste, to Apple Shortcuts All Actions list. I also use it as the initial trigger usually, to make a hotkey launch a Shortcut. Whisper looks like this https://i.imgur.com/ApAwf2E.png and ChatGPT looks like this https://i.imgur.com/g9f9ZDH.png .
Re:Ask HN: What have you built with LLMs?
by dostick on Wednesday February 07, 2024 @11:43PM
(#39298267)
Nobody heard of Raycast?
Re:Ask HN: What have you built with LLMs?
by geor9e on Thursday February 08, 2024 @11:26PM
(#39311380)
I have not. It looks like it just does some things Alfred was already doing 10 years earlier, and some ChatGPT. Seems like everything has ChatGPT integration these days. I don't think it's compelling enough for me to try tho personally, but I only skimmed the home page. The $8/mo subscription model turned me off a bit.
Re:Ask HN: What have you built with LLMs?
by isenhaard on Tuesday February 06, 2024 @02:50PM
(#39279574)
I really love that, super good ideas. I also generally love to create workflow optimizations. Will probably create some of your stuff for myself (I especially like the dictation replacement, could be super useful to me).
Wondering: How big is you monthly OpenAI bill when using all these tools? Only a few $$$, or is it higher?
Re:Ask HN: What have you built with LLMs?
by geor9e on Tuesday February 06, 2024 @09:00PM
(#39283557)
Only a few dollars a month
Re:Ask HN: What have you built with LLMs?
by nbbaier on Wednesday February 07, 2024 @02:47PM
(#39293307)
What are the settings and prompt you use for the youtube one?