News for hackers. Stuff that matters.
Re:ChatGPT vs. open source on harder tasks by andy_xor_andrew on Thursday May 18, 2023 @02:48PM (#35992386)
I'm employed by Microsoft, but not in any relation to the authors of this tool or this post. First time I saw github.com/mirosoft/guidance was on the HN front page, actually :)

I've been waiting for a tool exactly like guidance, something that lets me compose prompts the way I think about prompts. Langchain was too much of a headache for me. Playing with guidance, it feels like this is how programmatically interacting with a llm should be. Also, really happy to see the MIT license.

I'd love to see ports to other languages.

Re:ChatGPT vs. open source on harder tasks by hackernewds on Thursday May 18, 2023 @03:15PM (#35992709)
are we going to now invent a programming language that communicates with LLMs? I find that funny
Re:ChatGPT vs. open source on harder tasks by candiddevmike on Thursday May 18, 2023 @03:19PM (#35992764)
I'm not an LLM, but I am a native English speaker and English is pretty awful for conveying information succinctly. The lengths you must go with prompts to ensure you're getting the right response is extremely similar to the lengths you go to when delegating something to someone or describing requirements to a project. I wonder if whatever language we end up using to "converse" with LLMs would have value within an organization/email/Jira.
Re:ChatGPT vs. open source on harder tasks by dragonwriter on Thursday May 18, 2023 @03:21PM (#35992783)
> I’m not an LLM, but English is already pretty awful for conveying information succinctly. The lengths you must go with prompts to ensure you’re getting the right response is extremely similar to the lengths you go to when delegating something to someone or describing requirements to a project. I wonder if whatever language we end up using to “converse” with LLMs would have value within an organization/email/Jira.

People already adopt context-specific specialized languages in contexts like that for clarity, what will probably happen is that LLMs will get better at adapting or being adapted to specific contexts.

Re:ChatGPT vs. open source on harder tasks by bcrosby95 on Thursday May 18, 2023 @04:39PM (#35993731)
I prefix my longer prompts with glossaries. It lets me write more succinctly.
Re:ChatGPT vs. open source on harder tasks by redblacktree on Thursday May 18, 2023 @04:51PM (#35993867)
I would love an example of this.
Re:ChatGPT vs. open source on harder tasks by bcrosby95 on Thursday May 18, 2023 @10:04PM (#35996926)
It's pretty simple, I just add a glossary of terms at the top.

When asking for creative but well-structured output that requires specific definitions of certain words to be useful, I've found it works best to use words for your terms that don't actually exist. Otherwise it seems to focus a bit more on the broader word more than it should rather than your definition, especially if you use it a lot.

Re:ChatGPT vs. open source on harder tasks by Qweiuu on Friday May 19, 2023 @07:37AM (#36000480)
I'm normally the type of Google person with doing minus or using other tags.

I totally gave that up with chatgpt and the magic of it is that it understands it so so we'll.

Sometimes I also switch to German in the middle of a sentence or use very vague words to describe something if the word is missing in my head.

Re:ChatGPT vs. open source on harder tasks by rytill on Thursday May 18, 2023 @03:37PM (#35992984)
Why do you find that funny?
Re:ChatGPT vs. open source on harder tasks by ipaddr on Thursday May 18, 2023 @04:28PM (#35993632)
That's chatgpt main function. What if we introduced a language that could be converted to another language that uses tool to speak to chatgpt.
Re:ChatGPT vs. open source on harder tasks by seydor on Thursday May 18, 2023 @04:24PM (#35993595)
We can then train an LLM to generate it though
Re:ChatGPT vs. open source on harder tasks by gajnadsgjoas on Thursday May 18, 2023 @04:42PM (#35993775)
Re:ChatGPT vs. open source on harder tasks by behnamoh on Thursday May 18, 2023 @04:58PM (#35993971)
Can someone please compare guidance with lmql? I don’t wanna learn multiple programming languages to handle LLMs as that defeats the whole point.
Re:ChatGPT vs. open source on harder tasks by Decabytes on Thursday May 18, 2023 @05:31PM (#35994335)
I've been thinking about this a lot recently. Communicating with LLMs using Lobjan for less ambiguity in text, or some LLM optimized language that can inject the most amount of meaning per token. Or writing in a AI Optimized Programming Language that is easier for it to parse and reason about
Re:ChatGPT vs. open source on harder tasks by awwaiid on Thursday May 18, 2023 @11:44PM (#35997500)
JS > asm.js > wasm all over again
Re:ChatGPT vs. open source on harder tasks by behnamoh on Thursday May 18, 2023 @03:07PM (#35992628)
langchain caused more problems than it fixed. Really ugly software.
Re:ChatGPT vs. open source on harder tasks by WhatsName on Thursday May 18, 2023 @03:13PM (#35992690)
Please elaborate. So far it seems promising to me, but I started using it just recently.
Re:ChatGPT vs. open source on harder tasks by behnamoh on Thursday May 18, 2023 @03:17PM (#35992736)
Re:ChatGPT vs. open source on harder tasks by SparkyMcUnicorn on Thursday May 18, 2023 @05:07PM (#35994074)
And their "what's next?" links to a project that relies on langchain[0].

[0] https://github.com/imartinez/privateGPT

Re:ChatGPT vs. open source on harder tasks by stavros on Thursday May 18, 2023 @05:33PM (#35994376)
That just says "I got an error with it", hardly an indictment.