News for hackers. Stuff that matters.
Re:Introducing TypeChat from Microsoft by mahalex on Thursday July 20, 2023 @04:49PM (#36806555)
So, it's a thing that appends "please format your response as the following JSON" to the prompt", then validates the actual response against the schema, all in a "while (true)" loop (literally) until it succeeds. This unbelievable achievement is a work of seven people (authors of the blog post).

Honestly, this is getting beyond embarrassing. How is this the world we live in?

Re:Introducing TypeChat from Microsoft by jlnho on Thursday July 20, 2023 @04:59PM (#36806670)
It's because not everyone can be as gifted as you.

I think the (arguably very prototypical) implementation is not what's interesting here. It's the concept itself. Natural language may soon become the default interface for most of the computing people do on a day to day basis, and tools like these will make it easier to create new applications in this space.

Re:Introducing TypeChat from Microsoft by Edes on Thursday July 20, 2023 @05:49PM (#36807206)
I'm gonna love trying to figure out what query gets the support chatbot to pair me with an actual human so that I can solve something that's off script
Re:Introducing TypeChat from Microsoft by jlnho on Friday July 21, 2023 @01:49AM (#36810402)
Ideally you would jutst click the "talk to a human" button, but what do I know?
Re:Introducing TypeChat from Microsoft by siva7 on Thursday July 20, 2023 @04:54PM (#36806614)
One of the authors is Anders Hejlsberg, the guy behind c# and delphi
Re:Introducing TypeChat from Microsoft by mahalex on Thursday July 20, 2023 @05:01PM (#36806702)
That’s what makes it even more embarrassing.
Re:Introducing TypeChat from Microsoft by rob74 on Friday July 21, 2023 @02:37AM (#36810696)
I think he's probably more of an author in the way that the leader of a research team is always credited on any paper by the team, even if he didn't personally do any actual work on it?

Anyway, TIL that Hejlsberg is also involved with TypeScript...

Re:Introducing TypeChat from Microsoft by lsh123 on Thursday July 20, 2023 @05:49PM (#36807204)
Hm... so how do we know that the actual values in the produced json are correct???
Re:Introducing TypeChat from Microsoft by mahalex on Friday July 21, 2023 @02:58AM (#36810805)
As with anything output by “AI”: you don’t.
Re:Introducing TypeChat from Microsoft by TeeWEE on Friday July 21, 2023 @12:40AM (#36810067)
Yeah it’s basically a retry loop. I’m curious about the average response time and the worst case amount of iterations.

At best, all these “retry until successfully” are just hacks to bridge the formal world with the stochastic. It’s just useless without some stats on how it performs.

And even if it conforms. Your not sure the data makes sense. Probably .. but exactly that probably

I would not recommend using this in production.