Re:Introducing TypeChat from Microsoft
by waffletower on Friday July 21, 2023 @01:58PM
(#36817164)
In my experience, LLM responses result in a fair distribution of outputs that do have semantically useful outputs but do not precisely adhere to the requested format. If I chose to use a strongly typed language for LLM parsing, perhaps I would be tempted to eliminate complexity and simply throw structural outliers away, and explain to the suits that a certain percentage of our queries/expenses are unusable. Instead, more sophisticated coercion techniques could be applied instead to increase output utilization.
[ Parent
| on HN ]
There are no comments on this comment yet.