Re:New OpenAI Feature: Predicted Outputs
by cbhl on Monday November 04, 2024 @10:38PM
(#42048399)
If you use the Cursor IDE: the folks that wrote it talked about their use of speculative decoding to make "Apply" faster on the Lex Friedman podcast last month.
Here it is on YouTube, although you can also find it on Spotify and other podcast platforms:
Re:New OpenAI Feature: Predicted Outputs
by digdugdirk on Tuesday November 05, 2024 @03:00PM
(#42054684)
Any recommendations for high level overview/learning resources about this? It seems interesting, but like most Linux internals, things get real technical, real quick.
Here it is on YouTube, although you can also find it on Spotify and other podcast platforms:
https://youtu.be/oFfVt3S51T4?t=1206
As for the Predicted Outputs feature, it looks incredibly useful in a few of my pipelines. Can't wait to test it out.