News for hackers. Stuff that matters.

A comment on Google employees criticize CEO for “dumpster fire” response to ChatGPT. Parent comment

Re:Google employees criticize CEO for “dumpster fire” respon... by gerash on Tuesday February 14, 2023 @02:33PM (#34794719)
It all sounds good as a consumer but there are a few questions which are by no means clear to me:

* How does getting recommendations from a chatbot (what TV to buy) play with websites that produce such content (TV reviews) * How does it play with websites that rely on ad impression * How can you monetize a chatbot? (there's an easy way: free tier + monthly subscription) * How to reduce the massive compute cost of a good chatbot without making it bad (this also seems more straightforward)

[ Parent | on HN ]
Re:Google employees criticize CEO for “dumpster fire” respon... by visarga on Tuesday February 14, 2023 @03:04PM (#34795154)
Apparently Google is capable of doing cool things. DeepMind’s speculative sampling achieves 2–2.5x decoding speedups in LLM. That brings cost down significantly, without degradation in quality.
[ Parent | on HN ]