News for hackers. Stuff that matters.

A comment on Ask HN: What is the weirdest or most surreal (recent) technology you have seen?. Parent comment

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by skyde on Tuesday January 24, 2023 @02:35PM (#34508958)
For people familiar with how ChatGpT work, is there a youtube video or blog you recommend that explain how it work.

I have a very good understanding of how deeplearning neural network work and language model like "Word2vec" that convert a sentence or a word to a vector space.

But I completely fail to understand how Given an initial text as prompt, ChatGpt will produce text that continues the prompt.

[ Parent | on HN ]
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by skyde on Tuesday January 24, 2023 @03:03PM (#34509424)
I cant believe it simply use self-attention to generate one word at a time. It got to be more complex than that.
[ Parent | on HN ]