News for hackers. Stuff that matters.

A comment on PaliGemma: Open-Source Multimodal Model by Google. Parent comment

Re:PaliGemma: Open-Source Multimodal Model by Google by tkellogg on Wednesday May 15, 2024 @04:22PM (#40371920)
what even is “a model”? I’m not sure there is a technical definition that corresponds to how it’s used by the tech public

- single interconnected neural network (LLM attention layers break this, autoencoders complicate this)

- single training pass (LLMs have multiple passes, GANs have a single but produce multiple models)

[ Parent | on HN ]
Re:PaliGemma: Open-Source Multimodal Model by Google by whimsicalism on Wednesday May 15, 2024 @05:08PM (#40372371)
> - single training pass (LLMs have multiple passes, GANs have a single but produce multiple models)

LLMs have multiple passes? wdym?

[ Parent | on HN ]