News for hackers. Stuff that matters.
Re:"Building Machines That Learn and Think Like People", 7 Y... by KRAKRISMOTT on Sunday October 15, 2023 @04:56PM (#37893316)
How does it work? Does the encoder specifically pass the bounding box coordinates to the rest of the network as part of the embeddings?
Re:"Building Machines That Learn and Think Like People", 7 Y... by Hidios on Sunday October 15, 2023 @05:02PM (#37893349)
We don't understand how they work. We know how to make them, but much like the human brain, the very low level workings are beyond our understanding.

Broadly it can be said that LLMs work by reducing uncertainty. Interestingly, human consciousness is also theorized by some to work the same way, react to the input in ways to reduce uncertainty.

Re:"Building Machines That Learn and Think Like People", 7 Y... by tonmoy on Sunday October 15, 2023 @06:20PM (#37893928)
Internally that is probably something similar that is happening, but as far as I can tell it was never designed to specifically do that. Here is an example of the things GPT-4V is capable of: https://blog.roboflow.com/gpt-4-vision/amp/