How scientists are using Claude to accelerate research and discovery

Re:How scientists are using Claude to accelerate research an... by bob1029 on Sunday January 18, 2026 @12:15PM (#46669743)

CNNs and LLMs are fundamentally different architectures. LLMs do not operate on images directly. They need to be transformed into something that can ultimately be fed in as tokens. The ability to produce a confidence figure isn't possible until we've reached the end of the pipeline and the vision encoder has already done its job.

[ Parent | on HN ]

Re:How scientists are using Claude to accelerate research an... by kelipso on Sunday January 18, 2026 @07:44PM (#46673764)

The images get converted to tokens using the vision encoder, But the tokens are just embedding vectors. So it should be able to if you train it.

CNNs and LLMs are not that different. You can train an LLM architecture to do the same thing that CNNs do with a few modifications, see Vision Transformers.

[ Parent | on HN ]