News for hackers. Stuff that matters.
Re:DeepSeek-v4-flash-vision-exp by adastra22 on Friday August 21, 2026 @11:56AM (#49390019)
They’re not talking about zooming, hence the quotes.
Re:DeepSeek-v4-flash-vision-exp by knollimar on Friday August 21, 2026 @12:27PM (#49390460)
If the harness does it that's just like saying "please use a workaround". You'll lose fidelity and LLMs will lose the ability to count things or maintain relationships for schematics, etc
Re:DeepSeek-v4-flash-vision-exp by johndough on Friday August 21, 2026 @01:05PM (#49390992)
LLMs read images by splitting them up into e.g. 16x16 patches, which are then converted to embedding vectors and fed to the LLM, so from a technical point of view, feeding a big image as many 20x20 patches all at once is not too different from cropping subimages from the image, splitting those subimages into patches and feeding them to the LLM. Of course, the LLM has to be trained to understand that those images belong together, but it can be done.
Re:DeepSeek-v4-flash-vision-exp by knollimar on Friday August 21, 2026 @03:15PM (#49392639)
You say "it can be trained" but they fail at counting in my use cases, let alone maintaining symbolic relationships.

Can you point me at one that can understand a detailed block diagram? Frontier is fine, soliciting recommendations

Re:DeepSeek-v4-flash-vision-exp by johndough on Friday August 21, 2026 @06:10PM (#49394322)
For counting, there are specialized counting models, e.g. https://huggingface.co/spaces/MengqiLei/count-anything-demo

I tried to parse hand-drawn ER diagrams in the past and did not have much success with any model, frontier or otherwise. If you have annotated data, I'd recommend finetuning a recent (dense) VLM, but don't expect 100% accuracy. https://unsloth.ai/docs/basics/vision-fine-tuning

Re:DeepSeek-v4-flash-vision-exp by knollimar on Saturday August 22, 2026 @12:28PM (#49401287)
good advice; tbh I'm really trying to use counting as a proxy for "understand symbol, flag annotation next to it, associate annotation with symbol and store as object in location".

Ideally, look at second diagram and see something similar in the same location and understand it's the same physical object.

Re:DeepSeek-v4-flash-vision-exp by johndough on Friday August 21, 2026 @12:56PM (#49390851)
Yes. When the LLM tries to read an image, it will be resized by DeepSeek's server to 800x800, which might be a bit blurry. The LLM will then crop a smaller image from the high resolution image (using e.g. the `convert` tool via bash) and will then read the small cropped image. This image will still be resized to 800x800 by DeepSeek's server, but since it is already small, there is no or little loss of quality.