Re:Autonomous cars, drones cheerfully obey prompt injection ...
by nasreddin on Saturday January 31, 2026 @06:59PM
(#46842175)
Its an incorrect assumption, the inference speed and particularly the inference speed of the on-device LLMs with which AVs would need to be using is not compatible with the structural requirements of driving.
[ Parent
| on HN ]
Re:Autonomous cars, drones cheerfully obey prompt injection ...
by nharada on Saturday January 31, 2026 @08:11PM
(#46842657)
I think the assumption is valid. Most of the reasoning components of the next gen (and some current gen) robotics will use VLMs to some extent. Deciding if a temporary construction sign is valid seems to fall under this use case.
Re:Autonomous cars, drones cheerfully obey prompt injection ...
by theamk on Sunday February 01, 2026 @12:12AM
(#46843808)
[delayed]
Re:Autonomous cars, drones cheerfully obey prompt injection ...
by whoiskevin on Sunday February 01, 2026 @09:49AM
(#46846571)
Not a "proceed" command but they can influence the accelerator. I had a dodge ram van that would constantly decelerate on cruise control due to reading road signs. The signs in some states like California for trucks towing trailers are 55 mph but the speed limit would be 65 or 70 mph. The cruise control would detect the sign and suddenly decelerate to 55.
Re:Autonomous cars, drones cheerfully obey prompt injection ...
by theamk on Sunday February 01, 2026 @06:21PM
(#46850427)
That's an example of things working as expected - the sign recognition system is very limited, in that it can only return road sign information. So it can _ask_ cruise control system to change the speed, but it's up to cruise control to decide if it's safe to obey the request or not. For example, I am pretty sure it'll never raise the speed, no mater what sign recognition system says.