News for hackers. Stuff that matters.
Re:Watching o3 guess a photo's location is surreal, dystopia... by IAmGraydon on Saturday April 26, 2025 @10:57AM (#43804199)
Why would you go to all the trouble of creating a blog post about this but leave the EXIF data in the image and then proclaim that it probably works without the EXIF too? Why not remove the EXIF in the first place? The two EXIF-less examples given in the update very clearly show iconic landmarks, which makes guessing very easy.
Re:Watching o3 guess a photo's location is surreal, dystopia... by simonw on Saturday April 26, 2025 @11:09AM (#43804289)
I had already convinced myself through prior experiments that it wasn't using EXIF data, and decided not to spend extra time making my post 100% proof against cynics because I know from past experience that truly dedicated cynics will always find something to invalidate what they are reading.

I don't know how "iconic" that rocky outcrop in Madagascar is, to be honest. Google doesn't return much about it.

Re:Watching o3 guess a photo's location is surreal, dystopia... by hyperlink014 on Saturday April 26, 2025 @11:17AM (#43804356)
It absolutely tried to use EXIF data when I asked it to guess the location. Here is proof - https://imgur.com/a/CHde2Cx

I couldn't attach the chat directly since it's a temporary chat.

Re:Watching o3 guess a photo's location is surreal, dystopia... by simonw on Saturday April 26, 2025 @11:19AM (#43804375)
Right, but that's at least evident in the thinking trace. I added a note about that to my post.
Re:Watching o3 guess a photo's location is surreal, dystopia... by AstroBen on Saturday April 26, 2025 @11:29AM (#43804460)
How much can we trust the thinking trace? At most it says what's in its training set, but Anthropic showed that's not necessarily accurate for how it gets to its answer

I tried this with a (what I thought was) very generic street image in Bangkok. It guessed the city correctly, saying that "people are wearing yellow which is used to honor the monarchy". Wow, cool. I checked the image again and there's a small Thai flag it didn't mention at all. Seems just as plausible, even likely it picked up on that

Re:Watching o3 guess a photo's location is surreal, dystopia... by simonw on Saturday April 26, 2025 @11:35AM (#43804513)
I trust the thinking trace to show me the Python it runs.

(Though interestingly I believe there are cases where it can run Python without showing you, which is frustrating especially as I don't fully understand what those are. But I showed other evidence that it can do this without EXIF.)

In your example there I wouldn't be at all surprised if it used the flag without mentioning it. The non-code parts of the thinking traces are generally suspicious.

Re:Watching o3 guess a photo's location is surreal, dystopia... by whimsicalism on Saturday April 26, 2025 @11:30AM (#43804475)
if it's using tools to extract exif, it's gonna be in the trace - anthropic's paper is irrelevant here
Re:Watching o3 guess a photo's location is surreal, dystopia... by raincole on Saturday April 26, 2025 @11:23AM (#43804411)
> truly dedicated cynics

I bet a lot of people (on HN at least) thought of "Does it use EXIF?" when they read the title alone, and got surprised that it was not the first thing you tested.

Re:Watching o3 guess a photo's location is surreal, dystopia... by whimsicalism on Saturday April 26, 2025 @11:28AM (#43804455)
it doesn't use exif most times, it's able to do it consistently from google maps screenshots