News for hackers. Stuff that matters.
Re:Google's AI thinks I left a Gatorade bottle on the moon by simonw on Sunday October 06, 2024 @11:16PM (#41762459)
The linked article describes an attack against NotebookLM, which is limited to people who deliberately create a Notebook that includes the URL of the page with the attack on it.

I had a go at something a bit more ambitious a few weeks ago.

If you ask Google Gemini "what was the name of the young whale that hung out in pillar point harbor?" it will tell you that the whale was called "Teresa T".

Here's why: https://simonwillison.net/2024/Sep/8/teresa-t-whale-pillar-p...

(Gemini used to just say "Teresa T", but when I tried just now it spoiled the effect a bit by crediting me as the person who suggested the name.)

Re:Google's AI thinks I left a Gatorade bottle on the moon by hackernewds on Monday October 07, 2024 @03:07AM (#41763494)
Google employee read your comment and quickly fixed it OR Gemini read your comment and quickly fixed it.
Re:Google's AI thinks I left a Gatorade bottle on the moon by input_sh on Monday October 07, 2024 @03:52AM (#41763710)
Or it's just non-deterministic, like every LLM.
Re:Google's AI thinks I left a Gatorade bottle on the moon by hackernewds on Monday October 07, 2024 @03:08AM (#41763496)
Says Teresa T for me, but also links your article
Re:Google's AI thinks I left a Gatorade bottle on the moon by jadtz on Monday October 07, 2024 @03:21AM (#41763565)
For me the response was just:

```The young whale that visited Pillar Point Harbor in 2024 was named Teresa T.

It was a humpback whale that ventured into the harbor, likely by accident.```

Re:Google's AI thinks I left a Gatorade bottle on the moon by DrAwesome on Monday October 07, 2024 @04:05AM (#41763759)
Interesting! I got no citation/link until I clicked the "Double-Check Response" button, it just replied "The young whale that hung out in Pillar Point Harbor was named Teresa T."

One of the drafts had a little more: "Teresa T is the name of the young humpback whale that was spotted in Pillar Point Harbor. She made headlines in September 2024 when she was seen swimming near the shore, drawing crowds and causing excitement among local residents."

Re:Google's AI thinks I left a Gatorade bottle on the moon by fastball on Monday October 07, 2024 @04:35AM (#41763924)
Has anyone else named the humpback? If not, isn't "Teresa T" its actual name? As the first person to bother, you get dibs.
Re:Google's AI thinks I left a Gatorade bottle on the moon by simonw on Monday October 07, 2024 @03:21PM (#41769910)
I saw one news story that called it "Pillar".
Re:Google's AI thinks I left a Gatorade bottle on the moon by Lockal on Monday October 07, 2024 @07:59AM (#41765129)
There are (at least) 2 completely different public endpoints called as "Gemini":

1) https://gemini.google.com/ - this one just searches in Google with current language/region/safe-browsing settings and personal adjustments and rewrites top search results as an answer. Generative capabilities are basically not used.

2) https://aistudio.google.com/ - here you can select specific version and generate response with LLM. Retrieval Augmented Generation (i. e. Google Search) is not used.

I suppose you used #1, that's why you cave the correct result. #2 fails. There is a huge group of question where you can immediately find the answer, but LLM struggles. Another question (as example) is "What was the intended purpose of the TORIFUNE satellite in The Touhou Project?".

OpenAI has something similar, providing https://www.bing.com/chat for RAG and https://chat.openai.com for an actual LLM.

Re:Google's AI thinks I left a Gatorade bottle on the moon by simonw on Monday October 07, 2024 @03:21PM (#41769902)
Yes, in this case I meant the Gemini search-enabled user-facing product, not the model itself.