News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by CSMastermind on Tuesday July 18, 2023 @03:47PM (#36778198)
Oh that's interesting, the last time I checked GPT-4 I got a much worse result.

Yes that answer looks correct to me though it leaves off some later uses in the book series (which is what makes this a slightly tricky question to answer). But in terms of first use it nails it.

Did you add the "Mention the events leading up to it, the book number and name, and the chapter title if one exists." part to the prompt?

I'm wondering if that produces noticeably better results.

Edit:

For reference this is the response I get from Bard:

In A Crown of Swords (Chapter 13) Elayne and Nynaeve first learn about the Bowl of the Winds and begin their search for it.

The Bowl of the Winds is then used in the Wheel of Time series in the following books:

The Path of Daggers (Chapters 5, 24, and 35) - Nynaeve, Talaan, Aviendha, Elayne, Metarra, Garenia, Rainyn, Kirstian, Reanne, Tebreille, Naime, Rysael use the Bowl of the Winds.

Winter's Heart (Chapters 24 and 37) - The Bowl of the Winds is used to stop a massive storm that is threatening to destroy the city of Ebou Dar.

The Gathering Storm (Chapter 34) - The Bowl of the Winds is used to create a powerful windstorm that helps to defeat the Seanchan army at the Battle of Maradon.

A Memory of Light (Chapters 19 and 35) - The Bowl of the Winds is used to fight the weather-controlling abilities of the Dark One's forces during the Last Battle.

Re:Llama 2 – Meta AI by cevn on Tuesday July 18, 2023 @04:07PM (#36778392)
This sounds pretty good according to my memory. I did think it was first mentioned earlier than Path of Daggers. I don't remember it being used in The Last Battle but that was a pretty long chapter ...
Re:Llama 2 – Meta AI by lucubratory on Tuesday July 18, 2023 @07:45PM (#36780469)
It was used in The Last Battle throughout, but never focused on as a main set piece. It was just mentioned peripherally a couple of times that there was a large circle using the Bowl of the Winds to prevent catastrophic weather events from killing everyone during the battle/s.
Re:Llama 2 – Meta AI by cevn on Tuesday July 18, 2023 @09:36PM (#36781179)
Sounds about right now that you mention it. Time for a re read I guess.. :)
Re:Llama 2 – Meta AI by lucubratory on Tuesday July 18, 2023 @09:51PM (#36781262)
As always :P me and my husband will be starting our first WoT reread together (I got him into the books after he loved the show), just as soon as we finish the current series we're on, which is Children of Time by Adrian Tchaikovsky. Absolutely fantastic series.
Re:Llama 2 – Meta AI by cevn on Wednesday July 19, 2023 @02:47PM (#36791333)
Hm... might have to check that out as well, I love sci fi too.. Hopefully he likes the books more than the show, hah.
Re:Llama 2 – Meta AI by lucubratory on Wednesday July 19, 2023 @10:08PM (#36796111)
Children of Time is incredible, I would consider it the best sci-fi novel I've ever read in a similar way to how I consider Wheel of Time the best fantasy series I've ever read.

As for books vs show, in my opinion it's way too early to tell. Both me and him agree that the first season was significantly better than Eye Of The World, but because the later books are much better than EOTW I think the show will need to increase in quality significantly to be better than those later books - I'm excited for season 2, but in season 3 they're tackling the story of The Shadow Rising, which is probably my favourite book in the series. It's an open question in my mind if they can improve quality and characterisation enough to match that bar, although either way I'm going to enjoy it. And more importantly, I think it's not as important to judge them on a season vs book basis, because the reality is the show can't really be judged fairly against a completed book series until it is itself a completed television series. Once they're both finished (aka once I'm an old granny), I expect I'll have a much clearer idea of which rendition of the story I ultimately prefer. I know I'll definitely be talking about it with my husband a lot lol.

Re:Llama 2 – Meta AI by renewiltord on Tuesday July 18, 2023 @04:47PM (#36778851)
I did add that. In general, LLMs do better with some chain of thought prompting. "Let's think step by step" etc
Re:Llama 2 – Meta AI by lucubratory on Tuesday July 18, 2023 @07:49PM (#36780509)
That is an incredibly accurate answer for a niche question (about the best fantasy series of all time, but still less well known than Lord of the Rings so, niche). How is Bard getting that so accurate? My first thought is that maybe they've had an LLM go over their books training corpus and pre-summarise every single book or series, then trained on those summaries as well. Or maybe they did some semi-automated Q/A generation using knowledge extracted from books using traditional techniques (vector search, instance count, first mentioned, etc) to evaluate answers to the model's responses on books.

That's actually really fascinating, I've consistently found that Bard underperforms GPT-4 but this is a resounding win. I wonder what makes this question so different.

Re:Llama 2 – Meta AI by renewiltord on Tuesday July 18, 2023 @11:18PM (#36781733)
It's wild! I'm sure they used the Google Books dataset