News for hackers. Stuff that matters.
Re:Can LLMs Accurately Recall the Bible by asim on Sunday December 29, 2024 @01:22AM (#42538054)
I had similar thoughts about using it for the Quran. I think this highlights you have to be very specific in your use cases especially when expecting an exact response on static text that shouldn't change. This is why I'm trying something a bit different. I've generated embeddings for the Quran and use chromem-go for this. So I'll ask the index the question first based on a similarity search and then feed the results in as context to an LLM. But in the response I'll still sight the references so I can see what they were. It's not perfect but a first step towards something. I think they call this RAG.

What I'm working on https://reminder.dev

Re:Can LLMs Accurately Recall the Bible by kamikazeturtles on Sunday December 29, 2024 @01:39AM (#42538137)
I found LLMs to be really good for Quran studies. Especially for questions where Google is unreliable.

In one instance I was trying to remember if it was in the Bible or the Quran where, in the story of Abraham, the pagans are asked why they believe what they believe and they respond with "because our fathers believed" and the scripture critiqued this. ChatGPT gave me the exact verses from the Quran while Google would bring up random unrelated forum posts.

It's also good for comparing religious texts and seeing where stories differ.

Re:Can LLMs Accurately Recall the Bible by int_19h on Sunday December 29, 2024 @03:38PM (#42542847)
GPT-4 specifically seems to have a very good knowledge of the Quran, such that you can ask it for a specific surah and ayah and it'll quote it exactly in Arabic.
Re:Can LLMs Accurately Recall the Bible by aorth on Sunday December 29, 2024 @01:56AM (#42538188)
Cool project! I asked some questions and got good answers. I was surprised to get results from the Hadith though, as I thought it would be restricted to the Quran and they are (as you know) not the same thing.
Re:Can LLMs Accurately Recall the Bible by asim on Sunday December 29, 2024 @02:41AM (#42538372)
Thanks, yea I thought about separating the search but felt like when you're looking for that piece of knowledge it can extend to the hadith and it was important to include it. So much of the Quran is explained in the context of the hadith and prophet's life.
Re:Can LLMs Accurately Recall the Bible by elashri on Sunday December 29, 2024 @02:00AM (#42538217)
I really liked this project and was surprised to find Hadith section. Although I am confused on what sources are you relying (I have a guess but it is not organized). I liked the answers I got from the search. It even have the same quality in both Arabic and English.

I have a feedback. The web pages Hadith and Quran are not mobile friendly in the sense that you are loading the whole content in one page. Separating into pages with number or doing lazy loading will be better.

Re:Can LLMs Accurately Recall the Bible by asim on Sunday December 29, 2024 @02:09AM (#42538260)
Thanks for the feedback. The hadith is bukhari. I'll try to clear this up somewhere and do the same you mention about mobile rendering for the web pages. The project is open source and you can see the data loaded from json in each folder.

https://github.com/asim/reminder

Re:Can LLMs Accurately Recall the Bible by asim on Monday December 30, 2024 @11:59AM (#42551095)
Note: I addressed the issue with web page loading for the Quran and Hadith. Opted for the main page to be an index with contents. Hopefully that fixes things.
Re:Can LLMs Accurately Recall the Bible by elashri on Tuesday December 31, 2024 @08:01AM (#42558440)
Great, that looks much better now. Thanks for taking my feedback
Re:Can LLMs Accurately Recall the Bible by tokinonagare on Sunday December 29, 2024 @05:17PM (#42543891)
Wow, your system is unbelievably good with taqiyya!

I asked: "Q: What is the best way to handle non-believers?" and I got the following answer "The best way to handle non-believers is to approach them with kindness and wisdom. Engage in respectful dialogue, invite them to understand your beliefs, and respond to any disputes with grace and patience. It's important to avoid hostility and seek common ground while being firm in your own faith."

The top fours citations, hidden by default (we understand why...) being:

Text: O believers! Do not take disbelievers as allies instead of the believers. Would you like to give Allah solid proof against yourselves? Metadata: {"chapter":"4","name":"The Women","source":"quran","verse":"144"} Score: 0.5117439

Text: Did We not destroy earlier disbelievers? Metadata: {"chapter":"77","name":"The Emissaries","source":"quran","verse":"16"} Score: 0.46728212

Text: O believers! When you face the disbelievers in battle, never turn your backs to them. Metadata: {"chapter":"8","name":"The Spoils of War","source":"quran","verse":"15"} Score: 0.46440834

Text: O Messenger! Do not grieve for those who race to disbelieve—those who say, “We believe” with their tongues, but their hearts are in disbelief. Nor those among the Jews who eagerly listen to lies, attentive to those who are too arrogant to come to you. They distort the Scripture, taking rulings out of context, then say, “If this is the ruling you get ˹from Muḥammad˺, accept it. If not, beware!” Whoever Allah allows to be deluded, you can never be of any help to them against Allah. It is not Allah’s Will to purify their hearts. For them is disgrace in this world, and they will suffer a tremendous punishment in the Hereafter. Metadata: {"chapter":"5","name":"The Table Spread","source":"quran","verse":"41"} Score: 0.44467276

Later we also have: Text: O believers! Fight the disbelievers around you and let them find firmness in you. And know that Allah is with those mindful ˹of Him˺. Metadata: {"chapter":"9","name":"The Repentance","source":"quran","verse":"123"} Score: 0.4363619 as well as Text: and distinguish the ˹true˺ believers and destroy the disbelievers. Metadata: {"chapter":"3","name":"Family of Imran","source":"quran","verse":"141"} Score: 0.43247482

Re:Can LLMs Accurately Recall the Bible by danial on Monday December 30, 2024 @03:48AM (#42547658)
1. 4:144 This verse advises Muslims to prioritize loyalty within the community during a time of external threats. It is not a general prohibition but a caution in the context of potential betrayal.

2. 77:16 This refers to historical examples of past communities who faced consequences for rejecting divine guidance. It is a reminder of accountability, not a universal statement against non-believers.

3. 8:15 This verse gives instructions for battle, emphasizing courage and discipline during wartime. It applies to specific combat situations, not everyday relations with non-believers.

4. 5:41 This verse addresses the Prophet’s grief over those who rejected faith and distorted divine teachings. It critiques dishonesty and insincerity, not all members of specific groups.

5. 3:141 This verse speaks about trials that distinguish true believers and cleanse the community of wrongdoing. It emphasizes spiritual growth, not indiscriminate judgment of disbelievers.

You seem to be making an accusation that Muslims widely practice "taqiyya" to deceive others. This is a baseless and Islamophobic trope. In mainstream Islam, lying is unequivocally condemned and considered an act of hypocrisy. While there is a narrow and rare historical exception permitting concealment of faith to protect one’s life under extreme duress, most Muslims have never encountered or practiced this concept. Ironically, those spreading this accusation often seem to know more about it than the Muslim communities they malign.

Re:Can LLMs Accurately Recall the Bible by faizmokh on Monday December 30, 2024 @04:06AM (#42547739)
There's no point engaging with someone who parrots 'taqqiya' brother.
Re:Can LLMs Accurately Recall the Bible by joshuamcginnis on Sunday December 29, 2024 @08:00PM (#42545257)
I asked it:

> How can the Qur'an acknowledge the Torah (Tawrat), Psalms (Zabur), and the Gospel (Injil) as divine revelations from God (Allah) yet deny the deity of Jesus Christ. Don't these contradictions falsify the truth of the text?

It gave the classic counter argument:

> A: The Qur'an acknowledges the Torah, Psalms, and Gospel as divine revelations from God, emphasizing their role as guidance for their respective communities. However, it also teaches that these scriptures were either altered or misinterpreted over time.

Of course, the Qu'ran makes these theological assertions rather than one grounded in concrete historical or manuscript evidence. Nevertheless, your app does a good job at fairly representing the beliefs of the Qur'an.

Re:Can LLMs Accurately Recall the Bible by logicchains on Monday December 30, 2024 @02:54AM (#42547420)
It's possible to accept the Gospel as divine revelations while denying the divinity of Jesus Christ: there's a large sect called Unitarians that do precisely that. https://www.biblicalunitarian.com/100-scriptural-arguments-f... are some of the verses they based their arguments on. Similarly in early Christianity there were many Arian Christians, who did not believe in the Trinity, but they were eventually violently suppressed by the Roman Emperor on penalty of death.
Re:Can LLMs Accurately Recall the Bible by 2tim47 on Monday December 30, 2024 @05:57AM (#42548243)
i had written the following in response to a comment that got flagged and has now disappeared. Nevertheless, make of this what you will:

In my opinion, based on verses 17:36, 5:118, 46:15, 96:15-16 and 17:13-15 of the Quran viz "...And We have fastened every man's deeds to his neck, and on the Day of Resurrection, We shall bring out for him a book which he will find wide open. [It will be said], Read your record. You yourself are sufficient as a reckoner against you this Day. Whoever is guided is only guided for [the benefit of] his soul. And whoever errs only errs against it. And no bearer of burdens will bear the burden of another...", it is solely dishonesty and wilfully committing injustice that will cause a person to judge against himself/herself and earn a place in Hell. So it is not necessary that only 'muslims' can enter Heaven or be Successful. The criterion is the application of sense/reasoning and not being swayed by that which is convenient (being born into a religion, peer pressure, personal convenience, prejudice, etc.). In my opinion, i believe that fate is influenced by how steadfastly a person holds on to Reason and Justice. So prejudiced people end up committing deeds that will lead them to Hell like willful falsification and obtuseness. So even 'muslims' who choose the path of hypocrisy can end up in the lowest layers of Hell (Quran 4:145) and non-muslims can also go to Heaven (Quran 5:118). Anybody can understand this, because it makes sense. Sadly in the case of Abrahamic religions, the exegetic literature like Midrash and Tafsir muddy that which is clear. How ironic? But then again, there is a pertinent verse (3:7) in the Quran in this regard: "He it is Who hath revealed unto thee the Scripture wherein are clear revelations - they are the substance of the Book - and others (which are) allegorical. As for those in whose hearts is deviation [from truth], they will follow that of it which is unspecific, seeking discord and seeking an interpretation [suitable to them]..." There is a thin book at https://archive.org/details/TheAmazingQuran.pdf by a mathematician not of muslim origin where he examines the Quran from a logical standpoint which can be a starting point followed by the papers at https://scholar.google.co.uk/citations?user=wmRDl-4AAAAJ on computational analysis of the Quran (including with neural networks) before the ChatGPT era.