News for hackers. Stuff that matters.
Re:Bible as RAG Database by jacksonastone on Wednesday June 24, 2026 @09:42PM (#48667808)
Made this in a free evening. Index an permissive license translation of the Bible (WEB) into a RAG database to allow returning passages of similar semantic meaning. Lots of fun. For example, "more money more problems" returns Ecclesiastes 5:9-13 which, I'll just say, is spot on..

"Moreover the profit of the earth is for all. The king profits from the field. He who loves silver shall not be satisfied with silver, nor he who loves abundance, with increase. This also is vanity. When goods increase, those who eat them are increased; and what advantage is there to its owner, except to feast on them with his eyes? The sleep of a laboring man is sweet, whether he eats little or much; but the abundance of the rich will not allow him to sleep. There is a grievous evil which I have seen under the sun: wealth kept by its owner to his harm."

Anyway - thought it was fun enough to share. It's slow and I vibe coded it so I haven't sorted out how to make it not take 15 seconds to vector search against the full 4GB index.

Re:Bible as RAG Database by ReactiveJelly on Wednesday June 24, 2026 @11:12PM (#48668372)
> The king profits from the field

For the solution, read Henry George!

Re:Bible as RAG Database by mcswell on Wednesday June 24, 2026 @10:00PM (#48667922)
Slow, but interesting. I used the query "government" and got back passages in Romans 13 (as I expected), but also passages in Daniel and Ezra describing decrees by government officials, which made sense.
Re:Bible as RAG Database by jacksonastone on Thursday June 25, 2026 @07:45PM (#48680667)
6x'd the speed if you wanted to try again
Re:Bible as RAG Database by jnamaya on Wednesday June 24, 2026 @09:55PM (#48667893)
The site is not loading for me! Interesting project
Re:Bible as RAG Database by mcswell on Wednesday June 24, 2026 @10:01PM (#48667925)
You have to wait awhile. It came up for me after 30 seconds or so.
Re:Bible as RAG Database by jacksonastone on Wednesday June 24, 2026 @11:44PM (#48668596)
it's basically running on a toaster, sorry
Re:Bible as RAG Database by TeMPOraL on Thursday June 25, 2026 @01:29AM (#48669329)
If that toaster didn't have a plan already, then feeding it with monotheistic holy scripture will definitely give it some ideas.
Re:Bible as RAG Database by a96 on Thursday June 25, 2026 @04:09AM (#48670425)
A toaster is just a death ray with a smaller power supply
Re:Bible as RAG Database by TeMPOraL on Thursday June 25, 2026 @09:50AM (#48673384)
Less power, more hatred towards humankind.
Re:Bible as RAG Database by red-iron-pine on Thursday June 25, 2026 @11:36AM (#48675037)
only if you take it in the bath, or don't unplug it before fishing out a trapped slice
Re:Bible as RAG Database by jacksonastone on Thursday June 25, 2026 @07:29AM (#48671887)
I wonder if polytheistic toaster would be more or less... ambitious.
Re:Bible as RAG Database by cdong on Thursday June 25, 2026 @12:44AM (#48669012)
pg-vector with hnsw is still 15 seconds?
Re:Bible as RAG Database by kordlessagain on Thursday June 25, 2026 @01:40AM (#48669399)
This is really cool...great job! It's a favorite pastime of mine to index various large corpora.

As for speed, this might help for code referencing: https://github.com/deepbluedynamics/lume

Blog post: https://deepbluedynamics.com/blog/lume-retrieval-primitives

I use a small local model to extract entities for the graph, but it's not necessary.

You can optionally use GTR-T5 which is a few years old now, but still good for generating fast and free embeddings. That step is only run once if you run it in hybrid mode.

Feel free to take and remix or use!

Re:Bible as RAG Database by yjftsjthsd-h on Thursday June 25, 2026 @02:04AM (#48669570)
Any chance you wrote it up anywhere? I'm somewhat interested in RAG and a worked example would be nice.
Re:Bible as RAG Database by jacksonastone on Thursday June 25, 2026 @07:28AM (#48671875)
I'll just open source it, just a sec (keep in mind, vibe coded :D)

https://github.com/jacksonStone/cross-cannon

Re:Bible as RAG Database by atmanactive on Thursday June 25, 2026 @06:48AM (#48671614)
For completeness, this should include all possible books, including Ethiopian, and then it should include a drop-down with pre-defined sets one could choose from (Protestant, Catholic, Orthodox...).
Re:Bible as RAG Database by jacksonastone on Thursday June 25, 2026 @03:36PM (#48678204)
Yeah a drop down list like that would be sweet. I think you'd have to format / find the open source version / translation of that text. Finding a well formatted and readable, public use (not just nkjv for example) was tricky For WEB I had to do a good b it of data massaging to get it in a consumable format..
Re:Bible as RAG Database by jacksonastone on Thursday June 25, 2026 @08:36PM (#48681014)
Got the protestant and catholic now. Orthodox I am discovering is not a simple matter of "just include the canon"!
Re:Bible as RAG Database by atmanactive on Thursday June 25, 2026 @09:24PM (#48681305)
Fantastic. Thank you!