here's my recommendations feature: https://thegreatestbooks.org/recommendations
It's much more powerful if you're a member. you can restrict the results to certain genres or book lengths, as we as published date ranges, etc. If someone wants to try out the more powerful feature, DM me and i'll mark your account as a member.
Most of the team who created World of Warcraft were members in the guild.
some of my fondest memories:
- getting pretty far in the Plane of Air, which was an incomplete end game zone with almost impossible to beat bosses. - defeating the Avatar of War, which was not supposed to be killable. We figured out we could charm his guards by having a huge number of enchanters and use the guards to tank him. We managed to beat him and they patched/fixed the guards and made them uncharmable shortly afterwards
The death penalty in the end game zones was originally very tough to work around. You needed a key to reach the zone, but if you died the key required to get into the zone was on your corpse inside the zone. So if everyone wiped/died getting everyone's corpse back was a multi hour event.
- Series have always been a problem. Some book lists will include the entire series, and then some will have individual books. If the series is sold as a single book I'll often just include that. Like Lord of the Rings. Sometimes I will include only the first book in the series on a list, to prevent always adding every single book in a series when a list mentions "harry potter series".
basically I don't have a perfect way of handling series'
for the last point, kind of. If you add a book to the default "My Favorite Books" user list, it gets aggregated and used for this book list which is included in the rankings. https://thegreatestbooks.org/lists/463
I do plan on open sourcing more of the code over time. I also have started working on other sites using the same algorithm implementation (music, movies, video games)
This has just been a side project over the year generating passive income. I get around 250,000 page views a day, and with ads, memberships, and affiliate links I make around $2,500~ a month.
Tech stack is ruby on rails 8, postgresql 17, opensearch, redis, bootstrap 5.3 hosting on 3 servers on linode.
https://thegreatestbooks.org/recommendations?demo=tgb2025
warning: account required, and the full featured version where you can specify book length, include/exclude genres/subjects, etc requires a membership. if you would like to test it though just e-mail me at [email protected] and I'll mark your account as paid.
I created it 17~ years ago mostly as just a tool for myself and now it gets roughly 8 million views a month.
The hardest part of any side project is actually launching it and making it somewhat production ready. I always spend the vast majority of my time dealing with devops/deployment issues/tasks
I will say that I don't think they really defend their TOS too much from my experience. I used to have a cookbooks site for years that used the same affiliate tag i use for my greatest books site, and never had any issues.
I do use Gen AI now to generate genres, descriptions, and to grab other data. Previously years ago i would just scrape it or manually set it.
Amazon has a nice product API with up to date prices.
I am working on bookshop.org integration. I used to also do barnes & noble. The problem is neither of them have APIs to programmatically search for books, so i have to do complicated scraping. example: https://github.com/ssherman/bookshop-search
I created it in 2008 and have maintained and improved it over the years. I am trying to figure out how to monetize it more. I currently make around $2k a month. I just use adsense and have a paid membership feature through buymeacoffee. I get massive traffic and I'm pretty much the #1 result for anything related to best/greatest books.
It's built with Rails and Postgresql and hosted on 3 linode servers. I get around 250k page visits a day.
I now block all ai crawlers at the cloudflare WAF level. On Monday I noticed a HUGE spike in traffic and my site was not handling it well. After a lot of troubleshooting and log parsing, I was getting millions of requests from China that were getting past cloudflare's bot protection.
I ended up having to force a CF managed challenge for the entire country of China to get my site back in a normal working state.
In the past 24 hours CF has blocked 1.66M bot requests. Good luck running a site without using CloudFlare or something similar.
AI crawlers are just out of control
been my main side project since like 2008. working on goodreads import right now. Always working on improving the algorithm. would love to collab with a data scientist on ways to improve my algorithm. https://github.com/ssherman/weighted_list_rank
Before i moved my dns to cloudflare and got on their pro plan, which offers robust bot blocking, they were severely hurting my performance to the point that I bought a new server to offload the traffic.
no thanks. I will stick with Rails.
https://thegreatestbooks.org/global-canon
The biggest complaint with aggregated book lists, is they are way too western focused. I made a page with some very specific country and author limits at an attempt to correct this.My site aggregates 305~ book lists and uses a weighted min max normalization algorithm. This has been my little side project for almost 15 years now.