News for hackers. Stuff that matters.
Re:Show HN: We made an open-source personalization engine by shutty on Wednesday March 23, 2022 @10:58AM (#30779127)
Right now it runs in a dev-mode on a single EC2 t3.large instance with loadavg ~0.30, but the inference load is quite tiny right now: around 3-4 reranking requests per second. And yes, as a typical open-source project it still crashes from time to time :)

The training dataset is not that huge (see https://github.com/metarank/ranklens/ for details, it's open-source), so we do a full retraining directly on the node right after the deployment, and it takes around 1 minute to finish. We also run the same process inside the CI: https://github.com/metarank/metarank/blob/master/run_e2e.sh

There is an option to run this thing in a distributed mode:

* training is done using a separate batch job running on Apache Flink (and on k8s using flink's integration)

* feature updates are done in a separate streaming Flink job, writing everything in Redis

* The API fetches latest feature values from Redis and runs the ML model.

The dev-mode I've mentioned earlier is when all these three things are bundled together in a single process to make it easier to play with the tool. But we didn't spent much time testing distributed setup, as this thing is still a hobby side-project and we're limited in time spent developing it.

Re:Show HN: We made an open-source personalization engine by jka on Wednesday March 23, 2022 @11:01AM (#30779167)
From reading some of the repository and architecture overview, I think this is true, but: could you confirm that users of metarank can self-train their own models from scratch?
Re:Show HN: We made an open-source personalization engine by shutty on Wednesday March 23, 2022 @11:07AM (#30779233)
This is actually part of our CI process: https://github.com/metarank/metarank/blob/master/run_e2e.sh . This script runs on every PR to retrain the model used on a demo and confirms that it's working fine.

So you can just download the jar file from releases page and run ./run_e2e.sh <jar file> in the checked-out repository, it should do the job.

Re:Show HN: We made an open-source personalization engine by jka on Wednesday March 23, 2022 @01:41PM (#30781132)
Thanks!
Re:Show HN: We made an open-source personalization engine by dannywarner on Wednesday March 23, 2022 @09:31PM (#30785568)
What budget for cloud infrastructure for 100K/mo buyers to an ecommerce website, approximate range, with typical purchase habits? I am new to Flink. We use Redis in production.