Re:Manualslib – Database of More Than 2.6M Manuals
by Mister_Snuggles on Monday June 05, 2017 @08:30PM
(#14493696)
I just used the instructions here[0], with some minor changes (pathnames, db server, etc). I've never seen more than two tesseract processes running on my two-core VM, no matter how many documents I give it.
Maybe something changed at some point to limit the active workers to the number of cores.
[0] http://mayan.readthedocs.io/en/stable/topics/deploying.html
Re:Manualslib – Database of More Than 2.6M Manuals
by siloraptor on Tuesday June 06, 2017 @12:45AM
(#14494797)
Mayan EDMS issue to add rate limit support to the OCR backend. https://gitlab.com/mayan-edms/mayan-edms/issues/287
Re:Manualslib – Database of More Than 2.6M Manuals
by Mister_Snuggles on Tuesday June 06, 2017 @11:12AM
(#14497833)
I wonder if there was a change in celery that limits the number of active workers to the number of cores. This is the behavior I see on my instance.
For the OCR, my issue is that if I import several documents Mayan will feed them all to tesseract in parallel. Then I have two available cores, but 40 tesseract workers and the system comes down because it runs out of RAM and CPU. How did you set up your OCR?