News for hackers. Stuff that matters.
Re:Data-Mining Wikipedia for Fun and Profit by guidovranken on Thursday August 19, 2021 @11:24AM (#28235034)
At least the last times I checked, the WikiData SPARQL server was extremely slow, frequently timing out.
Re:Data-Mining Wikipedia for Fun and Profit by epaulson on Thursday August 19, 2021 @06:04PM (#28239947)
There's some mix between "it's slow" and "it sets its timeout threshold too low" - a lot of queries would be OK if they just had a bit more time to run. And unfortunately, the time wasted on the badput of the killed queries just slows down everyone else. (They really need a batch queue)

The Wikidata folks are well aware of the limits on their SPARQL service. They just posted an update the other day:

https://lists.wikimedia.org/hyperkitty/list/[email protected]...

Re:Data-Mining Wikipedia for Fun and Profit by lacksconfidence on Thursday August 19, 2021 @12:24PM (#28235816)
seems to depend on the query. I can issue straight forward queries that visit a few hundred thousand triples easily. But when i write a query that visits tens of millions of triples it times out.