News for hackers. Stuff that matters.
Re:Cayley – An open-source graph database by badtuple on Saturday April 08, 2017 @12:53PM (#14067802)
Anyone use Cayley in prod? An old job used Neo4j, and the graph concept was great for specific use cases. As a lightweight graph store, Cayley was really exciting when it came out, but I haven't had a need for it since I left that job. It strikes me as really well made, and I'd love to hear any war stories.
Re:Cayley – An open-source graph database by LukaAl on Saturday April 08, 2017 @05:29PM (#14069144)
Tried to use it in production a couple of years ago hosting a mirror copy of Freebase with mixed results:

- There were a couple of issue loading the data that we fixed and contributed back the patch

- Loading the data was really slow, and it got slower every time a new entry was added (Loading the full freebase dump required 1 week on a very beefy machine with SSD. Used LevelDB)

- Then the queries were relatively slow. Without going too much into details, we were using the data to analyze texts and extract entities, and the relationship between them, and even parallelizing the queries, they were relatively slow (depending on complexity between 0.1 and 1 sec on average). We solved the issue implementing a robust caching layer in front of it and carefully planning the queries.

- In general, it was stable and performant enough for a backend service. But we were pushing really the envelope of what it could do.

All in all, I would say that I was happy with it. In comparison, I tried a year earlier to use Neo4J in a similar role and I give up after 2 weeks because I wasn't even able to get it loading part of the dataset without crashing on a similar hardware.

Re:Cayley – An open-source graph database by frik on Saturday April 08, 2017 @06:22PM (#14069391)
What's the best way to load Freebase in 2017? Cayley with Postgres storage? Or some other RDF/graph DB? Or ElasticSearch? Or dump it in Postgres/MySQL? I am not interested in complex queries, but simple queries that execute reasonable fast.
Re:Cayley – An open-source graph database by pawanrawal on Saturday April 08, 2017 @06:33PM (#14069437)
We have it loaded on a Dgraph instance. In case you want to play around with it at https://play.dgraph.io
Re:Cayley – An open-source graph database by frik on Sunday April 09, 2017 @06:29AM (#14071530)
The movie subset, or the whole Freebase?

The Freebase Film Data has only 21M facts. Freebase 1.9 billion facts.

Re:Cayley – An open-source graph database by pawanrawal on Sunday April 09, 2017 @06:34AM (#14071552)
This is just the film data.
Re:Cayley – An open-source graph database by frik on Sunday April 09, 2017 @06:41AM (#14071579)
I would be interested if Dgraph can handle the full Freebase dataset. (250 GB RDF)

How long does it load? What's the avg query response for very simple searches (like who is the US president)?

Re:Cayley – An open-source graph database by mrjn on Sunday April 09, 2017 @07:24PM (#14074880)
(Dgraph author) That's a good point. I think I'll load one instance up with the entire Freebase data, run it on freebase.dgraph.io, and blog about how and whys etc. Expect that in the next couple of weeks.
Re:Cayley – An open-source graph database by mring33621 on Sunday April 09, 2017 @09:42AM (#14072227)
How is Dgraph licensed? I see both Apache and AGPL in GitHub.
Re:Cayley – An open-source graph database by mrjn on Sunday April 09, 2017 @07:20PM (#14074861)
Dgraph follows MongoDB licensing. The clients are all in Apache, and the server code is AGPL. This doesn't affect anyone using Dgraph for commercial purposes; but if they make changes to the server code, they'll have to release them under AGPL. Blog post here: https://open.dgraph.io/post/licensing/
Re:Cayley – An open-source graph database by dyu- on Sunday April 09, 2017 @10:02AM (#14072322)
Looking at the commit, they switched from asl to agpl.
Re:Cayley – An open-source graph database by ashwin95r on Saturday April 08, 2017 @10:33PM (#14070159)
Benchmarks for loading freebase data in Cayley vs Dgraph. https://discuss.dgraph.io/t/differences-between-dgraph-and-c...

Dgraph was 10X faster.

Re:Cayley – An open-source graph database by frik on Sunday April 09, 2017 @06:37AM (#14071560)
What's up with this toy dataset? The movie subset is just 21 mio facts. (21million.rdf.gz)

Can someone run the benchmark for the real Freebase (1.9 billion facts)?

Also LevelDB/Bolt is not suitable for this, better use MongoDB or Postgres or MySQL as Cayley data store.

Re:Cayley – An open-source graph database by mrjn on Sunday April 09, 2017 @07:30PM (#14074900)
Expect freebase.dgraph.io in a couple of weeks.