News for hackers. Stuff that matters.
Re:Arduino-Based Home Weather Station on the Elastic Stack by whatwasmypwd on Tuesday August 30, 2016 @06:08AM (#12388657)
Should you rely on es as your primary db?
Re:Arduino-Based Home Weather Station on the Elastic Stack by bryanrasmussen on Tuesday August 30, 2016 @08:03AM (#12389239)
Well my rule is basically - if search functionality is the most essential to your platform and the only other functionality you need otherwise is basic key-value stuff (look up items by user id, stuff like that) then yes, and handle performance issues with your preferred caching solution - redis in my case.

If you need something where money needs to be maintained then you need the security of relational database.

If search is only of secondary importance, use whatever database your prefer to work with and then index that.

But I also have the opinion that as time goes on search becomes a primary functionality of any platform.

Re:Arduino-Based Home Weather Station on the Elastic Stack by izak30 on Tuesday August 30, 2016 @09:54AM (#12390100)
Good question! For some toy weather data, Elasticsearch as the only data store made sense. If I were to add more sensors and features and make this a long term project, I'd likely try to wire up some automated backups. If it were some kind of production app that a second human relied on, then I would think hard about the data, the failure scenarios, budget, etc.

Does that answer your question at all?

Re:Arduino-Based Home Weather Station on the Elastic Stack by sbarre on Tuesday August 30, 2016 @07:21AM (#12389017)
It depends on what you're doing?
Re:Arduino-Based Home Weather Station on the Elastic Stack by fs111 on Tuesday August 30, 2016 @09:15AM (#12389721)
no, no and no
Re:Arduino-Based Home Weather Station on the Elastic Stack by swsieber on Tuesday August 30, 2016 @08:45AM (#12389485)
No, not for writing. It's never safe. It will eventually eat your data.

But for reading it's fine. So by all means, you can populate from a main data store that you never otherwise touch.

Then again, if you're running just a single instance on really small data... What could go wrong?

Edit: Again, small stuff, locally, it's probably fine. But ElasticSearch wasn't really built to be a primary data store.

Sources:

https://aphyr.com/posts/332-jepsen-crate-0-54-9-version-dive... (This has links to other good sources, right in the beginning).

https://news.ycombinator.com/item?id=11325316

https://news.ycombinator.com/item?id=11362069

Re:Arduino-Based Home Weather Station on the Elastic Stack by bryanrasmussen on Tuesday August 30, 2016 @12:13PM (#12391395)
yeah, I agree if your requirements is data consistency then not Elasticsearch, however I think from the Jepsen tests I don't think there has been any NoSQL db that performs really good on that? ( I seem to remember there was one that did bad on the first test but improved a lot with the second - SOLR, CouchDB?)
Re:Arduino-Based Home Weather Station on the Elastic Stack by earleybird on Tuesday August 30, 2016 @03:40PM (#12393218)
Re:Arduino-Based Home Weather Station on the Elastic Stack by bryanrasmussen on Tuesday August 30, 2016 @06:44PM (#12394560)
Thanks! I knew someone would have either a better memory than me or the willingness to actually go to http://jepsen.io/analyses.html and figure out which one it was! And now that I went I see both the ones I thought it might be haven't even ever been done!

I need to run a Jepsen test on my brain.