kzk_mover
High Availability Log Collector Configuration (Fluentd)
Re:It's like JSON. but fast and small.
on Saturday December 29, 2012 @08:00AM (#4981953)
For those who are interested in Pinterest usecase (Memcached + MessagePack), please access to this url too.
> http://engineering.pinterest.com/posts/2012/memcache-games/
Re:It's like JSON. but fast and small.
on Saturday December 29, 2012 @07:48AM (#4981931)
For those who are interested in Pinterest usecase (Memcached + MessagePack), please access to this url too.
> http://engineering.pinterest.com/posts/2012/memcache-games/
Fluentd: The Missing Log Collector
Treasure Data Working as an Alternative to Hadoop
Fluentd: Log Everything in JSON from Python Applications
Fluentd: Log Everything in JSON from Ruby
Fluentd v0.10.30 is released
Slides of Fluentd (lightweight but robust log collector)
Attack of the Hadoop Hybrids
Fluentd + HDFS: Instant Big Data Collection
Fluentd: Store Apache Logs into MongoDB
Fluentd: Store Apache Logs into Amazon S3
Fluentd + Hadoop: Instant Big Data Collection
Show HN: Instant jemalloc injection into Ruby apps
Fluentd Users
Fluentd + Hadoop: Instant Big Data Collection
Apache Nutch v2.0 Released
Re:Leap second causing Linux server crashes?
on Saturday June 30, 2012 @06:20PM (#4182990)
Now facing this issue... By using 'adjtimex' command, you can clear the problematic INS bit.
At first, you can confirm the status flag like this.
$ ./adjtimex --print | grep status
status: 8209
8209's binary representation is like this. This surely have INS bit "100000000[1]0001" (5th LSB). $ ruby -e 'p 8209.to_s(2)'
"10000000010001"
8193 is the value after the clearance of the INS big. $ ruby -e 'p 8193.to_s(2)'
"10000000000001"
Then, let's set it as a current value. Please ensure your ntpd is not running. $ adjtimex --status 8193How ContextLogic moved from Scribe to a cloud service to power their A/B testing
Who uses MessagePack in production?
Re:Real-Time Log Collection with Fluentd and MongoDB
on Monday December 05, 2011 @12:41AM (#3313304)
as hoop suggested, it can parse Apache's combined format :-) And the contribution is welcome!
Re:Real-Time Log Collection with Fluentd and MongoDB
on Monday December 05, 2011 @12:38AM (#3313299)
fluentd's greatest advantage is, it's written in Ruby. So, it's really easy to write the plugin for any datastores.
This is HDFS (Hoop, the HDFS REST gateway) plugin.
* https://github.com/tagomoris/fluent-plugin-hoop
And also, Cassandra plugin are now in under development.
* https://github.com/tomitakazutaka/fluent-plugin-cassandra
You can see the user contributed plugin list here.
Real-Time Log Collection with Fluentd and MongoDB
Re:Fluentd: the missing log collector
on Sunday November 20, 2011 @12:55PM (#3258569)
awesome slide!
Re:Fluentd: the missing log collector
on Sunday November 20, 2011 @05:54AM (#3257844)
Yep, we agree with your opinion CURRENTLY.
We're developing Hoop (REST API for HDFS) plugin, and also Stargate (REST API for HBase). It requires additional setup at the infra-side, but still very useful and performs well.
You can feed Twitter stream by writing in_twitter plugin. That will 30 lines of Ruby code :-)