News for hackers. Stuff that matters.
Re:The Beauty of Unix Pipelines by devchix on Thursday June 04, 2020 @07:19PM (#23423158)
>(1) everything is text

>(2) everything (ish) is a file

I'm having a moment. I have to get logs out of AWS, the thing is frustrating to no end. There's a stream, it goes somewhere, it can be written to S3, topics and queues, but it's not like I can jack it to a huge file or many little files and run text processing filters on it. Am I stupid, behind the times, tied to a dead model, just don't get it? There's no "landing" anywhere that I can examine things directly. I miss the accessibility of basic units which I can examine and do things to with simple tools.

Re:The Beauty of Unix Pipelines by macintux on Thursday June 04, 2020 @07:29PM (#23423244)
I worked around that by writing a Python script to let me pick the groups of interest, download all of the data for a certain time period, and collapse them into a CSV file ordered by time stamp.

Yes, it’s very annoying I have to do all that, but I commend Bezos for his foresight in demanding everything be driven by APIs.