News for hackers. Stuff that matters.
Re:Yahoo Pipes End-Of-life Announcement by psadri on Thursday June 04, 2015 @01:55PM (#9660873)
pipes creator here: sad to see pipes shutdown. i am surprised it lasted this long -- it was abandoned years ago. on the positive side, it is nice to see it mentioned in the same sentence as y! maps which used to be a big deal back in the day.
Re:Yahoo Pipes End-Of-life Announcement by smacktoward on Thursday June 04, 2015 @02:48PM (#9661271)
Pipes has long been a sort of monument to the faith of a bygone age -- the first flush of Web 2.0 optimism, when standard formats and open APIs were going to let us mix and match and mash up services of all kinds at will.

That faith is dead now, of course, scoured from the earth by walled gardens and VC money. But like Catholics in Elizabethan England, some of us quietly tend our secret shrines and pray for its return.

(Hopefully that will work out better for us than it did for them.)

Re:Yahoo Pipes End-Of-life Announcement by paganel on Thursday June 04, 2015 @07:59PM (#9663037)
Thank you for your comment, for a (long) while I thought that I was the only one remembering those times and especially the ideals people were bringing up then. Sometime in 2005 I even copy-pasted this quote on my blog, high in believing that the future will belong to open data and open information:

> Bosworth advocated an open model for data.(...) Imagine if you can query any data that is available anywhere in the world. Bosworth said that what this requires is a single, simple, open wire format for items. The format needs to be simple for any P programmer to deliver and any JavaScript programmer to consume. He also pointed out that "complex things tend to break and simple things tend to work." Google has the simplest query language in the world. There is no structure and no syntax. (my note: at that time Bosworth was VP of Product Management at Google)

That is all dead now.

Re:Yahoo Pipes End-Of-life Announcement by jaza on Thursday June 04, 2015 @09:52PM (#9663412)
Love your analogy, sure made me laugh (visualising a geeky dev like myself tending a weathered gnarly monument in a secluded English glade... in real life, that is, not in an RPG).

However, why such pessimism? I hardly think that standard formats and open APIs are dead. Sure, there are some nasty blights upon cyberspace in this regard (ahem, Facebook, Apple), but other players are still keeping the dream alive to some extent (e.g. Google, Yahoo).

Re:Yahoo Pipes End-Of-life Announcement by detaro on Thursday June 04, 2015 @10:28PM (#9663528)
I'd count google mostly as an example of deprecating or limiting useful interfaces. Yes, you can feed them stuff in "open" formats, but getting stuff out is harder. First example that comes to mind is youtube APIs, which offered easier access to stuff. Now try to get a feed of someones videos or similar...

But it is possible that it's confirmation bias + uncommon sample on my part.

Re:Yahoo Pipes End-Of-life Announcement by jaza on Friday June 05, 2015 @03:14AM (#9664255)
Yeah... for Google / YouTube, I blame OAuth for most of the difficulty in accessing data (while retaining one's sanity) these days. Once you've waded through the quagmire of access tokens, auth libraries (in different languages), account permissions, etc... making the actual API calls isn't so hard.
Re:Yahoo Pipes End-Of-life Announcement by icebraining on Friday June 05, 2015 @01:34AM (#9664028)
Now try to get a feed of someones videos or similar...

What do you mean? Channels have an element linking to an RSS feed. In fact, just pasting a channel URL to an RSS reader should work.

Example of a channel feed: https://www.youtube.com/feeds/videos.xml?channel_id=UCr4soU_...

Re:Yahoo Pipes End-Of-life Announcement by detaro on Friday June 05, 2015 @04:12PM (#9667820)
.... true. So they deprecated the methods for it in the API, but it is right there on the page. Strange.
Re:Yahoo Pipes End-Of-life Announcement by jrochkind1 on Thursday June 04, 2015 @07:19PM (#9662855)
Yep, I was trying to figure out how to say what you just said, but you did it better.
Re:Yahoo Pipes End-Of-life Announcement by joepie91_ on Thursday June 04, 2015 @08:14PM (#9663080)
Perfectly worded.
Re:Yahoo Pipes End-Of-life Announcement by djjose on Thursday June 04, 2015 @02:26PM (#9661126)
Let me just tell you and anyone that worked on the team, thanks so much for it. You saved me hours of work and let me do it really damn well. This is a sad, sad day. I used Pipes extensively and ironically enough at Yahoo for some features/prototypes on News and Search. It was such an elegant and powerful app, I really wish Yahoo had given it more love.
Re:Yahoo Pipes End-Of-life Announcement by webwanderings on Thursday June 04, 2015 @02:05PM (#9660947)
Please suggest alternate. You built a good thing. RSS overall is becoming history.
Re:Yahoo Pipes End-Of-life Announcement by psadri on Thursday June 04, 2015 @02:07PM (#9660968)
IFTTT and Zapier are spiritual successors to Pipes, although their focus is on APIs vs feeds.

Maybe start a new, open source version of Pipes?

Re:Yahoo Pipes End-Of-life Announcement by basch on Thursday June 04, 2015 @02:24PM (#9661104)
It really would be oh so nice to have something that can ingest RSS and Tweets and then apply filters to them while visualizing the logic through a graphical interface. Maybe even some fuzzy machine learning to use in building filters. Some more advanced dupe technology would go a long way. People would be building their own techmemes in no time. You could build ranking systems that award bonus points if something like longform or techmeme mention something.

Maybe im dreaming about a free version of Percolate, which I have heard is really cool.

Re:Yahoo Pipes End-Of-life Announcement by Concours on Thursday June 04, 2015 @02:56PM (#9661307)
This is exactly what we are doing at http://www.feedsapi.com , we don't use a graphical UI for the logic but keywords and RegEx to create filters... Many folks are already building their own techmeme with our API, it's however not a free service. I'm not sure if this fully fits your requirements but you should take a look.
Re:Yahoo Pipes End-Of-life Announcement by olviko on Thursday June 04, 2015 @04:33PM (#9661860)
Checkout https://github.com/olviko/RssPercolator

Pipes would often get blocked by 3rd party data providers, which motivated me to roll my own library.

No graphical interface. Personally, I found Y! Pipes UI hard to work with when I needed to build large pipelines.

Re:Yahoo Pipes End-Of-life Announcement by pldrnt on Thursday June 04, 2015 @02:31PM (#9661153)
For what it's worth, that is exactly one of the things I am building. Glad to read I am not the only one needing it.
Re:Yahoo Pipes End-Of-life Announcement by thehal84 on Thursday June 04, 2015 @06:16PM (#9662508)
Founder of Enginuity Analytics here. You can ingest RSS and Tweets into our platform where we apply machine learning to provide social data, sentiment analysis, rankings, filters and demographic analysis of all the content for 27 languages. And easily export the data to Excel and more. http://theenginuity.com
Re:Yahoo Pipes End-Of-life Announcement by mindcrime on Thursday June 04, 2015 @02:40PM (#9661210)
One of our open source projects[1], lets you consume RSS, Email, and Tweets, with more "stuff" coming, and apply filters and set triggers, etc. It's still pretty raw, and we don't have the really awesome visual interface for laying things out, but that sort of thing is something we hope to get to eventually. One other neat thing we do is pipe content through Apache Stanbol to do semantic entity extraction, and build up a knowledgebase as content is consumed.

[1]: https://github.com/fogbeam/Neddick/

Re:Yahoo Pipes End-Of-life Announcement by billybobza on Thursday June 04, 2015 @03:58PM (#9661649)
Instead of closing it down, releasing the source and giving it to the community could breath live into it. I remember being blown away by it, the fact that it was neglected and just kept on says a lot about it's good design.
Re:Yahoo Pipes End-Of-life Announcement by joepie91_ on Thursday June 04, 2015 @08:15PM (#9663084)
This would be the right solution.
Re:Yahoo Pipes End-Of-life Announcement by Toast_ on Thursday June 04, 2015 @03:09PM (#9661392)
Try Huginn. I found it very easy to setup and work with. https://github.com/cantino/huginn
Re:Yahoo Pipes End-Of-life Announcement by olviko on Thursday June 04, 2015 @04:26PM (#9661819)
Checkout https://github.com/olviko/RssPercolator.

RssPercolator is a .NET library used for downloading, aggregating, and filtering RSS feeds. Developed out of frustration with Yahoo Pipes.

- RSS and Atom feed formats - Asynchronous multi-feed download - Multiple sources and multiple destinations - Feed filters (string match, wildcards, and Regex)

Re:Yahoo Pipes End-Of-life Announcement by Concours on Thursday June 04, 2015 @02:59PM (#9661331)
Check out http://www.feedsapi.com , we do almost everything with rss feeds...
Re:Yahoo Pipes End-Of-life Announcement by bryanh on Thursday June 04, 2015 @02:48PM (#9661265)
Thanks so much for you and your team's work on Pipes - I'd be lying if I said it didn't inspire many parts of Zapier!
Re:Yahoo Pipes End-Of-life Announcement by mindcrime on Thursday June 04, 2015 @02:50PM (#9661286)
Same here... Pipes has been an inspiration to use with a lot of the stuff we've been doing as well.
Re:Yahoo Pipes End-Of-life Announcement by callmevlad on Thursday June 04, 2015 @04:31PM (#9661846)
Hey Pasha, thanks for your pioneering work!

We (Webflow) are actually considering building a Pipes alternative in the near future, and I'd love to sit down with you and brainstorm some ideas. If you'd be willing to make some time to see a very rough demo, I'd love to get in touch - my email is in my profile.

Re:Yahoo Pipes End-Of-life Announcement by anigbrowl on Thursday June 04, 2015 @02:10PM (#9660990)
Why did it fail, do you think? I thought it was an outstanding product in terms of both functionality and UI, but it never seemed to gain traction.
Re:Yahoo Pipes End-Of-life Announcement by idlewords on Thursday June 04, 2015 @02:20PM (#9661079)
Several reasons I can think of. For one, no one at Yahoo seemed to understand what Pipes was for (part of a wider problem where Yahoo didn't seem to know what the company was for).

For another, Yahoo legal prevented us from doing any kind of long-term storage of RSS feeds. That made the service far less useful than it could have been.

Finally, they didn't give it any resources at all. Management was too preoccupied with the failed Brickhouse project (internal startup incubator) and the host of failed ideas that it spawned.

Re:Yahoo Pipes End-Of-life Announcement by rokhayakebe on Thursday June 04, 2015 @03:03PM (#9661358)
no one at Yahoo seemed to understand what Pipes was for

What was Pipes for?

Re:Yahoo Pipes End-Of-life Announcement by anigbrowl on Thursday June 04, 2015 @06:22PM (#9662540)
Filtering and triggering without the annoyance of having to write code in some syntax-of-the-month or dredge through poorly written documentation for half-ass APIs.
Re:Yahoo Pipes End-Of-life Announcement by brador on Thursday June 04, 2015 @03:54PM (#9661632)
> legal prevented us from doing any kind of long-term storage of RSS feeds

Wait, is there something legally wrong about storing RSS feed data?

Re:Yahoo Pipes End-Of-life Announcement by frevd on Friday June 05, 2015 @06:00AM (#9664687)
If you are redistributing, hosting or using it commercially you have to have the agreement of the author of the content. RSS just gives you access in another way than HTML, but it does not circumvent copyright.
Re:Yahoo Pipes End-Of-life Announcement by ceejayoz on Thursday June 04, 2015 @02:00PM (#9660918)
It was really freaking awesome. Thank you!
Re:Yahoo Pipes End-Of-life Announcement by ilaksh on Thursday June 04, 2015 @02:09PM (#9660979)
This is an amazing product. Have you tried talking to VCs or anyone about someonr adopting it somehow?

I wonder if it would be possible to build something similar using IPV6/some kind of P2P/STUN/TURN/UDP hole punching/swarm/ethereum / any way to make a distributed system that does the same thing. Or maybe just volunteer running Node on their own VPSs.

Re:Yahoo Pipes End-Of-life Announcement by infinite8s on Saturday June 13, 2015 @09:42PM (#9713511)
Something like Pipes running on sandstorm.io would be nice.
Re:Yahoo Pipes End-Of-life Announcement by edho on Thursday June 04, 2015 @04:52PM (#9661974)
Thanks Pasha for letting me be a part of your brilliant idea.
Re:Yahoo Pipes End-Of-life Announcement by dankohn1 on Thursday June 04, 2015 @02:17PM (#9661049)
Thank you for the great work.
Re:Yahoo Pipes End-Of-life Announcement by smange on Friday June 05, 2015 @07:49AM (#9664928)
Thanks for creating something so awesome. I have relied on it heavily for years to clean up dodgy feeds.

Seriously, I think the only Yahoo products I use are Pipes, Groups and Flickr. And Flickr doesn't really count.