Pipes

I really loved Yahoo Pipes - Was ahead of its time if you ask me..Built some very cool automations on top of this. Basically was IFTTT and Zapier well before them.

Pipes was a handy tool, hope this project keeps up!

I don't think you remember how the yahoo pipes worked. It was a brilliant mix of graphs for flow control, premade boxes for all common data manipulation and scripting for that…

I've some experience in visual programming languages (both professional and in my studies) and I advise against the graph-form where you connect nodes and edges. This does not…

IMO, the reason the wiring model doesn't scale up is that most don't provide a way to create submodules (compounds?). I expect that decomposing a problem into a chain of smaller…

Nice. It's not very clear that you need to link the pipeline to the right-hand side. (I can't remember if you had to do that on Yahoo, it's been so long!). It's particularly a…

I used to use yahoo pipes for a few twitter bots I had. There was an rss to twitter webapp that I hooked up and it was fully automated for years before it stopped working. I…

Dead (could not connect to server)

Please try again. It should be up (works for me and http://downforeveryoneorjustme.com/www.pipes.digital supports that). Though I forgot scaling up the droplet it is running on…

would like to suggest a couple of "starter pipes" - samples to more easily illustrate some possibilities.

couple of code examples would be nice

Do you plan on supporting scraping content via css selectors/xpath/regex?

I added a block to download a page (instead of a feed), another block for extracting content via css selector or xpath, and a feed builder block to later combine those (but the…

Neat. Any chance of adding JSON processing where you can pick a key (ala `jq`[0]) and then combine it with RSS or other JSON or what have you? [0] https://stedolan.github.io/jq/

This is cool, but I feel like Zapier, IFTTT and their open source equivalents have moved far past Yahoo Pipes. How do you see this stacking up?

IMO, the reason the wiring model doesn't scale up is that most don't provide a way to create submodules (compounds?). I expect that decomposing a problem into a chain of smaller…

It only had submodules in the sense that you could embed a pipe, but IIRC, they were always sources -- you couldn't pipe data into them. It had a notion of the 'output' block but…

I'm surprised nobody has mentioned Node-RED yet: http://nodered.org/ Node.js-based with a Pipes-like visual wiring interface. It's quite popular with the Raspberry Pi and Arduino…

I'd love something like this that I can run locally. From looking at the comments, it looks like Node-RED and NoFlo are two possibilities. I was intrigued by Yahoo Pipes a while…

Interesting, have to take a proper look tomorrow. We've done similar things with NoFlo (https://noflojs.org)

This is cool, but I feel like Zapier, IFTTT and their open source equivalents have moved far past Yahoo Pipes. How do you see this stacking up?

This is cool, but I feel like Zapier, IFTTT and their open source equivalents have moved far past Yahoo Pipes. How do you see this stacking up?

Its interesting and I do applaud your work, but I'll probably just stick to Apache Nifi with its flexibility.

Checkout Rapidminer and Knime for great examples of box'n'arrows applied to machine learning pipelines. I've used Rapidminer a fair bit and they really have a great model…