In the previous Yahoo Pipes Tutorial, I briefly described what every module does. In this article, I demonstrate how to do many useful things with Yahoo Pipes.
Remember, the ultimate goal is to create great custom feeds that will automatically get posted on our websites. I showed you how to do this in a previous article How to Make Money Blogging. With those techniques, I was able to make an extra $11 bucks, after all fees, for each site I made. Each site took less than 20 minutes to put together and then required no maintanence. With Yahoo Pipes pulling even better articles, I’m pulling in $26 on average.
Pull Entire Article Using Yahoo Pipes
Normally, when you pull information from an RSS feed, you only get an abbreviated version of the article. Yahoo Pipes allow you to pull the entire article using the following steps. This is what the Yahoo Pipe page looks like after everything is set up. I’ll then describe the steps.
This Yahoo Pipe example, pulls every article from the current Huffington Post RSS feed, along with the whole article, if the title contains the word Hollywood. Here is how it’s built.
The Fetch Site Feed Module
Fetch the Whole Article for Each Feed Item
To grab the whole article, rather than just the abbreviated description in the feed, you need the Loop and Fetch Page Modules.
Finding the Tags that Surround an Article
You can find the other tag, by looking at which tag follows the ending for an article. To finish off the Fetch Page Module:
You could stop there, but I’ll explain how the Yahoo Pipes Filter Module works.
Yahoo Pipes Filter Module
With the Filter Module, you can either Block or Allow certain articles based of whether a certain word lies within some part of a feed item. Here I choose to only include articles that contained “Hollywood”, in the title. Here is how I did that.
I then connected all of my modules, as you see above. Then I clicked save and done.
Manipulating CSV Data with Yahoo Pipes
CSV stands for Comma Separated Values. Here I’ll show you how to pull data from a CSV, and manipulate it however you see fit.
I used the CSV file located at http://www.census.gov/popest/national/files/NST_EST2009_ALLDATA.csv
It contains population changes in each state from 2000 to 2009, among other things. It looks like this, in its raw form:
<pre>010,0,0,00,United States,281421906, ...
I will pull this information into Yahoo Pipes, and define that the first row should be used as column names. Here is what the Pipe will look like:
Fetch the CSV File with Yahoo Pipes
Change the Value of the RSS Description with the Regex Module
I then use the Regex, or Regular Expression module, to change the value of the description for each item in the feed.
Sorting the Data in the Feed
I then use the Sort Module to sort the order of the data in the new feed I created.
After I do this, the final output for the feed looks like this:
Pop in 2000: 9955308, Pop in 2009: 9969727, Net Pop change 08 to 09: -32759
Pop in 2000: 1277211, Pop in 2009: 1318301, Net Pop change 08 to 09: -1390
Pop in 2000: 1050736, Pop in 2009: 1053209, Net Pop change 08 to 09: -293
Pop in 2000: 609903, Pop in 2009: 621760, Net Pop change 08 to 09: 711
Pop in 2000: 1240446, Pop in 2009: 1324575, Net Pop change 08 to 09: 2703
Flickr and Yahoo Pipes
Here I created an RSS feed from images that I pulled from the Flickr website.
All I did was drag the Flickr Module on to the stage and asked it to return 50 photos of Pittsburgh, taken in Pittsburgh. It returned a map detailing where the photos were taken. It also returned a list of the photos and stuck them in a new RSS feed.
You could also use the Flickr module to populate your articles with interesting photos.
That’s All Folks
There are 3 interesting ways to use Yahoo Pipes. In the next article, I create a massive Yahoo Pipe that will use most of the modules. I’ll then describe how those modules work and you’ll be a Yahoo Pipe Master. Leave Questions Below
Here to Serve