Programmatic Data Aggregation: Difference between revisions

From P2P Foundation
Jump to navigation Jump to search
No edit summary
 
No edit summary
 
(3 intermediate revisions by one other user not shown)
Line 1: Line 1:
=About Programmatic Data Aggregation=


'''Aggregator2 = open source newstracking tool for  nonprofits'''
One of the most important effects of the drop in price for computing power and storage is automation and data storage.  When combined you get programmatic or automatic data aggregation.  


URL = http://drupal.org/node/32384
Imagine a computer that pulls in copies of websites and databases all day and all night long without ever getting tired.  


"Enter Aggregator2, an add-in module for the Drupal content management system. Drupal has previously gotten some love on this site as the platform behind projects like Deanspace, Participate.net and eAsylum. Aggregator2 turns the Drupal platform into a powerful tool for news tracking and republishing by offering options for customizing news feeds, tagging news items, and moderating incoming news.
In fact it is possible that your group or network may have use of this kind of functionality.  When you pull in content and data from other sources and republish it there can be a significant benefit because various search engines perceive your re-publication as the addition of new content to your site.


That feature set makes Aggregator2 an exceptionally flexible choice for setting up a nonprofit news tracker that aggregates news from a wide range of blogs, news sites and search engines. Because Aggregator2 saves each individual item as an independent node (like a web page) in Drupal, you can edit or annotate news items after you bring them onto your site. Because Aggregator2 lets you assign different tags to different incoming feeds, you can set up different news pages for different topics, and direct news to show up on the appropriate pages. And Aggregator2 is also a terrific tool for integrating content from multiple related web sites or overlapping organizations.
Besides this easy form of gaming the search engines, having loads of data at your disposal can keep your network more informed, and give them an opportunity to integrate new information, processing and finding relevance, within the context of your own organization, as opposed to solitary web browsing and the efforts required to re-publish and share the information.


At Social Signal we've used Aggregator2 to help move news through the different parts of the emergent telecentre.org network. We use it to bring news and links onto our own web site, including a web page that rounds up nonprofit technology news based on the nptech tag and other search terms. And we used Aggregator2 to set up a pilot aggregation site, Confeederation, to track candidate blogs during the recent Canadian federal elections."
The evolution of [[open data]] has made the opportunity for aggregation skyrocket. If you are so inclined, there's a good chance that you can make this work for you in some way.
(http://www.worldchanging.com/archives/004355.html)


[[Category:Resources]]
Listed below are options you can use for your own aggregator.
 
=Options=
 
==[[Drupal]] Options==
*Feeds Module - http://drupal.org/project/feeds
 
 
[[Category:Technology]]
 
[[Category:P2P Infrastructure]]

Latest revision as of 06:44, 29 January 2016

About Programmatic Data Aggregation

One of the most important effects of the drop in price for computing power and storage is automation and data storage. When combined you get programmatic or automatic data aggregation.

Imagine a computer that pulls in copies of websites and databases all day and all night long without ever getting tired.

In fact it is possible that your group or network may have use of this kind of functionality. When you pull in content and data from other sources and republish it there can be a significant benefit because various search engines perceive your re-publication as the addition of new content to your site.

Besides this easy form of gaming the search engines, having loads of data at your disposal can keep your network more informed, and give them an opportunity to integrate new information, processing and finding relevance, within the context of your own organization, as opposed to solitary web browsing and the efforts required to re-publish and share the information.

The evolution of open data has made the opportunity for aggregation skyrocket. If you are so inclined, there's a good chance that you can make this work for you in some way.

Listed below are options you can use for your own aggregator.

Options

Drupal Options