These are the old pages from the weblog as they were published at Cornell. Visit www.allthingsdistributed.com for up-to-date entries.

April 30, 2004

Wired on the Scalability of Feed Aggregators

It seems that people finally start to 'get it' (see wired article); that the current approach of continuous feed polling, will not scale. I have explained this in detail before, see for example 'On the Scalability of Feeds and Aggregators', or as early as two years ago (see Wes Felter's report from the Internet2 meeting).

It is cool to see that the solutions people are now willing to discuss (p2p or bittorrent style) are the ones that I have been advocating for a number of years, and that have found their implementation in Newswire. We have had some legal issues with the deployment of the newswire beta, and a new core communication component is being developed. But I would be happy to break open the ideas in the system and work with others to see whether this can be a good experimentation platform.

Posted by Werner Vogels at April 30, 2004 02:10 PM
TrackBacks

Don't Throw The Baby Out With The Bathwater
Excerpt: Dave Winer comments on a recent Wired article that raises concerns about the scalability issues associated with aggregators polling RSS/ATOM...
Weblog: h2os
Tracked: May 1, 2004 01:34 PM
PDC - Attendee Party @ Universal Studios
Excerpt:
Weblog: Geek Noise
Tracked: May 1, 2004 06:33 PM
RSS 리더가 웹을 망쳐놓을 것인가?
Excerpt: [via hochan.net] 호찬님의 RSS 리더가 웹을 망쳐놓을 것인가? 글과 인용된 Wired의 기사 - Will RSS Readers Clog the Web?. 예전에 이런 주제로 Werner Vogels' weblog에서 RSS scalability에 대한 글을 본적이 있어, 찾아 보니 역시 있더군요. - On the Scalability...
Weblog: HOLLOBLOG (별주부뎐)
Tracked: May 3, 2004 11:49 AM
Why is IzyNews faster than other RSS readers
Excerpt: IzyNews uses a lot more efficient method to communicate to the client
Weblog: IzyNews - News, Blogs, and RSS Feeds in your eMail
Tracked: June 10, 2004 09:26 AM
Comments