March 07, 2003

Playing the Internet scales

Is this a technical or political problem?

The blog world was enriched last week when Tim Bray's Weblog appeared on the scene. The co-founder and CTO of Antarctica Systems, Bray co-edited the XML 1.0 specification and remains deeply engaged in Web development. "It's not like it used to be," Bray observed in the hours following the launch of his blog, while "hovering over the access log like an expectant mother." The most dramatic change from a few years ago? The effect of RSS (Rich Site Summary/Really Simple Syndication) newsreaders:

"I'm seeing maybe four or five hits a minute on the RSS feed," Bray says. "When you consider the number of sites out there with RSS feeds and the number of people who subscribe to a bunch of them, we're talking some pretty serious traffic here. Architecturally, this seems pretty dumb, and you have to worry whether or not it's going to scale."  

Point taken. Although I've been publishing and subscribing to RSS feeds for four years now, I've noticed a change just recently. One Web site I manage used to attract more visitors by way of its e-mail newsletter than by way of its RSS feed. Three months ago, things tipped dramatically in favor of RSS.

My guess is that's just the start. RSS readers -- for example, Radio UserLand, NetNewsWire, AmphetaDesk, and NewzCrawler -- used to be pretty far off the beaten track. Last week, though, I started using Greg Reinacker's NewsGator -- a .Net-based plug-in for Outlook 2000 or 2002. If you're an Outlook user, this is probably the best and most natural way to tap into the vital stream of information that Weblogs deliver. If you're wondering where to start, just point NewsGator at somebody's OPML (Outline Processor Markup Language) subscriptions file -- mine, for example -- to read the same feeds as I.

For RSS, integration with Outlook is a huge opportunity to break into the mainstream. But as Bray points out, "Yes, Houston, we [potentially] have a problem." I, for example, subscribe to about 100 feeds. During the day, I migrate from one Windows box running NewsGator to another running Radio UserLand to a TiBook running NetNewsWire. Each of these RSS readers (also known as aggregators) polls each of its subscribed feeds hourly. A few months back, this sucked up a lot more bandwidth than it does today. Aggregators pulled whole feeds, then looked for changes until Simon Fell, the developer of PocketSoap, made this modest proposal:

Close

On Twitter now

Application development

Powered by Twitter

White Paper

D2D Virtual Tape Library Replication Primer

This whitepaper explains the terminology and concepts behind Data Replication technologies and establishes some sizing rules through worked examples. Learn the new paradigm in disaster tolerance—protect data anywhere.

Download now »

Trial

Free 30-Day Desktop Virtualization Trial

Download a free 30–day trial and experience how XenDesktop delivers a pristine, on–demand desktop experience to users on whatever device they choose, while cutting IT complexity and costs.

Download now »

White Paper

Why Your Firewall, VPN, and IEEE 802.11i Aren't Enough to Protect Your Network

The emergence of WLANs has created a new breed of security threats to enterprise networks.

Included in HP ProCurve WLAN solutions is security technology that alleviates threats from WLANs through:
* Monitoring wireless activity inside and out of the enterprise
* Classifying WLAN transmissions into harmful and harmless
* Preventing transmissions that pose a security threat to the enterprise network
* Locating participating devices for physical remediation

Download now »

Sign up to receive InfoWorld Resource Alerts

Subscribe to the Developer World Newsletter

Receive a weekly roundup about the art and science of software development.

©1994-2009 Infoworld, Inc.