FeedSpool is progressing nicely

2005-10-05T20:58:21+00:00

I'm at it again: Last night, I got an initial stab at a plugin API for FeedSpool working.

The first thing I built was an auto-adjusting feed poll schedule plugin which varies the time between feed polls based on whether there were new entries found in the latest poll. It's kind of like an AIMD algorithm used in networking—I thank Gnomon for the idea a few years back.

The next thing I built was a quick plugin bundle I call miniagg. If you'd like a preview, I've posted an HTML snapshot of what miniagg produces. It's a refinement and reworking of various aggregator UI pieces I've had floating around since AmphetaOutlines, only I think this is the simplest and cleanest I've gotten it yet. (CSS and unobtrusive JavaScript, hooray!)

This only seems to work on Firefox and Safari—it's currently broken for MSIE, and I don't care enough to fix it yet. (Something to do with multiple CSS classes, I believe.) But, if you're unfortunate enough to be using that browser, here's a screen capture:

Archived Comments

Julian Krause
2005-10-05T22:12:31

I've been using a program called Rawdog for a while as my feed reader. Miniagg looks very similar to it. I've been looking for a replacement as he is not planning to support Atom 1.0 since feedparser has gone unmaintained. The HTML preview looks really good, I'm importing my subscriptions right now ;)
l.m.orchard
2005-10-05T23:25:03

Alas, this miniagg uses feedparser also. However, I was thinking of patching / finding someone who'd patched feedparser for Atom 1.0—or replacing it with a new, maybe less liberal parser of my own, since FeedSpool is actually not all that liberal (in that it requires valid XML, anyway).
Aristotle Pagaltzis
2005-10-06T08:48:52

FeedParser Atom 1.0 support patch.
Dan V.
2005-10-26T19:16:09

The feedparser page says that a prerelease v4.0 can be downloaded that includes support for Atom 1.0 feeds. Beats writing your own :)

The zen of firehose drinking

2005-09-23T16:03:12+00:00

So in the last few days, I've read two blog posts lamenting symptoms of information overload, one about a backlog of aggregator items and another about unread mailing list threads. The common thread I've seen between both of these--and other bloggers expressing similar sentiments--is a vague sort of guilt over "missing something".

However, before we had access to syndication feeds or high-traffic mailing lists, we were missing all kinds of good stuff already. It's just been in the past decade or so that personal information aggregation tech has gotten to a point where we're now aware of the dull roar of Things Being Missed.

Fact is, though, that you can't catch everything. At least not and have a human life left over--and even then, you only have so much raw mental capacity to catch it. No, the best thing to do is to relax, accept that you're only able to lap from the stream as it goes by, and be happy that there's a stream to lap from where there was none before.

Aggregate, prioritize, peruse, and discard with abandon. This is continuous partial attention at work.

Archived Comments

Roger Benningfield
2005-09-23T21:24:58

I used to worry about Things Being Missed, but it was ultimately a limitation of my toolset. Once my preferred aggregator added effective search folders, I let all of that go... anything I absolutely *must* see will fall into a search folder, make everything else pleasantly optional.
Roger Benningfield
2005-09-23T21:25:29

er, "making"
Ryan Tomayko
2005-09-24T09:50:01

I'm feeling this right now. My aggregrator has been fixed to my desktop for some years now but within the past month or so I've found myself leaving it closed for 3-4 days at a time. That's just insane :) I feel like I'm not participating at the same level but I sure am getting a lot of other stuff done :)
Danny
2005-09-25T14:11:59

I'm sure you're right in the general case, that a Zen calm is the only sane way to deal with the overload. But I still reckon we can get much, much further towards maximising the signal/noise for the individual. So the total number of things seen may not change, but their relevance/utility can be pushed up. Things like Bayesian filters on mail can help, an aggegrator built something like Memeorandum but designed for the individual could make a lot of difference. Then there's the integration issue - why have completely separate, incompatible tools for reading mailing lists and feeds? And creating stuff? Blah, that was slipping into a bit of a rant, side effect of a spilling-over inbox and seriously overweight aggregator...
l.m.orchard
2005-09-25T15:17:04

Danny: You're totally right, of course. I think once you've gotten yourself into a no-guilt, zen calm about "missing stuff" you can start to ask yourself how to get the computer to help prioritize and get "better stuff" in front of you. Not to totally toot my own horn, but I've included a few tools in Hacking RSS and Atom to play with these issues. In Chapter 15, I've got a start on a Bayesian filter integrated with a feed aggregator. Also, there's a tool which (I think) is like a personal Memeorandum, in that it slurps down feeds, harvests links, then sorts the links in order of popularity along with the feed entries which mentioned them. I haven't found the Bayes thing to be of colossal use yet, but the popular links analyzer is right up near the top of my feed reading priority. And, I've got just about all the mailing lists I tend to care about in feed form now, thanks to Yahoo and Google offering feeds--as well as this script for Mailman archives: http://taint.org/mmrss/

0xDECAFBAD - Tag: aggregation

FeedSpool is progressing nicely

Archived Comments

The zen of firehose drinking

Archived Comments