0xDECAFBAD - Tag: ajax

Futility in alternate pasts and futures in human augmentation

2006-09-06T19:57:42+00:00

While it’s great to draw inspiration and ideas from the past, recreating the past in the hope that it becomes the future seems like a futile idea. Does anyone really want to return to a command-line interface to manipulate documents? It’s designing for a past that never happened, one where we all became computer scientists and enjoyed manipulating documents via arcane commands.
...
A better, more productive, use of time would have been to say, what inspiration can still be gained from Engelbart’s ideas? There’s still a lot to be gleaned from his 1962 (!) paper [Augmenting Human Intellect](http://www.bootstrap.org/augdocs/friedewald030402/augmentinghumanintellect/ahi62index.html). How might some of his thoughts on collaborative intelligence be implemented in our world now, in 2006, within the technology we have now? That’s the question waiting to be solved.

Source: adaptive path » blog » blog archive » The Futility of Designing for an Alternate Past

Allow me to engage in some Devil's Advocacy here - although I really am an Engelbart sympathizer:

Consider a program like Microsoft Word, with all its ribbons and toolbars and menus and animated assistance. When you first started working with it, you probably spent time navigating these visual and guided parts of the user interface to get your job done. But, after awhile, you probably discovered keyboard shortcuts and accellerators - CTRL-s to save, for instance. These have likely been invaluable in speeding up your work and helping the application get out of your way. So, having reached this point, do you ever really have a use for the "user friendly" bits anymore? Or, have you graduated to "manipulating documents via arcane commands"?

What if this application had never sugar-coated things and had instead optimized for efficiency and ergonomics in daily expert operation, trading an "intuitive interface" for an offer to incrementally train on its necessarily complex functionality? After awhile, you'll have it all down, and be ready to shed the training wheels.

What if - instead of a maze of menus and toolbar icons - your mouse just had dozens of easily-accessible buttons? You're used to only having a left and a right click from which to choose. If you've splurged, you might have the more expansive choices offered by a fancier pointing device. But, what if you had a chording keyboard under your off-mouse hand, offering an order of magnitude more mouse pointer actions?

For example, how about a "delete word" mouse button? Or a "copy sentence" button? Or maybe even a "jump to the selected link with a custom view filter" button? The important part is that these commands act immediately, just like a mouse button, upon whatever's under the pointer. There's no left-click then CTRL-x to Cut - no, you just point at a word, and say "cut that". There's a lot of power and efficiency here.

These "what if" scenarios are not just wishful thinking, though. They're what Doug Engelbart and crew implemented. These are things I picked up after being invited to try a hands-on self-guided tour of Augment. I only wish I'd had a chording keyboard to get the full experience. The interface was like a mouse-heavy VIM, with verb-object command patterns and structured document interactions. (Or, rather, VIM is like a mouse- and outline-deficient derivation of Augment.)

The basic core of this facet of Augment is this: Computers are powerful tools with great potential to augment human intellect. As such, they offer a lot of complex functionality. But, human beings are trainable, and can assimilate this functionality. Once assimilated, it's best to squeeze out all the performance you can. You don't see today's degree of computer "user friendliness" in chainsaws, tanks, jack-hammers, semi-trucks, or fighter jets. These things are necessarily complex and require training. Why should the most powerful of intelligence enhancement tools offered by computers be any different? Of course, you generally won't lose a limb to a computer, but you might be mentally impaired or lose valuable work in the process.

This is, I think, one of the still-relevant central facets of Doug Engelbart's ideas that could use some re-examination today. It could just be because I'm an übernerd who thinks it's fun to self-train on things like VIM and Augment, but I also think that there's a lot of potential to be unlocked once you clear away expectations of "intuitive interfaces" that are decidedly not nipples.

And, since I've admitted my recently acquired semi-addiction, consider World of Warcraft as an expert application. Advanced players could never succeed by navigating a complex yet "friendly" UI to invoke various spells and skills and in-game actions. Just take a look at some of the customizations and UI revisions being offered at this site. Some configurations of this game smack me as eerily similar to the principles of Augment. In fact, just this weekend, I was considering blowing the dust off this keyset controller I used to use with Everquest, years ago.

Then again, maybe it's a matter of intensity. Coordinating with a 40-player guild to slay something from the molten bowels of the earth is a slightly different activity than composing a memo or even a few-dozen-page report. On the other hand, I really would've liked to strip away most of the Word interface while writing my two books. And someday, who's to say that online interpersonal collaboration in the general case won't more closely resemble a World of Warcraft raid? Having just read Vernor Vinge's latest book Rainbows End, he makes a lot of intelligence augmentation and collaboration tasks look just like WoW.

Archived Comments

Bill Seitz
2006-09-06T21:58:26

The fighter-jet metaphor is interesting. Obviously a fighter has a narrower scope/focus than the general computer. But perhaps there's a narrower technique/practice of intelligence augmentation that warrants a more specialized/locally-optimized interface design.

But then maybe the Engelbart work isn't focused enough on a particular context and associated method-of-use?

To relate this to a similar software offering, how important are the specific Compendium features compared to the process of IBIS?

And a big factor in the ChangeFunction is how critical the problem/pain is being solved by the new offering. Can you convince people that there will be a pay-back for learning to use HyperScope that compensates for the investment, compared to other uses of your time?

Let's put it this way: if you were picking between 2 start-ups to invest in, how much weight would you associate with 1 of the teams using HyperScope? How does this compare to betting on a dogfight where 1 party has an F-15 and the other a Cessna?
phil jones
2006-09-07T22:22:40

Very nice post.

And Bill's comments too. They remind me of the LEO editor for Python which was always touted as having great productivity benefits if only your team would undergo the three month training required to use it properly. Not sure if it ever took off or could. But there's something nice about the idea that LEO empowered programmers could outperform the norm.

I'm convinced that there are certainly productivity improvements available to power-users, beyond anything currently dreamed of, once we step away from the assumption that "ease of use" equals "1-to-1 correspondance between functionality and UI objects".

As every nerd knows, real (interesting) productivity, comes from higher levels of abstraction. And maybe what's really important about the outliner tradition (from HyperScope to MORE / UserLand / OPML to LEO) is that it remains loyal to this notion. When you collapse a block of text and ideas down to a single-line, you are essentially abstracting away from that detail and working with the higher-level description.

OTOH, the Xerox Parc tradition of the GUI and direct manipulation, lost this core ideal. (At least as it was spread via Apple and Microsoft, although obviously you can probably do all sorts of powerful abstractions via a Smalltalk interface)

I'm pretty sure that this insight is general. The really interesting innovations beyond HyperScope are going to be new ways of giving the power-users yet more abstract ways of manipulating their information. Either by folding more of it together as complex aggrogates, or allowing large-scale cross-cutting processing. (Maybe style-sheets in Word are the only other surviving popular example.)
Harold
2006-09-08T22:45:31

Y'know - this is what it is like to be an Emacs user. I've come to the opinion that the set of document formats you can work with, and the set of commands you can perform on them, should be somewhat-to-completely separate from the UI.

That way, you can have a learners/beginners UI to get people up to speed, then they graduate to the intermediate UI that assumes knowledge of things like C-s, C-o, C-q etc. And of course, if an application follows strong UI design guidelines, experienced computer users might be able to start a new program in the intermediate UI. Gosh! C-o opens a file in Excel too!

Then, I think there should be a choice of expert-level UIs. For example, VIM and Emacs have both grown together (VIM started small, light and fast, and Emacs stared with everything AND the kitchen sink), so that they both represent reasonable choices for a power-user's text editor.

This is also one of the problems that web developers are working on (or working around). Google and others have started introducing intermediate level UI features in web apps (like shortcut keys), but try building a site that looks and feels like WoW...
Ben Tremblay
2006-09-12T20:35:09

What still catches me with systems like Augment (I would call Neuberg's new incarnation "hyperScope".) is precisely the mousing.

The war is long lost but I recall with fond pleasure how I blew a Word user away by using WP5.2 ... ^F6-P boom And when I rolled out the functions I'd cobbled together with WP's lovely macro language? Sonic boom. The key in that situation was that I had a large number of unique tasks and a small very number of tasks carrying a huge workload (MILSPEC change management). So it was ideal for hot-keyed macros: like shooting fish in a barrel.

For one thing, unless I'm reading passively or doing some flavour of CAD my hands are nowhere near the mouse. Or, to invert that, when I'm keyboarding I have to routinely suppress my resentment with reach, swivel, click, drag, select, click, select ... interminable menus and options bla-bla-blah, and nowhere muscle memory comes into play. But even with that aside, to have to right click and then select Delete from a menu /after/ having dragged to select a block ... I can outshoot that action stream using keystrokes anyday, if the app allowed me to.

I don't disagree with the fundamental insight ... far from it. But we've just barely begun to implement the foundational cognitive ergonomics. (I was gratified to see in one thread that Brad explicated his having moved Help to the upper right ... cuz that's where it is most often. When it works it works cuz it works. Tradition is sometimes/often arbitrary; life's like that and we should sometimes just suck it up.)

Harold's point about expert users is, I think, key. It's merely foolish to impose a system that makes good use of habituation onto a newly arrived visitor. I'm quite sure that attentive study shows a clustering or quantum of user intention and expertise ... until and unless we contrive some seamless continuum (a terrible distraction inspired by naive perfectionism) we should focus on differentiating expters from n00bs (no diss) and serve both well. "Intermediate level" sounds quite appropriate ... so long as this isn't just a maelstrum of fish/foul goat/sheep confounds.

Alternatively we can always fall back on the old TRW concept of making people think more like machines. There might be funding for that. ;-P
Ben Tremblay
2006-09-12T20:39:47

Muscle memory just jumped up and reminded me of this: in a situation where I was doing Print Preview a gazillion times a day Shift-F7 6 was as effortless as breathing. snap
Edward Vielmetti
2006-10-18T06:00:17

I can speak as a former Emacs user and coder that the only reason I gave it up for vi was that it hurt my hands too much to make all of those funky keyboard chords, and it started to hurt my head to remember all of the time-saving things I had built.

Classically there's a tradeoff between the ease of typing something and the amount of think time you have to put into remembering what to type.

One thing I am annoyed by on too many blogs is the inability to tab from the comment field to the "submit" button, which forces a mouse event and a scroll event.

Ajaxitagging

2006-08-16T13:12:07+00:00

Ever since I switched over to a new CMS back in February, I’ve been tagging all my journal entries. Until now, I haven’t been doing anything with those tags apart from exposing them in category elements in my RSS feed. Now that I’ve got a good head of steam going with my tags, I’ve decided to play around with them a bit.

Source: Adactio: Journal - Ajaxitagging

Book pimping time: In Hacking del.icio.us, I've got something not entirely unlike the above-linked hack. (Which, by the way, is good work!) Mine is much more basic, though - with less microformat, progress bar, and yellow fadey goodness. And, instead of AJAX, my hack uses JSONP. The Related Links hack in Chapter 9 of the book shows you how to include lists of the last few bookmarks you've posted under each tag / category / keyword used in a blog post.

Pulling the Linkmobile back into the garage

2006-02-09T15:49:42+00:00

As a follow-up to Tuesday's post, I've disabled the nightly link post as of now and turned off the links category on the main page template.

I got a surprising amount of good and friendly feedback on the change in comments, IMs, and emails. And, the balance to me sounds like there are people who sorta liked the change and a lot of people just plain turned off by it—the nays were louder than the yeas. I was on the fence, leaning toward dislike, so down go the links.

I'd still like to reintegrate my link posting output on del.icio.us into this site in some other fashion soon, because that's where the bulk of my hasty blogging happens these days. In the course of writing this new book, I've got a panoply of other options available from sidebars to AJAX-powered geegaws. I've also considered pulling FeedMagick into the mix to offer a "build your own" remixed feed option, but I've not yet had the ambition to deliver on that.

So sorry link fans, it's back to the status quo for me, for now.

Okay, okay, JSON is pretty hot

2005-12-19T04:17:55+00:00

The XML ~~purist~~ fanboy in me has had me pshaw'ing at JSON. But, now that the recent JSON release from Yahoo! reminded me of its existence and I gave it a shot myself, I have to admit that it's pretty hot—if only for the cross-domain bridging capabilities and the no-fuss parsing.

Although, I do worry about running into a poisoned payload someday that raids my cookie jar.

Archived Comments

fluffy
2005-12-19T06:50:57

JSON is currently the big Hot Thing at work. It's very good for some things, but IMO it's not nearly as robust as XML as far as generic interchange goes. Its big drawback is that it's not nearly as flexible, and since elements are either unordered or stored in an array, you have to agree upon the actual structure of the document before you send it across the wire (which isn't so much the case with XML where often all you care about is the nesting order which you can handle with XPath or similar).

It's GREAT for AJAX though, as long as you can trust the server of course.
Bill Humphries
2005-12-19T07:26:09

I thought AHAH was the current big thing. Just send HTML to the client and use Element.innerHTML.

FeedMagick gains an RSS-to-JSON filter

2005-12-19T03:01:51+00:00

So, I put some more infrastructure behind FeedMagick and lifted a RSS-to-JSON idea from John Resig to transform from MagpieRSS parsing to JSON output.

Here's a spiffy JSON-enriched demo. It was surprisingly easy, all told.

I'm not sure how much time I'll have to really put into this project, but this is the first decent effort I've put into a URL-line suite in a long time. I'm trying to throw in some bits to make it easy to build, document, and use these feed processing commands.

Google Reader is good

2005-10-08T17:47:15+00:00

For what it's worth, I still feel like I've been unfair to the guys at Google over Reader.

I know how much work must've gone into that thing, because I know how something like that could've been built. I really think it's just because it's not the right kind of app for me, and I'd like to see someone make that app. And, I'm also a bit burnt out on the whole AJAX Madness buzz.

Thing is, Reader is so good at being what it is. I'm just critical because it's good at being what I don't want.

Archived Comments

jperkins
2005-10-08T18:15:57

The issue that I have with Google's reader stem from a rushed to market feel that I think that it has. As a developer, I'm sure that you've been in the position where suits see a business opportunity and decide to launch an app that's not ready. That's what the Google reader feels like to me. More so when the acquisition of Ranchero (owner of NetNewsWire) earlier this week is taken to account. For example, the lack of rudimentary autodiscovery in supplied urls. That's a no brainer to add and yet it's missing. I suppose that the developers could've neglected that feature, but that seems like something that would've been added in a later internal development release prior to a public beta launch.

Eh, it's all supposition on my part, but if it is the case that perceived business opportunity outweighed holding off a bit and shipping a solid app then that's not a good sign for Google at all.
Sencer
2005-10-08T22:38:56

where suits see a business opportunity and decide to launch an app that’s not ready. That’s what the Google reader feels like to me.

That's exactly what I though. After an initial warm-up phase where I liked it, I decided it's not for me, and the app feels very, very beta to me. Not that it has errors, but it's doing very little to be actually helpful. Especially after an import I feel pretty much lost. Everything is new, no way to mark stuff as read. Upon revisiting everything is unmarked again. No way to scan snippets. That which is there maybe nice, but it's not useful enough to get me to switch.
Nick
2005-10-09T03:13:04

Yeah, it's not quite perfect, but it's also a Google LABS project. So, it's not really meant for 'release' as much as it's a proof of concept sort of thing..

BTW Les, I fixed the comment thingy.. It's called loading Wordpress..