This really is an outstanding example of the power of information architecture. Traditional intelligence focused on getting information up the chain of command, getting it analyzed, and getting a comprehensive plan back to the troops. However, this situation was too fluid, too fast, too rapidly changing to go through all that rigamarole. So, the oversight and aggregation process was automated.

This is fascinating for a couple of reasons:

First, it seems to highlight a general rule of technology: Once a process can’t move faster or be more flexible than automation, it will be subsumed. We have seen this a million times in a million different ways. Most of us have been a part of this process, either as an automator or being automated.

Second, it highlights how important it is for management and administration to improve as rapidly as the organizations they support. In the past, it has been the job of management to drive their subordinate organizations to improve, and often they did not hold themselves to the same standards. I can recall a time where the person who demanded that we automate everything possible required us to manually fill out and send an Excel spreadsheets that documented our progress.

I think that we are in the throws of new wave of organizational change based on newer, more flexible technologies like Wikis, Open Mapping Tools, and Social Networking. We should be seeing a lot more of stories like this in the MSM over the next year or so as it moves into the more public consciousness. And, in 24 months it will be a part of the common wisdom, and we won’t remember doing thing any differently.

However, the ‘new trend’ of allowing users actually provide feedback into the products that they are using has produced a professorship at MIT and been mentioned in the New York Times ::sigh::  IMHO, this is simply the realization that ignoring people is less effective than communicating with them, and less effective means less profitable.  I think the technology world should be embarassed that it is so disfunctional that this is at all new or interesting enough to study.

On a similar note, Ben Stein has some interesting thoughts about how to have a business conversation.  If you plan on doing anything other than pure solo work for the rest of your life it is mandatory reading.  Interestingly, it seems that the best conversationalists are the ones who are the most considerate and do the most listening.  Sounds like organizations might want to focus on having an actual conversation with their customers …

I see the current state of the Internet as the ultimate success … You can deploy a wildly successful Web 2.0 application that serves millions of users and never know how a router, switch or load-balancer works. Even network security and firewalls that were making headline news not more than a few years ago are considered perfunctory. The success of these networking devices and technologies has enabled them to become part of the technology landscape that exists for all to use as they see fit, similar to the microprocessor or electricity.

It is always odd to see the once-glamorous jobs of your youth thrown onto the scrap heap of history (think about the differences in perception between the masons of the middle ages and your local bricklayer). Network Engineers were once the masters of a difficult and arcane field, literally bringing information from chaos. Now, the wizards have been trapped in tiny control panels for now, until they can be embedded in silicon for all time.

This has really got me to thinking about my own field, and its future. What specialties are going to dissapear if data becomes as reliable as electricity? For one thing, I think we would see ETL and Business Analysis become a single career path that is much more abstract and tools-based. With the advent of good BPM, I could see a lot of the scheduling and other mechanics pushed off towards the DBA’s and Systems Administrators. Also, I think that a lot of the hardware could be appliance based, or outsourced completely. Of course, this leaves a great opportunity for open source BI and for nimble players to attack the market and take advantage of the innovators dilemma.

A brave (an infinitely more useful) new world!

Recently, ran across DBPedia, an organization that is turning Wikipedia entries into RDF, the language used for the semantic web. DBPedia has actually has downloadable datasets based on Wikipedia that are available today. These are datasets that can be queried with existing tools and linked to other datasets. Wow!

Even if you aren’t a Wikipedia fan, this is really a big step forward for the enterprise. Think about the amount of knowledge that exists in your organization that isn’t captured, but is critical to your operations. It has always been a big pain to try and sit down and do formal knowledge engineering. However, most people are comfortable enough with a Wiki to sit down and start typing. For a small organization this might not be such a big deal, but for a larger enterprise this could provide some very useful information.

The first time your Director or CXO can make a financial decision based exclusively on the information from your company wiki, it will have proved its worth. Until then, it is just another trendy tool. The work that DBPedia is doing is an important step in making this a reality.

When tech analyst John Gantz at researcher IDC began tallying up all the digital information generated annually, he first looked in the obvious places …

Gantz ultimately calculated that 161 exabytes of digital data — or about 161 billion GB — were generated in 2006. And the amount is expected to rise fast.

It is worth a quick read, although if you are a data geek a lot of this is pretty elementary, so you might just want to forward the URL on to your favorite business leader or project manager.

The article is a bit light on is the downstream ramifications of the data deluge. Obviously, there will be a lot of SAN units sold, but that opportunity is long gone unless you are able to take advantage of the innovators dillema. Looking over the horizon, there is a huge opportunty for people who can make this data not just searchable, but accessible and usable and trustworthy for decision-making.