Corporate intelligence

Using roots and derivatives

In the interest of full disclosure, this post is not about algebra, nor is it about financial instruments.  It’s about various kinds of business research ‘raw materials’ and how to discern their quality if you are a producer or user of such research.

Whether you are navigating the waters off Tuscany in a cruise ship, or analyzing a new business opportunity, the quality of the data you use is integral to the outcome you will deliver.  While the availability and use of high-quality data does not guarantee a desired outcome, the absence of it renders the desired outcome more a result of chance than of strategic intention.

Manufacturing re-thought quality

When I originally developed the KVC model, it was partly a test to see how well best practices in manufacturing could be applied to organizational intelligence.  In so doing I borrowed heavily from earlier work I had done in TQM (Total Quality Management).  One of TQM’s most basic principles is that in any manufacturing process, it is no longer acceptable to just get to the end of the process — the finished goods — and weed out the ones that do not meet quality standards.  Instead, it is much more efficient to build quality checks into each stage of the process, reducing the number of adverse quality-related surprises at the end of the process.

Intelligence can, too

So it is with intelligence — the ‘manufacture’ of a knowledge-based product.  One of the implications is that each step up the value chain tends to replicate (and in my experience, amplify) any quality shortfalls embedded in earlier stages.  ‘Garbage in, garbage out’, as the expression goes — though we prefer its converse, ‘Quality in, quality out.’

tree_with_rootsAnother implication is that wherever possible, in developing your source data, you go to the lowest possible level on the chain at which it’s available.  If information and intelligence are the branches and leaves of the ‘knowledge tree’, then data points are the roots.  You want to get to the ‘root-most’ level in order to start your analysis.

To the extent you accept at face value someone else’s processing or analysis of the data, you may save yourself some analytic time and effort — but also you leave yourself open to inheriting and building on their errors.

One of the ways this happens is when people rely on second-order ‘derivative’ work at the start of their process.  This is work that ‘derives’ from another, or (in Knowledge Value Chain terms) enters at a higher level in the chain.  For example, an analyst may cite a newspaper article about a new study that has been released, instead of citing the study itself.  This is usually because he hasn’t taken the time to find the root source, read and analyze it, and draw his own conslusions.

The result is a data quality vulnerability — one that’s typically easy to overcome.  When you see a newspaper article cited that refers to a study that someone is announcing, it is essential to (where possible) obtain the original study, read it critically, and do your own analysis and interpretation of the results.

Apples, oranges, and pineapples

I’ll give you a recent example from my casebook.  We have been studying various issues related to heath care for more than a year now.  Most recently, we’ve done work around the aging of the population and what market opportunities and challenges it presents.  One of the unusual things about this assignment is the sheer volume of high-quality material readily available.  The US government publishes lots of data — the Census Bureau, Centers for Disease Control and Prevention, and Center for Medicare and Medicaid Services were especially useful to us.  In addition, many universities have centers that study health and/or aging, and there are not-for-profit groups (like the Urban Institute) that also do so.

In short, instead of a dearth of data, there are so many sources that we were still discovering new ones more than ten weeks into our study.  And of course, none of them totally reconciled in terms of their target population, what they measured, how they measured it, when they measured it — we were dealing with apples, oranges, and pineapples in terms of the comparability of our data.

The case of the poisoned pie chart

At the beginning of our aging study I found one source that was especially useful, a monograph published by a leading not-for-profit research organization.  Its source list was a rich trove of ‘root’ sources that we culled to build a ‘knowledge base’ for the market opportunity we were evaluating.

One of the key facts we were looking for was the breakdown among funding sources for elderly long-term care — Medicare, Medicaid, private insurance, self-pay, and so on.  The monograph contained an analysis and informative pie chart, but — as I’m recommending here — we had also obtained the source material cited (in this case, National Health Expenditures data produced by the US government).  We do this as a matter of course, not so much for checking on our sources, but more as a way of digging more deeply into the source material, and to develop still more sources from their citations.Apples Oranges

In this case I could get the total figures to agree with this authoritative derivative source, but not the allocations among these sources.  After spending an hour or so trying to reconcile the difference, I went back to the monograph and read the part of the text in which it explained the pie chart.  There, to my amazement, I found the breakdown very similar to the one I had developed independently.  As far as I can tell, there had been an error made by the person (quite possibly not the author) who created the accompanying pie chart.

If I had used only the ‘derivative’ source, I would have given an incorrect result to our client — complete with a citation to a ‘reliable’ source.  Only by finding a ‘root’ source and checking against that was I able to deliver a result that met our standards of data quality.

It’s not totally clear in this case that an incorrect answer would have significantly affected our client’s decision to pursue an entry into this market.  But in this case — as is often the case — the cost of higher-quality data was not much greater than incorrect data.  So having the best you can get becomes a good work habit to develop.

Cheap gas in a BMW

Imagine for a second you’ve won the lottery, and are now driving a new $75,000 BMW M3.  Would you put low-octane gasoline and bargain motor oil into it?  Unlikely, since the value and usefulness of what you have would likely be degraded significantly by doing so.

Yet companies do this all the time — put low-quality data into a highly-tuned decision-making machine — often without knowing it.  The quality of raw unprocessed data is not always immediately obvious to its end user, since by that time it has been transformed by the ‘intelligence manufacturing’ process.  (It’s usually clear to me where the vulnerabilities are, but that comes with having done business research for a long time.  I’ve seen most of the mistakes you can make, and made a fair number of them myself.)

I’ll give you some of the signposts we use for data quality in a future post.  But one of the things that immediately starts me checking is the use of derivative sources, where the roots are available.

Information overload: an urban myth?

I just listened to a fascinating webinar in which five authors recounted their experiences, both personal and professional, with information overload.  One of the speakers, Jonathan Spira, reports that he has measured this phenomenon, and that it costs the US economy over $1 trillion per year!

Shifting the blame

But in naming the phenomenon ‘information overload’, it seems to place the blame on the information—not on ourselves, where it belongs.  People bemoan the distractions offered by ubiquitous information devices like smart phones and tablets—similar to the complaints that were made when the telegraph and the printed book were introduced!

This seems to us like blaming obesity on food.  “Gee, there’s so much food out there, if I ate it all, I’d get really fat.”  (Yes, you would…and with an obesity rate running over 30% in many US states, some people appear to be trying to do just that.)  If we were to talk about obesity as a food overload, it would sound pretty silly.  Though our general abundance is certainly an enabling factor, most people realize that you have to eat intelligently and selectively to stay healthy.

Maybe what we’re all experiencing is better described as collective attention deficit, or of being focus-challenged.

The information metabolism

all-you-can-eat_25Organizations have this problem too, and typically don’t fare much better.  In my article “The Information Metabolism” (Competitive Intelligence Review, Fall 1995), I compared the intake and processing of information to the intake and processing of food—eating and digestion. Though my tone was whimsical, I was only half-kidding.   I believe they are closely analogous, as my article described:

Some organizations are ‘information starved’…Others are ‘fat’ with information—they acquire it, but can’t use it effectively to create value.  Still other organizations ‘binge’ on information—they get lots of it at certain times (like strategic planning season), but not enough the rest of the time.

This was written at the dawn of the Internet Age, and the situation has accelerated dramatically since then.  I’ve seen this up close in companies, and it can be quite distressing.  Some are literally awash in so much data that it erodes their ability to process and use it effectively to manage their business.

Read the rest of this entry »

Rebalance your knowledge portfolio

If you have any experience with investing, you know about rebalancing your portfolio.  Every so often—at the end of every year, say—you need to reassess your investments.  Some may have grown, such that you’re too heavily invested in a particular stock or sector in the economy.  In other areas, you may find that you have less invested than you would like, given the prospects for another higher-potential sector.

Why do we need to do this?  Because the world changes, and the asset mix may no longer meet our needs.  I may feel that the economy is risky, and I’d rather be more invested in safer things like bonds than stocks.

In addition to the ebb and flow of securities prices, my needs may also change.  I may need to take out money for my child’s education, or for other unexpected expenses.  I may feel that I’d rather have more insurance.

The knowledge portfolio

It’s much the same way for organizational information and research assets.  They are financial investments—not costs—and each one brings to the organization a return in the form of optimized decisions and business results.  I find it helpful to think of all the research, information, and intelligence in an organization as its ‘knowledge portfolio’, with each research initiative, report, and staff position representing a specific asset in that portfolio.

Read the rest of this entry »

Competitive myopia

I recently had a conversation with the publisher of a start-up niche business-to-business magazine.  We had pointed out several things that we felt were opportunities for him.  For one, our view—confirmed with some informal research—that the “look and feel” of his product was not what it could be, and that with a small investment, he could bring it up to the much higher standard we feel he needs.

His reply was that, even though he’s always interested in making improvements, they weren’t needed here.  The reason?  He had just met with his chief rival, the CEO of another similar publication, and they both had agreed that my client’s product had the better approach.

This illustrates perfectly what in my experience is one of the most common hazards of conventional competitive intelligence—one I’ll call competitive myopia. Competitive myopia is defined as a focus on a competitor or rival that is so intense that it causes distraction from larger strategic threats or opportunities.

BearCompetitive myopia results in a mindset that says:  If we just manage to beat the other guys, we’ll do fine in our market.  “I don’t have to outrun the bear,” goes the joke about the two men meeting the hungry bear in the woods.  “I just have to outrun YOU.”

Read the rest of this entry »

IntelliJam: a fast ride through the past and future of corporate intelligence

I speak often with Eric Garland, a leading futurist, thinker, and blogger.  We typically have a free-ranging and—to us, at least—entertaining and enlightening conversation.

This time he recorded it.  Here are some of the notes we hit:

  • Businesses have always wanted and needed to know about each other’s activities.  Until the 20th century, this was mostly handled by direct conversations among business leaders.
  • The conditions that created the need for modern competitive intelligence in the US began to be laid by the anti-trust legislation of the early 20th century.  When businesses were legally prevented from sharing information, they had to devise some other way to obtain it.

Read the rest of this entry »

You can call me “Don”

One recent Tuesday (June 29th) first thing I got a very excited e-mail from my marketing colleague and friend Professor Plum.  “Did you see the thing in the [NY] Times about the Russian spies who were arrested?”  (Indeed, I had read it earlier with great interest.)  “I know one of those guys, Don Heathfield…he works with a business development firm I’m also working with.”

Interesting coincidence.  Being the research guy I am, I looked up Heathfield and found that his company had a product FutureMap that sounds similar in some respects to a product we’ve been working on at TKA—something to monitor trends and events that could affect a company.  I emailed my futurist colleague and friend Colonel Mustard a link with a “Check this out!” subject line.

Within five minutes Mustard called me back.  “You’re not going to believe it, but I know one of these guys—Donald Heathfield.  I met him through the World Future Society.  He was always asking me for introductions, and to have my clients try out his software.”  We had a rollicking conversation during which Mustard pointed out the many things in Heathfield’s story that didn’t quite add up.

Read the rest of this entry »

Signal to noise

Why doesn’t early warning work?  While it’s a good idea in theory, in practice it seldom seems to have its intended effect.  In every major intelligence failure I’ve looked at, there were clear, credible early signals—and even explicit warnings—that tragically remained unheeded.  Why is this, and what can we do about it?

For example, in the recent meltdown of the US real estate market, and much of the world economy with it, there were lots of warning signs.  Some of these were very explicit and very public.  To name a couple:

  • The FBI’s 2006 published report warning of widespread fraud in the US residential mortgage market, which backed the mortgage-back securities market that subsequently collapsed
  • Yale economist Robert Shiller’s testimony before Congress in September 2007 that housing prices were dangerously overinflated, and that their imminent collapse would cause significant damage to the economy.
World Trade Center - September 11, 2001 9:45am

Downtown New York City - September 11, 2001 9:45am

In another example, leading up to the bombing of the World Trade Center towers in New York City in 2001, there were many events that could have been read as “feasibility tests” for 9/11.  There is a chapter (“Foresight—and Hindsight”) in the 9/11 Commission Report that catalogs the missed signals and other structural conditions that might have prevented the attack.  In retrospect, there seems to have been a straight-line connection between:

  • The February 1993 truck bombing of the WTC North Tower
  • The August 1998 bombings of the US embassies in Nairobi, Kenya and Tanzania
  • The October 2000 bombing of the USS Cole.

Read the rest of this entry »

The two kinds of information

When asked to name his favorite kind of music, pioneering jazz musician Louis Armstrong is said to have replied, ”There are only two kinds of music, good and bad.  I like good music.”

You could say the same about information—there are fundamentally only two kinds, good and bad.

According to one definition (“Intelligence:  An Economic Good” by Mark Jensen), good information is defined as being timely, objective, usable, accurate, and relevant to whatever decision it is supporting.   It’s not the same as “good news”—good information can be favorable or unfavorable—but solely by virtue of its being “good”, it’s essential to decision-making.

To the extent information doesn’t adhere to most or all of the above criteria, it is “bad” information.  The problem is, it’s often hard to tell the difference between the bad and the good.

Read the rest of this entry »

The value contract

Still more ideas from the SCIP annual conference in Chicago…

When I work with internal corporate practitioners of intelligence or research, one of my first recommendations is to run their operation as if it were a stand-alone business.  That is, with clients (managerial decision-makers), suppliers (databases, contractors, etc.), and possibly even rivals of their own-both internal and external.  This helps them determine where the value for their clients is, and how to maximize that value.

Few of the internal practitioners I’ve met charge back for their services—so they are essentially “free” to their users on a transactional basis.  In those rare cases where there is a charge-back system, there is a market value assigned to the function.  People either pay for the service at the quoted price, or they do not.  The user is the judge of what value is received, and whether it was “worth it”.

However, absent this market mechanism—which has its own drawbacks—there is no direct measure of value for intelligence.  There must be some proxy for it—typically informal conversations or a survey at budget time to the effect—Is this function worth its salt, or not?

Read the rest of this entry »

Intelligence takes a holiday

Last week I went on vacation with my “lifemate” Ellen and the rest of my immediate family.  We were on Cape Cod, MA, which is a pretty sophisticated area as far as vacation spots go, so I had assumed that there would be good Internet connections.

Wrong.  No Wi-Fi signals, only one bar (at best) of cell phone, and my cell-powered wireless WAN working only briefly on one very stormy morning.  (Thanks, Verizon!)

I started thinking maybe Ellen planned it this way.  Instead of reading various chat boards, calling people, and posting to my blog, I actually talked to my family and read some of those heavy paper things—oh right, books.

Ellen claims that “vacation” means not only do you vacate your usual PLACE, you also vacate your MIND—and that you can’t do that while constantly being on the phone and the Internet.  So I think she secretly engineered this—to save my sanity.  It’s scary to go “off the grid” for even several hours, let alone several days as I did.  There are stages:  first you panic, then you get angry…but then you start to care less and less, and so on.  Eventually, you settle into a deeper zen-like level based more on the sunsets and the tide patterns than on the latest news morsel.  I wouldn’t want to live there, but it sure is a nice place to visit.

Read the rest of this entry »