Archive for March, 2009

Value and the Solution Gap

Monday, March 16th, 2009

I have been doing some work recently applying Agile techniques on a business process reengineering project.  This has led to some thoughts on what I am calling the “Solution Gap”. 

I see the Solution Gap as the gap between the intended value of a system and the solution that is supposed to deliver that value.   

The Solution Gap is particularly significant when the intended value is people-oriented.  IT systems are a good example of this.  An IT system might be intended to make people’s work more efficient, or it might be intended to engage with people more effectively.  People however do not react in consistent, obvious,  or predictable ways. 

It is often said that IT projects are different from other types of project, and the Solution Gap is one of the significant ways they are different.  The concept has wider application than just IT projects though.  Business processes are another example of systems with intended value which is people-dependent.  Services (commerical and public) are another example.  Even marketing initiatives and creative projects can be viewed in this way.       

The Solution Gap is one form of uncertainty.  One approach to removing uncertainty is to perfrom extra analysis.  The other approach is to incorporate validation and feedback into the overall process.   In the case of closing the Solution Gap additional analyis is to be recommended, but it is important that this does not then preclude the option for validation and feedback.   Ultimately you cannot know whether the solution will deliver the intended value until the solution is put into operation.

There is therefore a point where analysis stops being cost beneficial.  More specifically, this applies to analysis which is based on zero feedback.  It makes most sense if such analysis is an ongoing activity rather than a purely up-front activity, incorporating increasing amounts of actual feedback as the project progresses.    

One common trap that projects fall into is to assume that the analysis and design effort put into identifying the solution has resulted in the ‘correct’ solution, ie the Solution Gap is deemed not to exist.  This thinking is enshrined in governance approaches that view implementation as purely a cost center - the solution is known and the cost now needs to be managed down, or at least to target.  This is a generic form of delegation where only the solution is delegated.   The obvious implication of this approach is that the risk associated with the Solution Gap is owned entirely upstream (eg by people required to ’sign off’ the solution), but more importantly the opportunity to optimise across both solution and value has been lost.

The Agile approach has some built in resolutions for the Solution Gap.  Firstly, they inherently build in validation and feedback mechanisms.  Secondly they promote collectively working towards clearly defined goals and continuous optimisation (eg prioritisation) against those goals.    

There are however areas relating to the Solution Gap where the de-facto Agile processes are not prescriptive, and it is left to the vision and experience of the team to get it right.  

For example, the focus of prioritisation is on deliverying business value.  This approach might be effective in closing the Solution Gap, but might not.  An alternative approach which I have used effectively is to focus (initially) on validating that the solution will deliver the intended value with minimum investment, with the likelihood that this will also generate real business value. 

A precursor to this is that the intended value needs to be clearly identified and communicated in the early stages of the project.  Note that this is different from identifying objectives and goals.  Objectives can be expressed as easily in terms of solution as they can in terms of value, and my experience is that it is more effective to focus the conversation on value directly.

The Guardian opens API access

Tuesday, March 10th, 2009

The Guardian continues to demonstrate that openness and innovation are its strong suits; and if you happen to be The Guardian and the content that you can provide open access to includes 10 years of broadsheet quality journalism from guardian.co.uk then people take notice.

This is the context within which The Guardian has launched what it is calling Open Platform: a set of content APIs and a collection of datasets that will provide developers of 3rd party applications with access to Guardian content, which includes ‘full fat’ feeds: the full text of articles including content types such as video, audio and photo galleries. In total some 1 million pieces of content published on guardian.co.uk from 1999-2008.

The Guardian has already shared little secrets that provide us with an insight into novel ways to access and explore its content. My favourite is the seemingly unique way that you can combine tags and keywords to create your own virtual page, and the wistful way that The Guardian’s Sean Clarke introduced us to this concept in his Inside guardian.co.uk blog post from last year. What we see exposed in features like this is an insight into the innovations around the use of tags and tag pages that make the site able do things in response to the “what-if we had a tag page that did…” type of request that creative writers and designers at The Guardian come up with every day.  Requests that have been fulfilled because The Guardian had the backing and vision to acquire and nurture the in-house capabilities and experience to deliver them.

Innovations, like Open Platform, are made possible by a series of incremental changes to the inner workings of the content management system that, had they been thought of sooner, might have so heavily weighed down the early design as to have anchored the project firmly to the launch pad. Luckily for us the approach has been far more agile and successful than perhaps some dared to hope and the result is far more munificent and adaptable. It demonstrates the commitment that The Guardian is willing, and prepared, to make; not only to the technology, but also to the philosophy, of the web.

Virtues of Lean versus Strengths of Agile

Monday, March 9th, 2009

At a company away day last week, Rob H was extolling the virtues of Lean’s Single Piece flow over Iteration-based planning and development.  It provoked a lively debate with Rob’s compelling experience from IPC pitched against Nigel’s views from the Guardian project.   It’s difficult to argue that Single Piece Flow does not reduce waste; planning and review meetings are dispensed with and replaced with work in Play Limits and continual process refinement.  But is the structure created by iterations necessary to provide adequate focus and control? Conversely, do iterations lead to slop, lower quality and thrashing as the team strives toward the end of the period?

I remain undecided on the subject; clearly both approaches have merits that are better suited in certain situations.  I’m tempted to think that iteration planning provides a focal point for communication in larger teams and that Single Piece Flow will run into issues as projects scale, but equally I suspect I’m being disingenuous.  After all, it’s this type of lazy thinking that leads traditionalists to dismiss Agile.

The debate will no doubt continue.  Watch this space.

The Tipping Point for Agile?

Friday, March 6th, 2009

There seems to be a low level flame war occurring at the moment between advocates of Agile and supporters of Lean. It seems to me that this is rather like two bald men arguing over a comb. The assumption within these communities is that these new methods are embedded and understood throughout the IT industry. This is reinforced by the fact that the supporters spend a large amount of time talking to each other via blogs, newsgroups, message boards etc. And when they are not online, they attend seminars and conferences to talk to each other about the same things in person. All of this strengthens the illusion that a much wider community understands about these methods than actually exists.

My main job is sales. I probably attend around 3 or 4 sales meetings with customers or prospective customers per week and they are usually at a fairly senior level. And, for first meetings, around 70% of the people I meet have never heard of Agile or Lean. Hard to believe isn’t it? For every 10 CIOs or Software Development Directors I meet, 7 of them have no idea that Agile and Lean exist in IT or what benefits they can bring.

Since 2002 my colleagues have assured me that Agile is on the tipping point to becoming the de facto way of running projects. Lean advocates assure me that soon their ways of identifying value and reducing waste will be endemic. I can see precious little evidence of that in the real world. And until we become better at proselytising these methods to people outside our communities and stop internecine bickering about which adds the most value, they will remain a country lane off the information super highway.