Outcomes Matter in an Agile World

The primary outcome of Agile is achieving better business results. This is why outcome based measures are much more aligned with Agile then output measures. Output measures focuses on how much you delivered, while outcome measures focus on the results of what you deliver.  It is the results (aka, the outcomes) that matter. 

Outcome based measures are drivers to help you understand business success.  You may still need some output measures to help you on your way.  Just ensure that they are relevant to help you determine if you are reaching the outcomes you are looking for.  The output could be the delivery of a release or the number of releases.  The outcome is how many customers either bought or used the product release.  Often times people focus on outputs because they tend to be easier to measure or are a carry-over from a more traditional mindset.  

The danger of focusing on outputs is that you may have a high number of outputs with a low number of outcomes.  Outcomes are what drive business success. As illustrated in the chart, it appears that the output of the 4th quarter is best.  However, if you look at the outcomes chart, the 3rd quarter is better with revenues of $80,000 instead of only $20,000 from the 4th quarter. While the output of four releases sounds good, $20,000 is not favorable to good business results. Outcomes  ask you to measure different things, with a particular focus on customer value.

In addition, an outcome focus changes our perspective from internal to a customer or external focus.  This helps us better understand what we are aiming for in the customer value-driven world we need to establish. So next time you are considering measures of success, just remember that outcomes matter!

Agile Lagging to Leading Metric Path

Even in an Agile environment there is a benefit to applying measures to understand progress.  It can be tempting to apply the same iron triangle input metrics (based on cost, schedule, and scope) that may have been used in a more traditional mindset to Agile projects and initiatives.  Those, however, tend to be output related. Instead, I suggest removing all of those metrics and start with a clean slate. On the clean slate, first consider your outcomes.

An Agile mindset asks that you consider an outcome instead of output as a measure of success.  This means you should first start with understanding your desired outcomes for an initiative or project.  Within a business context of building products, one measure of success is an increase in revenue. Having a customer revenue metric helps you understand whether the products being built are increasing revenue upon release. While capturing revenue is a good starting point, it is a “lagging” indicator meaning you don’t recognize the evidence of revenue movement until after the release is in production and has been in the marketplace for a period of time.

To supplement a lagging measure, it is beneficial to have corresponding leading measures or indicators that provide you with visibility during creation to gauge if you are moving the product into a position of increased revenue. I call this framework the Lagging to Leading Metric Path.  This visibility is important because it provides input for making decisions as you move forward. Making the right decision leads to improved results. As you consider measures (or indicators), think about how they help you gain visibility and information for decisions in building a product that helps you lead toward an increase in revenue.

For a hopeful increase in customer revenue, what leading metrics can we put in place to ensure we are moving in the right direction?  Let’s say in this case that increased revenue is the hopeful lagging metric based on expected customer sales.  Examples of leading measures or indicators to achieve an outcome of this lagging metric for increased customer revenue include:

• Customers attending Sprint Review: a leading metric where you capture how many customers are actually attending the sprint review and how much feedback they give. This indicates engagement and interest. 
• Customer satisfaction from Sprint Review: a leading metric is capturing customer satisfaction from the functionality they viewed within the sprint review.  This indicates levels of satisfaction with the functionality as the product is being built. 
• Customer satisfaction of product usage: an indicator of the most recent release highlighting a level of satisfaction on the usage of the current product including commentary.   

When applying Agile to product development, the outcome that matters most are often represented by lagging metrics.  Therefore you will need leading indicators to ensure you are moving in the right direction, to provide visibility, and to help you with decision-making.   Within your own context, consider constructing a lagging to leading metric path so that you know you are moving in the right direction during your Agile journey.

                    ------------------------------------------------------------------------
Note: the lagging to leading metric path really isn't specific to Agile and I would suggest applying this to an initiative or project aligning with any mindset, process, method, or practice of delivering value.

To read more about establishing an Agile Lagging to Leading Metric Path and Agile Measures of Success, consider reading Chapter 14 of Being Agile.