Sunday, April 13, 2014

Agile Lagging to Leading Metric Path

Even in an Agile environment there is a benefit to applying measures to understand progress.  It can be tempting to apply the same iron triangle input metrics (based on cost, schedule, and scope) that may have been used in a more traditional mindset to Agile projects and initiatives.  Those, however, tend to be output related. Instead, I suggest removing all of those metrics and start with a clean slate. On the clean slate, first consider your outcomes.

An Agile mindset asks that you consider an outcome instead of output as a measure of success.  This means you should first start with understanding your desired outcomes for an initiative or project.  Within a business context of building products, one measure of success is an increase in revenue. Having a customer revenue metric helps you understand whether the products being built are increasing revenue upon release. While capturing revenue is a good starting point, it is a “lagging” indicator meaning you don’t recognize the evidence of revenue movement until after the release is in production and has been in the marketplace for a period of time.

To supplement a lagging measure, it is beneficial to have corresponding leading measures or indicators that provide you with visibility during creation to gauge if you are moving the product into a position of increased revenue. I call this framework the Lagging to Leading Metric Path.  This visibility is important because it provides input for making decisions as you move forward. Making the right decision leads to improved results. As you consider measures (or indicators), think about how they help you gain visibility and information for decisions in building a product that helps you lead toward an increase in revenue.
For a hopeful increase in customer revenue, what leading metrics can we put in place to ensure we are moving in the right direction?  Let’s say in this case that increased revenue is the hopeful lagging metric based on expected customer sales.  Examples of leading measures or indicators to achieve an outcome of this lagging metric for increased customer revenue include:
  • Customers attending Sprint Review: a leading metric where you capture how many customers are actually attending the sprint review and how much feedback they give. This indicates engagement and interest. 
  • Customer satisfaction from Sprint Review: a leading metric is capturing customer satisfaction from the functionality they viewed within the sprint review.  This indicates levels of satisfaction with the functionality as the product is being built. 
  • Customer satisfaction of product usage: an indicator of the most recent release highlighting a level of satisfaction on the usage of the current product including commentary.   

When applying Agile to product development, the outcome that matters most are often represented by lagging metrics.  Therefore you will need leading indicators to ensure you are moving in the right direction, to provide visibility, and to help you with decision-making.   Within your own context, consider constructing a lagging to leading metric path so that you know you are moving in the right direction during your Agile journey.

                    ------------------------------------------------------------------------
Note: the lagging to leading metric path really isn't specific to Agile and I would suggest applying this to an initiative or project aligning with any mindset, process, method, or practice of delivering value.

To read more about establishing an Agile Lagging to Leading Metric Path and Agile Measures of Success, consider reading Chapter 14 of Being Agile

8 comments:

  1. Mario,
    Interesting article… however, I wonder how strong a connection exists between customer participation in Sprint Reviews, etc. and revenue. Particularly, the challenge I see is that if the participant in the Sprint Review is a “customer” then, almost by definition, the revenue has already been obtained, and thus this process doesn’t necessarily lead to new or additional revenue.

    So while customer participation in Sprint Reviews should certainly help improve customer satisfaction and defend against the customer defecting to a competitor (which is most definitely a worthy goal), I’m not sure whether there really exists a direct, casual relationship between these leading and lagging indicators as you describe. I guess it could help in upselling additional products/services/licenses, and thus lead to more revenue… but is that always the case?

    Certainly, I can see an indirect consequence, where satisfied customers recommend your company’s products/services to other prospects, and thereby help attain more revenue. But that connection is perhaps less tenuous than is implied here.

    What do you think?

    ReplyDelete
    Replies
    1. Hi Luis, Actually in most of my sprint review events, having the customer attend is rarely a commitment to buy but a feedback loop to ensure I'm building in the right direction of the value. I do ask the question that if you like it enough, would you buy it to ensure I'm in the right direction of revenue (ergo why its a leading indicator).

      The key with a Lagging to Leading metric path is for you to determine your outcome (lagging) and what leading indicators would work best for your product/service/other to ensure it leads to the outcome you are looking for.

      Thanks for your thoughts!

      Delete
    2. Mario - thanks for advancing leading indicators discussion. The community needs to keep upping our game here.

      Customer attendance at sprint reviews are neccessary but not sufficient. I’ve had customers attend and be deeply engaged and sprint reviews and demos only to reject at release.

      I believe releasing or decreasing lead time to release is the leading indicator. If you aren’t releasing enough THAT is a leading indicator of trouble.

      Your metics of customer sprint attendance and custom sprint satisfaction are leading indicators in the most basic sense - that is the absence is a leading indicator for failure.

      Consider an edit to the post so it can be a source of leading indicators we can all get behind.

      Delete
  2. An abnormal increase in number of change requests may be a leading indicator that we have not been understanding requirements correctly.

    ReplyDelete
  3. The tool avoids the rating system approach and rather looks at three measurements area. This approach has allowed for the flexibility to ensure the steps are flexible of writing term paper but also specific on certain criteria that would be expected along the journey.

    ReplyDelete
  4. Thank you for your post, I look for such article along time. And do you want to leave the virtual worth yourself? If you want, let go to the game sims 4 cheats. Click link to participate game.

    ReplyDelete
  5. Playing computer games makes kids smarter? Experts answer this question "yes".
    In the friv 2 site, children are playing games, as well as mathematical games that will help their lessons alongside games. These games contribute to children's intelligent development.
    According to a new study by experts, the students who play 5 minutes before dersten are more successful. 580 students participated in the survey conducted in the United States. Children play the game called "Activate", a mental gymnastic developed for research.
    It was seen that the students who played this game for 5 minutes before the lesson had a much higher success in the examinations. Focusing and enhancing memory skills, the long-term effect of the game was also positive.
    Children who played 20 minutes of play 3 times a week for 4 months were found to be more successful in reading and mathematics exams. However, experts warn parents about computer games.
    Some computer games based on mathematics have significant contributions to positively affect the attitude of mathematics. Just as the antibiotic used increases with vitamins, which are catalyzed, one of the catalysts of permanent learning is games. At the point where we combine mathematics and game concepts, permanent learning is likely to have taken place. It should not be surprising that a child who has passed through middle school but still living in the multiplication table knows enough detail to surprise any computer or web application. This will bring the question "Is the problem in the student or in the system?" Although this question is not a single and concrete answer, the important thing is to be able to combine the positive aspects of both. In the United States, serious scientific research and questionnaires on this topic have been made, and some schools have already incorporated some math-based computer games into their teaching systems. They even organize regional or national competitions on these math-based games. The game "24 Game", which has been held since 1980, has become one of the most known games based on mathematics. Later, this version of the game was made in computer versions and wider masses were achieved.
    These positive examples give us clues about a new educational model that learns by doing-and-learn, and contributes to learning permanently with mathematical play. In such a system or model, one of the most important elements that help to provide a permanent and complete learning in large student groups is to enrich the content of that course. Mathematics-based computer games are among the most powerful instruments among these enrichments.
    Spending too long at the computer is said to have negative effects on children's physical and mental health.
    Your children in the friv site can spend time without boredom. They can also play intelligence games on this site.

    ReplyDelete