3 Continuous Delivery KPIs

Jan 7, 2019 by Armory

Continuous delivery isn’t just a buzzword: There are concrete business reasons for building a continuous delivery pipeline. Here are some important ways to judge whether or not your CD system is helping you reach the business and IT objectives that led you towards CD in the first place.

Time to Market

Innovations in development practices are not just about shipping better software—it’s about getting features in front of your customers that give your business a competitive edge, and doing so as quickly as possible. Continuous delivery is part of an agile development model that allows you to release new features to customers, get feedback and adjust/innovate based on your customers’ behaviors.

Continuous delivery should dramatically speed up time to market and time to value, so measuring the amount of time it takes from determining a business logic for a specific application or new feature to deploying that app or feature to your customer base is the ultimate measure of how well your continuous delivery system is working.

Accelerate Your Deployment Velocity!

Bugs—Do You Have Them and How Quickly Are They Fixed?

Move fast and break things, right? Errr, just to be clear, if we’re talking about your customer-facing ecommerce site on Black Friday, actually let’s break things at the QA stage, ok?

Part of a continuous delivery pipeline is recognizing that mistakes happen and things break. But a successful pipeline includes a sufficiently robust QA process that customers aren’t the ones discovering bugs in your software. It also involves testing new releases in an environment that is identical to your production environment, and managing deployments in a repeatable way, so you know that code is deployed to test and production environments in exactly the same way.

You should track how many bugs are caught during the QA testing v.s. how many are caught in production—sometimes called your defect escape rate.

And that’s not all. There are a couple other important bug-related metrics: How long does it take to fix bugs in production, when they happen? How often is a defect so serious it crashes the application?

Ease/Speed of Deployment

When operating a truly continuous delivery pipeline, deployments will likely happen multiple (perhaps even thousands) times per day. The deployment process should be automated and repeatable, to ensure the following:

It’s impossible to speed up the actual deployment process—and ensure it is done safely and repeatably every time—if you’re deploying manually. Using a deployment automation platform like Spinnaker and Armory is the only way to make sure you’re handling deployments quickly and safely.

The goal of continuous delivery is to tighten your feedback loop, constantly improve your software and make deployments a routine, ho-hum, push-of-a-button affair rather than a major event followed by wrap-up party. A successful transition to continuous delivery will usually change your company culture and lead to happier developers—but that’s harder to measure than the points discussed above.

What to learn more about how Armory can help make your CI/CD pipeline a success? Reach out.

Share this post:

Recently Published Posts

Lambda Deployment is now supported by Armory CD-as-a-Service

Nov 28, 2023

Armory simplifies serverless deployment: Armory Continuous Deployment-as-a-Service extends its robust deployment capabilities to AWS Lambda.

Read more

New Feature: Trigger Nodes and Source Context

Sep 29, 2023

The Power of Graphs for Ingesting and Acting on Complex Orchestration Logic We’ve been having deep conversations with customers and peer thought leaders about the challenges presented by executing multi-environment continuous deployment, and have developed an appreciation for the power of using visual tools such as directed acyclic graphs (DAG) to understand and share the […]

Read more

Continuous Deployments meet Continuous Communication

Sep 7, 2023

Automation and the SDLC Automating the software development life cycle has been one of the highest priorities for teams since development became a profession. We know that automation can cut down on burnout and increase efficiency, giving back time to ourselves and our teams to dig in and bust out innovative ideas. If it’s not […]

Read more