A featured contribution from Leadership Perspectives: a curated forum reserved for leaders nominated by our subscribers and vetted by the Manage HR Advisory Board.

Brown & Brown

Learning Analytics: The KPI Dilemma

Heather Torres

Heather Torres

Balancing Metrics With Meaning—What L&D Should Actually Measure

Learning and development leaders know the pressure: Show us the impact. Prove the ROI. Justify the budget. And too often, that turns into reporting numbers that are easy to pull but don’t actually say much.

Completions. Logins. Time spent. We know them. We report them. But do they really help us tell the story of learning?

I’ve been in conversations where leaders asked for updates on our training program and I found myself sharing metrics that, while technically accurate, didn’t reflect the actual value of the learning experiences. Yes, teammates watched hours of content. But did they apply it? Did it help them close a deal, reduce errors or become better leaders?

The truth is that we’re often measuring what’s easy instead of what matters. And when we do that, we miss the opportunity to connect learning to business strategy.

Let’s Start Here: What Are You Trying To Change?

Before you collect any data, pause and ask: What is this learning experience intended to change—skills, behavior, results? How will I know if it worked?

If we can’t answer those two questions, it doesn’t matter how fancy our dashboard is.

The 3 P’s Of Strategic Learning Measurement

To tell a more meaningful story, I use a simple framework: Participation, Progress and Performance.

1. Participation

This is where most people stop—and it’s a good starting point. Who is attending, engaging, enrolling? Are the right people in the room? How many people are opting in, not just being assigned?

“We’re often measuring what’s easy instead of what matters. And when we do that, we miss the opportunity to connect learning to business strategy”

For example, in our courses, we track assigned attendance vs. voluntary sign-ups. That tells us not just who we reached, but who’s interested in similar content— fueling future course development.

2. Progress

Are learners developing? Advancing in a pathway? Applying what they’ve learned?

• Pre/post assessments

• Certifications earned

• Confidence ratings

• Scenario completion or branching in eLearning

Progress data helps us show development in action. It also builds a stronger case when reporting on long-term programs like onboarding, leadership development or role-based pathways.

3. Performance

This is where it all comes together: Are we changing business outcomes?

• Sales lift

• Customer retention

• Reduced onboarding time

• Fewer compliance errors

• Improved engagement scores

• Lower turnover

Performance data connects the dots between learning and impact. And yes, it’s harder to measure. But even directional data—when paired with stories—can be incredibly powerful.

Real-Life Example: Sales Workshop ROI

We ran a workshop for a group of sales teammates. Six months later, we followed up with a short survey:

• Did they win or retain any business as a result?

• What concepts or tools from the session helped them?

• Could they name a specific case and the associated revenue?

Less than half of the attendees responded, but even that small sample gave us rich insight.

From those responses alone, we calculated an 11x return on investment—and we gained clarity on which elements of the workshop resonated most. That helped us refine future content and strengthened our case for continued investment.

You don’t need 100 percent response rates to prove value. Just ask the right questions and pair qualitative feedback with the quantitative data you already have.

Attribution Matters

Could we have just looked at post-workshop sales data and declared success? Sure. But learning doesn’t happen in a vacuum. Sales teammates also get coaching, use playbooks and attend other trainings. So, we stayed conservative with attribution—and focused on patterns and stories, not perfection.

This kind of nuance builds trust with leadership. They know we’re not just inflating numbers—we’re telling the real story of growth.

Reporting It All To Leadership

When it’s time to share results:

• Keep it simple.

• Lead with visuals.

• Provide context.

• Don’t assume they remember the original goal— remind them.

A one-page dashboard with a few bullet points and one or two quotes from learners can be far more compelling than a spreadsheet full of stats.

At its best, learning analytics doesn’t just show what happened—it shows why it mattered. So the next time you’re asked for KPIs, ask yourself: Are we tracking activity or capturing impact?

Metrics are only meaningful when they align with outcomes. Let’s make sure our data is telling the right story—one that celebrates growth, drives improvement and earns investment in what we do best.

The articles from these contributors are based on their personal expertise and viewpoints, and do not necessarily reflect the opinions of their employers or affiliated organizations.
Take Me Top