The Podcast Performance Review: How to Measure and Optimize Your Show for Real Growth
Roger Nairn
If your branded podcast hit 10,000 downloads last quarter and you can't explain what that did for the business, you don't have a performance problem — you have a measurement problem. Downloads are not outcomes. They're the beginning of a question, not the answer.
Roger Nairn, CEO of JAR Podcast Solutions, frames it directly: "If your brand's podcast gets 10,000 listens but does nothing for the brand, is it successful?" That question should be uncomfortable. For too many marketing teams running branded shows, it is.
Why Podcast Metrics Fail Most Marketing Teams
Downloads became the default measurement because they're easy to pull. Every hosting dashboard surfaces them. They look like progress. They give you a number to put in a slide.
The problem is structural. A download — as defined by most hosting platforms, and flagged by IAB-certified analytics providers — can include a bot scraping your RSS feed, an auto-download that never gets played, or a file request from a device where the listener stopped after 90 seconds. None of those represent a person choosing to spend time with your content. None of them move your business forward.
Reach metrics (downloads, listens, subscribers) measure distribution. Performance metrics measure impact. They are not the same thing, and conflating them is the single most common reason branded podcasts get cancelled. A show with 4,000 highly engaged listeners in your exact ICP is more valuable than one with 40,000 passive downloaders who couldn't name your brand. The number that looks worse in a deck is often the one doing real work.
The shift required here is not technical. It's philosophical. It means accepting that podcast success is business success — and that the measurement framework has to reflect that from the start.
Define Success Before You Launch — Or Redefine It Before Your Next Review
The most important performance question isn't "how many people listened?" It's "what was this show supposed to do?"
JAR Podcast Solutions runs every show through a proprietary framework called the JAR System: Job. Audience. Result. The job is what the podcast needs to accomplish for the business — build trust with a new buyer segment, support sales enablement, establish thought leadership in a category, deepen loyalty with existing customers. The audience is a specific, defined group — not "anyone interested in our industry." The result is the measurable outcome that proves the show is doing its job.
A performance review, whether it's the first one or the fifth, is fundamentally an audit against that original brief. Did the show do its job? Did it reach the right audience? Did it produce results you can trace to the business? If you launched without clear answers to those three questions, the review is also the moment to establish them retroactively — because without them, every metric you pull is meaningless context.
If you're at the stage where you're still deciding whether to commit to a podcast before you have that brief locked, Five Questions to Ask Before You Sign a Six-Figure Podcast Contract is worth reading before the next internal conversation.
The Metrics That Actually Tell You Something
There are three layers of measurement worth building into every performance review. Each layer answers a different question.
Engagement depth answers: are people actually listening? The most useful number here is consumption rate — what percentage of each episode listeners complete. Industry research from The Podcast Consultant points to 70%+ completion as a strong signal of content quality. Drops below 50% on specific episodes signal a format problem, a topic that missed the mark, or an opening that didn't earn attention. Return listener rate — how many people come back episode after episode — tells you whether you're building a habit or just attracting one-off traffic. Retention trends over time reveal whether the show is improving or plateauing.
Audience quality answers: are the right people listening? Downloads tell you volume. Platform data from Apple Podcasts, Spotify, and YouTube can tell you verified listener counts — distinct humans, deduplicated — which is a meaningfully different number. Beyond that, listener profile data (demographics, geography, device), survey responses from engaged listeners, and social signal (comments, shares, mentions) tell you whether you're attracting the audience the show was built for. A B2B podcast reaching procurement managers in enterprise tech means something very different than the same download count spread across students and casual browsers.
Business outcomes answer: did any of this move the needle? This layer is the hardest to build but the most defensible. UTM parameters in show notes track which listeners click through to your site or content. CRM tagging for prospects who mention the podcast in sales calls creates a pipeline influence trail. Brand lift studies — periodic surveys of listeners versus non-listeners — measure whether the show is shifting perception or purchase intent. Inbound referrals that cite the podcast are a low-tech but legitimate signal. None of these are perfect individually. Together, they make an argument.
For a deeper look at measuring trust specifically — the outcome most B2B podcasts are quietly trying to build — How to Measure Trust — Not Just Traffic — From Your Branded Podcast covers the framework in detail.
A Working Example: Small Audience, Outsized Impact
The counterargument to download anxiety is concrete, and JAR has documented it.
Breaking Bottlenecks, produced for the Port of Vancouver, was built for an audience of roughly 2,000 people — specifically, employees and operators at the approximately 25 companies working within the port. That number wasn't a failure to scale. It was the entire point. The show was designed for a precise, hard-to-reach professional community with shared operational context and a specific set of concerns.
Engagement was, by all accounts, through the roof. Because every listener was exactly the right listener. There was no passive reach, no incidental downloads from people who stumbled onto an RSS feed. The show had a job, a defined audience, and a result — and those three things were in complete alignment.
This is what right-sized success looks like in practice. A show with 2,000 listeners who are all key stakeholders in your business universe is more strategically valuable than a show with 200,000 listeners spread thinly across an audience that has no commercial relationship with your brand. The measurement framework has to account for that. A review that flags Breaking Bottlenecks as underperforming because its numbers are small is a review using the wrong criteria.
When Jennifer Maron, Producer at RBC, described working with JAR — "We 10x'ed our downloads in the early days" — the more instructive part of that quote is what drove it: improved storytelling, better audio quality, and an active marketing strategy working together. No single lever. The growth was an outcome of the whole system improving at once. That's the right frame for any performance review — not chasing a single metric, but asking whether the whole system is functioning.
How to Run a Quarterly Podcast Performance Review
A 90-day review cycle is practical for most branded shows. Long enough to see real patterns; short enough to course-correct before a full season goes in the wrong direction.
Start with episode consumption data. Pull completion rates across the quarter and flag outliers in both directions — episodes that significantly over- or underperformed your average. High completion on a specific format or topic is a signal to replicate. Sharp drop-offs at a consistent timestamp suggest a structural issue: too long an intro, a mid-episode format break that loses people, a topic that ran out of runway before the episode ended.
Benchmark against yourself first. Your own historical data is the most meaningful baseline, because it controls for your specific audience, your show format, and your distribution channels. Competitor benchmarking is secondary. Tools like Podchaser offer rough download estimates for competitive shows — useful for orientation, not for precision. The numbers are directional at best. Social signal around competitor shows (comments, shares, community activity) is often more telling than the download estimates anyway.
Evaluate content-to-business alignment. Look at which episodes performed well and ask whether those episodes also served the show's stated job. Sometimes the most-listened episodes are the ones that drifted furthest from the brief. That's not growth — that's drift. The quarterly review is where you catch it.
Identify format experiments. Every show should be running small, structured experiments each quarter — a different episode length, a solo episode versus a guest format, a narrative-driven episode versus a conversational one. The review is where you score those experiments against engagement data and decide what to carry forward.
Audit distribution and marketing activity. Many branded podcasts exist on RSS and nowhere else. If no active promotion ran in the quarter — no social clips, no newsletter mentions, no cross-promotion, no pitch to directories for featuring — then flat or declining numbers aren't a content problem. They're a distribution problem. The review has to separate those two diagnoses.
Optimization Isn't Just Content — It's the System Around the Show
Performance review findings should feed three levers, not one.
Content is the obvious one — format adjustments, topic pivots, guest mix, episode length. But content changes alone rarely move the needle if distribution and repurposing stay flat. A show that publishes well and then sits on a hosting platform waiting to be discovered is structurally limited, regardless of quality.
Distribution — which platforms the show lives on, what promotion was active, whether the show is being surfaced in directories or through paid channels — determines whether the right audience can find it. This is where the review should ask hard questions: Is the show on YouTube, and is it built for how YouTube actually works as a recommendation engine? Is there a social content strategy creating regular touchpoints for the audience between episodes? Are there cross-promotion opportunities with adjacent shows that share the target audience?
Repurposing determines whether each episode generates value beyond its initial publish window. A single conversation — recorded, edited, published — can become short-form social clips, a newsletter section, a sales enablement asset, a blog post, a quote card. How to Turn One Podcast Episode Into 20 Plus Content Assets Without Diluting Quality lays out the mechanics of that process in detail. The ROI per episode changes significantly when repurposing is built into the production workflow rather than treated as an afterthought.
There's a fourth lever that most podcast performance reviews don't account for at all: re-engaging listeners after the episode ends. JAR Replay, JAR's listener retargeting service, addresses exactly this gap. Powered by technology from Consumable, Inc., it captures anonymous listener signals via a privacy-safe pixel or RSS prefix, then activates those listeners with targeted paid media — full-screen, sound-on visual audio ads served across premium mobile apps. The audience that listened to your episode is still reachable. Most shows never find a way back to them. JAR Replay turns a one-time listen into an ongoing relationship with a defined media channel.
The performance review, done properly, isn't a report card. It's a diagnostic. It tells you where the system is working, where it's leaking value, and which specific adjustments — in content, distribution, repurposing, or reactivation — will move outcomes in the next 90 days. The brands that treat it that way are the ones whose podcasts compound in value over time rather than plateau after the launch spike.
JAR's core philosophy holds that a podcast is for the audience, not the algorithm. The corollary is equally true: performance measurement is for the business, not the dashboard. Build your review around that distinction, and the metrics start telling you something worth acting on.
If your show is mid-run and you're not confident the numbers you're tracking map to outcomes the business cares about, that's worth a conversation. Start one at jarpodcasts.com/contact — or if you're ready to talk scope and structure, request a quote at jarpodcasts.com/request-a-quote.
