New AI Agent can now build your knowledge base, connect channels and invite agents — all by chat Try it now
YundaDesk
PricingBlogChannels
Start freeLog in
Questions?Contact sales
Playbook

Running a Post-Promotion Support Retrospective: A Data-Driven Playbook

The sale ending isn't the finish line for support. Use the conversation data sitting in your shared inbox to run a structured retrospective, close knowledge gaps, confirm new answers into the knowledge base, and turn the findings into next time's staffing plan.

YundaDesk Team 2026-02-02Updated 2026-07-10 6 min read

Once a big sale wraps, most teams “retrospect” by getting on a call and saying it was rough but manageable, then everyone goes home to catch up on sleep. The problem: next time the sale comes around, what the team remembers is the feeling, not the data — the same knowledge gaps get missed again, the same channel staffing gets misjudged again. A retrospective that actually helps pulls the conversation data sitting in your shared inbox, breaks it down by issue type and channel, and turns the findings into two concrete outputs: what to add to the knowledge base, and how to staff next time.

A retrospective is data, not a meeting

Every handoff, every escalation, every “AI couldn’t answer so an agent stepped in” during the sale is logged in the shared inbox. That record isn’t there to tally workload — it’s there to answer a handful of specific questions:

  • What share of inquiries did AI resolve on its own, and which topics did it consistently miss?
  • Of the conversations escalated to a human, how many were genuine knowledge gaps versus a customer who just needed a person to de-escalate?
  • Which channel’s volume grew fastest, and where did response times get tightest?

Write the answers down. That’s what gives the retrospective meeting something concrete to discuss, instead of stopping at “everyone worked hard.”

DATA

Running a Post-Promotion Support Retrospective: the data baseline to remember before peak

$11.5BShopify merchant GMV during BFCM 2024
+24%Year-over-year growth
Source: Shopify official BFCM 2024 figures

Break issues down by type: knowledge gaps versus process gaps

Cluster the sale’s conversations by topic and they usually split into two buckets:

Type Signature What to do
Knowledge gap AI couldn’t answer; an agent improvised the answer from experience, and it belongs in the knowledge base Clean up the agent’s answer and confirm it into the knowledge base
Process gap AI answered correctly, but the customer was still unhappy (address changes are too convoluted, refund approval too slow) Fix the process or approval chain — this isn’t a knowledge base problem

The distinction matters. Treat a process gap like a knowledge gap and all you’ve done is teach AI to more fluently repeat a broken process.

Break issues down by channel: where the volume came from, and how much AI caught

Run the same retrospective again, sliced by channel. Performance during a sale often varies a lot by channel — a website widget’s AI resolution rate can run well ahead of WhatsApp, since messaging-app inquiries tend to carry more emotion, images, and multi-turn back-and-forth. Lay out each channel’s volume, AI resolution rate, and the reasons conversations escalated, and two things become visible: whether this sale’s channel staffing made sense, and whether next time you should shift headcount toward the fastest-growing channel.

Close the knowledge base: confirm agent answers into it

Don’t let the knowledge gaps you surface sit in a document. Fix them directly, prioritizing three sources:

  1. Answers agents typed out repeatedly by hand during the sale — anything that came up three or more times is worth turning into a standard entry
  2. Cases where AI couldn’t answer, escalated, and the customer left satisfied with the human’s reply — the answer was right, it just wasn’t in the knowledge base yet
  3. Temporary questions tied to a new product or sale-specific policy — the sale is over, but the product may still be selling, so the answer should stay

Once these are added, the next wave of inquiries — sale or not — gets caught by AI directly instead of relying on an agent to improvise every time.

Controlled learning: confirm the new answer, don’t let AI teach itself

Retrospectives regularly surface moments where an agent “corrects the AI” — the AI gave an answer that was slightly off or tonally wrong, and the agent fixed it on the spot mid-conversation. Those corrections generate a pending learning suggestion, but nothing takes effect automatically. The retrospective meeting is the right moment to review that queue: a manager or team lead goes through each suggestion, and only after it’s confirmed does it get folded into a skill or knowledge base entry — every change traceable, testable, and one click from being rolled back. This is what “gets smarter the more it’s used” looks like at the retrospective stage: AI doesn’t quietly change on its own, every change passes through a human first.

For more on how that loop works, see Teaching AI Support to Get Smarter.

Turn the findings into next time’s staffing plan

A retrospective’s real output should be a short list of concrete changes, not a summary report. Turn it into a checklist:

  • The knowledge base has been updated with the high-frequency gaps found this round
  • Every pending learning suggestion has been reviewed and confirmed or rejected
  • Next sale’s agent staffing has been rebalanced against channel volume growth
  • Escalation triggers for high-risk topics (refunds, complaints) have been updated for anything missed this round
  • SLA targets have been recalibrated against what was actually achieved

This checklist is itself the starting point for the next sale. Paired with the peak-season support playbook, staffing and retrospective form a closed loop — every sale feeds the next one instead of starting from zero.

How often, and who should be in the room

The best window for a retrospective is within a week of the sale ending, while the data is still fresh and agents still remember specific cases. It doesn’t need a big group — a support lead plus one or two frontline agents who can read shared-inbox data and judge what counts as a real knowledge gap is enough. This process isn’t reserved for major sales, either; smaller, recurring promotions can run the same loop at a smaller scale and on a shorter cycle.


The value of a retrospective isn’t in how long the write-up is — it’s in how many accurate answers land in the knowledge base and how much data backs the next staffing plan. Run this loop a few times and the firefighting during each sale starts to shrink, not because luck improved, but because last time’s lessons actually got captured.

Run this playbook in your own workspace

AI answers first, humans back up, every step is revertible — everything in this article can be put into practice in YundaDesk.