Something went wrong!
Hang in there while we get back on track
Attribution Gap Diagnosis - Tracking vs Real Success
Edge case analysis for anomalous data: unusually high conversion rate with massive attribution gap. Diagnoses whether the issue is broken tracking or genuine viral success, with diagnostic tests and fix recommendations.
Input
What you provide to the skill
2K total visitors across channels but 400 signups—unusually high conversion. Only 60 attributed to sources. Rest are direct traffic. Is this tracking broken or real success?
Output
What the skill generates for you
Multi-Channel Attribution Analysis
Scenario Overview
2,000 Total Visitors
↓ 20% visitor-to-signup (!!)
400 Signups
↓ 15% attribution coverage
60 Attributed Conversions
340 Unknown Conversions (85% attribution gap)
The Numbers Don’t Lie—But What Do They Mean?
| Metric | Value | Industry Benchmark | Verdict |
|---|---|---|---|
| Overall conversion rate | 20% | 2-5% typical | EXTREMELY HIGH |
| Attribution coverage | 15% (60/400) | 70%+ target | CRITICALLY LOW |
| Direct/unknown traffic | 85% of conversions | <30% typical | RED FLAG |
Three Possible Scenarios
Scenario 1: Tracking is Broken (Most Likely: 70%)
Evidence pointing to broken tracking:
- 20% conversion rate is extraordinary—even best-in-class SaaS products see 5-10% with warm traffic
- 85% unattributed conversions suggests systematic tracking failure, not just a few missing UTM tags
- Only 60 conversions attributed across “multiple channels” means most tracking isn’t firing
Likely causes:
- UTM parameters stripped before conversion (redirects, login flows, multi-step forms)
- Analytics script not loading on signup confirmation page
- Cookie consent blocking tracking for majority of users (GDPR/privacy tools)
- Tracking code implemented AFTER most signups occurred
- Cross-domain tracking broken (e.g., marketing site → app subdomain for signup)
- Single-page app (SPA) not triggering page view events properly
- Ad blockers stripping tracking parameters (affects 25-40% of users)
Scenario 2: Real Success with Strong Offline/Word-of-Mouth (Possible: 25%)
Evidence pointing to real success:
- Recent viral moment or PR hit you haven’t mentioned
- Strong offline presence: Podcast appearance, conference talk, word-of-mouth from a tight community
- Brand searches: People heard about you elsewhere, typed your URL directly
- Private sharing: Slack channels, Discord servers, WhatsApp groups sharing direct links
What this would look like:
- “Direct” traffic includes people who heard about you from non-trackable sources
- 20% conversion is high but possible if traffic is pre-qualified (e.g., came from a referral)
- Your product has network effects or strong word-of-mouth virality
Scenario 3: Hybrid—Some Real Success + Broken Tracking (Possible: 5%)
The middle ground:
- Your product IS performing well (maybe 8-10% true conversion rate)
- BUT tracking is also broken (capturing only a fraction)
- The 340 “direct” conversions include both real direct traffic AND misattributed channel traffic
Attribution Gap Diagnosis
85% attribution gap breakdown (estimated):
| Likely Cause | % of Unknown | Est. Conversions | Priority to Fix |
|---|---|---|---|
| Broken tracking/stripped UTMs | 50-60% | 170-204 | CRITICAL |
| Legitimate direct (brand search, bookmarks) | 15-20% | 51-68 | MEDIUM |
| Word-of-mouth/offline | 10-15% | 34-51 | MEDIUM |
| Cross-device journeys | 5-10% | 17-34 | LOW |
| Dark social (private shares) | 5-10% | 17-34 | LOW |
The Verdict
85% confidence: Your tracking is broken.
15% confidence: You’ve achieved exceptional product-market fit with viral growth.
The only way to know for sure: Implement the post-signup survey and audit your tracking.
Critical Action Items (Prioritized)
1. DIAGNOSE TRACKING HEALTH (Do This First—1 Hour)
Quick tests:
- Check Google Analytics Real-Time: Sign up yourself, does it appear?
- Inspect signup page source: Is GA/tracking code present?
- Browser console during signup: Any JavaScript errors?
- Compare server logs to analytics: Do visitor counts match?
- Review UTM parameters: Do they persist through entire signup flow?
If ANY test fails → tracking is broken.
2. IMPLEMENT POST-SIGNUP ATTRIBUTION SURVEY (1 Day)
Add a required dropdown on signup confirmation page:
"How did you hear about us?" [Required]
- Google search
- Twitter/X
- LinkedIn
- Friend or colleague referral
- Blog post or article
- Podcast
- Direct (already knew about you)
- Other: [text field]
Why this works:
- Captures 100% of signups (required field)
- Self-reported data isn’t perfect but better than 85% unknown
- Takes 1 day to implement, provides immediate visibility
3. FIX UTM PARAMETER PERSISTENCE (2-3 Days)
Common issue: UTM parameters lost during signup flow.
Solution:
- Capture
utm_source,utm_medium,utm_campaignon first page load - Store in session cookie or localStorage
- Pass through ALL redirects and form submissions
- Write to database with signup record
4. AUDIT YOUR ANALYTICS SETUP (3-5 Days)
Check for common issues:
- GA tracking code on ALL pages (especially signup confirmation)
- Cookie consent banner blocking analytics before user consents
- Single-page app not triggering pageview events
- Ad blockers interfering (test in incognito with no extensions)
- Cross-domain tracking configured (if marketing site ≠ app domain)
- Server-side analytics as backup (doesn’t rely on JavaScript)
30-Day Action Plan
Week 1: Diagnose
- Day 1-2: Run all tracking health tests
- Day 3-5: Implement post-signup survey
- Day 6-7: Interview 10 recent users manually
Week 2: Fix
- Day 8-10: Fix UTM persistence
- Day 11-12: Ensure GA on all pages
- Day 13-14: Implement server-side tracking backup
Week 3: Validate
- Day 15-21: Collect survey data from new signups
- Compare survey responses to GA data
- Identify discrepancies
Week 4: Optimize
- Day 22-28: Use survey data to inform channel strategy
- Double down on channels survey reveals as top performers
- Rebaseline metrics with clean data
Data Quality Assessment
| Metric | Current State | Target | Fix Priority |
|---|---|---|---|
| Attribution coverage | 15% | 85%+ | CRITICAL |
| Conversion tracking | Partial | Complete | CRITICAL |
| Channel granularity | Unknown | Source/medium/campaign | HIGH |
| Multi-touch tracking | None | First + Last touch | MEDIUM |
Current state: UNRELIABLE for decision-making
The Hard Truth
With only 15% attribution coverage, you’re flying blind.
You could be:
- Wasting money on channels that appear to drive zero conversions (but actually drive many)
- Underfunding channels that are your true growth engine
- Celebrating “direct traffic” that’s actually misattributed paid ads
You can’t optimize what you can’t measure.
Fix tracking first. Celebrate success second.
About This Skill
Analyzes marketing channel data to reveal which sources drive conversions (not just traffic), calculates ROI per channel, and provides actionable recommendations for time/budget reallocation.
View Skill DetailsMore Examples
ROI-Based Time Reallocation Analysis
Comprehensive quarterly analysis with revenue data, time investment tracking, and specific reallocation recommendations. Calculates ROI per hour and projects expected impact of reallocation strategy.
Simple Channel Performance Comparison
Basic attribution analysis comparing organic search vs social media with partial conversion data. Demonstrates conversion rate calculations, attribution gap identification, and actionable recommendations.