Use a funnel model to choose commercial experiments
An education business combined practitioner benchmarks, its own funnel data, and AI-assisted brainstorming to explore pricing and offer changes before testing them.
How this works
An education business combined practitioner benchmarks, its own funnel data, and AI-assisted brainstorming to explore pricing and offer changes before testing them. A simple funnel model makes a commercial hypothesis explicit before customers or budgets are exposed to it. Its value is in revealing assumptions and measurement gaps, not in making simulated improvements appear inevitable.
Reconcile a baseline from observed cohorts, then vary a small number of assumptions in a transparent spreadsheet or script. Keep revenue, refunds, variable costs, acquisition spend, and contribution separate. Use benchmarks as contextual ranges only after checking comparability.
Before you start
Cohort definition
Define the customer journey, acquisition period, conversion maturity, and payment recognition basis.
Reliable records
Obtain compatible funnel counts, payment events, refunds, and cost data with clear units.
Experiment owner
Identify who can approve customer-facing terms and any spend; modeling itself remains reversible local work.
Prepare the inputs
- funnel_counts
- Required
Cohort table
Record stage definitions, unique-user counts, period, and missing events.
- payments_costs
- Required
Ledger or export
Separate gross receipts, refunds, variable delivery costs, and acquisition costs.
- benchmarks
- Required
Evidence notes
Include business model, market, period, source, and comparability limitations.
- hypotheses
- Required
Human-authored list
State the proposed offer or journey change and expected mechanism.
- optional_constraints
- Optional / conditional
Rules
Include capacity, pricing restrictions, customer commitments, and authorized test bounds.
Implementation, step by step
Reconstruct the baseline
- Map journey stages and join compatible cohorts without mixing acquisition and payment periods.
- Check duplicate transactions, delayed payments, refunds, and missing cost categories.
Checkpoint: The model reconciles to observed totals or shows an explicit unresolved difference.
Calculate unit economics
- Use deterministic formulas for conversion, net receipts, cost per acquired customer, and contribution.
- Document whether each denominator is a lead, buyer, paid order, or retained customer.
Checkpoint: Each displayed metric has a reproducible formula and unit.
Assess benchmark relevance
- Compare only benchmarks with compatible offers, stages, and maturity.
- Use broad ranges when context differs and label unavailable evidence.
Checkpoint: External figures do not silently replace observed company data.
Expand hypotheses
- Ask the assistant to identify mechanisms, dependencies, and likely tradeoffs in the human proposals.
- Separate changing price, conversion, retention, and fulfillment cost rather than assuming they all improve.
Checkpoint: Each experiment changes a defined part of the model.
Simulate scenarios
- Build downside, base, and upside assumptions with visible inputs.
- Compute sensitivity to the uncertain variables and identify break-even conditions.
Checkpoint: The reader can distinguish observations from assumed future values.
Design the real test
- Select a bounded hypothesis and define instrumentation, customer-facing terms, success, and stop rules.
- After an authorized test, reconcile actual results to the predicted cohort and document model errors.
Checkpoint: The next decision depends on measured outcomes rather than the simulation alone.
Decisions along the way
A cost category is unknown
Show contribution as incomplete and use a labeled sensitivity range.
A price increase could reduce conversion
Model both variables jointly instead of holding demand unrealistically fixed.
A benchmark uses a different funnel stage
Retain it as context or exclude it from the numerical comparison.
What you will produce
Funnel model
Spreadsheet or reproducible scriptA transparent model of the current journey and proposed changes.
Include: baseline · formulas · assumptions · scenarios · sensitivity
Experiment brief
DocumentA bounded test proposal with explicit authorization requirements.
Include: hypothesis · mechanism · measurement · customer_terms · success · stop
Check the result
- Counts and payment amounts use compatible cohorts.
- Refunds and delivery costs are not hidden in a revenue-only success claim.
- Assumed rates are visibly distinguished from measured ones.
- Calculations can be reproduced without relying on the assistant's arithmetic.
When something goes wrong
Model totals do not match the ledger
Reconcile filters and timing before prioritizing experiments.
Projected gains require several unsupported improvements
Present the assumptions separately and narrow the first test.
Payment outcomes are immature
Delay final comparison and label provisional results.
A worked example
SYNTHETIC EXAMPLE · NOT A REPORTED BUSINESS RESULT
Request
Compare a pricing hypothesis for a short online course.
Inputs
Synthetic example. A mature cohort has 1,000 leads, 50 buyers, price 100, refunds 500, delivery cost 1,000, and acquisition spend 2,000. A proposed price is 110 with 45 buyers assumed.
Expected result
Synthetic expected result. Baseline contribution is 5,000 minus 500 minus 1,000 minus 2,000, or 1,500. The scenario separately states refund and cost assumptions; it does not treat 4,950 gross receipts as profit. The test brief checks whether the assumed demand change actually occurs.
Run a small pilot
Start small
One complete cohort and one price or funnel hypothesis.
Record the baseline
Measure baseline reconciliation error and current experiment-planning time.
Agree success criteria
Track prediction error, missing assumptions discovered, and measured contribution after testing.
Stop or revise
Stop using the model for decisions if cohort totals or material costs remain unreliable.
Keep the scope clear
- A simulation is planning support, not financial advice or a guaranteed outcome.
- Do not alter prices, charge customers, or spend advertising funds without authorization.
Check before using
Verify payment events, refunds, and customer-facing terms. Simulated economics and external benchmarks do not establish that an experiment will work.
Business activities
- Run advertising and acquisition tests
- Manage finances and accounting
- Plan products and business changes
FROM A RECIPE TO YOUR WORKFLOW
Bring the company context together.
This workflow needs reliable inputs before it needs a better prompt. Moat8 Vault brings working information into a readable archive for the AI tools you use.
For this recipe: Observed funnel conversion and payment data · Comparable business benchmarks · Human-written hypotheses
Start with one recurring task, agree which sources to use, and review the first result with your team.
Discuss this workflow