PlaysbyMoat8
Back to the library
The workflow guideManagement

Classify delivered engineering work by business theme

Group merged changes into evidence-backed themes for a portfolio discussion without treating code counts as productivity.

5 implementation stepsIntermediate

How this works

Use this when leaders need to understand the kinds of work delivered across many repositories without reading every merged change. AI groups the records into themes such as reliability, customer-facing capabilities and internal maintenance, then links each theme back to evidence.

The map describes observed change records, not employee performance or hours spent. Pull requests differ dramatically in size and meaning; a large change count can reflect workflow conventions. Keep counts clearly labelled and avoid translating them into effort percentages unless independently measured effort data exists.

Before you start

Review scope

Choose repositories, merge-date window and inclusion rules for bots, backports and dependency updates.

Theme definitions

Provide initiative definitions where available and allow an explicit unclassified category for ambiguous records.

Prepare the inputs

merged_changes
Required

PR export with stable IDs

Include title, description, merge time, repository and relevant issue references.

taxonomy
Optional / conditional

Versioned theme definitions

If absent, generate provisional themes for owner review rather than asserting strategic intent.

initiative_links
Optional / conditional

Issue or planning references

Treat links as evidence; do not infer business priority from an author’s identity.

Implementation, step by step

  1. Build the scoped dataset

    • Retrieve merged records through authorized tools or use a local export. Record the query, window and any repositories without access.
    • Exclude unmerged drafts and reconcile duplicates, backports and automated updates according to the agreed rules. Preserve excluded counts and reasons.

    Checkpoint: The dataset has a clear denominator and reproducible inclusion criteria.

  2. Extract change meaning

    • Summarize each record’s stated purpose using its description and linked issue where available. Avoid reading unrelated source code or private discussions beyond scope.
    • Separate explicit intent from an inferred theme. Mark titles such as fix or cleanup as insufficient evidence when no detail supports classification.

    Checkpoint: Each change has a short evidence-based description or an information gap.

  3. Propose themes

    • Map clear records to the approved taxonomy. Where discovery is needed, cluster semantically similar descriptions and propose plain-language labels.
    • Allow multiple relevant tags while defining one primary theme only if required for totals. Keep ambiguous records unclassified instead of forcing a neat distribution.

    Checkpoint: Every proposed theme includes representative evidence and its classification rule.

  4. Validate the interpretation

    • Ask engineering and product owners to review boundary cases and a sample of apparently clear assignments. Apply corrections consistently across similar records.
    • Check whether a theme represents delivered functionality, maintenance or a planning label. Do not report a whole initiative complete because one related change merged.

    Checkpoint: The theme map reflects reviewed classifications and visible uncertainty.

  5. Produce the portfolio view

    • Export themes, counts of records, representative changes and unresolved gaps. Explain the denominator and whether multi-tag totals can overlap.
    • Compare periods only when inclusion rules are consistent. Return a reproducible table and a short narrative of observed delivery patterns without ranking individuals.

    Checkpoint: The review can trace each theme to actual records and understand the limits.

Decisions along the way

A change spans several themes

Use explicit multiple tags or a reviewed primary theme; disclose the counting convention.

Only vague titles are available

Leave the record unclassified and request context instead of inventing a business rationale.

What you will produce

delivered-work-themes.csv

CSV

A traceable classification register.

Include: change_id · repository · merge_date · theme · evidence · inference · review_status

delivery-theme-review.md

Markdown

A portfolio discussion brief with metric limitations.

Include: scope · counts · representative_changes · gaps · interpretation

Check the result

  • Reconcile included, excluded and unclassified records.
  • Verify sample assignments against original descriptions.
  • Check no count is labelled as hours, impact or individual productivity.

When something goes wrong

Repository access is incomplete

Label the view partial and avoid organization-wide conclusions.

Taxonomy changed between periods

Remap both periods or refrain from direct trend comparisons.

A worked example

SYNTHETIC EXAMPLE · NOT A REPORTED BUSINESS RESULT

Request

Synthetic: review eight merged changes.

Inputs

Three describe billing features, two reliability fixes, one documentation update and two have no usable description.

Expected result

Report those observed record counts and two unclassified items. Do not claim billing consumed 37.5 percent of engineering effort.

Run a small pilot

Start small

Pilot one team and one recent review period.

Record the baseline

Measure manual classification time and owner correction rates.

Agree success criteria

Require evidence coverage and stable agreement on theme definitions.

Stop or revise

Stop quantitative comparisons when inclusion rules or source coverage differ materially.

Keep the scope clear

  • Never use this output to rank employees or infer individual effort from code activity.
  • Merged changes do not prove customer adoption, business impact or completed strategic outcomes.

Check before using

Engineering and product owners confirm themes and interpretation.

Business activities

  • Review business performance
  • Build and change software

Editorially adapted workflow; not independently tested.

FROM A RECIPE TO YOUR WORKFLOW

Bring the company context together.

This workflow needs reliable inputs before it needs a better prompt. Moat8 Vault brings working information into a readable archive for the AI tools you use.

For this recipe: Merged change records · Initiative taxonomy · Review period · Optional issue links

Start with one recurring task, agree which sources to use, and review the first result with your team.

Discuss this workflow

What does your team do?

Choose the recurring work you would like to improve.

A field guide, made for work.

Plays is a curated library of anonymized business workflows. Each recipe explains the inputs, steps, tools, and checks you can adapt to your team. These are editorial guides, not independently tested implementations.

When you share a company website, the guide may read a limited number of public pages on that website. Messages and retrieved page text are sent to our AI provider, NVIDIA, to recommend relevant workflows. Share a general description rather than confidential information.

Saved workflows and selected activities stay in this browser. Your chat history and selected company website are kept in this tab and cleared when you reload or start a new chat. The server does not store conversations. Live source monitoring is not enabled.

If you allow analytics, PostHog receives page views and actions such as workflow saves, skill downloads and link clicks. Random browser and session identifiers connect these actions without identifying you by name. Your choice and browser identifier expire after 90 days; sessions restart after 30 minutes of inactivity or 24 hours. We use local storage, not analytics cookies. Messages, company URLs, search text, full referrers and IP addresses are not sent. There are no person profiles or session recordings. You can decline or withdraw in Analytics settings; Do Not Track and Global Privacy Control keep analytics off.

Read the Plays Privacy Notice ↗