-
Step 1: Define the decision and baseline
What to do: State what decision the model must support, then document the base assumptions and period. For the rental property example, the basis is a €620.0K Year 1 entry value and a 10-year hold.
What success looks like: Every scenario can be compared against one clearly named baseline.
Common mistake to avoid: Do not change the baseline and the stress assumptions at the same time without recording which variable caused the difference.
-
Step 2: Gather and normalize source data
What to do: Bring together source files and standardize field names, observation dates, units, currencies, and missing-value treatment. Macro examples use fields including observation_date, Inflation_YoY, FEDFUNDS, UNRATE, DGS10, and GDP_YoY.
What success looks like: Each input has a known definition, unit, date, and source.
Common mistake to avoid: Do not combine monthly and annual observations without making the frequency transformation explicit.
-
Step 3: Create controlled scenarios
What to do: Create a small set of interpretable cases, such as Baseline, Rate Shock at plus 200 basis points, and Stagflation. For construction, compare front-loaded infrastructure with staged development; for retail, compare discount buckets.
What success looks like: Each scenario has a short name, a precise input change, and a rationale.
Common mistake to avoid: Avoid vague labels such as “bad case” when the actual assumption change can be stated numerically.
-
Step 4: Calculate decision thresholds
What to do: Select metrics that describe both performance and failure. Examples include DSCR against the 1.0x threshold, break-even occupancy, cumulative cash flow, operating coverage against 1.0x, annualized volatility, maximum drawdown, margin, and regression R².
What success looks like: The analysis shows exactly when an outcome crosses from acceptable to unacceptable.
Common mistake to avoid: Do not report a favorable return without also reporting volatility, drawdown, coverage, or downside duration where relevant.
-
Step 5: Visualize paths, relationships, and breakpoints
What to do: Use scenario scorecards, time-series paths, heatmaps, scatter plots, correlation trackers, and allocation or margin tables. A path view reveals whether a deficit reverses, compounds, or recovers only near the end of the horizon.
What success looks like: A reviewer can identify the highest-risk period and the variable driving it without rebuilding the model.
Common mistake to avoid: Do not hide a threshold breach in an aggregate average.
-
Step 6: Test model reliability outside the training regime
What to do: Compare calm periods with crisis or post-2020 regimes, inspect residuals, test lagged specifications, and difference trending variables when appropriate. The supplied diagnostics show levels R² of 98.1% falling to 19.0% after differencing, while removing lookahead reduces R² by 61.3 percentage points.
What success looks like: The model’s strengths and failure conditions are visible rather than implied by one impressive fit statistic.
Common mistake to avoid: Never treat in-sample fit as proof that the relationship will hold after a regime change.
-
Step 7: Preserve the audit trail and decision record
What to do: Store source references, assumptions, transformations, outputs, exceptions, and reviewer notes with the final report. An independent AI auditor can recompute, trace, and cross-check numbers in spreadsheets, PDFs, CAD, scans, and other supported files.
What success looks like: A stakeholder can move from a reported result to the evidence used to produce it.
Common mistake to avoid: Do not distribute a polished chart without retaining the underlying calculation and source context.