Model change releases
Record when the old model can be retired
Keeping a previous configuration available supports recovery, but it also creates maintenance and data-handling obligations. Give it an explicit retirement condition.
In this article
Identify what still depends on it
List active conversations, paused workflows, evaluation baselines and fallback routes that reference the previous configuration. Completed historical reports may only need retained metadata and outputs, while paused tasks may still require compatible execution.
Check whether the old endpoint has an announced lifecycle or configuration limit using the provider's current documentation. Do not rely on an assumed indefinite rollback window.
Keep the model dependency separate from workflow code. Some saved operations can finish without another model call, while others require the original prompt and tool contract to continue meaningfully.
Define the observation window
Agree what evidence is needed before removing the prior route: representative task coverage, acceptable production outcomes and resolution of material regressions. A calendar date alone may be insufficient if important workloads have not occurred during the window.
Name who can extend the window and why. Keeping every previous configuration forever creates operational clutter and can leave unused credentials or data paths active.
Document the fallback after retirement. It may be another tested configuration, a restricted capability or a manual process. Do not leave support expecting a rollback that no longer exists.
Transfer the release evidence
Keep the manifest, paired evaluation results and known limitations in a maintained location. Explain which cases drove the decision and which behaviours require ongoing monitoring.
Give operators a way to identify the configuration behind a user report. Include the procedure for containing a regression and reconciling in-flight mutations.
Have the receiving team perform a restoration rehearsal during the valid window. This confirms the documented prior route is executable and that the team understands its compatibility limits.
Retire with a dependency check
Before disabling the old endpoint or removing credentials, confirm no supported run or fallback still needs it. Resolve long-paused tasks through the agreed migration or closure process.
Preserve historical release records according to their retention rules, without retaining unnecessary sensitive payloads. Record the retirement date and the replacement recovery path. The handover is complete when support knows both how to restore behaviour now and what will change once the old configuration is no longer available.
Primary sources
Microsoft Learn: evaluation and observabilityOWASP: logging guidanceReferences checked 11 September 2026.