Why investing in testing, change governance and observability is essential for operational stability, better employee experience and continuous innovation.
Listen to a short audio summary (6 min)
Are organizations investing sufficiently in testing environments and operational readiness to keep pace with these changes?
Based on my experience in enterprise IT service ownership, I continue to observe gaps in how some organizations invest in and prioritize their development, UAT and pre-production environments. While investments are being made, there is still room to strengthen testing capabilities, particularly as technology changes accelerate and delivery timelines become increasingly demanding.
Investing in testing, monitoring and operational readiness is not simply an additional IT expense. It helps organizations maintain stable services while creating more opportunities to focus on innovation.
Testing Environments Are an Essential Investment
Development, integration, UAT and pre-production environments play an important role in validating changes before they reach production.
These environments should adequately represent critical production configurations, dependencies, security controls and business workflows. They do not necessarily need to replicate every production component, but they should help identify risks relevant to the services being changed.
Testing should also cover appropriate failure scenarios, not just successful outcomes.
Testing environments should also use appropriately protected test data, with production credentials and sensitive information kept out of non-production environments wherever possible.
A change that works in isolation may behave differently when introduced into a complex enterprise environment.
Investing in suitable environments, test automation and skilled resources can help organizations strengthen validation practices and reduce avoidable disruptions.
Align Your Testing Roadmap with Technology Roadmaps
Technology vendors continuously introduce new features, security updates, platform changes and capabilities. Organizations may have limited control over these external release schedules, but they can establish their own approach to testing and deployment.
An organization's testing roadmap should evolve alongside the product and technology roadmaps it depends on.
This involves understanding upcoming changes, assessing dependencies, planning validation activities and allowing sufficient time for testing before broader deployment.
Not every change can be deferred, particularly when urgent security remediation is required. However, appropriate risk-based validation and deployment safeguards should remain part of the process.
Just because a new capability becomes available does not necessarily mean it needs to reach the entire organization immediately.
Pilot groups, phased deployments and clearly defined acceptance criteria can help teams evaluate changes before introducing them to larger user populations.
Change Management Is Evolving, but Validation Remains Essential
Traditional change management practices often relied on documented testing results, risk assessments, implementation plans and approvals before production deployment.
With DevOps, CI/CD and touchless change management, many of these activities can now be integrated into automated delivery pipelines.
Testing evidence, security checks, deployment results and approvals can be captured automatically, helping reduce manual effort while maintaining traceability.
Touchless change management should not mean testing-free change management.
Whether changes are deployed manually or automatically, organizations should maintain appropriate validation, risk-based controls and documented evidence.
The delivery approach may evolve, but the responsibility to protect production services remains.
Connecting Testing, Deployment and Observability
A reliable operating model should connect testing with deployment, monitoring and continuous improvement.
| Stage | Key Considerations |
|---|---|
| Development and UAT | Validate functionality, integrations, security, business workflows and relevant failure scenarios using representative environments and appropriately protected test data. |
| Roadmap and change governance | Align testing with upcoming releases, assess risks, automate quality gates and retain validation evidence. |
| Production deployment | Use pilot groups, phased rollouts, health checks and appropriate rollback or recovery procedures. |
| Monitoring and observability | Monitor service health, performance, dependencies and unexpected behavior through relevant telemetry and alerts. |
| Remediation and improvement | Maintain response procedures, document findings and use production lessons to strengthen future testing. |
These practices become increasingly relevant as organizations introduce AI agents and automation into enterprise workflows.
Beyond functional testing, teams should consider agent permissions, access to enterprise data, connected tools, unexpected actions and mechanisms for human intervention.
These considerations also connect with my earlier article, Who Owns an AI Agent After It Goes Live?
Testing Does Not End at Production Deployment
Even well-designed testing environments cannot reproduce every production condition.
This is where continuous monitoring and observability become essential.
Organizations need appropriate visibility into application and infrastructure health, integrations, performance and unexpected behavior through relevant logs, metrics, traces and alerts.
Equally important are clearly defined service ownership, incident response procedures and remediation capabilities.
Testing results, deployment records, approvals and operational documentation should also be retained to support troubleshooting, audit readiness and continuous improvement.
Production observations should feed back into testing strategies, helping teams address previously unidentified risks and strengthen future validation.
This complements the perspective shared in Observability Is Taking Center Stage
Update — 18 October 2026: When Trusted Applications Become a Security Risk
The recent ConnectWise Cloud Backup (formerly SkyKick) incident highlights an important risk in Microsoft 365 environments: compromised vendor application credentials can provide access to customer tenants without compromising user passwords or triggering user MFA.
Huntress reported unauthorized application sign-ins across 162 tenants as of 16 October 2026. In one investigated tenant, a related application reportedly gained Global Administrator privileges and added credentials to other applications.
The lesson: Third-party application consent is not a one-time approval. Application identities, permissions and credentials require continuous governance, validation and monitoring.
Organizations should review:
- Application access: Identify affected applications by Application ID and follow vendor guidance on disabling them.
- Sign-in activity: Examine service principal sign-in logs, not just user sign-ins.
- Privilege changes: Investigate unexpected credentials, certificates and directory role assignments.
- Log retention: Preserve relevant logs promptly, especially where retention is limited.
This reinforces why testing, change governance and observability must work together, including for vendor-managed integrations and automated services.
References: Huntress Investigation | ConnectWise Trust Advisories
Final Thoughts
As enterprise technology continues to evolve, organizations should periodically reassess whether their investments in testing environments, validation processes and operational readiness remain aligned with their technology ambitions.
Where gaps exist, now is an appropriate time to revisit testing and operational strategies.
Testing roadmaps should evolve alongside product roadmaps, with teams having suitable environments, resources and time to validate changes before introducing them to larger user populations.
While strengthening these capabilities may require additional investment, it can help reduce avoidable production issues, minimize end-user disruption and improve service stability.
A stable IT environment with fewer recurring issues gives teams more time to focus on innovation, improve digital employee experiences and deliver greater business value.
Modernizing technology delivery should not mean rushing changes into production. It should mean enabling innovation with the testing, governance, observability and operational safeguards needed to support it.
Additional Resources — Microsoft Guidance
The perspectives shared in this article are based on my experience in enterprise IT service ownership, change governance and operational readiness. The following Microsoft Azure Well-Architected resources provide additional guidance for cloud workloads, with principles that are also relevant to Microsoft 365, endpoint management and broader enterprise IT operations.
Operational Excellence Design Principles — DevOps practices, operational excellence and reliable delivery.
Architecture Strategies for Testing — Testing strategies, validation and quality assurance.
Architecture Strategies for Designing a Monitoring System — Observability, telemetry and monitoring practices.





















