Vibe-Coded Infrastructure Is Still Infrastructure

Observability Courtney Gannon

Key takeaways

  1. AI-generated infrastructure changes can look valid on paper but still introduce hidden costs, security risks, or dependencies no one is ready to support.
  2. Setting up monitoring and performance baselines before deploying changes lets teams compare before-and-after behavior instead of just trusting generated code.
  3. Clear policies, testing, defined ownership, and runtime safety guardrails help teams catch risky AI-generated changes before they cause real production problems.

I recently saw a social media post arguing that vibe-coding infrastructure creates more operational debt than it saves. That concern is real, but the outcome is not inevitable. When AI generates application code, a failure may first show up in a test or a poor user experience. When it generates infrastructure, the impact can spread across shared systems and become a production incident.

Platform and infrastructure teams are already feeling that shift. If developers can generate changes quickly but no one owns how those changes behave in production, delivery speed turns into operational debt.

The Debt Is Unowned Change

The problem is not that every AI-generated infrastructure change is bad. AI can help teams move faster when experienced engineers review the work, standards are clear, changes are tested, and ownership is explicit.

The problem comes when infrastructure is treated as an implementation detail instead of part of the production system. Generated Terraform can be valid and still introduce unnecessary cost, public exposure, weak resilience, or dependencies no one is prepared to support. A clean diff shows what someone intended to change; it does not prove the deployed system is safe or suitable.

Static Review Cannot Show Runtime Behavior

A pull request is evidence of intent. It cannot show by itself how a deployed system will behave under real traffic or how a change will affect its dependencies.

Useful controls include reviewing the rendered plan, enforcing policy as code, testing changes in representative environments, and making ownership clear. These controls focus on the risks and outcomes of a change, regardless of whether a person or an AI tool wrote it.

Smaller organizations may not have a dedicated infrastructure team or capacity for another approval layer. They can still protect critical paths, provide reusable templates, require meaningful tests, and name an owner for each change.

Build the Evidence Pipeline Before Deployment

Before changing a service or infrastructure path, decide how the team will know whether it is healthy. Establish a reference point with the signals that matter: SLOs, dependency health, latency, errors, resource consumption, deployment markers, and relevant logs and traces. That gives the team a way to compare behavior before and after a release.

For AI-backed applications, include signals about the agent as well as its supporting systems. Track workflow latency and errors, model and tool calls, output quality, token usage, estimated cost, and relevant security risks. A shared view of these signals helps teams investigate whether a change improved the system or introduced a new problem.

Splunk Observability Studio (ObStudio) helps developers work with OpenTelemetry data during development. It provides a local workspace to receive and explore traces, metrics, and logs, and to validate telemetry and instrumentation before teams rely on it in production. Splunk Observability Cloud can then help teams monitor service and infrastructure behavior after deployment. Agent Observability adds visibility into agent workflows, evaluations, cost, and security signals alongside the infrastructure those workflows depend on.

Guardrails Should Reduce Toil, Not Move It

Good guardrails prevent predictable failures and give teams evidence to act when behavior changes. For infrastructure, that means policy checks, reviewable plans, representative tests, and clear ownership. For AI agents, it also means looking beyond uptime and latency: teams need to understand output quality, security risks, and resource use across the agent, model, and infrastructure.

Because agent behavior can vary from one interaction to the next, evaluate it continuously from development through production. Measure whether tasks succeed and watch for hallucinations, bias, harmful content, prompt injection, data leakage, and misuse of tools. When an evaluation identifies a risk, runtime guardrails can block or redirect the proposed action before a tool runs or an unsafe response reaches a user.

A useful operating model includes:

Observability and enforcement work together. Guardrails can block or steer risky actions; telemetry and traceable decisions help teams understand what happened, why a control acted, and whether the change affected quality, reliability, or cost. That shared evidence helps infrastructure, security, and AI teams respond from the same picture instead of reconstructing the incident from scattered systems.

The DevOps Response Is Not To Become the Cleanup Crew

The answer to AI-generated infrastructure is not necessarily a blanket ban. It is a clearer contract:

This is how DevOps helps teams move faster without pushing failure downstream. The goal is not to read every generated line forever. It is to make systems observable, alert on meaningful changes, and give the right people enough context to solve problems quickly.

Turn Every Change Into a Feedback Loop

Vibe coding becomes operational debt when teams measure only how quickly changes are produced. It becomes useful when changes are tested, observed, owned, and used to improve the next change.

That feedback loop starts during development. Use ObStudio to inspect the OpenTelemetry data your service emits and validate that the signals needed for troubleshooting are present and useful. This helps catch instrumentation gaps before a production incident depends on telemetry that was never collected.

After deployment, use Splunk Observability Cloud to compare service and infrastructure behavior against the baseline. For agentic applications, Agent Observability can add workflow traces, model and tool activity, quality evaluations, token use, and security signals. Seeing those signals in context helps teams investigate whether a failure began in the agent, a model or tool call, or the infrastructure underneath.

You can try this workflow with one AI-assisted service or infrastructure path. Start with ObStudio to validate the telemetry during development, then use Splunk Observability Cloud Free Edition to explore the service’s behavior after deployment. The Free Edition supports up to 15 hosts and includes Agent Observability, so teams can follow agent workflows and the infrastructure and services they depend on as they move from experimentation toward production.

The most important question is not whether AI generated the infrastructure. It is whether the organization can explain the system, operate it confidently, and recover when reality differs from the prompt.

Try It Now

Try Splunk Observability Studio to validate your OpenTelemetry data during development. Then get started with Splunk Observability Cloud Free Edition to explore service, infrastructure, and agent behavior with your own data.

Related Articles

Deploy, Test, Monitor: Mastering Microsoft AppLocker, Part 1
Security
11 Minute Read

Deploy, Test, Monitor: Mastering Microsoft AppLocker, Part 1

The Splunk Threat Research Team provides a comprehensive overview of AppLocker and guidance for getting started with AppLocker policies
Splunk Named a Leader in the 2022 IDC MarketScape for SIEM
Security
2 Minute Read

Splunk Named a Leader in the 2022 IDC MarketScape for SIEM

See why Splunk earned a spot in the 'Leaders' category in the 2022 IDC MarketScape for worldwide SIEM software.
High(er) Fidelity Software Supply Chain Attack Detection
Security
4 Minute Read

High(er) Fidelity Software Supply Chain Attack Detection

Software supply chain attacks are not going away. As our network defenses improve, adversaries must move up the chain to stay a step ahead of our defenses.