Skip to content
STRATEGY JUN 2026 · 7 MIN read

AI in security: from copilots to agents

What to automate, what never to, and how to measure results without vanity metrics.

TD
Technical direction
Strategy & operations
Service: CISO Virtual →
THE ESSENTIALS

A copilot answers questions; an agent executes work with goals and a log. The operational difference is enormous.

The line never crossed: no agent closes a confirmed incident or executes containment without human authorization.

The honest metric is the shift's outcome, real cases surviving the filter, time to first action, not the count of automations.

For two years the industry sold copilots: assistants that answer questions about an alert. Useful, but the analyst still did the work. The real leap is the agent, software that executes a complete task with a goal, tools and a log of every step.

What to automate first

The rule we use: automate what is repetitive, verifiable and reversible. Volume triage meets all three. Containment that interrupts the business meets none, which is why it stays human.

WHERE OUR SIX AGENTS OPERATE

  • Alert classification and enrichment, repetitive, verifiable against the log.
  • Reconnaissance in offensive exercises, accelerates; the pentester decides and exploits.
  • Detection hypothesis generation, measured against 90 days of history before deploying.
  • Report drafting, the draft is the agent’s, the signature is the analyst’s.

The question is not how much we automate. It’s which decisions we keep reserving for a person with a name.

How to measure without fooling yourself

Vanity metrics abound: “alerts processed by AI”, “hours saved”. Three matter: how many real cases survived the filter (ours: all, audited monthly), time from critical alert to first action (under 15 minutes) and how many business decisions a machine took alone (zero).

If your security provider can’t show you the reasoning log of their automations, you’re not buying AI, you’re buying a black box with marketing on top.

Material like this, every week.

The CERT-CBRT bulletin: what is being exploited in the region and what the shift learns by operating. No marketing.