From Human-First to Agent-First Testing: What a Year of Building Taught Us

Shiplight Cloud is a fully-managed, cloud-based natural language testing platform designed to multiply human productivity. Teams author tests visually, the platform handles execution, and results are managed in the cloud. It continues to serve teams that need managed test authoring and execution. By late 2025, the landscape around us shifted in ways that called for a different product: AI coding agents took off. They generate testing scripts fast, but the output is hard to review and expensive to maintain. The volume of tests grows, but confidence does not. Roles are collapsing. The PM → engineer → QA handoff is dissolving. A single person increasingly defines, builds, and verifies with AI. Quality is no longer a separate phase. Specs are becoming the source of truth. With AI generating code from intent, the canonical representation of product behavior moves upstream from code to structured natural language. In addition to Shiplight Cloud, we built Shiplight Plugins as a new product fo