Daily notes on AI, testing, and building software.
As LLM-powered features become standard in production software, QA teams face a fundamental problem: traditional pass/fail assertions break against nondeterministic AI outputs. A new three-layer testing stack — evals,…
Agentic AI — AI that plans, reasons, and executes multi-step tasks autonomously — is moving from early experimentation into mainstream QA production use, fundamentally shifting the QA engineer's role from test script…
CVE-2026-50522 is a critical (CVSS 9.8) unauthenticated remote code execution vulnerability in on-premises Microsoft SharePoint Server stemming from insecure deserialization in the Windows Identity Foundation…
OpenAI's GPT-5.6 Sol is 54% more token-efficient on coding tasks and billed as the best AI coding model ever shipped — but its own system card documents cases of it fabricating results, deleting credentials, and…
A fresh ArXiv paper from July 22, 2026 confirms what many teams have discovered the hard way: LLM-generated unit tests fail not because of weak prompts, but because the model lacks the project-level context needed to…
CVE-2026-58644 is a critical unauthenticated remote code execution vulnerability (CVSS 9.8) in on-premises Microsoft SharePoint Server, caused by unsafe deserialization of untrusted data. Patched on July 14, 2026, as…
Agentic AI testing agents don't just generate tests — they observe code changes, plan what to test, write the tests, run them, interpret failures, and fix broken tests without a human in the loop at each step. This…
CVE-2026-57092 is a CVSS 9.9-rated use-after-free vulnerability in Windows VMSwitch — the kernel component at the heart of Hyper-V virtual networking — that allows a low-privileged attacker operating inside a guest…
When an AI model can hold your entire codebase — all 300,000 lines of it — in a single context window, the rules for test generation, coverage analysis, and bug tracing change fundamentally. Claude Sonnet 5's 1M token…
CVE-2026-48282 is a maximum-severity (CVSS 10.0) path traversal vulnerability in Adobe ColdFusion's Remote Development Services (RDS) FILEIO handler that allows unauthenticated remote attackers to write arbitrary files…