Install
Testing & Quality
Unit/integration tests, fuzzing, reliability, and observability for apps.
- 23 Tracked terms
- Last 30 days Feed window
What this topic collects on
An article joins this feed when it matches these terms. Each one is also a search of its own.
Related topics
Latest in Testing & Quality
meu primeiro teste: LuizaLabs
16+ min ago (400+ words) Resolvi voltar a esse projeto agora e documentar aqui a lógica que usei e as decisões que tomei na época, tanto como registro pessoal dessa fase quanto para quem estiver enfrentando um desafio parecido hoje. 🔗 Repositório no GitHub Na época,…...
Ollama's Responses API accepts previous_response_id, returns 200, and forgets the whole conversation
13+ min ago (538+ words) Ollama 0.34.0, Debian 13, CPU only, qwen2.5:1.5b. The Responses API, which is the OpenAI-compatible endpoint Codex and similar clients use. Turn 1 plants something the model could not guess: password. Now two controls. The same question with the full history sent in the request…...
My Harness Used One Label for Three Different Failures.
6+ min ago (1083+ words) Three fixtures, three separate calls into the same reducer. Here is the complete failure_reasons each one returned, unedited: These are minimal fixtures with no sandbox event and no tool response, so the first and last codes fire in all three and…...
Playwright email verification can pass for the wrong reason: six checks for a trustworthy test
1+ hour ago (575+ words) We deliberately made an email-verification test finish on the wrong account. The page said Email verified. Playwright passed. Then we added an assertion for which account had been verified. The same scenario failed. This was a controlled browser experiment with…...
The Workflow Ran With Four Personas Instead of Five and Looked Fine
1+ hour, 6+ min ago (504+ words) I run Claude Code as five separate subagents with different permissions — architect, coder, reviewer, conflict resolver, UI designer. One of them stopped loading. The symptom has the shape of not working well. The cause was not being there. Five conditions…...
AI Model Evaluation: Best Practices for Testing and Validation
1+ hour, 52+ min ago (19+ words) Evaluating AI models is... Tagged with ai, evaluation, machinelearning, testing....
Cutting PR review time is really changing where review happens
2+ hour, 6+ min ago (248+ words) Atlassian reports its Rovo Dev AI reviewer cut PR cycle time by up to 45% internally and 32% for customers (primary source, Jan 2026). That figure gets quoted as proof that AI review saves review time. Read what the reviewer is described as…...
Two "Codex CLI" models on the same benchmark: the harness hides the model
2+ hour, 6+ min ago (260+ words) Specific Labs dropped Real-SWE, an enterprise-code SWE benchmark, and the leaderboard is a great study in why you should never read "Claude Code" or "Codex CLI" as a model name. Same harness, two different brains: Same vendor's CLI, same harness,…...
My Scanner Passed Until I Built a Harness That Lied to It on Purpose
2+ hour, 20+ min ago (271+ words) Every security tool has a dirty secret: nobody tests whether the detector detects. The tests pass, the CI is green, and everyone moves on. Today I pointed my own scanner, mcpscan, at a set of synthetic attack files I wrote…...
# The Suspiciously Round Number That Stopped Me Cold
2+ hour, 52+ min ago (232+ words) I was pulling data from SAP through an OData API — every Internal Order from 2020 to today. The response came back with exactly 1000 rows. Not 987, not 1214. A clean, round 1000. Was I happy? No. I got suspicious. In data work, a number…...