iCreatAI News
Skip to content
Hacker News AI· spaghetti0·· 16 days agoAI score60

Assure – your AI agent says "done." This checks if it's lying

Assure – your AI agent says "done." This checks if it's lying

AI summary

Assure runs an AI agent against a disposable SQLite and file workspace, routing all tool use through a policy-enforcing gateway and judging results with human-written deterministic assertions, with no LLM involved in any verdict. It ships scenarios covering false success, collateral change, prohibited access, tampering and prompt injection, plus benchmark suites (customer-adversarial, customer-hard, customer-long, code-fix, code-long) that report pass rates, pass^k, claim honesty and failure kinds, and it can test any MCP-speaking agent through an adapter. CI runs the full test suite and check-suite on every push, while a manual bench workflow makes paid API calls and fails on significant regressions.

Source: Hacker News AI · github.com