Content tagged with "evaluation"
A label-free evaluation framework for continual learning harnesses in cybersecurity, using teacher-relative lift as a proxy for uplift against a held-out gold standard.
Four engineering pillars, a maturity checklist, and the concrete artifacts, gates, and numbers behind Sublime's AI safety program.
A 30,000-example open-source benchmark for evaluating natural-language → DSL generation, with a public model leaderboard.
A framework for evaluating earned autonomy in deployed AI systems.
A three-pillar framework — detection accuracy, robustness, and economic cost of coverage — for evaluating LLM-generated detection rules, applied to Sublime's ADÉ agent.
An open-source evaluation framework and three benchmark metrics for measuring LLM-generated cybersecurity detection rules.
A benchmark and three metrics for measuring LLM-generated cybersecurity rules — CAMLIS 2025.