#cybersecurity

Evaluating Agentic Learning Harness Capabilities Without Labels via the Scaling Hypothesis

2026-08-11 Aryan Luthra, Kshitij Jain, Siddharth Arya, Bobby Filar, Anna Bertiger Conference on Applied Machine Learning in Information Security (CAMLIS) 2025

#LLMs #Evaluation #Cybersecurity

A label-free evaluation framework for continual learning harnesses in cybersecurity, using teacher-relative lift as a proxy for uplift against a held-out gold standard.

View

Evaluating LLM Generated Detection Rules in Cybersecurity

2025-09-20 Anna Bertiger, Bobby Filar, Aryan Luthra, Stefano Meschiari, Aiden Mitchell, Sam Scholten, Vivek Sharath Conference on Applied Machine Learning in Information Security (CAMLIS) 2025

#LLMs #Evaluation #Cybersecurity #Featured

An open-source evaluation framework and three benchmark metrics for measuring LLM-generated cybersecurity detection rules.

View

Evaluating LLM-Generated Detection Rules

2025-09-20

#Evaluation #LLMs #Cybersecurity

A benchmark and three metrics for measuring LLM-generated cybersecurity rules — CAMLIS 2025.

View