Malware-model reliability
98.0% overall accuracy hid an 85.2% false-negative rate for one malware family.
Aggregate calibration looked excellent. Slice-level evaluation exposed a concentrated failure that the headline metrics missed.
Hi, I'm Tara! I'm a CS student at Stanford interested in security, especially where the security we expect on paper breaks down in practice. Recently, I've been working on malware-model reliability, vulnerability intelligence, enterprise security, and security for autonomous AI systems.
Malware-model reliability
Aggregate calibration looked excellent. Slice-level evaluation exposed a concentrated failure that the headline metrics missed.
CVE enrichment
But its predicted score and severity contradicted each other on 1 in 5 test CVEs. Rare vulnerability types were also much harder to recover.
Government security guidance
Even close security allies differed substantially in what they recommended enterprises prioritize.