What Is an ML Threat Model and Why Does Every AI Team Need One?

A threat model maps how someone could attack your system. ML adds attack surfaces that most teams never write down.

Write down where your model, training data and updates come from, and who can touch each one. Most ML teams focus only on adversarial examples. The bigger risks are often boring ones, like loading a model file you didn’t check.

What a threat model is

A threat model is a written map of how someone could attack your system. Software teams have done this for…