Any of the three components of a machine-learning system can be hidden, or in a black box. As is often the case, the algorithm is publicly known, which makes putting it in a black box less effective.

Protect AI sells software that allows companies to monitor the various layers and components of machine learning systems, detecting potential violations and logging information on those attacks.