How do you stop an attacker? By thinking and planning like one! We have a supervised machine learning as a concept, but supervising an AI itself is not deeply thought out. In this chapter, we focus on ongoing controls over the AI solution. We will discuss what does it involve supervising an AI and elaborate mainly the concept of a red team in the context of AI solutions.