Before defining interpretability, we first need to understand why we are even thinking about studying interpretability of ML models? Well in today’s era, Machine learning models are deployed in every sector including health sector, banking, Decision making at Judicial level as well medicine. The decisions in all these sectors are crucial.​