In general, bias in an AI system largely results from the data the system is trained on. The model itself “does not come with built-in discrimination, it comes as a blank canvas of sorts that learns from and with you,” said Alan Pelz-Sharpe, founder and principal analyst at Deep Analysis. Yet, many vendors sell pre-trained models as a way to save their clients the time and know-how it normally takes to train a model. That’s ordinarily uncontroversial if the model is used to, say, detect the difference between an invoice and a purchase order, Pelz-Sharpe continued.