Quality of an AI model?

What should a consumer expect from an AI model in terms of quality?

The standard rule when selling products to consumers is that you have to live up to the promises made. To some extent, this also applies to both a software product and a model, although the rules are currently a lot less strict than for physical products. So, pay attention to what you promise about the product.

Furthermore, you may have to remind customers of the limitations of your product. If a Tesla drives in Autopilot, for which Tesla states on its website that the driver must remain active, the driver must keep his hand on the wheel. Failure to do so will disable Autopilot. The court ruled in 2018 that a Tesla's Autopilot was not the actual driver of the car. However, this ruling could have turned out differently if the Tesla did not have a system to check whether the driver was still alert and, if not, to disable Autopilot.