Notes From the Field ツ

Monitoring and observability systems track the performance and reliability of recommender systems in production. They report metrics computed from model inputs, outputs, and customer interactions. These metrics help organisations assess the health and effectiveness of their recommender systems. Failure to adopt a proper monitoring and observability system could negatively impact business operations affecting things like user experience and revenue. I believe there are three main components essential for monitoring a recommender system in production: Metrics, Logging, and Reporting. ...

The promise of generative AI is exaggerated in the short-term and underestimated in the long-term leading to an uncontrollable hype. Naturally, many choose to ride this hype with false advertisement to further their agenda — whether it is to drive up stock prices or to win customers. BBC recently referred this false misrepresentation of the benefits of AI (to businesses) as “AI washing”: It is a problem that has quietly existed for a number of years, according to data from another tech investment firm, MMC Ventures. In a 2019 study it found that 40% of new tech firms that described themselves as “AI start-ups” in fact used virtually no AI at all. ...