Notes From the Field ツ

What are wildcard tables? Wildcard tables provide a concise way to query multiple tables that share a common naming pattern and schema. A wildcard table effectively represents a UNION of all tables matching a specified wildcard expression (e.g., table_prefix*). When you query a wildcard table, BigQuery treats the matching tables as a single logical table. A special pseudo-column, _TABLE_SUFFIX, is automatically included in the query results. This column contains the value matched by the wildcard character for each row, allowing you to identify the source table. ...

Monitoring and observability systems track the performance and reliability of recommender systems in production. They report metrics computed from model inputs, outputs, and customer interactions. These metrics help organisations assess the health and effectiveness of their recommender systems. Failure to adopt a proper monitoring and observability system could negatively impact business operations affecting things like user experience and revenue. I believe there are three main components essential for monitoring a recommender system in production: Metrics, Logging, and Reporting. ...

The promise of generative AI is exaggerated in the short-term and underestimated in the long-term leading to an uncontrollable hype. Naturally, many choose to ride this hype with false advertisement to further their agenda — whether it is to drive up stock prices or to win customers. BBC recently referred this false misrepresentation of the benefits of AI (to businesses) as “AI washing”: It is a problem that has quietly existed for a number of years, according to data from another tech investment firm, MMC Ventures. In a 2019 study it found that 40% of new tech firms that described themselves as “AI start-ups” in fact used virtually no AI at all. ...