Skip to content

ml-test-score.md

Latest commit

 

History

History
14 lines (9 loc) · 980 Bytes

ml-test-score.md

File metadata and controls

14 lines (9 loc) · 980 Bytes
Raw
description How can you test your machine learning system?

ML Test Score

{% embed url="https://youtu.be/SIoYEd7VPDQ" caption="ML Test Score - Testing and Deployment" %}

Summary

  • ML Test Score :  A Rubric for Production Readiness and Technical Debt Reduction  is an exhaustive framework/checklist from practitioners at Google.
  • The paper presents a rubric as a set of 28 actionable tests and offers a scoring system to measure how ready for production a given machine learning system is. These are categorized into 4 sections: (1) data tests, (2) model tests, (3) ML infrastructure tests, and (4) monitoring tests.
  • The scoring system provides a vector for incentivizing ML system developers to achieve stable levels of reliability by providing a clear indicator of readiness and clear guidelines for how to improve.