Iterative Multi-stakeholder Project

ABOUT MLGet Involved

ABOUT ML DRAFT IS CURRENTLY CLOSED TO PUBLIC COMMENT

The V0 Draft is now closed to public comment to allow the Steering Committee to integrate comments and for input from the Diverse Voices process. V1 will be released for public comment in early 2020. To discuss topics in the V0 Draft and keep apprised of updates, please visit the ABOUT ML public forum, which is always open.

Read the v0 draft

This Version 0 draft is presented in 5 chapters, 1 supplemental ML primer, and 1 appendix of documentation questions from a selection of research papers. For audience members who do not have a strong background in machine learning, we recommend starting with the Supplement: Primer on ML Lifecycles document for background knowledge and definitions of terms used throughout the version 0 draft.

Chapter 1-5 are the documents for public comment. We welcome all comments, anecdotes about experiences with documentation practices, suggestions for pilots, and beyond. Future drafts will incorporate feedback from the public and the Steering Committee and may include deep dives on other enablers of ML transparency, such as team and institutional setting, ML system-level considerations, test suites, feedback loops. See Process and Timeline for more details.

  1. Supplement: Primer on ML Lifecycles

    High level explanation of portions of the ML lifecycle, including defining machine learning system, describing types of data sets and defining ML model

  2. 1
    Chapter 1: Project Overview

    Provides a statement of importance for the ABOUT ML project as well as more details on the process and timeline

  3. 2
    Chapter 2: Current Recommendations on Documentation for Transparency in the ML Lifecycle

    Currently the bulk of ABOUT ML recommendations. A summary of existing research in the documentation for transparency space, context on why documentation is a process as well as an artifact, and deep dives into documentation questions and considerations for different portions of the ML lifecycle

  4. 3
    Chapter 3: Current Challenges of Implementing Documentation

    Brief summary of existing themes in challenges for implementation. We invite comments here that share any and all challenges experienced in the process of experimenting with documentation for transparency

  5. 4
    Chapter 4: Evaluating Best Practices

    [Currently empty, will be filled in future releases] We invite comments here to share any solutions or practices that have worked for increasing transparency via documentation. Anecdotes, code, process documents or any other formats all welcome.

  6. 5
    Chapter 5: Conclusion

    A brief summary of Chapter 1-4. A new conclusion section will be appended for each ABOUT ML release

  7. Appendix

    Compiled List of Documentation Questions

  8. Download the full draft

Join the public discussion

Submit your proposed changes

We are partnering with PAI Partner UL to offer a collaborative software platform for collecting and viewing submitted public comments. In order to submit your proposed changes for ABOUT ML, you will need to go through a few steps to create on account on the CSDS system and access the document.

Useful links for returning users:

Log in page

Direct link to ABOUT ML project workspace

Short overview video about the CSDS system

Reference video about how to submit comments in the CSDS system

Additional tutorial information about the CSDS system

1

First create an account with UL and accept the user agreement.

2

Once you have created your account and logged in, visit the ABOUT ML workspace page to join the project as a commenter

3

Click “Obtain Proposal Access”

4

Click on the “PAI 999J” link at the top of the page to enter the ABOUT ML project workspace. Alternatively, go directly to this link.

5

To comment, click into the section you want to comment on from the home screen or  navigate to the “Add/View Comments” tab

6

From the “Add/View Comments” tab, click “Add Comment” to open a pop up window where you can add your comment. Note: you are commenting on a specific section of the draft. Please use the left hand menu to select the correct section. You will be able to see other submitted comments in the bottom half of the Add/View Comments tab.

7

Write your comments within the popup window, or attach a file with your comments.  Please double check that you are commenting on your intended section using the “Subject” line at the top. For line edits, please say “Change [X text] to [Y text]” so that it is clear for reviewers.

8

To see the original text of any section, click the icon next to “Supporting Documentation” in the right hand menu. You will see a popup window with all of the sections available and links to download the PDFs.

Submit your proposed changes