The V0 Draft is now closed to public comment to allow the Steering Committee to integrate comments and for input from the Diverse Voices process. V1 will be released for public comment in early 2020.
This Version 0 draft is presented in 5 chapters, 1 supplemental ML primer, and 1 appendix of documentation questions from a selection of research papers. For audience members who do not have a strong background in machine learning, we recommend starting with the Supplement: Primer on ML Lifecycles document for background knowledge and definitions of terms used throughout the version 0 draft.
Chapter 1-5 are the documents for public comment. We welcome all comments, anecdotes about experiences with documentation practices, suggestions for pilots, and beyond. Future drafts will incorporate feedback from the public and the Steering Committee and may include deep dives on other enablers of ML transparency, such as team and institutional setting, ML system-level considerations, test suites, feedback loops.
High level explanation of portions of the ML lifecycle, including defining machine learning system, describing types of data sets and defining ML model
Provides a statement of importance for the ABOUT ML project as well as more details on the process and timeline
Currently the bulk of ABOUT ML recommendations. A summary of existing research in the documentation for transparency space, context on why documentation is a process as well as an artifact, and deep dives into documentation questions and considerations for different portions of the ML lifecycle
Brief summary of existing themes in challenges for implementation. We invite comments here that share any and all challenges experienced in the process of experimenting with documentation for transparency
[Currently empty, will be filled in future releases] We invite comments here to share any solutions or practices that have worked for increasing transparency via documentation. Anecdotes, code, process documents or any other formats all welcome.
A brief summary of Chapter 1-4. A new conclusion section will be appended for each ABOUT ML release
Compiled List of Documentation Questions
We are partnering with PAI Partner UL to offer a collaborative software platform for collecting and viewing submitted public comments. In order to submit your proposed changes for ABOUT ML, you will need to go through a few steps to create on account on the CSDS system and access the document.
Useful links for returning users:
– Log in page
– Direct link to ABOUT ML project workspace
– Short overview video about the CSDS system
– Reference video about how to submit comments in the CSDS system
– Additional tutorial information about the CSDS system
First create an account with UL and accept the user agreement.
Once you have created your account and logged in, visit the ABOUT ML workspace page to join the project as a commenter
Click “Obtain Proposal Access”
Click on the “PAI 999J” link at the top of the page to enter the ABOUT ML project workspace. Alternatively, go directly to this link.
To comment, click into the section you want to comment on from the home screen or navigate to the “Add/View Comments” tab
From the “Add/View Comments” tab, click “Add Comment” to open a pop up window where you can add your comment. Note: you are commenting on a specific section of the draft. Please use the left hand menu to select the correct section. You will be able to see other submitted comments in the bottom half of the Add/View Comments tab.
Write your comments within the popup window, or attach a file with your comments. Please double check that you are commenting on your intended section using the “Subject” line at the top. For line edits, please say “Change [X text] to [Y text]” so that it is clear for reviewers.
To see the original text of any section, click the icon next to “Supporting Documentation” in the right hand menu. You will see a popup window with all of the sections available and links to download the PDFs.