An ongoing multistakeholder initiative to enable responsible AI by increasing transparency and accountability with machine learning system documentation.
ABOUT ML (Annotation and Benchmarking on Understanding and Transparency of Machine learning Lifecycles) is a multi-year, multi-stakeholder initiative led by PAI. This initiative aims to bring together a diverse range of perspectives to develop, test, and implement machine learning system documentation practices at scale.
The initiative is an ongoing, iterative process designed to co-evolve with the rapidly advancing field of AI development and deployment. In recognition that documentation is both an artifact and a process, ABOUT ML is structured into an artifact workstream and a process workstream.
Our goal for 2021 is to design testable pilots in a multi stakeholder manner. To make this process more tractable, we’ve broken this into two different workstreams. Each button below leads to a key subtask in this process, and we invite you to share your thoughts, comments, and feedback on any that you are interested in.
Help us solve the challenge of how documentation can be created at scale within an organization.
Comment on and Share your organizational challenges
Join the debate on what information stakeholders deserve to know about ML systems, and how that information should be presented.
Give feedback on deployed examples
Contribute to our database of questions
Implement and scale what works
Thanks for the submission!
The ABOUT ML Steering Committee is comprised of around 30 experts, researchers and practitioners recruited from a diverse set of PAI Partner organizations. The Steering Committee guides the process of updating ABOUT ML drafts based on the public comments submitted and new developments in research and practice. They vote to approve new releases by “rough consensus” commonly used by other multi-stakeholder working groups. They convene 1-3 times a year, depending on the volume of proposed changes and velocity of change of research and practice.
To allow for as many diverse perspectives as possible, PAI limits participation in the Steering Committee to up to 2 people per organization, with 1 vote per organization. As needed, PAI will periodically reopen applications to the Steering Committee and recruit more members.
Himani Agrawal
Data Scientist (AT&T Research Labs); Organizer (Women in Machine Learning and Data Science)
Norberto Andrade
Privacy and Public Policy Manager (Facebook)
Amir Banifatemi
General Manager, Innovation & Growth (XPRIZE)
Rachel Bellamy
Principal Researcher & Manager, Human-AI Collaboration (IBM)
Umang Bhatt
Student Fellow (Leverhulme Centre for the Future of Intelligence)
Jacomo Corbo
Chief Scientist (QuantumBlack)
Daniel First
Associate / Data Scientist (McKinsey / QuantumBlack)
Ben Garfinkel
Research Fellow (Future of Humanity Institute)
Jeremy Gillula
Tech Projects Director (EFF)
Jerremy Holland
Director of AI Research (Apple)
Sara Jordan
Senior Counsel, AI & Ethics (Future of Privacy Forum)
Brenda Leong
Senior Counsel and Director of Strategy (Future of Privacy Forum)
Tyler Liechty
Data Engineer (DeepMind)
Lassana Magassa
Graduate Research Associate (Tech Policy Lab/University of Washington)
Meg Mitchell
AI/ML Researcher
Amanda Navarro
Managing Director (PolicyLink)
Sinead O'Brien
AI/ML Engagement Lead (BBC)
Deborah Raji
Fellow (Mozilla Foundation)
Becca Ricks
Researcher (Mozilla Foundation)
Andrew Selbst
Postdoctoral Scholar (Data & Society)
Ramya Sethuraman
Product Manager (Facebook)
Moninder Singh
Research Staff Member (IBM)
Spandana Singh
Policy Analyst (Open Technology Institute)
Amber Sinha
Senior Programme Manager (Centre for Internet and Society)
Michael Spranger
Senior Research Scientist, AI Collaboration Office (Sony)
Andrew Strait
Associate Director of Research Partnerships (Ada Lovelace Institute)
Hanna Wallach
Senior Principal Researcher (Microsoft)
Adrian Weller
Senior Research Fellow (Leverhulme Centre for the Future of Intelligence)
Abigail Wen
Author & Filmmaker
Alexander Wong
Co-Director, Vision and Image Processing (VIP) Research Group (University of Waterloo)
Jennifer Wortman Vaughan
Senior Principal Researcher (Microsoft)
Andrew Zaldivar
Senior Developer Advocate (Google)
