CHAOSS Metrics (Release 201908)
Released metrics are only a subset of metric ideas that are being developed. If you would like to learn more and discuss different metrics please visit the working group repositories. The metrics are sorted into Focus Areas. CHAOSS uses a Goal-Question-Metric format to present metrics. Individual metrics are released based on identified goals and questions. The metrics include a detail page with definitions, objectives, and examples.
Focus Areas by Working Group
Common Metrics WG
Diversity and Inclusion WG
Important Dates for Release 201908
Release Freeze: June 21st, 2019
Candidate Release: June 24th, 2019
Public Comment Period: June 24th, 2019 to July 24th, 2019
Metrics Release Date: August 6th, 2019
Diversity and Inclusion
D&I Repository: https://github.com/chaoss/wg-diversity-inclusion
Focus Area - Event Diversity
Identify the diversity and inclusion at events.
|Diversity Access Tickets||How are Diversity Access Tickets used to support diversity and inclusion for an event?|
|Code of Conduct at Event||How does the Code of Conduct for events support diversity and inclusion?|
|Family Friendliness||How does enabling families to attend together support diversity and inclusion of the event?|
Focus Area - Governance
Identify how diverse and inclusive our governance is.
|Code of Conduct for Project||How does the Code of Conduct for the project support diversity and inclusion?|
Focus Area - Leadership
Identify how healthy our community leadership is.
|Mentorship||How effective are our mentorship programs at supporting diversity and inclusion in our project?|
Evolution Repository: https://github.com/chaoss/wg-evolution
Scope: Aspects related to how the source code changes over time, and the mechanisms that the project has to perform and control those changes.
Focus Area - Code Development
Activity - Learn about activity involved in changing (or adding) code.
Question: How many changes are happening to the source code, during a certain time period?
|Code Changes||What changes were made to the source code during a specified period?|
|Code Changes Lines||What is the sum of the number of lines touched (lines added plus lines removed) in all changes to the source code during a certain period?|
Question: How many reviews to proposed changes to the source code are happening during a certain time period?
|Reviews||What new review requests for changes to the source code occurred during a certain period?|
|Reviews Accepted||How many accepted reviews are present in a code change?|
|Reviews Declined||What reviews of code changes ended up declining the change during a certain period?|
Question: How many issues related to the source code are happening during a certain time period?
|Issues New||What are the number of new issues created during a certain period?|
|Issues Active||What is the count of issues that showed activity during a certain period?|
|Issues Closed||What is the count of issues that were closed during a certain period?|
Efficiency - Learn how effective new code is merged into the code base.
Question: How efficient is the project in reviewing proposed changes to the code, during a certain time period?
Risk Repository: https://github.com/chaoss/wg-risk
Focus Area - Business Risk
Understand how active a community exists around/to support a given software package.
|Elephant Factor||What is the distribution of work in the community?|
|Committers||How robust and diverse are the contributors to a community?|
Focus Area - Code Quality
Understand the quality of a given software package.
|Test Coverage||How well is the code tested?|
Focus Area - Licensing
Understand the potential intellectual property(IP) issues associated with a given software package’s use.
|License Count||How many different licenses are there?|
|License Coverage||How much of the code base has declared licenses?|
|License Declared||What are the declared software package licenses?|
Focus Area - Transparency
Understand how transparent a given software package is with respect to dependencies, licensing (?), security processes, etc.
|Bill of Materials||Does the software package have a standard expression of dependencies, licensing, and security-related issues?|
Value Repository: https://github.com/chaoss/wg-value
Focus Area - Labor Investment
Estimate the labor investment in open source projects.
|Labor Investment||What was the cost of an organization for its employees to create the counted contributions (e.g., commits, issues, and pull requests)?|
|Project Velocity||What is the development speed for an organization?|
Focus Area - Living Wage
Expanding opportunities for people to make a living wage in open source.
|Organizational Project Skill Demand||How many organizations are using this project and could hire me if I become proficient?|
CHAOSS contributors include:
Ahmed Zerouali, Akshita Gupta, Alberto Martín, Alberto Pérez García-Plaza, Alexander Serebrenik, Alexandre Courouble, Alolita Sharma, Alvaro del Castillo, Ana Jimenez Santamaria, Andre Klapper, Andrea Gallo, Andy Grunwald, Andy Leak, Aniruddha Karajgi, Anita Sarma, Ankit Lohani, Anna Buhman, Armstrong Foundjem, Atharva Sharma, Ben Lloyd Pearson, Benjamin Copeland, Bingwen Ma, Boris Baldassari, Bram Adams, Brian Proffitt, Camilo Velazquez Rodriguez, Carol Chen, Carter Landis, Chris Clark, Christian Cmehil-Warn, Damien Legay, Daniel German, Daniel Izquierdo Cortazar, David A. Wheeler, David Moreno, David Pose, Dawn Foster, Derek Howard, Don Marti, Drashti, Eleni Constantinou, Emma Irwin, Fil Maj, Gabe Heim, Georg J.P. Link, Gil Yehuda, Harish Pillay, Harshal Mittal, Henri Yandell, Henrik Mitsch, Ildiko Vancsa, Jaice Singer Du Mars, Jason Clark, Javier Luis Cánovas Izquierdo, Jeff McAffer, Jeremiah Foster, Jessica Wilkerson, Jesus M. Gonzalez-Barahona, Jocelyn Matthews, John Mertic, Jon Lawrence, Jonathan Lipps, Jono Bacon, Jordi Cabot, Jose Manrique Lopez de la Fuente, Joshua R. Simmons, Josianne Marsan, Kate Stewart, Keanu Nichols, Kevin Lumbard, Kristof Van Tomme, Lars, Laura Gaetano, Lawrence Hecht, Luis Cañas-Díaz, Luis Villa, Lukasz Gryglicki, Mark Matyas, Matt Germonprez, Matt Snell, Michael Downey, Miguel Ángel Fernández, Mike Wu, Neil Chue Hong, Nicole Huesman, Nishchith K Shetty, Nithya Ruff, Parth Sharma, Peter Monks, Pranjal Aswani, Prodromos Polychroniadis, Quan Zhou, Ray Paik, Remy DeCausemaker, Robert Lincoln Truesdale III, Robert Sanchez, Rupa Dachere, Santiago Dueñas, Sarah Conway, Sean P. Goggins, Shane Curcuru, Sharan Foga, Shreyas, Stefano Zacchiroli, Thom DeCarlo, Tobie Langel, Tom Mens, UTpH, Valerio Cosentino , Venu Vardhan Reddy Tekula, Vicky Janicki, Victor Coisne, Vinod Ahuja, Will Norris, Zibby Keaton
CHAOSS Governing Board members at time of release:
- Brian Proffitt, Red Hat
- Daniel M. German, University of Victoria
- Dawn Foster, Pivotal
- Don Marti, Mozilla
- Georg Link, Bitergia
- Ildikó Vancsa, OpenStack
- Jesus M. Gonzalez-Barahona, Universidad Rey Juan Carlos
- Josianne Marsan, Université Laval
- Matt Germonprez, University of Nebraska at Omaha
- Ray Paik, GitLab
- Sean Goggins, University of Missouri
- Wayne Beaton, Eclipse Foundation
- Kate Stewart, Linux Foundation