CHAOSS Metrics (Release 201908)

Released metrics are only a subset of metric ideas that are being developed. If you would like to learn more and discuss different metrics please visit the working group repositories. The metrics are sorted into Focus Areas. CHAOSS uses a Goal-Question-Metric format to present metrics. Individual metrics are released based on identified goals and questions. The metrics include a detail page with definitions, objectives, and examples.

Focus Areas by Working Group

Common Metrics WG

Diversity and Inclusion WG

Evolution WG

Risk WG

Value WG

Important Dates for Release 201908

Release Freeze: June 21st, 2019
Candidate Release: June 24th, 2019
Public Comment Period: June 24th, 2019 to July 24th, 2019
Metrics Release Date: August 6th, 2019

Download a PDF of the 201908 Release

Common Metrics

Common Metrics Repository: https://github.com/chaoss/wg-common

Focus Area - Organizational Affiliation

Goal:
Understand organizational engagement with open source projects.

Metric Question
Organizational Diversity What is the organizational diversity of contributions?

Diversity and Inclusion

D&I Repository: https://github.com/chaoss/wg-diversity-inclusion

Focus Area - Event Diversity

Goal:
Identify the diversity and inclusion at events.

Metric Question
Diversity Access Tickets How are Diversity Access Tickets used to support diversity and inclusion for an event?
Code of Conduct at Event How does the Code of Conduct for events support diversity and inclusion?
Family Friendliness How does enabling families to attend together support diversity and inclusion of the event?

Focus Area - Governance

Goal:
Identify how diverse and inclusive our governance is.

Metric Question
Code of Conduct for Project How does the Code of Conduct for the project support diversity and inclusion?

Focus Area - Leadership

Goal:
Identify how healthy our community leadership is.

Metric Question
Mentorship How effective are our mentorship programs at supporting diversity and inclusion in our project?

Evolution

Evolution Repository: https://github.com/chaoss/wg-evolution

Scope: Aspects related to how the source code changes over time, and the mechanisms that the project has to perform and control those changes.

Focus Area - Code Development

Goal:
Activity - Learn about activity involved in changing (or adding) code.
Question: How many changes are happening to the source code, during a certain time period?

Metric Question
Code Changes What changes were made to the source code during a specified period?
Code Changes Lines What is the sum of the number of lines touched (lines added plus lines removed) in all changes to the source code during a certain period?

Question: How many reviews to proposed changes to the source code are happening during a certain time period?

Metric Question
Reviews What new review requests for changes to the source code occurred during a certain period?
Reviews Accepted How many accepted reviews are present in a code change?
Reviews Declined What reviews of code changes ended up declining the change during a certain period?

Question: How many issues related to the source code are happening during a certain time period?

Metric Question
Issues New What are the number of new issues created during a certain period?
Issues Active What is the count of issues that showed activity during a certain period?
Issues Closed What is the count of issues that were closed during a certain period?

Goal:
Efficiency - Learn how effective new code is merged into the code base.
Question: How efficient is the project in reviewing proposed changes to the code, during a certain time period?

Metric Question
Reviews Accepted How many accepted reviews are present in a code change?
Review Duration What is the duration of time between the moment a code review starts and moment it is accepted?

Risk

Risk Repository: https://github.com/chaoss/wg-risk

Focus Area - Business Risk

Goal:
Understand how active a community exists around/to support a given software package.

Metric Question
Elephant Factor What is the distribution of work in the community?
Committers How robust and diverse are the contributors to a community?

Focus Area - Code Quality

Goal:
Understand the quality of a given software package.

Metric Question
Test Coverage How well is the code tested?

Focus Area - Licensing

Goal:
Understand the potential intellectual property(IP) issues associated with a given software package’s use.

Metric Question
License Count How many different licenses are there?
License Coverage How much of the code base has declared licenses?
License Declared What are the declared software package licenses?

Focus Area - Transparency

Goal:
Understand how transparent a given software package is with respect to dependencies, licensing (?), security processes, etc.

Metric Question
Bill of Materials Does the software package have a standard expression of dependencies, licensing, and security-related issues?

Value

Value Repository: https://github.com/chaoss/wg-value

Focus Area - Labor Investment

Goal:
Estimate the labor investment in open source projects.

Metric Question
Labor Investment What was the cost of an organization for its employees to create the counted contributions (e.g., commits, issues, and pull requests)?
Project Velocity What is the development speed for an organization?

Focus Area - Living Wage

Goal:
Expanding opportunities for people to make a living wage in open source.

Metric Question
Organizational Project Skill Demand How many organizations are using this project and could hire me if I become proficient?

CHAOSS contributors include:

Ahmed Zerouali, Akshita Gupta, Alberto Martín, Alberto Pérez García-Plaza, Alexander Serebrenik, Alexandre Courouble, Alolita Sharma, Alvaro del Castillo, Ana Jimenez Santamaria, Andre Klapper, Andrea Gallo, Andy Grunwald, Andy Leak, Aniruddha Karajgi, Anita Sarma, Ankit Lohani, Anna Buhman, Armstrong Foundjem, Atharva Sharma, Ben Lloyd Pearson, Benjamin Copeland, Bingwen Ma, Boris Baldassari, Bram Adams, Brian Proffitt, Camilo Velazquez Rodriguez, Carol Chen, Carter Landis, Chris Clark, Christian Cmehil-Warn, Damien Legay, Daniel German, Daniel Izquierdo Cortazar, David A. Wheeler, David Moreno, David Pose, Dawn Foster, Derek Howard, Don Marti, Drashti, Eleni Constantinou, Emma Irwin, Fil Maj, Gabe Heim, Georg J.P. Link, Gil Yehuda, Harish Pillay, Harshal Mittal, Henri Yandell, Henrik Mitsch, Ildiko Vancsa, Jaice Singer Du Mars, Jason Clark, Javier Luis Cánovas Izquierdo, Jeff McAffer, Jeremiah Foster, Jessica Wilkerson, Jesus M. Gonzalez-Barahona, Jocelyn Matthews, John Mertic, Jon Lawrence, Jonathan Lipps, Jono Bacon, Jordi Cabot, Jose Manrique Lopez de la Fuente, Joshua R. Simmons, Josianne Marsan, Kate Stewart, Keanu Nichols, Kevin Lumbard, Kristof Van Tomme, Lars, Laura Gaetano, Lawrence Hecht, Luis Cañas-Díaz, Luis Villa, Lukasz Gryglicki, Mark Matyas, Matt Germonprez, Matt Snell, Michael Downey, Miguel Ángel Fernández, Mike Wu, Neil Chue Hong, Nicole Huesman, Nishchith K Shetty, Nithya Ruff, Parth Sharma, Peter Monks, Pranjal Aswani, Prodromos Polychroniadis, Quan Zhou, Ray Paik, Remy DeCausemaker, Robert Lincoln Truesdale III, Robert Sanchez, Rupa Dachere, Santiago Dueñas, Sarah Conway, Sean P. Goggins, Shane Curcuru, Sharan Foga, Shreyas, Stefano Zacchiroli, Thom DeCarlo, Tobie Langel, Tom Mens, UTpH, Valerio Cosentino , Venu Vardhan Reddy Tekula, Vicky Janicki, Victor Coisne, Vinod Ahuja, Will Norris, Zibby Keaton

CHAOSS Governing Board members at time of release:

  • Brian Proffitt, Red Hat
  • Daniel M. German, University of Victoria
  • Dawn Foster, Pivotal
  • Don Marti, Mozilla
  • Georg Link, Bitergia
  • Ildikó Vancsa, OpenStack
  • Jesus M. Gonzalez-Barahona, Universidad Rey Juan Carlos
  • Josianne Marsan, Université Laval
  • Matt Germonprez, University of Nebraska at Omaha
  • Ray Paik, GitLab
  • Sean Goggins, University of Missouri
  • Wayne Beaton, Eclipse Foundation
  • Kate Stewart, Linux Foundation

Copyright © 2019 CHAOSS a Linux Foundation® project. All rights reserved. The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our Trademark Usage page. Linux is a registered trademark of Linus Torvalds. Privacy Policy and Terms of Use.