CHAOSS Metrics

CHAOSS metrics are identified and defined using a continuous contribution process. The metrics are officially released biannually following a 30 day comment period. To contribute to the release or comment on metrics under review, please follow the links provided in the working group tables located below.

To obtain a pdf copy of previous releases or see what is new in this release please visit the Release History.

To make suggestions or edits to this webpage please visit the website repo and open an issue or create a pull request.


Metrics on this page were debated in working groups and undergo a 30 day comment period to ensure validity. Released metrics are only a subset of many possible metrics. CHAOSS acknowledges that more metrics exist and is working to identify and release new metrics in the future. If you would like to learn more about metrics, suggest new metrics, and or help define metrics please visit our participate page.

The CHAOSS project recognizes that there are ethical and legal challenges when using the metrics and software provided by the CHAOSS community. Ethical challenges exist around protecting community members and empowering them with their personal information. Legal challenges exist around GDPR and similar laws or regulations that protect personal information of community members. Particular challenges may arise in the use that is specific to your context.

Focus Areas by Working Group

CHAOSS metrics are sorted into Focus Areas. CHAOSS uses a Goal-Question-Metric format to present metrics. Individual metrics are released based on identified goals and questions. The metrics include a detail page with definitions, objectives, and examples.

Dates for Release 2022-04

Release Freeze: March 1st, 2022
Public Comment Period: March 1st, 2022 to March 31th, 2022
Metrics Release Date: First week of April 2022

Tentative Dates for Next Release 2022-10

Release Freeze: September 1st, 2022
Public Comment Period: September 1st, 2022 to September 30th, 2022
Metrics Release Date: First week of October 2022

Common Metrics

Common Metrics Repository:

Focus Area - Contributions

Understand what contributions from organizations and people are being made.

Metric/DetailsQuestionProvide Feedback
ClonesHow many copies of an open source project repository have been saved on a local machine?
Occasional ContributorsHow do we understand the number of occasional contributors and the contributions that they make?
Programming Language DistributionWhat are the different programming languages present in an open source project(s), and what is the percentage of each language?
Technical ForkWhat are a number of technical forks of an open source project on code development platforms?
Types of ContributionsWhat types of contributions are being made?

Focus Area - Time

Understand when contributions from organizations and people are happening.

Metric/DetailsQuestionProvide Feedback
Activity Dates and TimesWhat are the dates and timestamps of when contributor activities occur?
BurstinessHow are short timeframes of intense activity, followed by a corresponding return to a typical pattern of activity, observed in a project?
Review Cycle Duration within a Change RequestWhat is the duration of a review cycle within a single change request?
Time to First ResponseHow much time passes between when an activity requiring attention is created and the first response?
Time to CloseHow much time passes between creating and closing an operation such as an issue, review, or support ticket?

Focus Area - People

Understand organizational and personal engagement with open source projects.

Metric/DetailsQuestionProvide Feedback
Bot ActivityWhat is the volume of automated bot activity?
ContributorsWho are the contributors to a project?
Contributor LocationWhat is the location of contributors?
Organizational DiversityWhat is the organizational diversity of contributions?

Focus Area - Place

Goal Identify where contributions occur in terms of physical and virtual places (e.g., GitHub, Chat Channel, Forum, conferences)

Metric/DetailsQuestionProvide Feedback
Collaboration Platform ActivityWhat is the count of activities across digital collaboration platforms used by a project?
Event LocationsWhere are open source project events located?

Diversity, Equity, & Inclusion

DEI Repository:

Focus Area - Event Diversity

Goal: Identify the diversity, equity, and inclusion aspects at events.

Metric/DetailsQuestionProvide Feedback
Code of Conduct at EventHow does the Code of Conduct for events support diversity, equity, inclusion?
Diversity Access TicketsHow are Diversity Access Tickets used to support diversity, equity, and inclusion for an event?
Family FriendlinessHow does enabling families to attend together support diversity, equity, and inclusion of the event?
Event AccessibilityTo what extent does your event accommodate those with various accessibility needs?
Event DemographicsHow well does the speaker lineup for the event represent a diverse set of demographics and can be improved in the future?
Inclusive Experience at EventTo what extent does an event organizing team commit to an inclusive experience at an event?
Time Inclusion for Virtual EventsHow can organizers of virtual events be mindful of attendees and speakers in other time zones?

Focus Area - Governance

Goal: Identify how diverse, equitable, and inclusive project governance is.

Metric/DetailsQuestionProvide Feedback
Board/Council DiversityWhat is the diversity within our governing body or council?
Code of Conduct for ProjectHow does the Code of Conduct for the project support diversity, equity, and inclusion?

Focus Area - Leadership

Goal: Identify how healthy community leadership is.

Metric/DetailsQuestionProvide Feedback
Inclusive LeadershipHow well is a project setup for diverse leadership?
MentorshipHow effective are our mentorship programs at supporting diversity, equity, and inclusion in our project?
SponsorshipHow effective are long-time members who sponsor people in supporting diversity, equity, and inclusion in a community?

Focus Area - Project and Community

Goal: Identify how diverse, equitable, and inclusive our project places are, i.e. where community engagement occurs.

Metric/DetailsQuestionProvide Feedback
Chat Platform InclusivityHow do you review Chat Platform inclusivity for your community?
Documentation AccessibilityHow does the documentation accommodate different users?
Documentation DiscoverabilityHow easily can users and contributors find the information they are looking for in a project’s documentation?
Documentation UsabilityWhat is the usability of documentation from content and structure perspectives?
Issue Label InclusivityHow easily can users and contributors find the information they are looking for in a project’s documentation?
Project BurnoutHow is project burnout identified and managed within an open source project?
Project DemographicsWhat are the demographics within a project?
Psychological SafetyTo what extent do community members feel safe within a community, including adding contributions, influencing change, bringing their authentic selves, and general participation within the project?


Evolution Repository:

Scope: Aspects related to how the source code changes over time, and the mechanisms that the project has to perform and control those changes.

Focus Area - Code Development Activity

Learn about the types and frequency of activities involved in developing code.

Metric/DetailsQuestionProvide Feedback
Branch LifecycleHow do projects manage the lifecycle of their version control branches?
Change Request CommitsHow many code change commits are included in a change request?
Code Changes CommitsWhat changes were made to the source code during a specified period?
Code Changes LinesWhat is the sum of the number of lines touched (lines added plus lines removed) in all changes to the source code during a certain period?

Focus Area - Code Development Efficiency

Learn how efficiently activities around code development get resolved.

Metric/DetailsQuestionProvide Feedback
Change Requests AcceptedHow many accepted change requests are present in a code change?
Change Requests DeclinedWhat reviews of change requests ended up declining the change during a certain period?
Change Request DurationWhat is the duration of time between the moment a change request starts and moment it is accepted?
Change Request Acceptance RatioWhat is the ratio of change requests accepted to change requests closed without being merged?

Focus Area - Code Development Process Quality

Learn about the processes to improve/review quality that are used (for example: testing, code review, tagging issues, tagging a release, time to response, CII Badging).

Metric/DetailsQuestionProvide Feedback
Change RequestsWhat new requests for changes to the source code occurred during a certain period?
Change Request ReviewsTo what extent are change requests put through a formal review process using platform features?

Focus Area - Issue Resolution

Identify how effective the community is at addressing issues identified by community participants.

Metric/DetailsQuestionProvide Feedback
Issues NewWhat are the number of new issues created during a certain period?
Issues ActiveWhat is the count of issues that showed activity during a certain period?
Issues ClosedWhat is the count of issues that were closed during a certain period?
Issue AgeWhat is the average time that open issues have been open?
Issue Response TimeHow much time passes between the opening of an issue and a response in the issue thread from another contributor?
Issue Resolution DurationHow long does it take for an issue to be closed?

Focus Area - Community Growth

Identify the size of the project community and whether it is growing, shrinking, or staying the same.

Metric/DetailsQuestionProvide Feedback
Contribution AttributionWho has contributed to an open source project and what attribution information about people and organizations is assigned for a contribution?
Inactive ContributorsHow many Contributors have gone inactive over a specific period of time?
New ContributorsHow many contributors are making their first contribution to a given project and who are they?
New Contributors Closing IssuesHow many contributors are closing issues for the first time?


Risk Repository:

Focus Area - Business Risk

Understand how active a community exists around/to support a given software package.

Metric/DetailsQuestionProvide Feedback
Bus FactorHow high is the risk to a project should the most active people leave?
CommittersHow robust and diverse are the contributors to a community?
Elephant FactorWhat is the distribution of work in the community?

Focus Area - Code Quality

Understand the quality of a given software package.

Metric/DetailsQuestionProvide Feedback
Defect Resolution TimeHow much time does a project take to resolve defects once they have been reported and recorded?
Test CoverageHow well is the code tested?

Focus Area - Dependency Risk Assessment

Understand the quality of a given software package.

Metric/DetailsQuestionProvide Feedback
LibyearsWhat is the age of the project’s dependencies compared to current stable releases?
Upstream Code DependenciesWhat projects and libraries does my project depend on?

Focus Area - Licensing

Understand the potential intellectual property (IP) issues associated with a given software package’s use.

Metric/DetailsQuestionProvide Feedback
License CoverageHow much of the code base has declared licenses?
License DeclaredWhat are the declared software package licenses?
OSI Approved LicensesWhat percentage of a project’s licenses are OSI approved open source licenses?
SPDX DocumentDoes the software package have an associated SPDX document as a standard expression of dependencies, licensing, and security-related issues?

Focus Area - Security

Understand security processes and procedures associated with the software’s development.

Metric/DetailsQuestionProvide Feedback
OpenSSF Best Practices badgeWhat is the current OpenSSF Best Practices status for the project?


OSPO Repository:

Focus Area - Academic Value

Identify the degree to which a project is valuable to researchers and academic institutions.

Metric/DetailsQuestionProvide Feedback
Academic Open Source Project ImpactWhat is the impact of open source projects that an academician or a team of academicians creates as an important part of a university reappointment, tenure, and promotion process?

Focus Area - Communal Value

Identify the degree to which a project is valuable to its community of users (including downstream projects) or contributors

Metric/DetailsQuestionProvide Feedback
Project VelocityWhat is the development speed for an organization?
Project RecommendabilityHow likely is it that you would recommend a community or project to other people?

Focus Area - Individual Value

Identify the degree to which a project is valuable to me as an individual user or contributor

Metric/DetailsQuestionProvide Feedback
Organizational Project Skill DemandHow many organizations are using this project and could hire me if I become proficient?
Job OpportunitiesHow many job postings request skills with technologies from a project?

Focus Area - Organizational Value

Identify the degree to which a project is monetarily valuable from an organization's perspective

Metric/DetailsQuestionProvide Feedback
Organizational InfluenceHow much influence does an organization have on an open source community?
Labor InvestmentWhat was the cost of an organization for its employees to create the counted contributions (e.g., commits, issues, and pull requests)?

CHAOSS Contributors

Aastha Bist, Abhinav Bajpai, Ahmed Zerouali, Akshara P, Akshita Gupta, Amanda Brindle, Anita Ihuman, Alberto Martín, Alberto Pérez García-Plaza, Alexander Serebrenik, Alexandre Courouble, Alolita Sharma, Alvaro del Castillo, Ahmed Zerouali, Amanda Casari, Amy Marrich, Ana Jimenez Santamaria, Andre Klapper, Andrea Gallo, Andy Grunwald, Andy Leak, Aniruddha Karajgi, Anita Sarma, Ankit Lohani, Ankur Sonawane, Anna Buhman, Armstrong Foundjem, Atharva Sharma, Ben Lloyd Pearson, Benjamin Copeland, Beth Hancock, Bingwen Ma, Boris Baldassari, Bram Adams, Brian Proffitt, Camilo Velazquez Rodriguez, Carol Chen, Carter Landis, Chris Clark, Christian Cmehil-Warn, Clement Li, Damien Legay, Dani Gellis, Daniel German, Daniel Izquierdo Cortazar, David A. Wheeler, David Moreno, David Pose, Dawn Foster, Derek Howard, Don Marti, Drashti, Duane O’Brien, Dylan Marcy, Eleni Constantinou, Elizabeth Barron, Emily Brown, Emma Irwin, Eriol Fox, Fil Maj, Gabe Heim, Georg J.P. Link, Gil Yehuda, Harish Pillay, Harshal Mittal, Henri Yandell, Henrik Mitsch, Igor Steinmacher, Ildiko Vancsa, Jacob Green, Jaice Singer Du Mars, Jaskirat Singh, Jason Clark, Javier Luis Cánovas Izquierdo, Jeff McAffer, Jeremiah Foster, Jessica Wilkerson, Jesus M. Gonzalez-Barahona, Jilayne Lovejoy, Jocelyn Matthews, Johan Linåker, John Coghlan, John Mertic, Jon Lawrence, Jonathan Lipps, Jono Bacon, Jordi Cabot, Jose Manrique Lopez de la Fuente, Joshua Hickman, Joshua R. Simmons, Josianne Marsan, Justin W. Flory, Kate Stewart, Katie Schueths, Keanu Nichols, Kevin Lumbard, King Gao, Kristof Van Tomme, Lars, Laura Dabbish, Laura Gaetano, Lawrence Hecht, Leslie Hawthorne, Luis Cañas-Díaz, Luis Villa, Lukasz Gryglicki, Mariam Guizani, Mark Matyas, Martin Coulombe, Matthew Broberg, Matt Germonprez, Matt Snell, Michael Downey, Miguel Ángel Fernández, Mike Wu, Neil Chue Hong, Neofytos Kolokotronis, Nick Vidal, Nicole Huesman, Nishchith K Shetty, Nithya Ruff, Nuritzi Sanchez, Parth Sharma, Patrick Masson, Peter Monks, Pranjal Aswani, Pratik Mishra, Prodromos Polychroniadis, Quan Zhou, Ray Paik, Remy DeCausemaker, Ria Gupta, Richard Littauer, Ritik Malik, Robert Lincoln Truesdale III, Robert Sanchez, RoyceCAI Rupa Dachere, Ruth Ikegah, Saicharan Reddy, Saloni Garg, Saleh Abdel Motaal, Samantha Lee, Samantha Venia Logan, Samson Goddy, Santiago Dueñas, Sarit Adhikari, Sarvesh Mehta, Sarah Conway, Sean P. Goggins, Shane Curcuru, Sharan Foga, Shaun McCance, Shen Chenqi, Shreyas, Silona Bonewald, Sophia Vargas, Sri Ramkrishna, Stefano Zacchiroli, Stefka Dimitrova, Stephen Jacobs, Tharun Ravuri, Thom DeCarlo, Tianyi Zhou, Tobie Langel, Saleh Abdel Motaal, Tom Mens, UTpH, Valerio Cosentino, Venu Vardhan Reddy Tekula, Vicky Janicki, Victor Coisne, Vinod Ahuja, Vipul Gupta, Will Norris, Xavier Bol, Xiaoya Xia, Yash Prakash, Yehui Wang, zhongjun2, Zibby Keaton

Are you eligible to be on this list? You are if you helped in any capacity, for example: Filed an issue. Created a Pull Request. Gave feedback on our work. Please open an issue or post on the mailing list if we've missed anyone.

CHAOSS Governing Board Members

  • Amy Marrich, Red Hat
  • Armstrong Foundjem, MCIS Laboratory at Queen's University
  • Daniel Izquierdo, Bitergia
  • Dawn Foster, VMware
  • Don Marti, CafeMedia
  • Georg Link, Bitergia
  • Ildikó Vancsa, OpenStack
  • Kate Stewart, Linux Foundation
  • Matt Germonprez, University of Nebraska at Omaha
  • Nicole Huesman, Intel
  • Sean Goggins, University of Missouri
  • Sophia Vargas, Google
  • Wayne Beaton, Eclipse Foundation
  • Yehui Wang, Huewei

Copyright © 2018-2022 CHAOSS a Linux Foundation® project. All rights reserved. The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our Trademark Usage page. Linux is a registered trademark of Linus Torvalds. Privacy Policy and Terms of Use.