Open communities lack a shared language to talk about metrics and share best practices. Metrics are aggregate information that summarise raw data into a single number, stripping away any context of data. Pedagogical metric displays are an idea for metrics that include an explanation and educates the user on how to interpret the metric. Metrics are inherently biased and can lead to discrimination. Many problems brought up during the MozFest session are worked on in the CHAOSS project.
Previously, we’ve explored the challenge of measuring progress in open source projects and looked forward to the recent CHAOSScon meeting, held right before the North American Open Source Summit (OSS). CHAOSS, for those who may not know, is the Community Health Analytics Open Source Software project. August’s CHAOSScon marked the first time that the project had held its own, independent pre-OSS event.
My colleague Matt Germonprez recently hit me and around 50 other people at CHAOSScon North America (2018) with this observation:
“A lot of times we get really great answers to the wrong questions.”
Matt explained this phenomena as “type III error”, an allusion to the more well known statistical phenomena of type I and type II errors. If you are trying to solve a problem or improve a situation, sometimes great answers to the wrong questions can still be useful because in all likelihood somebody is looking for the answer to that question! Or maybe it answers another curiosity you were not even thinking about. I think we should call this (Erdelez, 1997). There’s an old adage:
“Even a blind squirrel finds a nut every once in a while.”
We have a new release of GrimoireLab, 18.09-02, corresponding to grimoirelab-0.1.2 (the main Python package).
This release includes full support Mattermost and GoogleHits, some improvements in the Kibiter UI and panels, some bug fixes and minor new features.
The corresponding packages have been uploaded to pypi (so they’re installable with pip). I’ve tested most of the examples in the GrimoireLab Tutorial with this new release, and everything seems to work. Please, report any problem you may find.
As usual, this release of pypi packages was generated with docker containers, to ensure platform independence. You can install all the packages just with:
$ pip install grimoirelab
Remember that now we also have a new grimoirelab package, that pulls all the Python packages for the release. So, installation is easier, and traceability too: for knowing the GrimoireLab release, just run
$ grimoirelab -v
The tag you get (0.1.2 in this case) corresponds to a certain release file (18.09-02 in this case), and specific commits and Python package versions.
We have also produced four Docker images available in DockerHub, all of them with the tags :18.09-02 and :latest. You can pull and run them straight away:
- grimoirelab/factory: for creating the Python packages
- grimoirelab/installed: with GrimoireLab installed
- grimoirelab/full: grimoirelab/installed plus services needed to produce a dashboard, by default produces a dashboard of the CHAOSS project.
- grimoirelab/secured: grimoirelab/full plus access control and SSL for access to Kibiter
If you want to use or help to debug the containers, have a look at the docker directory in the chaoss/grimoirelab repository.
The list of new stuff is in the NEWS file (check all changes since 18.08-01, which was the latest release with packages in pypi).
The CHAOSS project aims to develop metrics and software for measuring open source projects. One group of people that care about this are community managers. Every year, Jono Bacon, a CHAOSS Governing Board member who professionalized community management with his book “The Art of Community”, invites community managers to his Community Leadership Summit. (In his book, Jono dedicated the entire chapter 7 to measuring communities.)Judging by the reactions on Twitter and engagement with other conference participants, metrics was a popular topic at the conference. It is no surprise, that members of the CHAOSS project would naturally be at this conference. This blog post summarizes the presence of CHAOSS at the Community Leadership Summit and highlights some takeaways and insights.
Draft of Goal-Metrics for Diversity & Inclusion in Open Source (CHAOSS)
By Emma Irwin
In the last few months, Mozilla has invested in collaboration with other open source project leaders and academics who care about improving diversity & inclusion in Open Source through the CHAOSS D&I working group. READ MORE
Traditional metrics don’t accurately predict the success or impact of open source projects. Check out this article on opensource.com written by CHAOSS community members – Vinod Ahuja, Don Marti, Georg Link, Matt Germonprez, and Sean Goggins.
Want to know more about Community Health and Analytics? Join CHAOSS at the Open Source Leadership Summit March 6th to 8th, 2018.
The CHAOSS community was formed as result of a Birds-of-a-Feather on Community Health Analytics at the Open Source Leadership Summit 2017. Come see what we have been up to and be a part of defining and creating tools to analyze community health.
Open Source Summit Europe (October 23 – 26, 2017: Prague, Czech Republic)
- CHAOSS project breakout session; Tuesday (Oct. 24th) at 12pm – 5pm local time; Room London
Open Source Summit North America (September 11-14, 2017: Los Angeles, CA)
Meet the CHAOSS and GrimoireLab community in Brussels, Belgium on February 2nd, 2018. Come be a part of building, defining, and using tools for open source communities to track and analyze their development activities, community health, and diversity.
CHAOSSCon + GrimoireCon Europe will highlight CHAOSS and GrimoireLab updates, use cases, and feature hands-on workshops for developers, community managers, and project managers.
The workshops will cover the basic training for using open source GrimoireLab toolkit for analyzing software development processes to manage them through metrics and KPIs.
Community managers, software development managers, developers, and anyone involved in open source and inner source software development will learn through real examples how to set up and use GrimoireLab for their specific needs.
Come help define the metric of community growth/maturity/decline in BOF: Community Health Analytics for Open Source on Monday Sept. 11 5:40pm at Open Source Summit North America. This BoF is for those interested in community health and sustainability. An ongoing challenge for open source communities and participating organizations is to objectively understand issues related to community health. Community leaders, open source foundations, and organizations are putting an effort into understanding healthy and sustainable communities but are lacking cohesive and common measures and tools to assess such issues. The Linux Foundation Community Health Analytics for Open Source Software (CHAOSS) project will organize the BoF with the goal to advance the new project and further the development of objective health metrics. In particular, we will spend the time exploring how members understand and describe the particular composite metric of community growth/maturity/decline.
There will be a continuation of this session on Tuesday, Sept. 11 from 2-4pm for those wanting to continue the discussion. Details will be announced at the Monday BOF.