Chat Platform Inclusivity
Question: How do you review Chat Platform inclusivity for your community?
Open Source communities need places for contributors to interact and engage with each other. Much of this communication is likely to be project-related, but there may also be spaces for general social connection with other contributors. This metric describes synchronous communication in Chat Platforms, which include platforms for public shared chat rooms, real-time conversations, and video conferences.
Chat Platforms are essential to a functioning open source community. Chat Platforms support a healthy project by enabling cross-team collaboration in different skill areas, helping peer collaborators find and interact with each other faster, increasing project transparency which allows team members to notice potential problems before they occur, and saving time by cutting across organizational hierarchies. Persistent Chat Platforms also become a reference for newcomers to familiarize themselves with project history, practice, and culture.
Chat Platforms should be chosen, moderated, and managed transparently, using inclusive language in order to accelerate innovative problem-solving and sustain contributor participation.
- Support decision-makers when choosing a Chat Platform.
- Provide ideas that contributors and potential contributors may use to evaluate the specific context of any given project.
- Identify characteristics of the Chat Platforms, such as those identified under filters, that suggest greater inclusivity.
The usage and dissemination of health metrics may lead to privacy violations. Organizations may be exposed to risks. These risks may flow from compliance with the GDPR in the EU, with state law in the US, or with other law. There may also be contractual risks flowing from terms of service for data providers such as GitHub and GitLab. The usage of metrics must be examined for risk and potential data ethics problems. Please see CHAOSS Data Ethics document for additional guidance.
How do these filters measure inclusivity? Think of it like an office space. How many teams (Chat Platforms) are there? How active are they? For example, very active chats can be difficult to follow and that difficulty will vary from person to person.
- Number of active Chat rooms/groups
- Number of messages per day, week, month
- Number of active participants per day, week, month
- Number of passive participants (i.e. reading but not participating)
- Number of external participants (i.e. people who are not associated with a leading company working on an Open Source Project, such as Red Hat with the Fedora Project)
- Number of (independent) volunteers
- Number of corporate volunteers (people being paid by another entity to volunteer work)
- Number of workers (employees or contractors)
- Platforms without persistent connections (i.e., IRC):
- Number of daily connections to the room
- Number of repeat logins
- Most active hours in community-specific Chat Platforms
- Number of active new chat members vs. older chat members
- Word clouds (for public Chat Platforms, e.g., public Mattermost rooms)
- “On-topic” vs. “off-topic” conversation
- How often do certain keywords or phrases show up, etc.
Tools Providing the Metric
GrimoireLab Perceval currently supports data collection from various Chat Platforms.
Data Collection Strategies
- Trace data from Chat Platforms:
- See supported platforms for data collection in Perceval.
- Open Source status of Chat Platform:
- See the CHAOSS blog post on open source platform status.
- Does the chat platform offer Open Source client applications?
- Does the chat platform offer Open Source server implementations?
- Does the chat platform offer an Open API for integrating with data collection or bridging?
- Features for low-bandwidth connections:
- Does it require a persistent Internet connection to use (e.g., IRC)?
- Does the Chat Platform function with minimal bandwidth?
- Features for community management and moderation:
- Does the Chat Platform offer robust moderation tools for moderators?
- Does the Chat Platform have bot functionality or does it require full manual intervention for moderation?
- Features for internationalization:
- Is the Chat Platform available in multiple countries, or are there geographic limitations?
- Does the Chat Platform provide tools for translation?
- Features for access:
- Does the Chat Platform support tools for accessibility (e.g., friendly for screen readers)?
- Is the Chat Platform easy to use for newcomers?
- Is the Chat Platform available for a variety of devices?
- Features for privacy:
- Does the Chat Platform require the personal information to be verified or submitted for users to sign up?
- Love or hate chat? 4 best practices for remote teams — Opensource.com
- Open source status of chat platforms — Chaoss.community
- Moderation advice (can inform the choice of platform):
This metric was last reviewed on July 20, 2022 as part of the metrics revision process.