Developer Reputation Estimator: Increasing the Transparency of Developer Contributions in Open Source Software

In this work, we present Developer Reputation Estimator (DRE), a web application that measures the technical and social aspects of a developer's expertise in the open source software (OSS) ecosystem. We provide several measures, from basic activity trace counts (e.g. number of commits, projects, etc.) to more advanced impact measures, such as tracking code re-use for a particular developer. We perform these measures on a novel scale using the World of Code infrastructure, which houses over 18 billion Git objects from many of the major OSS platforms. Together, these measures increase the transparency of a developer's experience in OSS and can be utilized to quickly establish trust between developers by gauging each other's skill sets and social network. As a byproduct of developers signing up for DRE, we also build a ground-truth dataset consisting of author identities we know belong to a single developer as well as the ones they do not claim. This dataset can be used as a training set for researchers to perform identity correction on author identities to better model the relationship between developers and other entities in OSS.DRE is the first system that utilizes the WoC infrastructure in this way. It provides several use cases, including lowering the barrier of entry for developers attempting to contribute to a new OSS project, aiding researchers with a training dataset for identity correction, and allowing recruiters to corroborate resume claims made by applicants or seek out qualified developers based on a certain set of criteria. While this first version of DRE might not provide full support for each use case, we motivate these use cases and several other areas of future work to realize the full potential of our application.