Source code analysis dataset

Ben Gelman; Banjo Obayomi; Jessica Moore; David Slater

doi:10.1016/j.dib.2019.104712

Source code analysis dataset

Data Brief. 2019 Oct 24:27:104712. doi: 10.1016/j.dib.2019.104712. eCollection 2019 Dec.

Authors

Ben Gelman¹, Banjo Obayomi¹, Jessica Moore¹, David Slater¹

Affiliation

¹ Machine Learning Group, Two Six Labs, 901 N. Stuart St, Suite 1000, Arlington, VA, 22203, USA.

Abstract

The data in this article pair source code with three artifacts from 108,568 projects downloaded from Github that have a redistributable license and at least 10 stars. The first set of pairs connects snippets of source code in C, C++, Java, and Python with their corresponding comments, which are extracted using Doxygen. The second set of pairs connects raw C and C++ source code repositories with the build artifacts of that code, which are obtained by running the make command. The last set of pairs connects raw C and C++ source code repositories with potential code vulnerabilities, which are determined by running the Infer static analyzer. The code and comment pairs can be used for tasks such as predicting comments or creating natural language descriptions of code. The code and build artifact pairs can be used for tasks such as reverse engineering or improving intermediate representations of code from decompiled binaries. The code and static analyzer pairs can be used for tasks such as machine learning approaches to vulnerability discovery.

Keywords: Bug detection; Code comments; Source code; Static analysis.