Dataset Reuse Indicators Datasets (Q6718835)

Thisdataset containstwo files. 1) A python pickle file (github_dataset.zip) that contains Github repositories with datasets.Specifically, usingGoogles public dataset copy of Github and the BigQuery serviceto build a list of repositories that havea CSV or XLSX or XLS file. We then used the GitHub API to collectnformation about each repository in this list. The resulting dataset consists of 87936 repositories that contain at least a CSV, XLSX or XLS file, alongside with information abouttheir features (e.g. number of open and closed issues and license) from GitHub. This corpus had more than two million data files. We then excluded those files withless then ten rows, which was the case for 65537 repositories with a total of 1,467,240 data files. 2) A python pickle file (processed_dataset.zip) containing the feature information necessary to train a machine learning model to predict reuse on these Github datasets Source code can be found at:https://github.com/laurakoesten/Dataset-Reuse-Indicators For a full description of the content see: Koesten, Laura and Vougiouklis, Pavlos and Simperl, Elena and Groth, Paul, Dataset Reuse: Translating Principles to Practice. Available at SSRN:https://ssrn.com/abstract=3589836orhttp://dx.doi.org/10.2139/ssrn.3589836