DataCite Monthly Data File access examples

Overview

This repository contains examples for accessing the DataCite Monthly Data File using a selection of tools and SDKs for different programming languages.

Access is provided via temporary AWS credentials retrieved from the DataCite REST API, which can then be used to access an AWS S3 bucket containing the contents of the DataCite Monthly Data File.

All access and use of the DataCite Monthly Data File is subject to the DataCite Data File Use Policy.

Warning

Example code and guides are provided "as-is" for demonstration purposes only and are offered as minimal implementations without robust error handling or logging.

Authentication Flow

Regardless of the tool or SDK used, the authentication works in the same way:

1. Use your DataCite username and password to authenticate with the DataCite REST API and retrieve temporary AWS credentials.
2. Use those temporary AWS credentials to authenticate yourself to AWS and access the data.

The credentials provided by the DataCite REST API are temporary credentials, valid for one hour. If you require access after one hour, you will need to retrieve a new set of credentials.

DataCite Monthly Data File structure overview

The public data file contains a top-level dois folder. The dois folder contains a series of folders named with an updated_YYYY-MM convention. Each of these folders contains:

1. All Findable DataCite DOI records updated during the corresponding month (at the time the public data file was generated).
2. A tabular report for the corresponding month containing a summary of the data in the corresponding month.

All files within the dois folder are compressed using GZIP.

For more detail, please see the DataCite Monthly Data File structure file in this repository and the DataCite Monthly Data File support page.

Tool and Code Examples

• AWS CLI
• cURL
• Python (Boto3)
• Ruby (AWS SDK for Ruby)