PEDP scripts

This is not your normal GitHub repository.

Instead of containing a single project with a coherent structure, it is intended to allow any coders who are:

• archiving data sets for the Public Environmental Data Partners (https://screening-tools.com) OR
• building utilities for audit/maintenance of archive spaces like Dataverse or Zenodo to upload their working scripts both for safe-keeping and for others to reference and possibly build upon.

Eventually, the code in this repo may evolve into more coherent structure of tools. For now, however,

• small scraping/archiving code should simply be added in folders named after the acronym of the agency, under /DataArchiveProjects , along with a readme file for the project. If there are multiple projects for a specific agency folder, subset folders should be added for clarity.
• auditing and other scripts should be added under /utilities .

Adding code

If you have built code in the course of your work on a PEDP project, we strongly encourage you to share it here. It does not need to be perfect or even polished (read some of the existing code if you need to be convinced of that ;-). If code was useful to you, it may save another contributor or your future self some time and trouble to be able to find it here as a starting point for another project.

In general, follow the steps in the Contributing guide, specifically for making code changes using Pull Requests. In addition, here are some notes specific to the folders in this repo.

DataArchiveProjects

If you add code here, please:

• create a folder for your code, use your own best judgement for a folder name. Standard practice is to use the agency acronym. If a folder for the agency you're working on already exists, create a subfolder within that.
• along with any working code, add a readme.txt file that documents:
  • the URL of the primary web page you were archiving
  • the URL of the online repository location where your archived data was stored
  • any other notes you made about the code you are archiving
  • (optional) a url to the google drive metadata for the archived dataset

(Note also that, while it is not currently required, it has become a common and recommended practice to bundle the code you used for an archving project into a zip file that is archived with the data.)

utilities

For code that is not associated with a specific archiving project, please add it here. You're welcome to add code to any existing folder or, if none apply, to create a folder of your own. If you add code to an existing folder, please update the readme.txt there. If you create a new folder, please include a readme.txt file

---

git process from your local development environment

New to git and github? We have documented steps for making a change using git and the pull request process in our organization's CONTRIBUTING doc and a doc with git tips here for working with git locally.