Skip to content

Notifications for Aspera uploads to S3#1

Description

@nutjob4life

馃 Tell Us About the Feature

It'd be nice if we could get an email or a text message or something whenever someone uses Aspera to upload files to us that end up in S3.

馃帀 What Solution You'd Like

Aspera doesn't have an event notification system (that I could find) but AWS does. So far we've created an AWS Simple Notification Service (SNS) topic for "EDRN Data Received" and added my email as a "subscription" to this topic. We've then added the topic to s3://edrn-labcas for all s3:ObjectCreated events.

Testing shows that for every file uploaded, an email is generated鈥攚hich is nice as a proof-of-concept, but will be terrible in practice as our various partner institutions upload 1000s of files at a time.

A better concept would be for SNS or an AWS Lambda function to collect batches or perhaps detect timestamps of related uploads and report on those so there's just 1 email for a batch of 1000 files.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions