Skip to content

Add support for simple background migration jobs - #873

Merged
jvyden merged 2 commits into
LittleBigRefresh:mainfrom
jvyden:background-migrations
Jul 22, 2025
Merged

Add support for simple background migration jobs#873
jvyden merged 2 commits into
LittleBigRefresh:mainfrom
jvyden:background-migrations

Conversation

@jvyden

@jvyden jvyden commented Jul 22, 2025

Copy link
Copy Markdown
Member

This introduces support for background migration jobs that run alongside Refresh, have access to all of our database code, and don't block on startup.

They can filter and order a table, then iterate over the results. An example migration is provided for the unit tests.

This is good for migrations that we can't easily write with raw SQL or EF migration code, or can take a long time. They're also database agnostic as they're written in C#.

Ideally, and I've done some preparatory work for this but I'm not sure if it's exactly working, is that they can also be terminated as they run and cleanly be picked back up.

This isn't the system that will be used to import the dry archive - that will most likely be a different project. This is only marked under the dry archive milestone because it's preparatory work for #618.

@jvyden jvyden added this to the Import dry archive milestone Jul 22, 2025
@jvyden
jvyden merged commit 816b115 into LittleBigRefresh:main Jul 22, 2025
@jvyden
jvyden deleted the background-migrations branch July 22, 2025 06:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant