Skip to content

Register dask_cudf serializers - #3832

Merged
jacobtomlinson merged 1 commit into
dask:masterfrom
jakirkham:reg_ser_dask_cudf
May 28, 2020
Merged

Register dask_cudf serializers#3832
jacobtomlinson merged 1 commit into
dask:masterfrom
jakirkham:reg_ser_dask_cudf

Conversation

@jakirkham

Copy link
Copy Markdown
Member

As dask_cudf simply relies on the same serialization machinery that is in cudf ( plus whatever is implemented by dask_cudf objects themselves, rapidsai/cudf#5294 ), just reuse the cudf serialization import to handle dask_cudf object serialization for simplicity.

As `dask_cudf` simply relies on the same serialization machinery that is
in `cudf` (plus whatever is implemented by `dask_cudf` objects
themselves), just reuse the `cudf` serialization import to handle
`dask_cudf` object serialization for simplicity.
@mrocklin

Copy link
Copy Markdown
Member

This seems fine to me.

@quasiben

Copy link
Copy Markdown
Member

Thanks all. Merging in

@quasiben

Copy link
Copy Markdown
Member

Oh, looks like @jakirkham needs to move out of draft mode

@jakirkham
jakirkham marked this pull request as ready for review May 27, 2020 23:54
@jakirkham

Copy link
Copy Markdown
Member Author

Thanks all! Though I'm starting to second guess this change. Could use some help understanding when pickling of collections is used to better inform next steps.

@jacobtomlinson
jacobtomlinson merged commit 9db7368 into dask:master May 28, 2020
@jacobtomlinson

Copy link
Copy Markdown
Member

Gah for some reason @jakirkham's last message didn't display when I hit merge. Only that it was marked as ready.

Though I'm starting to second guess this change.

Do you want to revert it?

@jakirkham

Copy link
Copy Markdown
Member Author

No worries 🙂

I’m not aware of any downside to this change. At worst it simply doesn’t do anything.

I think we can leave it in. If we determine we don’t need it, we can always come back and cleanup.

@jakirkham
jakirkham deleted the reg_ser_dask_cudf branch May 28, 2020 18:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants