Cut the conda-lock v3.0.0 release

[maresb]

I want to let everyone know my thinking regarding the release process of conda-lock v3 and also prepare the release notes. Comments welcome!

My current impression is that the recent release of mamba/micromamba v2 has caused a bit of chaos, and that it's prudent to wait for things to stabilize somewhat before cutting this release. (Ideally this specifically means merging #720 and #724.) On the other hand, I expect this release to resolve many outstanding bugs and blockers, so many will want to install as soon as possible.

I'd like to encourage the eager and brave to install from the main branch. Installing via pip should look something like

pipx install --force 'git+https://github.com/conda/conda-lock@main'

where pipx can be replaced with pip and main can be replaced with a current Git SHA.

Alternatively, from an environment.yml, you can add the following to your dependencies

dependencies:
- git  # Only necessary when Git is unavailable at the system level
- pip
- pip:
  - conda-lock @ git+https://github.com/conda/conda-lock@main

First draft release notes, up to and including #633:

[explanation of major changes goes here]

[say something nice about pixi, and link to the migration docs]

TODO: categorize the below, remove bot contributions, combine followups, check the authors, e.g. srilman is missing

What's Changed

Breaking changes

• Update Poetry to 1.8.3 by @romain-intel in Update Poetry to 1.8.3 #637, Update pyproject.toml to fix required dependencies for vendored poetry #678, Cleanup vendoring #685
• Support Multiple Categories for Sub-Dependencies in Lockfile (Rebase Support Multiple Categories for Sub-Dependencies in Lockfile  #390) by @srilman in Support Multiple Categories for Sub-Dependencies in Lockfile (Rebase #390) #697

New features

• Sort BaseLockedDependency.dependencies when alpha-sorting a Lockfile by @peterbygrave in Sort BaseLockedDependency.dependencies when alpha-sorting a Lockfile #654
• Add support for PEP 508 environment markers by @maresb in Add support for PEP 508 environment markers #684
• Improve loading of PyPI mapping by @maresb in Improve loading of PyPI mapping #690
• Add render-lock-spec subcommand for exporting lock specification to pixi.toml by @maresb in Add render-lock-spec subcommand for exporting lock specification to pixi.toml #664
• Add pixi.toml configuration by @maresb in Add pixi.toml configuration #705, Write pixi.toml source file list as posix #706
• Add/improve support for Path dependencies and GIT dependencies by @romain-intel in Add/improve support for Path dependencies and GIT dependencies #712

Bugfixes

• Fix parsing of Poetry's caret and tilde dependencies by @maresb in Fix parsing of Poetry's caret and tilde dependencies #679, minor: clean up vendored grayskull #683, Revendor with the official Grayskull released version #714
• Refactor lock command and fix an edge case by @maresb in Refactor lock command and fix an edge case #695
• Fix erroneous PyPI to Conda dep name conversion for PyPI deps by @maresb in Fix erroneous PyPI to Conda dep name conversion for PyPI deps #701, Always convert Poetry versions to Conda versions #704

Documentation

• Clarify that existing lockfiles are used for relocking by @sfinkens in Clarify that existing lockfiles are used for relocking #632
• Correct mistake in basic usage documentation by @sfinkens in Correct mistake in basic usage documentation #647

Maintenance

• Update GHA release workflow to use trusted publishing / OIDC by @maresb in Update GHA release workflow to use trusted publishing / OIDC #631, Only run the publish job on releases #700
• Replace logger.warn w/ logger.warning by @zklaus in Replace logger.warn w/ logger.warning #646
• Fix failing mypy check by @maresb in Fix failing mypy check #648
• Do a strict pkg meta check @ release CD workflow by @webknjaz in Do a strict pkg meta check @ release CD workflow #657
• Log the solve command (DEBUG) by @maresb in Log the solve command (DEBUG) #662
• Show default values in CLI by @maresb in Show default values in CLI #661
• Fix vulnerable version of black in test by @maresb in Fix vulnerable version of black in test #680
• Update .gitignore for pixi by @maresb in Update .gitignore for pixi #681
• Split virtual-package repo from LockSpecification by @maresb in Split virtual-package repo from LockSpecification #663
• Add vendoring script by @maresb in Add vendoring script #682
• Add integration tests by @maresb in Add integration tests #686
• Collect test duration data for various runner configurations by @maresb in Collect test duration data for various runner configurations #687
• Use a quicker example for the channel-inversion test by @maresb in Use a quicker example for the channel-inversion test #688
• Split tests into multiple runners with pytest-split by @maresb in Split tests into multiple runners with pytest-split #689
• Simplify pytest GHA workflow by @maresb in Simplify pytest GHA workflow #691
• Fix test that fails when cache is deleted by @maresb in Fix test that fails when cache is deleted #694
• Reduce Ubuntu and MacOS runners from 4 to 3 by @maresb in Reduce Ubuntu and MacOS runners from 4 to 3 #696
• Code migrations for Pydantic v2 by @maresb in Code migrations for Pydantic v2 #692
• Revendor conda by @maresb in Revendor conda #699
• Install conda-lock with pipx in integration tests for better isolation by @maresb in Install conda-lock with pipx in integration tests for better isolation #698
• Refactor to make mapping url explicit and eliminate LookupLoader by @maresb in Refactor to make mapping url explicit and eliminate LookupLoader #703
• Echo bash commands during integration test by @maresb in Echo bash commands during integration test #711
• Support Micromamba v2 by @maresb in Support Micromamba v2 #713, Support micromamba v2, continued #717, Revert one of the micromamba v2 workarounds #721
• Use JSON version of the default PyPI mapping by @maresb in Use JSON version of the default PyPI mapping #715
• Pin mamba<2 in dev environment and relock dependencies by @maresb in Pin mamba<2 in dev environment and relock dependencies #723

New Contributors

• @zklaus made their first contribution in Replace logger.warn w/ logger.warning #646
• @peterbygrave made their first contribution in Sort BaseLockedDependency.dependencies when alpha-sorting a Lockfile #654
• @webknjaz made their first contribution in Do a strict pkg meta check @ release CD workflow #657

[maresb]

For anyone following this, this has taken a bit longer than I hoped.

I am waiting for a resolution of #720 which is currently blocked by mamba-org/mamba#3467.

[romain-intel]

Thanks for following this! I am also waiting for micromamba to stabilize to cut a new updated release for my users. It seems the change they think will fix it was merged last week. Hopefully they will cut a release soon.

[maresb]

Also blocked on the regression #730

[maresb]

We are still gradually inching closer.

For example, on the #720 front, mamba-org/mamba#3467 has been resolved, but it's now blocked by mamba-org/mamba#3628.

[romain-intel]

I was just wondering about that yesterday (since I was testing the pre-release of conda-lock to see if it solved an issue a user was having -- it does which is great :)). So to summarize, the current blockers are:

• Micromamba queries Conda channel server with censored URL mamba-org/mamba#3628
• Dependency of pip installed package is missing #730

Is that it? Hopefully 3628 can be solved quickly (it seems more like a "whoops" type of bug) and I can try looking at #730.

[maresb]

Thanks @romain-intel!!! You are correct that those are the (known) blockers. (I also personally want to get in #708 so that I can mention it in the v3 release notes, but it's not actually a blocker.)

I agree with your assessment of 3628.

I haven't managed yet to look into a fix for #730. It would be incredible if you could help with that!!!

[maresb]

Thanks to mamba-org/mamba#3681 the just-released v2.0.5 of micromamba will likely unlock #720 / #724.

[maresb]

Still blocked on #720 / #724. 😞 Thanks to v2.0.5 we're getting further, but have now hit a new snag with mamba-org/mamba#3693.

[aphedges]

Still blocked on #720 / #724. 😞 Thanks to v2.0.5 we're getting further, but have now hit a new snag with mamba-org/mamba#3693.

@maresb, it looks like mamba-org/mamba#3693 was resolved with mamba-org/mamba#3696. Does that unblock the two blocking PRs, or are you waiting for another Mamba release?

[maresb]

Hey @aphedges, that's basically correct. They just published a release candidate that I will test once I get the chance.

This raises the urgency of tying up loose ends on our side, in particular #730. I'm currently in a bit of a time crunch for the next several days with a bunch of deadlines, so I won't be able to act immediately.