add recipe extension cep

[wolfv]

No description provided.

[wolfv]

Discussion:

Technically, it would be nicer to solve this with a flexible script. Challenge: we only want to run over the new files in the prefix.

Should we leak "rust" regex features? Would be easy to use them from Python as well. We can also turn off the regex feature where capture groups can be referenced easily with $....

Example from Rust docs:

string: "Springsteen, Bruce"
regex: (?<last>[^,\s]+),\s+(?<first>\S+)
replacement: "$first $last"
result: "Bruce Springsteen"

[jaimergp]

Python has \g<name> and \g<number> for that. So maybe there's a way to convert things more or less easily. The $ syntax is reasonable enough to me.

[jaimergp]

Challenge: we only want to run over the new files in the prefix.

Can that be injected in the post_build namespace? A \0 separated list of paths in an env var or something? Maybe it overflows 😬. Maybe a file can be placed somewhere strategically which, upon parsing, returns the newly detected files.

[jaimergp]

Does this have to do with recipe post-processing? 🤔

[chenghlee]

Yeah. This really feels like it should just be incorporated into the build script(s).

[h-vetinari]

The positive/negative globs should be part of the recipe. Using the build scripts just to shuffle files around into separate output is a lot of core for little gain, especially because it's a well-defined operation and doesn't overload the recipe syntax IMO.

C.f. also conda/conda-build#5216

[wolfv]

No this doesn't really have anything to do with post-processing per se. The idea is that any list of globs can also include negative globs.

List of globs appear in multiple places in the recipe.

[wolfv]

TODO:

• I have recently been thinking about adding the compression settings to the build section so that compression can be configured easily per-output.