Collector watcher not pulling all metadata

[jaydeluca]

I noticed that #336 is not working, likely because we aren't properly pulling the data with the watcher.

Looking at the memory limiter processor metadata, there is telemetry:

https://github.com/open-telemetry/opentelemetry-collector/blob/main/processor/memorylimiterprocessor/metadata.yaml#L19-L28

But the page shows none:

Looking at our registry, we don't have any telemetry data tracked at all:

https://github.com/open-telemetry/opentelemetry-ecosystem-explorer/blob/main/ecosystem-registry/collector/core/v0.156.0/processor.yaml#L22-L38

We need to update the collector-watcher to pull in all of the available metadata, including telemetry.

We will then need to run a backfill, which will be done after the change is merged, so do not include the re-generated metadata in the PR.

[vanshika2720]

Hey @jaydeluca , I would love to work on this...
Could you assign it to me???

[jaydeluca]

@vanshika2720 thanks let me know if you have any questions

[vanshika2720]

@jaydeluca I have one question should the parser preserve all currently unknown metadata fields generically for forward compatibility, or would you prefer only adding support for the fields that exist in the current upstream schema (like telemetry)?

[jaydeluca]

we are tracking the schema of the files separately, so I think it's safe for us to handle it generically and allow any unknown fields