FouroverSix - #2882
Conversation
There was a problem hiding this comment.
Code Review
This pull request updates the generate_gparam call in src/llmcompressor/observers/base.py to include the four_over_six parameter retrieved from self.args. The reviewer suggested enhancing robustness by also checking self.args.observer_kwargs for this parameter, providing a clear code suggestion to implement this fallback.
| global_scale = generate_gparam( | ||
| -global_absmax.reshape(1), global_absmax.reshape(1) | ||
| -global_absmax.reshape(1), | ||
| global_absmax.reshape(1), | ||
| four_over_six=getattr(self.args, "four_over_six", False), | ||
| ) |
There was a problem hiding this comment.
The four_over_six parameter might be configured as an observer-specific argument and stored within self.args.observer_kwargs rather than directly as an attribute on self.args (which is a QuantizationArgs instance). To ensure robustness, we should check both self.args attributes and self.args.observer_kwargs.
| global_scale = generate_gparam( | |
| -global_absmax.reshape(1), global_absmax.reshape(1) | |
| -global_absmax.reshape(1), | |
| global_absmax.reshape(1), | |
| four_over_six=getattr(self.args, "four_over_six", False), | |
| ) | |
| global_scale = generate_gparam( | |
| -global_absmax.reshape(1), | |
| global_absmax.reshape(1), | |
| four_over_six=getattr(self.args, "four_over_six", False) | |
| or getattr(self.args, "observer_kwargs", {}).get("four_over_six", False), | |
| ) |
Merge Protections🔴 2 of 2 protections blocking · waiting on 👀 reviews
🔴 Require one maintainer reviewWaiting for any of
This rule is failing.All PRs must have at least one approving review from a maintainer before merging.
🔴 Require two reviewsWaiting for
This rule is failing.PRs labelled "two-reviews" must have at least two approving reviews before merging.
|
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
📝 WalkthroughWalkthroughA single cosmetic reformatting in ChangesObserver Formatting
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~2 minutes Suggested labels
🚥 Pre-merge checks | ✅ 3 | ❌ 2❌ Failed checks (2 inconclusive)
✅ Passed checks (3 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Warning Review ran into problems🔥 ProblemsLinked repositories: Your configuration references 1 linked repositories, but your current plan allows 0. Analyzed ``, skipped Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review. Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed. |
|
The quality checks have failed. Please run |
This reverts commit eb8966a. put on different branch
|
This pull request has merge conflicts that must be resolved before it can be |
Accident push to this remote, reverted This reverts commit 72572be.
|
Closing for #3015 |
No description provided.