Thank you for your interest in contributing to inspect_evals_scoring!
We welcome contributions of all kinds, including:
- Bug fixes and issue reports
- Feature enhancements
- Documentation improvements
- Infrastructure optimizations
- New utility functions
- Performance improvements
-
Fork the repository and clone it locally
-
Create a virtual environment:
python -m venv .venv source .venv/bin/activate # On Windows: .venv\Scripts\activate
-
Install the package in development mode:
pip install -e ".[dev]" -
Make your changes
-
Run tests to ensure your changes don't break existing functionality:
# Run tests using the interpreter in the virtual environment .venv/bin/python -m pytest -
Submit a pull request with a clear description of the changes and their purpose
- Write tests to confirm new functionality
- Follow the existing code style (we use
rufffor linting) - Add appropriate documentation for new features
- Keep the codebase modular and maintainable
- Ensure AWS resources are parameterized and configurable
If you have ideas for new features, please open an issue describing:
- The problem you're trying to solve
- Your proposed solution
This project is intended to be a starting point for building scalable evaluation systems. While we aim to provide a solid foundation, we recognize that different users will have different needs. Contributions that make the system more flexible, configurable, and adaptable to various use cases are especially welcome.
Please be respectful and constructive in all interactions. We aim to foster an inclusive and welcoming community.
By contributing to this project, you agree that your contributions will be licensed under the project's MIT license.