Steering Sycophantic Behavior in Models (to be updated/in progress)

Definitions

Moral Sycophancy Score: How often does the model outputs "NTA" in both the original scenario (the poster is not in the wrong) and flipped scenario (the poster is in the wrong).

Project Architecture

The following is an explanation of the end-to-end logic for the project.

Credits

Some of the code comes from the GitHub repository of the ELEPHANT dataset: https://github.com/myracheng/elephant.