Problem
Binomial coefficient answers are common on MATH/AIME. The extractor reads the lower index digit, and normalize leaves \binom intact so sympy never equates the value:
extract_last_number(r"\binom{5}{2}") # "2"
score_text("math500", r"$\binom{5}{2}$", "2") # 1.0 FALSE POSITIVE
score_text("math500", r"$\binom{5}{2}$", "10") # 0.0 FALSE NEGATIVE
score_text("math500", r"\boxed{\binom{5}{2}}", "10") # 0.0
# same class: {5 \choose 2}
Sibling of #419 (frac/sqrt operand-digit bleed).
Expected
Extract the whole \binom{n}{k} / {n \choose k} term; normalize to a sympy-friendly binomial(n,k) so gold 10 matches and bare 2 does not.
Environment
Problem
Binomial coefficient answers are common on MATH/AIME. The extractor reads the lower index digit, and normalize leaves
\binomintact so sympy never equates the value:Sibling of #419 (frac/sqrt operand-digit bleed).
Expected
Extract the whole
\binom{n}{k}/{n \choose k}term; normalize to a sympy-friendlybinomial(n,k)so gold10matches and bare2does not.Environment