BUG: Handle dtype conversion failures with on_bad_lines='skip' (pandas-dev#63168)
Description
Modify pandas/_libs/parsers.pyx to treat dtype conversion failures as bad lines when on_bad_lines="skip" or on_bad_lines="warn" is set.
Problem
Currently, on_bad_lines="skip" only handles lines with wrong number of fields (during tokenization). Dtype conversion failures still raise exceptions even when on_bad_lines="skip" is set.
Bug example
BUG: Handle dtype conversion failures with on_bad_lines='skip' (pandas-dev#63168)
Description
Modify
pandas/_libs/parsers.pyxto treat dtype conversion failures as bad lines whenon_bad_lines="skip"oron_bad_lines="warn"is set.Problem
Currently,
on_bad_lines="skip"only handles lines with wrong number of fields (during tokenization). Dtype conversion failures still raise exceptions even whenon_bad_lines="skip"is set.Bug example