Understanding and Resolving the `pyarrow.lib.ArrowInvalid` Exception in PySpark Data Processing