Errors

Classes

AnalysisException([message, errorClass, ...])	Failed to analyze a SQL query plan.
ArithmeticException([message, errorClass, ...])	Arithmetic exception thrown from Spark with an error class.
ArrayIndexOutOfBoundsException([message, ...])	Array index out of bounds exception thrown from Spark with an error class.
DateTimeException([message, errorClass, ...])	Datetime exception thrown from Spark with an error class.
IllegalArgumentException([message, ...])	Passed an illegal or inappropriate argument.
NumberFormatException([message, errorClass, ...])	Number format exception thrown from Spark with an error class.
ParseException([message, errorClass, ...])	Failed to parse a SQL command.
PySparkAssertionError([message, errorClass, ...])	Wrapper class for AssertionError to support error classes.
PySparkAttributeError([message, errorClass, ...])	Wrapper class for AttributeError to support error classes.
PySparkException([message, errorClass, ...])	Base Exception for handling errors generated from PySpark.
PySparkKeyError([message, errorClass, ...])	Wrapper class for KeyError to support error classes.
PySparkNotImplementedError([message, ...])	Wrapper class for NotImplementedError to support error classes.
PySparkPicklingError([message, errorClass, ...])	Wrapper class for pickle.PicklingError to support error classes.
PySparkRuntimeError([message, errorClass, ...])	Wrapper class for RuntimeError to support error classes.
PySparkTypeError([message, errorClass, ...])	Wrapper class for TypeError to support error classes.
PySparkValueError([message, errorClass, ...])	Wrapper class for ValueError to support error classes.
PySparkImportError([message, errorClass, ...])	Wrapper class for ImportError to support error classes.
PySparkIndexError([message, errorClass, ...])	Wrapper class for IndexError to support error classes.
PythonException([message, errorClass, ...])	Exceptions thrown from Python workers.
QueryContext()	Query context of a PySparkException.
QueryContextType(value)	The type of QueryContext.
QueryExecutionException([message, ...])	Failed to execute a query.
SessionNotSameException([message, ...])	Performed the same operation on different SparkSession.
SparkRuntimeException([message, errorClass, ...])	Runtime exception thrown from Spark with an error class.
SparkUpgradeException([message, errorClass, ...])	Exception thrown because of Spark upgrade.
SparkNoSuchElementException([message, ...])	Exception thrown for java.util.NoSuchElementException.
StreamingQueryException([message, ...])	Exception that stopped a StreamingQuery.
StreamingPythonRunnerInitializationException([...])	Failed to initialize a streaming Python runner.
TempTableAlreadyExistsException([message, ...])	Failed to create temp view since it is already exists.
UnknownException([message, errorClass, ...])	None of the other exceptions.
UnsupportedOperationException([message, ...])	Unsupported operation exception thrown from Spark with an error class.
PickleException([message, errorClass, ...])	Represents an exception which is failed while pickling from server side such as net.razorvine.pickle.PickleException.

Methods

PySparkException.getCondition()	Returns an error condition.
PySparkException.getErrorClass()	Returns an error class as a string.
PySparkException.getMessage()	Returns full error message.
PySparkException.getMessageParameters()	Returns a message parameters as a dictionary.
PySparkException.getQueryContext()	Returns QueryContext.
PySparkException.getSqlState()	Returns an SQLSTATE as a string.