lakehouse.spark.utils.assertionspark

lakehouse.spark.utils.assertionspark.assert_class_options(class_options: Dict[str, Any], spark: SparkSession) → None

Function to assert that the class options are valid.

Parameters:

• class_options (Dict[str, Any]) – class options

• spark (SparkSession) – spark session

lakehouse.spark.utils.assertionspark.assert_col_in_dataframe(df: DataFrame, col: str) → None

Function to assert that a column exists in a DataFrame.

Parameters:

• df (DataFrame) – DataFrame

• col (str) – column name

lakehouse.spark.utils.assertionspark.assert_optimize_options_per_tbl(optimize_opts: Dict[str, Any], spark: SparkSession, tbl_name: str) → None

Function to assert that the optimize options are valid on table level

Parameters:

• optimize_opts (Dict[str, Any]) – optimize options

• spark (SparkSession) – spark session

• tbl_name (str) – tbl name uri as catalog.schema.table