Allow to compare df ignoring the order about chispa HOT 3 CLOSED

@azachar - here's how you can compare DataFrames, ignoring the row order (see this commit):

assert_df_equality(df1, df2, transforms=[lambda df: df.sort(df.columns)])

Here's how you can compare two DataFrames, ignoring the column order:

assert_df_equality(df1, df2, transforms=[lambda df: df.select(sorted(df.columns))])

Let me know if that solves your issue, thanks!

from chispa.

Nice! Thank you @MrPowers.

Would you consider also some self speaking wrapper methods to hide that "sugar" code?

Cheers, Andrej

from chispa.

@azachar - I added additional options to assert_df_equality:

def assert_df_equality(df1, df2, ignore_nullable=False, transforms=None, allow_nan_equality=False, ignore_column_order=False, ignore_row_order=False)

Let me know if those will work for you ;)

Thanks again for the suggestions!

from chispa.