Rule and DataFrame datatypes not matching

[FShinoda]

Hey there!

I am getting the following error:

and yeah, acc_benefits_id is not string. it is long datatype.

How can I define the rules so it considers this column like long or some related datatype?

Thanks in advance!!

[canimus]

Hello, happy to help. What kind of check are you performing? I assume that is has_pattern as it is the only one with a string requirement.
And yes, certain checks are associated to specific data types as shown in the README. One alternative is to simply cast your column:

# assuming your dataframe as `acc_benefits_id`
from cuallee import Check, CheckLevel
check = Check(CheckLevel.WARNING, "Pattern")
check.has_pattern("acc_benefits_id_str", "your_pattern")
check.validate(df.select("acc_benefits_id").cast("string").alias("acc_benefits_id_str")).show()

However, I do think that a pattern check in a numeric data type, is probably not what you are searching for isn't?
Is computationally more expensive, or probably I am just wildly making assumptions?
Ok. Hope it helps @FShinoda
Regards,