Skip to content

Commit

Permalink
small change
Browse files Browse the repository at this point in the history
  • Loading branch information
bubriks committed Dec 9, 2024
1 parent 840824e commit be76f78
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion utils/python/hsfs_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -304,7 +304,7 @@ def offline_fg_materialization(spark: SparkSession, job_conf: Dict[Any, Any], in
)

# Cache the DataFrame in memory
df.cache()
df = df.cache()

# filter only the necassary entries
filtered_df = df.filter(expr("CAST(filter(headers, header -> header.key = 'featureGroupId')[0].value AS STRING)") == str(entity._id))
Expand Down

0 comments on commit be76f78

Please sign in to comment.