CHANGELOG.md

Changelog

v0.2.15 (2021-10-12)

Full Changelog

Implemented enhancements:

• Configurable templates by job type for spark kubernetes jobs #99 (pyalex)

v0.2.14 (2021-09-27)

Full Changelog

Implemented enhancements:

• Enable sql expression evaluation in fieldMapping for historical retrieval #98 (pyalex)

v0.2.13 (2021-09-25)

Full Changelog

Implemented enhancements:

• Add streaming metrics #95 (khorshuheng)

Fixed bugs:

• Fix setup requirement #97 (khorshuheng)
• Remove spark bigquery package download at run time #96 (khorshuheng)

v0.2.12 (2021-08-19)

Full Changelog

Implemented enhancements:

• Keep only unique entity rows in entity dataframe in historical retrieval job #93 (pyalex)
• Add checkpoint in each iteration of join loop (historical retrieval job) to truncate logical plan #92 (pyalex)
• Add persistent checkpoint in historical retrieval #91 (pyalex)
• Omit skewness in spark join by broadcasting entity dataframe #90 (pyalex)

v0.2.11 (2021-08-16)

Full Changelog

Implemented enhancements:

• Speed-up join in historical retrieval by replacing pandas with native spark #89 (pyalex)

v0.2.10 (2021-08-13)

Full Changelog

Implemented enhancements:

• Optimize historical retrieval by filtering rows only within timestamp boundaries from entity dataframe #87 (pyalex)

Fixed bugs:

• Pandas is missing in spark job base image #88 (pyalex)
• Do not use gcThreshold for historical retrieval jobs #86 (pyalex)

v0.2.9 (2021-07-28)

Full Changelog

Fixed bugs:

• Refresh redis topology on write #83 ([khorshuheng]
• Use hash for schedule job id #80 ([khorshuheng]

Implemented enhancements:

• Make max inflight RPCs in bigtable client configurable through spark config #81 ([pyalex])
• Use gcThresholdSec label instead of max_age if present #82 ([pyalex])

v0.2.8 (2021-07-07)

Full Changelog

Implemented enhancements:

• Use entity source project dataset for bigquery view creation #79 ([khorshuheng])(https://github.com/khorshuheng))

v0.2.7 (2021-06-15)

Full Changelog

Implemented enhancements:

• Extra configuration for bigtable client #78 ([pyalex])(https://github.com/pyalex))
• Add configuration for bigquery entity staging location #77 ([khorshuheng])(https://github.com/khorshuheng))

v0.2.6 (2021-05-20)

Full Changelog

Fixed bugs:

• Fix broken scheduled batch ingestion jobs #72 (khorshuheng)

v0.2.5 (2021-05-11)

Full Changelog

Fixed bugs:

• Fix SSTable name length restrictions during ingestion #70 (terryyylim)

Merged pull requests:

• Test long entity names in e2e tests #71 (pyalex)

v0.2.4 (2021-05-05)

Full Changelog

Fixed bugs:

• Batch Ingestion job is stuck after exception thrown #69 (pyalex)

Merged pull requests:

• Update redis host for e2e tests #68 (khorshuheng)
• Bigtable sink (row level) metrics #67 (pyalex)

v0.2.3 (2021-04-29)

Implemented enhancements:

• Support for Schedule Spark Application #59 (khorshuheng)

Fixed bugs:

• Call admin.modifyTable only if table spec changes: preventing quota to be exceeded #66 (pyalex)

Merged pull requests:

• Explicitly stop sparkSession on exception to prevent it stucking #65 (pyalex)
• Migrate sparkop e2e tests to kf-feast cluster #62 (khorshuheng)

v0.2.2 (2021-04-27)

Full Changelog

Implemented enhancements:

• Add project whitelist #57 (terryyylim)
• Configurable triggering interval from streaming ingestion #63 (pyalex)

Merged pull requests:

• Bump spark version to 3.0.2 #60 (pyalex)

v0.2.1 (2021-04-19)

Full Changelog

Implemented enhancements:

• Cassandra as sink option for ingestion job #51 (khorshuheng)

Merged pull requests:

• Reuse stencil client between Spark Tasks #58 (pyalex)

v0.2.0 (2021-04-15)

Full Changelog

Implemented enhancements:

• Cassandra as sink option for ingestion job #51 (khorshuheng)
• Bigtable as alternative Online Storage #46 (pyalex)

Fixed bugs:

• Cassandra schema update should not fail when column exist #55 (khorshuheng)
• Fix avro serialization: reuse generated schema in advance #52 (pyalex)

Merged pull requests:

• Fix dependencies for aws e2e #56 (pyalex)
• Better handling for invalid proto messages #54 (pyalex)
• Bump feast version to 0.9.5 #53 (terryyylim)
• Fix setup.py dependencies #49 (woop)
• Add documentation building for readthedocs.org #47 (woop)
• Cleanup Scala code #28 (YikSanChan)

v0.1.2 (2021-03-17)

Full Changelog

Implemented enhancements:

• Implicit type conversion for entity and feature table source #43 (khorshuheng)

Merged pull requests:

• Make field mapping for batch source consistent with streaming source #45 (khorshuheng)
• Better cleanup for cached rdds in Streaming Ingestion #44 (pyalex)
• Add tests for master branch #25 (woop)

v0.1.1 (2021-03-11)

Full Changelog

v0.1.0 (2021-03-08)

Full Changelog

Fixed bugs:

• Fix GH Actions PR Workflow Support for PRs from External Contributors #35 (mrzzy)
• Allow only project filter when listing ft #32 (terryyylim)

Implemented enhancements:

• Configurable retry for failed jobs (JobService Control Loop) #29 (pyalex)

Merged pull requests:

• Add Helm chart publishing for Feast Spark #24 (woop)

• Add project filter to list jobs #16 (terryyylim)

• Add protos and update CI #23 (pyalex)

• Add SparkClient as separate pytest fixture #22 (pyalex)

• Update CI workflow #19 (terryyylim)

• Update submodule #18 (terryyylim)

• Use feast core images from GCR instead of building them ourselves #17 (pyalex)

• Build & push docker workflow for spark ingestion job #13 (pyalex)

• Fix Azure e2e tests #11 (oavdeev)

• fix submodule ref #10 (oavdeev)