Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

on-deamnd tranformations working #2

Closed
wants to merge 58 commits into from
Closed

on-deamnd tranformations working #2

wants to merge 58 commits into from

Conversation

manu-sj
Copy link
Owner

@manu-sj manu-sj commented Jul 1, 2024

This PR adds/fixes/changes...

  • please summarize your changes to the code
  • and make sure to include all changes to user-facing APIs

JIRA Issue: -

Priority for Review: -

Related PRs: -

How Has This Been Tested?

  • Unit Tests
  • Integration Tests
  • Manual Tests on VM

Checklist For The Assigned Reviewer:

- [ ] Checked if merge conflicts with master exist
- [ ] Checked if stylechecks for Java and Python pass
- [ ] Checked if all docstrings were added and/or updated appropriately
- [ ] Ran spellcheck on docstring
- [ ] Checked if guides & concepts need to be updated
- [ ] Checked if naming conventions for parameters and variables were followed
- [ ] Checked if private methods are properly declared and used
- [ ] Checked if hard-to-understand areas of code are commented
- [ ] Checked if tests are effective
- [ ] Built and deployed changes on dev VM and tested manually
- [x] (Checked if all type annotations were added and/or updated appropriately)

manu-sj added 30 commits June 11, 2024 10:08
@manu-sj
hopsworks_udf first version
85a27ac
@manu-sj
working code for running hopsworks udf without saving in backend usin…
9e4478b 
…g python client
@manu-sj
removing debugging logs
75441a3
@manu-sj
statistics working with python client
7af03f2
@manu-sj
basic functionality working with backend
3ac5b26
@manu-sj
code with statistics working and saved to backend
df5c969
@manu-sj
working code for feature vector
2e9aa72
@manu-sj
reformatted and documented Hopswork UDF class
fceb9b5
@manu-sj
unit tests for transformation functions
52167f1
@manu-sj
clearning transformations engine and adding unit tests
a66f9e3
@manu-sj
feature view api formated
853995a
@manu-sj
reformatting and fixing feature_view_engine
b4a37af
@manu-sj
reformatted and added unit tests for feature view
2a62500
@manu-sj
updating documentation for feature store
35d72dc
@manu-sj
updating documentation for feature store
7ca35fd
@manu-sj
fixed tests for training datatset features
5e377e6
@manu-sj
reformatted and added unit tests for python engine
fa12032
@manu-sj
most unit tests fixed
f79a349
@manu-sj
all unit tests working
5608c18
@manu-sj
removed print
3fc94f8
@manu-sj
adding test for hopsworks_udf
2bf5f20
@manu-sj
correcting merge for vector server
594640c
@manu-sj
reformatting with ruff
f0e9540
@manu-sj
fixing vector server
6072642
@manu-sj
fixing docs
f46f0b7
@manu-sj
fixing vector server
07348d5
@manu-sj
fixing building in transformations
41a02ac
@manu-sj
correcting get feature vector
2215606
@manu-sj
adding missed changes for build in transformations
e1d7abe
@manu-sj
shallow copying scope dictonary to not overwrite statistics variable …
2d0bca3 
…for different udf's having same statistics parameter name
manu-sj added 20 commits June 11, 2024 10:08
@manu-sj
using feature view transformation functions
68c95aa
@manu-sj
addressing review comments
88bff75
@manu-sj
using PYARROW_EXTENSION_ENABLE during import rather than as a function
5ea3e43
@manu-sj
skiping transformation function test in windows spark udf failing due…
58678bc 
… to dependencies with greater expectation
@manu-sj
changing transformed_feature_vector_col_name to transformed_features …
be5036b 
…to obtain feature names after transfromations
@manu-sj
adding property transformed_features in feature view to obtain featur…
3a01ead 
…e names after transfromations
@manu-sj
updating doc string and adding property decorator missed during rebase
2753ec4
@manu-sj
refactoring transformation functions to update parsing of statistics …
23c7b8a 
…parameters and also renaming decorator name
@manu-sj
refactoring transformation functions to update parsing of statistics …
659f2ab 
…parameters and also renaming decorator name
@manu-sj
reformating with ruff
0a22fd7
@manu-sj
adding statistics to udf only if required
159da54
@manu-sj
convrting extended statistics to dictonary
eef2cb5
@manu-sj
sorting built in label encoder to maintain consistency
50e944c
@manu-sj
adding type hints for class TransformationStatistics
7111f86
@manu-sj
adapating to backend update of reaturning output_types, transformatio…
114a792 
…n_features and statistics_argument_names as Lists
@manu-sj
fixing unit tests
bd4bb1f
@manu-sj
removign space in doc string
64f34cd
@manu-sj
replace - from output column names with _
9891900
@manu-sj
revreting unwanted spark test _ replace changes
6ebd9f4
@manu-sj
on-deamnd tranformations working
c020210
@manu-sj manu-sj closed this Jul 1, 2024
@manu-sj manu-sj reopened this Jul 2, 2024
@manu-sj manu-sj closed this Jul 9, 2024
@manu-sj manu-sj deleted the FSTORE-1411 branch July 9, 2024 04:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@manu-sj