Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark 2.4 support #402

Merged
merged 64 commits into from
Feb 19, 2020
Merged

Spark 2.4 support #402

merged 64 commits into from
Feb 19, 2020

Commits on Sep 4, 2019

  1. Revert "Revert back to Spark 2.3 (#399)" 

    This reverts commit 95a77b1.
    @tovbinm
    tovbinm committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    77e2229 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2019

  1. Update to Spark 2.4.3 and XGBoost 0.90

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    485fcd5 View commit details
    Browse the repository at this point in the history

  2. special double serializer fix

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    12f5333 View commit details
    Browse the repository at this point in the history

  3. fix serialization

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    a4ee986 View commit details
    Browse the repository at this point in the history

  4. fix serialization

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    47703fa View commit details
    Browse the repository at this point in the history

  5. docs

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    ea4b11f View commit details
    Browse the repository at this point in the history

  6. fixed missng value for test

    @wsuchy @nicodv
    wsuchy authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    ab81e31 View commit details
    Browse the repository at this point in the history

  7. meta fix

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    c017869 View commit details
    Browse the repository at this point in the history

  8. Updated DecisionTreeNumericMapBucketizer test to deal with the change… 

    … made to decision tree pruning in Spark 2.4. If nodes are split, but both child nodes lead to the same prediction then the split is pruned away. This updates the test so this doesn't happen for feature 'b'
    @Jauntbox @nicodv
    Jauntbox authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    99ea7e1 View commit details
    Browse the repository at this point in the history

  9. fix params meta test

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    daa2672 View commit details
    Browse the repository at this point in the history

  10. FIxed failing xgboost test

    @wsuchy @nicodv
    wsuchy authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    7d3ebb7 View commit details
    Browse the repository at this point in the history

  11. ident

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    5661640 View commit details
    Browse the repository at this point in the history

  12. cleanup

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    8852d69 View commit details
    Browse the repository at this point in the history

  13. added dataframe reader and writer extensions

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    2ab8924 View commit details
    Browse the repository at this point in the history

  14. added const

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    7c8b988 View commit details
    Browse the repository at this point in the history

  15. cherrypick fixes

    @nicodv
    nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    d98c8a9 View commit details
    Browse the repository at this point in the history

  16. added xgboost params + update models to use public predict method

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    cce0d8f View commit details
    Browse the repository at this point in the history

  17. blarg

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    8afbae7 View commit details
    Browse the repository at this point in the history

  18. double ser test

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    e8770f6 View commit details
    Browse the repository at this point in the history

  19. update mleap and spark testing base

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    afffc56 View commit details
    Browse the repository at this point in the history

  20. Update README.md

    @tovbinm @nicodv
    tovbinm authored and nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    ed43719 View commit details
    Browse the repository at this point in the history

  21. type fix

    @nicodv
    nicodv committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    8804acd View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2019

  1. Merge branch 'master' into ndv/spark2.4

    @nicodv
    nicodv committed Oct 15, 2019
    Configuration menu
    Copy the full SHA
    a1461c7 View commit details
    Browse the repository at this point in the history

  2. bump minor version

    @nicodv
    nicodv committed Oct 15, 2019
    Configuration menu
    Copy the full SHA
    b54d0f5 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2019

  1. Merge branch 'master' into ndv/spark2.4

    @tovbinm
    tovbinm committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    861f862 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    41f9dc4 View commit details
    Browse the repository at this point in the history

  3. Update Spark version in the README

    @tovbinm
    tovbinm committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    cb4cb7b View commit details
    Browse the repository at this point in the history

  4. bump version

    @nicodv
    nicodv committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    abca58b View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/ndv/spark2.4' into ndv/spark2.4

    @nicodv
    nicodv committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    ab8daf8 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2019

  1. Update build.gradle

    @tovbinm
    tovbinm committed Oct 19, 2019
    Configuration menu
    Copy the full SHA
    e58da6c View commit details
    Browse the repository at this point in the history

  2. Update pom.xml

    @tovbinm
    tovbinm committed Oct 19, 2019
    Configuration menu
    Copy the full SHA
    37614d7 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Oct 19, 2019
    Configuration menu
    Copy the full SHA
    e8a27ea View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2019

  1. Merge branch 'ndv/spark2.4' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Oct 21, 2019
    Configuration menu
    Copy the full SHA
    e205856 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Oct 21, 2019
    Configuration menu
    Copy the full SHA
    f93db0b View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2019

  1. set correct json4s version

    @nicodv
    nicodv committed Nov 5, 2019
    Configuration menu
    Copy the full SHA
    505a881 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2019

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    e21d06c View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2019

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Nov 9, 2019
    Configuration menu
    Copy the full SHA
    84bb70a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/revert-399-mt/revert-spark-2.4' … 

    …into revert-399-mt/revert-spark-2.4
    @nicodv
    nicodv committed Nov 9, 2019
    Configuration menu
    Copy the full SHA
    08db1db View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2019

  1. upgrade helloworld deps

    @nicodv
    nicodv committed Nov 15, 2019
    Configuration menu
    Copy the full SHA
    3ba95b6 View commit details
    Browse the repository at this point in the history

  2. upgrade notebook deps on TMog and Spark

    @nicodv
    nicodv committed Nov 15, 2019
    Configuration menu
    Copy the full SHA
    d77515c View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2019

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    d3b53be View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2019

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    1634927 View commit details
    Browse the repository at this point in the history

  2. bump to version 0.7.0 for Spark update

    @nicodv
    nicodv committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    b8a43b5 View commit details
    Browse the repository at this point in the history

  3. align helloworld dependencies

    @nicodv
    nicodv committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    094be05 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/revert-399-mt/revert-spark-2.4' … 

    …into revert-399-mt/revert-spark-2.4
    @nicodv
    nicodv committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    cc7de97 View commit details
    Browse the repository at this point in the history

  5. align helloworld dependencies

    @nicodv
    nicodv committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    4bd5977 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2019

  1. get -> getOrElse with exception

    @nicodv
    nicodv committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    46fc60a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    0211fde View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2020

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4 

    # Conflicts:
#	core/src/test/scala/com/salesforce/op/ModelInsightsTest.scala
    @nicodv
    nicodv committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    7147b72 View commit details
    Browse the repository at this point in the history

  2. fix helloworld compilation

    @nicodv
    nicodv committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    4d686c7 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2020

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    f6a2a4e View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2020

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Jan 22, 2020
    Configuration menu
    Copy the full SHA
    adc5b25 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2020

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @nicodv
    nicodv committed Jan 27, 2020
    Configuration menu
    Copy the full SHA
    c64eb51 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2020

  1. Merge branch 'master' into revert-399-mt/revert-spark-2.4

    @tovbinm
    tovbinm committed Jan 30, 2020
    Configuration menu
    Copy the full SHA
    e0c164d View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2020

  1. Spark 2.4.5

    @tovbinm
    tovbinm committed Feb 14, 2020
    Configuration menu
    Copy the full SHA
    b3c0a74 View commit details
    Browse the repository at this point in the history

  2. Spark 2.4.5

    @tovbinm
    tovbinm committed Feb 14, 2020
    Configuration menu
    Copy the full SHA
    f4ab3fd View commit details
    Browse the repository at this point in the history

  3. Spark 2.4.5

    @tovbinm
    tovbinm committed Feb 14, 2020
    Configuration menu
    Copy the full SHA
    50d9dfb View commit details
    Browse the repository at this point in the history

  4. Update OpTitanicSimple.ipynb

    @tovbinm
    tovbinm committed Feb 14, 2020
    Configuration menu
    Copy the full SHA
    3417972 View commit details
    Browse the repository at this point in the history

  5. Update OpIris.ipynb

    @tovbinm
    tovbinm committed Feb 14, 2020
    Configuration menu
    Copy the full SHA
    df38bcc View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2020

  1. Revert "Spark 2.4.5" 

    This reverts commit b3c0a74.
    @tovbinm
    tovbinm committed Feb 15, 2020
    Configuration menu
    Copy the full SHA
    3af27f3 View commit details
    Browse the repository at this point in the history

  2. Revert "Spark 2.4.5" 

    This reverts commit f4ab3fd.
    @tovbinm
    tovbinm committed Feb 15, 2020
    Configuration menu
    Copy the full SHA
    66afd79 View commit details
    Browse the repository at this point in the history

  3. Revert "Spark 2.4.5" 

    This reverts commit 50d9dfb.
    @tovbinm
    tovbinm committed Feb 15, 2020
    Configuration menu
    Copy the full SHA
    39ff755 View commit details
    Browse the repository at this point in the history

  4. Revert "Update OpTitanicSimple.ipynb" 

    This reverts commit 3417972.
    @tovbinm
    tovbinm committed Feb 15, 2020
    Configuration menu
    Copy the full SHA
    09c5f2b View commit details
    Browse the repository at this point in the history

  5. Revert "Update OpIris.ipynb" 

    This reverts commit df38bcc.
    @tovbinm
    tovbinm committed Feb 15, 2020
    Configuration menu
    Copy the full SHA
    d79bcc3 View commit details
    Browse the repository at this point in the history