Releases: palantir/spark
Releases · palantir/spark
3.0.0-palantir.70
- Infer Pandas string columns in Arrow conversion on Python 2 (#679)
3.0.0-palantir.69
3.0.0-palantir.68
- Upgrade parquet to 1.12.0-palantir.7 (#666)
3.0.0-palantir.67
- Support refreshing CondaEnvironment auth in specfile mode (#669)
3.0.0-palantir.66
3.0.0-palantir.65
- Split image name into snapshot and release registries, with a separate path parameter (#645)
3.0.0-palantir.64
Not print conda environment when executing conda process (#644) Not print conda environment as spark doesn't have arg logging and the env can therefore contain unsafe information.
3.0.0-palantir.63
- [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case (#640)
3.0.0-palantir.62
- Rename the configuration to set the shuffle storage plugin class (#637)
3.0.0-palantir.61
- [SPARK-27083][SQL] Add a new conf to control subqueryReuse
- [SPARK-27393][SQL] Show ReusedSubquery in the plan when the subquery is reused
- [SPARK-27747][SQL] add a logical plan link in the physical plan
- [SPARK-27816][SQL] make TreeNode tag type safe
- [SPARK-28057][SQL] Add method
clone
in catalyst TreeNode - [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout
- [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
- [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution
- [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name
- [SPARK-28356][SQL] Do not reduce the number of partitions for repartition in adaptive execution
- [SPARK-28356][SHUFFLE][FOLLOWUP] Fix case with different pre-shuffle partition numbers
- [SPARK-28237][SQL] Enforce Idempotence for Once batches in RuleExecutor
- [SPARK-28583][SQL] Subqueries should not call
onUpdatePlan
in Adaptive Query Execution - [SPARK-28753][SQL] Dynamically reuse subqueries in AQE
- [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution
- [SPARK-26840][SQL] Avoid cost-based join reorder in presence of join hints
- [SPARK-27225][SQL] Implement join strategy hints
- [SPARK-27783][SQL] Add customizable hint error handler
- [SPARK-29002][SQL] Avoid changing SMJ to BHJ if the build side has a has a high ratio of empty partitions
- [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans
- [SPARK-27236][TEST] Refactor log-appender pattern in tests
- [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)
- [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)
- [SPARK-28532][SPARK-28530][SQL][FOLLOWUP] Inline doc for FixedPoint(1) batches "Subquery" and "Join Reorder"
- [SPARK-29906][SQL] AQE should not introduce extra shuffle for outermost limit
- [SPARK-27824][SQL] Make rule EliminateResolvedHint idempotent
- [SPARK-28306][SQL] Make NormalizeFloatingNumbers rule idempotent
- [SPARK-28306][SQL][FOLLOWUP] Fix NormalizeFloatingNumbers rule idempotence for equi-join with
<=>
predicates