15 Pull requests opened by 13 people

• [MINOR] Improve documentation of concat functions in pyspark

  #51086 opened Jun 4, 2025

• [SPARK-52402][PS] Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode

  #51090 opened Jun 4, 2025

• [SPARK-52403][SQL] Add numTargetRowsCopied metric to MergeRowExec

  #51091 opened Jun 4, 2025

• [SPARK-52238][TESTS][FOLLOW-UP] Fix test failure in classic-only envs

  #51094 opened Jun 5, 2025

• [SPARK-52399][Kubernetes] Support local ephemeral-storage resource

  #51096 opened Jun 5, 2025

• [SQL][MINOR] Update comments and remove dead code in UnionLoop

  #51097 opened Jun 5, 2025

• [SPARK-52406][CORE][TESTS] Move the test case named "benchmark" from `PercentileHeapSuite` to `PercentileHeapBenchmark`

  #51099 opened Jun 5, 2025

• pyspark: Improve SparkConf typing

  #51100 opened Jun 5, 2025

• Add unit test to verify in Spark Connect, Column object defined outside of an UDF can be referenced properly.

  #51101 opened Jun 5, 2025

• [SPARK-52413][PYTHON][TEST] `test_install_spark` switch to Spark 3.5.6

  #51103 opened Jun 6, 2025

• [SPARK-52400][SQL][TESTS][FOLLOWUP] Regenerate `nonansi/try_arithmetic.sql.out` for Java 21

  #51104 opened Jun 6, 2025

• [WIP][SPARK-42746][SQL] Fix optimizer failure for SortOrder in the LISTAGG function

  #51105 opened Jun 6, 2025

• [SPARK-52415][BUILD] Upgrade Maven to 3.9.10

  #51106 opened Jun 6, 2025

• [SPARK-52417][SQL] Simplify Table properties handling in View Schema Evolution Mode

  #51107 opened Jun 7, 2025

• [SPARK-37940][SQL]update error mechanism to fully SparkThrowable

  #51108 opened Jun 7, 2025

16 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [SPARK-52187][SQL] Introduce Join pushdown for DSv2

  #50921 commented on Jun 4, 2025 • 8 new comments

• [SPARK-52388][SQL] Handle named and positional parameters under `PlanWithUnresolvedIdentifier`

  #51073 commented on Jun 6, 2025 • 6 new comments

• [SPARK-52381][Core] JsonProtocol: Only accept subclasses of SparkListenerEvent

  #51061 commented on Jun 6, 2025 • 5 new comments

• [SPARK-47547] BloomFilter fpp degradation

  #50933 commented on Jun 6, 2025 • 3 new comments

• [SPARK-52348][CONNECT] Add support for Spark Connect handlers for pipeline commands

  #51057 commented on Jun 6, 2025 • 1 new comment

• [SPARK-52354] Add type coercion to UnionLoop

  #51063 commented on Jun 6, 2025 • 1 new comment

• [SPARK-52356][PS] Enable divide-by-zero for boolean floordiv with ANSI enabled

  #51079 commented on Jun 6, 2025 • 1 new comment

• [SPARK-51554][SQL] Add the time_trunc() function for TIME datatype

  #50607 commented on Jun 5, 2025 • 0 new comments

• [Spark-50873][SQL] Prune column for ExistsSubquery in DSV2

  #50916 commented on Jun 6, 2025 • 0 new comments

• [SPARK-52186][SQL] Rewrite EXISTS to add Scalar Project

  #50917 commented on Jun 6, 2025 • 0 new comments

• [SPARK-52334][CORE][K8S] update all files, jars, and pyFiles to reference the working directory after they are downloaded

  #51037 commented on Jun 5, 2025 • 0 new comments

• [SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2

  #51046 commented on Jun 5, 2025 • 0 new comments

• [SPARK-52404][SQL] Give a separate error class to failures in `BindReferences`

  #51066 commented on Jun 5, 2025 • 0 new comments

• [SPARK-47404][SQL] Add configurable size limits for ANTLR DFA cache

  #51069 commented on Jun 6, 2025 • 0 new comments

• Dev 132930 spark image research

  #51075 commented on Jun 4, 2025 • 0 new comments

• Creating minimal CVE spark base image

  #51076 commented on Jun 4, 2025 • 0 new comments