All pull requests

Pull requests

• [SPARK-60458][SQL] Optimize skewed joins per join instead of all-or-nothing

  #59703·ulysses-you opened Oct 22, 2026Contributor·

  ·
  3

• [SPARK-60459][SQL] Push down filters through ASOF JOIN

  #59702·LukaZdravic opened Oct 22, 2026Contributor·

  ·
  1

• [SPARK-27052][SQL][PYTHON][FOLLOWUP] Fix issues in lifting Python UDFs out of higher-order function lambdas

  #59701·HyukjinKwon opened Oct 22, 2026Member·

  ·

• [SPARK-56906][SQL] Add SKEW_JOIN hint with SkewKeyJoinExec

  #59700·pratham76 opened Oct 22, 2026Contributor·

  ·
  1

• [SPARK-60449][SQL] Fix ORC filter pushdown on TIMESTAMP values with sub-microsecond digits

  ai-review-requested
  #59699·dongjoon-hyun opened Oct 22, 2026Member·

  ·

• [SPARK-60447][SQL] Support V2 functions in CREATE FUNCTION on session catalog

  ai-review-requested
  #59697·pan3793 opened Oct 22, 2026Member·

  ·
  13

• [SPARK-56093][CORE][HISTORY] Allow AppStatus to be cached and reused by the history server

  #59696·ForVic opened Oct 22, 2026Contributor·

  ·
  13

• [INFRA] Tolerate an unreachable ASF JIRA in the merge script

  ai-review-requested
  #59695·holdenk opened Oct 22, 2026Contributor·

  ·
  3

• [SPARK-56632][SQL][CONNECT] Keep re-selected hidden join keys regular in DataFrame column resolution

  #59694·dejankrak-db opened Oct 22, 2026Contributor·

  ·
  3

• [WIP][SQL] Add a native Parquet source with an arrow-rs RowFilter to the Rust SDK examples

  ai-review-requested
  #59692·gengliangwang opened Oct 21, 2026Member·

  ·

• [SPARK-60445][SS][PYTHON] Stop the transformWithState state server before a failed task aborts its state store

  #59690·dylanwong250 opened Oct 21, 2026Contributor·

  ·

• [SPARK-60442][SQL][PYTHON] Fix variant decoding rejecting spec-valid decimals

  #59689·qlong opened Oct 21, 2026Contributor·

  ·

• [SPARK-60096][4.x][CONNECT][SQL] Raise a user-facing error instead of INTERNAL_ERROR for an unresolved DataFrame subquery plan id

  #59687·sadikovi opened Oct 21, 2026Contributor·

  ·
  1

• [SPARK-60441][CORE] Let a task release UnsafeSorterSpillReader's record buffer before it ends

  #59685·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-60439][SQL] Support DataSource V2 pushdown for aggregates with FILTER clauses

  #59684·hemanthboyina opened Oct 21, 2026Contributor·

  ·

• [SPARK-60437][DOCS] Fix stale API references in the Data Source V2 page and add a connector walkthrough

  #59683·lisancao opened Oct 21, 2026·

  ·
  18

• [SPARK-60433][SQL] Support non-constant expressions in VALUES lists

  ai-review-requested
  #59681·dtenedor opened Oct 21, 2026Contributor·

  ·
  15

• [SPARK-60432][CORE] Validate spark.io.compression.zstd.bufferSize

  ai-review-requested
  #59679·dongjoon-hyun opened Oct 21, 2026Member·

  ·
  2

• [SPARK-60431][SQL] Split a wide projection's outputs into methods under whole-stage codegen

  #59678·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-60428][SQL] Avoid zeroing Arrow vectors to their full capacity in ArrowWriter.reset()

  #59677·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-59718][SQL][4.x] Add opt-in in-process Python UDF execution via Arrow C Data Interface

  ai-review-requested
  #59676·viirya opened Oct 21, 2026Member·

  ·
  1

• [SPARK-60425][SQL] Fix InternalRow.copyValue to clone Array[Byte] values

  ai-review-requested
  #59675·wangyum opened Oct 21, 2026Member·

  ·
  11

• Andres.amar/kotlin spark package build

  #59672·andresamar-batch-infra opened Oct 21, 2026·

  ·

• [SPARK-60420][SQL] Add JDBC options to control Oracle TimestampNTZ mapping and wall-clock conversion separately

  #59671·aleksandar-trajkovic-db opened Oct 21, 2026Contributor·

  ·

• [SPARK-60419][CORE] Fix file descriptor leak in FileSystemPersistenceEngine.deserializeFromFile when compression is enabled

  #59670·sarutak opened Oct 21, 2026Member·

  ·
  4