Skip to main content

LakeSoul 4.0.0 Compatibility Matrix

This page defines the supported runtime and platform boundaries for LakeSoul Core 4.0.0. “Release CI” identifies the exact baseline exercised by the 4.0.0 release gates; it does not imply support for unlisted versions.

Core runtimes

ComponentSupported baselineRelease CI baselineStatusNotes
SparkSpark 3.5.8, Scala 2.12.15, Java 11Spark 3.5.8, Scala 2.12.15, Temurin 11GAUse lakesoul-spark-3.5_2.12:4.0.0.
FlinkFlink 1.20.0, Scala 2.12, Java 11 or laterFlink 1.20.0, Temurin 11GAUse lakesoul-flink-1.20_2.12:4.0.0.
Flink CDC3.5.03.5.0GAReusing a Flink CDC 3.0 savepoint is unsupported.
PrestoPresto 0.296, Java 17Presto 0.296, Temurin 17GAUse lakesoul-presto-0.296:4.0.0. Replace the complete deployment; mixed connector versions are unsupported.
PostgreSQLPostgreSQL 14 or laterPostgreSQL 14.5GAApply the versioned metadata migration before starting 4.0.0.

Python compatibility

LakeSoul Python is released independently from LakeSoul Core. The Python release aligned with the Core 4.0.0 compatibility gates is 2.0.0.

ComponentSupported rangeRelease CI baselineStatus
LakeSoul Python2.0.02.0.0Independent release
Python>=3.103.10GA
Official wheel platformLinux x86_64, manylinux2014x86_64-unknown-linux-gnuGA
PyArrow>=16,<21Resolved from the locked Python release environmentGA
PySpark extra3.5.83.5.8GA
Ray extra>=2.55,<2.56Resolved from the locked Python release environmentOptional
Daft extra>=0.7.15Resolved from the locked Python release environmentOptional

A Core tag does not publish Python, and a py-vX.Y.Z tag does not publish Core artifacts or change the website’s stable Core version.

Native platform support

Operating systemArchitectureABI/targetBuildNative smoke testConnector E2ESupport level
Linux GNUx86_64x86_64-unknown-linux-gnuRequiredRequiredRequiredGA Production
Linux GNUaarch64NoNoNoUnsupported
Linux muslAnyNoNoNoUnsupported
macOSAnyNoNoNoUnsupported
WindowsAnyNoNoNoUnsupported
Any 32-bit OSAnyNoNoNoUnsupported

Official connector JARs embed Linux x86_64 GNU native libraries. LakeSoul 4.0.0 does not publish official native artifacts or provide an official source-build support contract for the unsupported platforms above.

File and upgrade compatibility

Capability4.0.0 supportCompatibility boundary
Read legacy ParquetSupportedCovered by release compatibility gates.
Read VortexSupportedUses Vortex's standard writer strategy; files use the .vortex extension.
Read Vortex CompactSupportedUses the compact strategy; files also use the .vortex extension.
Mixed-format snapshotSupportedOne snapshot may contain Parquet and either Vortex write strategy.
Default writesVortex CompactLakeSoul 3.x cannot read the resulting Vortex files.
Upgrade from 3.0.0Supported cold upgradeStop all processes, restore-test a consistent metadata/data backup pair, migrate metadata, and replace all runtimes together.
Direct upgrade from 2.xUnsupportedUpgrade through the verified 3.0.0 baseline.
Mixed 3.x/4.0.0 operationUnsupportedDo not mix writers, readers, connector JARs, or native libraries.
In-place rollback after a Vortex commitUnsupportedRestore PostgreSQL metadata and table data from the same quiesced pre-upgrade backup.
Flink CDC 3.0 savepoint reuseUnsupportedUse source retention or an independently verified replay/backfill procedure.

See Physical File Formats for the differences between parquet, vortex, and vortex-compact, format selection in each writer, and the Vortex rollback boundary.

Gluten Preview

LakeSoulSparkScalaGlutenPlatformDistributionSupport level
4.0.03.5.82.121.6.0Linux x86_64 GNUGitHub Release JAR onlyPreview

The Gluten artifact is lakesoul-spark-gluten-3.5_2.12-4.0.0.jar. It is not published to Maven Central and does not block Core GA. Preview status means its dependency chain and production support contract are not yet at GA level.

See the 4.0.0 release notes and upgrade and recovery guide before upgrading.