[Yandex Cloud documentation](../../index.md) > [Yandex Data Processing](../index.md) > [Concepts](index.md) > Apache Iceberg™ in Yandex Data Processing

# Apache Iceberg™ in Yandex Data Processing

[Apache Iceberg™](https://iceberg.apache.org/) is an [open table format](https://iceberg.apache.org/spec/) for storing and processing large data arrays. It expands the feature set of the [Apache Spark™](https://spark.apache.org/) platform:

* Supports the high-performance Apache Iceberg™ tables you use the same way as regular SQL tables.
* Provides the [schema evolution](https://iceberg.apache.org/docs/latest/evolution/#schema-evolution) mechanism which eliminates side effects when updating schemas.
* Provides [hidden partitioning](https://iceberg.apache.org/docs/latest/partitioning/) in auto mode thus preventing errors related to manual partitioning.
* Allows retrospective requests enabled by the [time travel](https://iceberg.apache.org/docs/latest/spark-queries/#time-travel) mechanism. You can use the feature to make reproducible requests based on table snapshots or compare changes.

    {% note info %}

    This mechanism requires Apache Spark™ 3.3.x or higher.

    {% endnote %}

* Allows rolling tables back to previous versions (version rollback) for quick response to issues.
* Provides [advanced filtering](https://iceberg.apache.org/docs/latest/performance/#metadata-filtering) that relies on column-level and partition-level statistics as well as table metadata. This accelerates request processing, even for very large tables: data files unrelated to the request will not be processed.
* Enables the [serializable](https://iceberg.apache.org/docs/latest/reliability/) isolation level — the strictest one for transaction isolation. All changes in tables are atomic, and the readers will see only the committed ones.
* Supports [concurrent writing](https://iceberg.apache.org/docs/latest/reliability/#concurrent-write-operations) based on the optimistic strategy: a writer will retry an operation if their changes are in conflict with those of another writer.

You can [configure Apache Iceberg™ in a Yandex Data Processing cluster](../operations/apache-iceberg.md) versions 2.0 or higher.


{% note info %}

Apache Iceberg™ is not part of Yandex Data Processing. It is not covered by Yandex Cloud support and its usage is not governed by the [Yandex Data Processing Terms of Use](https://yandex.ru/legal/cloud_termsofuse/?lang=en).

{% endnote %}


For more information about Apache Iceberg™, see [this official guide](https://iceberg.apache.org/docs/latest/).

## Compatibility between Apache Iceberg™ versions and Yandex Data Processing images {#compatibility}

Apache Iceberg™ versions and Yandex Data Processing images are only compatible if the Apache Iceberg™ version is compatible with the Apache Spark™ version used in the cluster. The table below lists compatible versions and links to the library files you will need to configure Apache Iceberg™ in your cluster.

#|
|| **Yandex Data Processing image** | **Apache Spark™ version**   | **Apache Iceberg™ version** | **JAR files**     ||
|| 2.0.x                          | 3.0.3
| [1.0.0](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.0.0)
| [iceberg-spark-runtime-3.0_2.12-1.0.0.jar](https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark-runtime-3.0_2.12/1.0.0/iceberg-spark-runtime-3.0_2.12-1.0.0.jar) ||
|| 2.1.x                | 3.3.2
| [1.5.2](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.5.2)
| [iceberg-spark-runtime-3.3_2.12-1.5.2.jar](https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark-runtime-3.3_2.12/1.5.2/iceberg-spark-runtime-3.3_2.12-1.5.2.jar) ||
|| 2.2.x                          | 3.5.0
| [1.5.2](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.5.2)
| [iceberg-spark-runtime-3.5_2.12-1.5.2.jar](https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark-runtime-3.5_2.12/1.5.2/iceberg-spark-runtime-3.5_2.12-1.5.2.jar) ||
|#


{% note info %}

Access to image 2.2 is provided on request. Contact [support](https://center.yandex.cloud/support) or your account manager.

{% endnote %}