[Yandex Cloud documentation](../../index.md) > [Tutorials](../index.md) > Building a data platform > All tutorials

# Building a data platform based on Yandex Cloud

## Apache Kafka® {#kafka}

* [Unassisted deployment of the Apache Kafka® web interface](deploy-kafka-ui.md)
* [Upgrading a Managed Service for Apache Kafka® cluster to migrate from ZooKeeper to KRaft](zk-kraft-kafka-migration.md)
* [Migrating a database from a third-party Apache Kafka® cluster to Yandex Managed Service for Apache Kafka®](kafka-connector.md)
* [Moving data between Managed Service for Apache Kafka® clusters using Data Transfer](data-transfer-mkf.md)
* [Delivering data from Yandex Managed Service for MySQL® to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](data-transfer-mmy.md)
* [Delivering data from Yandex Managed Service for MySQL® to Yandex Managed Service for Apache Kafka® using Debezium](debezium-mmy.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](data-transfer-mpg.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for Apache Kafka® using Debezium](debezium-mpg.md)
* [Delivering data from Yandex Managed Service for YDB to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](ydb-mkf-replication.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](data-transfer-mkf-mch.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](managed-kafka-to-greenplum.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex StoreDoc using Yandex Data Transfer](data-transfer-mkf-mmg.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for MySQL® using Yandex Data Transfer](data-transfer-mkf-mmy.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for OpenSearch using Yandex Data Transfer](data-transfer-mkf-mos.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for PostgreSQL using Yandex Data Transfer](mkf-to-mpg.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for YDB using Yandex Data Transfer](mkf-ydb-stream.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Data Streams using Yandex Data Transfer](mkf-yds-stream.md)
* [Delivering data from a Data Streams queue to Managed Service for Apache Kafka® using Yandex Data Transfer](yds-to-kafka.md)
* [Configuring Kafka Connect to work with a Yandex Managed Service for Apache Kafka® cluster](kafka-connect.md)
* [Syncing data from Apache Kafka® topics to an Object Storage bucket without using the internet](kafka-topic-s3-sync-private.md)
* Using a schema registry with Yandex Managed Service for Apache Kafka®:
  * [Managing data schemas in Managed Service for Apache Kafka®](schema-registry-overview.md)
  * [Using Managed Schema Registry with Yandex Managed Service for Apache Kafka®](managed-schema-registry.md)
  * [Using Managed Schema Registry with Yandex Managed Service for Apache Kafka® through the REST API](managed-schema-registry-rest.md)
  * [Using Confluent Schema Registry with Yandex Managed Service for Apache Kafka®](confluent-schema-registry.md)
* [Monitoring message loss in an Apache Kafka® topic](retention-policy.md)

## Apache Airflow™ {#airflow}

* [Automating Yandex Query tasks with Yandex Managed Service for Apache Airflow™](airflow-auto-tasks.md)
* [Sending requests to the Yandex Cloud API via the Yandex Cloud Python SDK](using-python-sdk-in-airflow.md)
* [Configuring an SMTP server to send e-mail notifications](airflow-test-smtp-notification.md)
* [Running a PySpark job using Yandex Managed Service for Apache Airflow™](airflow-spark-min.md)

## ClickHouse® {#clickhouse}

* [Adding data to ClickHouse®](insert-data-ch.md)
* [Migrating data to Managed Service for ClickHouse® using ClickHouse®](clickhouse-migration.md)
* [Migrating data to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](ch-to-mch-migration.md)
* [Migrating databases from MySQL® to ClickHouse® using Yandex Data Transfer](mysql-to-clickhouse.md)
* [Asynchronously replicating data from PostgreSQL to ClickHouse®](rdbms-to-clickhouse.md)
* [Exchanging data between Yandex Managed Service for ClickHouse® and Yandex Data Processing](dp-mch-data-exchange.md)
* [Configuring Yandex Managed Service for ClickHouse® for Graphite](clickhouse-for-graphite.md)
* [Fetching data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for ClickHouse®](fetch-data-from-mkf.md)
* [Delivering data to ksqlDB](use-ksqldb-with-mkf.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](data-transfer-mkf-mch.md)
* [Fetching data from RabbitMQ to Yandex Managed Service for ClickHouse®](fetch-data-from-rabbitmq.md)
* [Saving a Yandex Data Streams data stream in Yandex Managed Service for ClickHouse®](yds-to-clickhouse.md)
* [Using hybrid storage in Yandex Managed Service for ClickHouse®](clickhouse-hybrid-storage.md)
* [Sharding Yandex Managed Service for ClickHouse® tables](clickhouse-sharding.md)
* [Loading data from Yandex Direct to a Yandex Managed Service for ClickHouse® data mart using Yandex Cloud Functions, Yandex Object Storage, and Yandex Data Transfer](data-transfer-direct-to-mch.md)
* [Loading data from Yandex Object Storage to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](object-storage-to-clickhouse.md)
* [Copying data from Managed Service for OpenSearch to Managed Service for ClickHouse® using Yandex Data Transfer](opensearch-to-clickhouse.md)
* [Loading data from Yandex Managed Service for YDB to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](ydb-to-clickhouse.md)
* [Migrating databases from Google BigQuery to Yandex Managed Service for ClickHouse®](bigquery-to-clickhouse.md)
* [Yandex Managed Service for ClickHouse® integration with external Microsoft SQL Server database via ClickHouse® JDBC Bridge](jdbc-ch-to-sql-server-integration.md)
* [Yandex Managed Service for ClickHouse® integration with Oracle via ClickHouse® JDBC Bridge](jdbc-ch-to-oracle-integration.md)

## Greenplum® {#greenplum}

* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](managed-kafka-to-greenplum.md)
* [Migrating data from Yandex Managed Service for MySQL® to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](mmy-to-mgp.md)
* [Migrating databases from Greenplum® to ClickHouse®](greenplum-to-clickhouse.md)
* [Migrating databases from Greenplum® to PostgreSQL](greenplum-to-postgresql.md)
* [Exporting Greenplum® data to a cold storage in Yandex Object Storage](greenplum-yezzey.md)
* [Loading data from Yandex Object Storage to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](object-storage-to-greenplum.md)
* [Copying data from Managed Service for OpenSearch to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](opensearch-to-greenplum.md)
* [Creating an external table from a Yandex Object Storage bucket table using a configuration file](mgp-config-server-for-s3.md)
* [Getting data from external sources using named queries](pxf-named-queries.md)

## MongoDB/Yandex StoreDoc {#mongodb}

* [Migrating collections from MongoDB to Yandex StoreDoc](mongodb-migration-with-data-transfer.md)
* [Migrating data to Yandex StoreDoc](storedoc-data-migration.md)
* [Migrating a Yandex StoreDoc cluster from version 4.4 to 6.0 using Yandex Data Transfer](storedoc-versions.md)
* [Sharding Yandex StoreDoc collections](storedoc-sharding.md)
* [Performance analysis and tuning of Yandex StoreDoc](storedoc-profiling.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex StoreDoc using Yandex Data Transfer](data-transfer-mkf-mmg.md)


## MySQL® {#mysql}

* [Migrating a database from a third-party MySQL® cluster to a Yandex Managed Service for MySQL® cluster](mysql-data-migration/index.md)
* [Managed Service for MySQL® performance analysis and tuning](profiling-mmy.md)
* [Syncing data from a third-party MySQL® cluster to Yandex Managed Service for MySQL® using Yandex Data Transfer](sync-mysql.md)
* [Migrating databases from Yandex Managed Service for MySQL® to a third-party MySQL® cluster](mmy-to-mysql-migration.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for MySQL® using Yandex Data Transfer](data-transfer-mkf-mmy.md)
* [Migrating databases from MySQL® to ClickHouse® using Yandex Data Transfer](mysql-to-clickhouse.md)
* [Migrating databases from Yandex Managed Service for MySQL® to Yandex Object Storage](mmy-objs-migration.md)
* [Migrating data from Yandex Object Storage to Yandex Managed Service for MySQL® using Yandex Data Transfer](objs-mmy-migration.md)
* [MySQL® change data capture and delivery to YDS](mmy-to-yds.md)
* [Migrating data from Managed Service for MySQL® to Managed Service for PostgreSQL using Data Transfer](mmy-to-mpg.md)
* [Migrating data from Yandex Managed Service for MySQL® to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](mmy-to-mgp.md)
* [Importing data from Yandex Managed Service for MySQL® to Yandex Data Processing using Sqoop](sqoop-mmy.md)
* [Delivering data from Yandex Managed Service for MySQL® to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](data-transfer-mmy.md)
* [Delivering data from Yandex Managed Service for MySQL® to Yandex Managed Service for Apache Kafka® using Debezium](debezium-mmy.md)
* [Migrating databases from Yandex Managed Service for MySQL® to Yandex Managed Service for YDB using Yandex Data Transfer](mmy-ydb-migration.md)


## OpenSearch {#opensearch}

* [Configuring an index policy in Yandex Managed Service for OpenSearch](opensearch-index-policy.md)
* [Configuring a cold storage policy in Yandex Managed Service for OpenSearch](opensearch-cold-storage-policy.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for OpenSearch using Yandex Data Transfer](data-transfer-mkf-mos.md)
* [Migrating data from a third-party OpenSearch cluster to Yandex Managed Service for OpenSearch using Yandex Data Transfer](mos-migration-from-standalone.md)
* [Loading data from Yandex Managed Service for OpenSearch to Yandex Object Storage using Yandex Data Transfer](opensearch-to-object-storage.md)
* [Migrating data from Yandex Managed Service for OpenSearch to Yandex Managed Service for YDB using Yandex Data Transfer](opensearch-to-ydb.md)
* [Copying data from Managed Service for OpenSearch to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](opensearch-to-greenplum.md)
* [Copying data from Managed Service for OpenSearch to Managed Service for ClickHouse® using Yandex Data Transfer](opensearch-to-clickhouse.md)
* [Migrating data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for OpenSearch using Yandex Data Transfer](postgresql-to-opensearch.md)
* [Authenticating a Yandex Managed Service for OpenSearch cluster in OpenSearch Dashboards using Keycloak](opensearch-saml-keycloak.md)
* [Using the yandex-lemmer plugin in Yandex Managed Service for OpenSearch](opensearch-yandex-lemmer.md)
* [Sending notifications via email in Yandex Managed Service for OpenSearch](opensearch-email-notifications.md)
* [Connecting an MCP client to an OpenSearch cluster](mos-mcp.md)

## PostgreSQL {#postgresql}

* [Creating a PostgreSQL cluster for 1C:Enterprise](1c-postgresql.md)
* [Diagnosing Managed Service for PostgreSQL cluster performance issues](mpg-performance-problems.md)
* [Managed Service for PostgreSQL performance analysis and tuning](mpg-profiling.md)
* [Logical replication PostgreSQL](mpg-replication-overview.md)
* [Migrating a database from a third-party PostgreSQL cluster to Managed Service for PostgreSQL](postgresql-data-migration.md)
* [Migrating a database from Managed Service for PostgreSQL](outbound-replication.md)
* [Migrating a Yandex Managed Service for PostgreSQL cluster to a different version using Yandex Data Transfer](postgresql-versions.md)
* [Asynchronously replicating data from PostgreSQL to ClickHouse®](rdbms-to-clickhouse.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for PostgreSQL using Yandex Data Transfer](mkf-to-mpg.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](data-transfer-mpg.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for Apache Kafka® using Debezium](debezium-mpg.md)
* [Importing data from Yandex Managed Service for PostgreSQL to Yandex Data Processing using Sqoop](sqoop-mpg.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for YDB using Yandex Data Transfer](mpg-ydb-replication.md)
* [Migrating databases from Managed Service for PostgreSQL to Object Storage](mpg-to-objstorage.md)
* [Migrating data from Yandex Object Storage to Yandex Managed Service for PostgreSQL using Yandex Data Transfer](object-storage-to-postgresql.md)
* [Migrating data from Managed Service for PostgreSQL to Managed Service for MySQL® using Data Transfer](mpg-to-mmy.md)
* [PostgreSQL change data capture and delivery to YDS](mpg-to-yds.md)
* [Migrating data from AWS RDS for PostgreSQL to Yandex Managed Service for PostgreSQL using Yandex Data Transfer](rds-to-mpg.md)
* [Migrating data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for OpenSearch using Yandex Data Transfer](postgresql-to-opensearch.md)
* [Fixing string sorting issues in PostgreSQL after upgrading glibc](postgresql-glibc-collation-issues.md)
* [Using a Yandex Lockbox secret in a PySpark job to connect to Yandex Managed Service for PostgreSQL](job-pyspark-secret-access.md)
* [Configuring permissions for access to a secret created by Yandex Connection Manager for a Yandex Managed Service for PostgreSQL user](conn-man-secret-access.md)

## Valkey™ {#valkey}

* [Migrating a database from a third-party Valkey™ cluster to Yandex Managed Service for Valkey™](valkey-data-migration.md)
* [Using a Yandex Managed Service for Valkey™ cluster as a PHP session storage](valkey-as-php-sessions-storage.md)

## YDB {#ydb}

* [Delivering data from Yandex Managed Service for YDB to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](ydb-mkf-replication.md)
* [Delivering data from Yandex Managed Service for Apache Kafka® to Yandex Managed Service for YDB using Yandex Data Transfer](mkf-ydb-stream.md)
* [Migrating databases from Yandex Managed Service for MySQL® to Yandex Managed Service for YDB using Yandex Data Transfer](mmy-ydb-migration.md)
* [Delivering data from Yandex Managed Service for PostgreSQL to Yandex Managed Service for YDB using Yandex Data Transfer](mpg-ydb-replication.md)
* [Loading data from Yandex Object Storage to Yandex Managed Service for YDB using Yandex Data Transfer](object-storage-to-ydb.md)
* [Loading data from Yandex Managed Service for YDB to Yandex Object Storage using Yandex Data Transfer](ydb-to-object-storage.md)
* [Loading data from Yandex Managed Service for YDB to Yandex Managed Service for ClickHouse® using Yandex Data Transfer](ydb-to-clickhouse.md)
* [Migrating data from Yandex Managed Service for OpenSearch to Yandex Managed Service for YDB using Yandex Data Transfer](opensearch-to-ydb.md)
* [Delivering data from an Data Streams queue to Managed Service for YDB using Yandex Data Transfer](yds-to-ydb.md)
* [Yandex Managed Service for YDB change data capture and delivery to Yandex Data Streams](ydb-to-yds.md)

## Yandex Cloud DNS {#dns}

* [Configuring Yandex Cloud DNS to access a Yandex Managed Service for ClickHouse® cluster from other cloud networks](clickhouse-dns-peering.md)

## Yandex Data Processing {#dataproc}

* [Migrating an HDFS Yandex Data Processing cluster to a different availability zone](hdfs-cluster-migration.md)
* [Exchanging data between Yandex Managed Service for ClickHouse® and Yandex Data Processing](dp-mch-data-exchange.md)
* [Importing data from Yandex Managed Service for MySQL® to Yandex Data Processing using Sqoop](sqoop-mmy.md)
* [Importing data from Yandex Managed Service for PostgreSQL to Yandex Data Processing using Sqoop](sqoop-mpg.md)
* [Mounting Yandex Object Storage buckets to the file system of Yandex Data Processing hosts](data-processing-init-actions-geesefs.md)
* [Working with Apache Kafka® topics using PySpark jobs in Yandex Data Processing](data-processing-and-kafka.md)
* [Automating operations with Yandex Data Processing using Yandex Managed Service for Apache Airflow™](data-processing-and-airflow.md)
* [Shared use of Yandex Data Processing tables through Apache Hive™ Metastore](data-processing-to-data-processing.md)
* [Transferring metadata across Yandex Data Processing clusters using Apache Hive™ Metastore](metastore-import.md)
* [Importing data from Yandex Object Storage, processing and exporting to Yandex Managed Service for ClickHouse®](s3-data-processing-ch.md)
* [Using Yandex Managed Service for Apache Spark™ in Yandex DataSphere](spark-and-datasphere.md)

### Basic examples of working with jobs {#jobs-basic-tutorials}

* [Working with Hive jobs](hive-job-basics.md)
* [Working with MapReduce jobs](mapreduce-job-basics.md)
* [Working with PySpark jobs](pyspark-job-basics.md)
* [Working with Spark jobs](spark-job-basics.md)

### Advanced examples of working with jobs {#jobs-advanced-tutorials}

* [Running Apache Hive jobs](how-to-use-hive.md)
* [Launching and managing applications for Spark and PySpark](run-spark-job.md)
* [Running jobs from remote hosts that are not part of the Yandex Data Processing cluster](remote-run-job.md)

## Yandex Query {#query}

* [Processing Yandex Audit Trails events](audit-log-processing.md)
* [Processing Yandex Cloud Logging logs](cloud-logging-processing.md)
* [Processing Debezium CDC streams](debezium-yq.md)
* [Analyzing data with Jupyter](jupyter-yq.md)
* [Processing files with usage details in Yandex Cloud Billing](billing-detail-files-processing.md)

## Yandex Data Streams {#yds}

* [Ingesting data into storage systems](data-ingestion.md)
* [Smart log processing](log-ingestion.md)
* [Data transfer in microservice architectures](message-broker.md)
* [Migrating data to Yandex Object Storage using Yandex Data Transfer](yds-obj-migration.md)

## Yandex Data Transfer {#data-transfer}

* [Migrating data from a third-party Greenplum® or PostgreSQL cluster to Yandex MPP Analytics for PostgreSQL using Yandex Data Transfer](managed-greenplum.md)
* [Migrating MongoDB clusters](storedoc.md)
* [Migrating MySQL® clusters](managed-mysql.md)
* [Migrating to a third-party MySQL® cluster](managed-mysql-to-mysql.md)
* [Migrating PostgreSQL clusters](managed-postgresql.md)
* [Migrating a Yandex Managed Service for PostgreSQL cluster to a different version using Yandex Data Transfer](postgresql-versions.md)
* [Creating a schema registry to deliver data in Debezium CDC format from Apache Kafka®](schema-registry-cdc-debezium-kafka.md)

## Yandex Managed Service for Apache Spark™ {#spark}

* [Automating operations using Yandex Managed Service for Apache Airflow™](airflow-and-spark.md)
* [Working with an Object Storage table from a PySpark job using Apache Hive™ Metastore and Apache Iceberg™](spark-simple-rw-job.md)
* [Yandex Managed Service for Apache Spark™ integration with Apache Hive™ Metastore](metastore-and-spark.md)
* [Running a PySpark job using Yandex Managed Service for Apache Airflow™](airflow-spark-min.md)
* [Using Yandex Object Storage in Yandex Managed Service for Apache Spark™](spark-objstorage-integration.md)
* [Using Yandex Managed Service for Apache Spark™ in Yandex DataSphere](spark-and-datasphere.md)
* [Using a Yandex Lockbox secret in a PySpark job to connect to Yandex Managed Service for PostgreSQL](job-pyspark-secret-access.md)


## Yandex Managed Service for YTsaurus {#ytsaurus}

* [Running a PySpark job in Yandex Managed Service for YTsaurus](yt-run-spark-job.md)


_ClickHouse® is a registered trademark of [ClickHouse, Inc](https://clickhouse.com)._