[Yandex Cloud documentation](../index.md) > Yandex Data Streams > Data Streams # Yandex Data Streams Yandex Data Streams is a scalable service for real-time data stream management. This service continuously collects data from multiple sources, including browsing history, application and system logs. Its API is compatible with both the Amazon Kinesis Data Streams API and Kafka API through version 3.4.0. # Yandex Data Streams ## Getting started - [Preparing the environment](quickstart/index.md) - [Creating a data stream](quickstart/create-stream.md) ### Data collection and delivery - [Fluentd](quickstart/fluentd.md) - [Logstash](quickstart/logstash.md) - [AWS CLI](quickstart/aws-cli.md) - [Debezium Change Data Capture (CDC) stream processing](quickstart/debezium.md) ## Step-by-step guides - [All guides](operations/index.md) - [Managing data streams](operations/manage-streams.md) ### Working with the AWS CLI - [Creating a data stream](operations/aws-cli/create.md) - [Getting stream info](operations/aws-cli/describe.md) - [Sending data to a stream](operations/aws-cli/send.md) - [Reading data from a stream](operations/aws-cli/get-records.md) - [Deleting a stream](operations/aws-cli/delete.md) ### Working with the AWS SDK - [Preparing the environment](operations/aws-sdk/prepare.md) - [Creating a data stream](operations/aws-sdk/create.md) - [Sending data to a stream](operations/aws-sdk/send.md) - [Reading data from a stream](operations/aws-sdk/get-records.md) - [Deleting a stream](operations/aws-sdk/delete.md) ## Concepts - [Overview](concepts/index.md) - [Terms and definitions](concepts/glossary.md) - [Shards and partition keys](concepts/partition-keys.md) - [Quotas and limits](concepts/limits.md) - [Comparison with Yandex Message Queue](concepts/yds-ymq-comparison.md) - [Transactions involving data streams and YDB tables](concepts/topic-table-transactions.md) ## Tutorials - [All tutorials](tutorials/index.md) - [Ingesting data into storage systems](tutorials/data-ingestion.md) - [Smart log processing](tutorials/log-ingestion.md) - [Data transfer in microservice architectures](tutorials/message-broker.md) - [Storing data in ClickHouse®](tutorials/send-to-clickhouse.md) - [Log replication to Object Storage via Fluent Bit](tutorials/replicate-logs-to-storage.md) - [Log replication to Object Storage via Data Streams](tutorials/replicate-logs-to-storage-via-data-streams.md) - [Data migration to Yandex Object Storage using Yandex Data Transfer](tutorials/yds-obj-migration.md) - [Data delivery from Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](tutorials/kafka-to-yds.md) - [Data delivery from an Data Streams queue to Managed Service for YDB](tutorials/yds-to-ydb.md) - [Delivering data to Yandex Managed Service for Apache Kafka® using Yandex Data Transfer](tutorials/yds-to-kafka.md) - [Change data capture (CDC) from YDB and delivery to YDS](tutorials/ydb-to-yds.md) - [Change data capture (CDC) from PostgreSQL and delivery to YDS](tutorials/mpg-to-yds.md) - [Change data capture (CDC) from MySQL® and delivery to YDS](tutorials/mmy-to-yds.md) ### Storing a static access key in a Yandex Lockbox secret - [Overview](tutorials/static-key-in-lockbox/index.md) - [CLI](tutorials/static-key-in-lockbox/console.md) - [Terraform](tutorials/static-key-in-lockbox/terraform.md) - [Streaming Yandex Cloud Postbox events to Yandex Data Streams and analyzing them with Yandex DataLens](tutorials/events-from-postbox-to-yds.md) - [Building an interactive serverless application using WebSocket](tutorials/websocket-app.md) - [Processing Audit Trails events](tutorials/audit-trails.md) ### Searching for events in audit logs - [Overview](tutorials/search-events-audit-logs/index.md) - [Audit log management tools](tutorials/search-events-audit-logs/tools.md) - [Sample queries for event search](tutorials/search-events-audit-logs/examples.md) - [Configuring Yandex Query](tutorials/search-events-audit-logs/query.md) - [Debezium Change Data Capture (CDC) stream processing](tutorials/debezium.md) ### Exporting audit logs to MaxPatrol SIEM - [Overview](tutorials/maxpatrol/index.md) - [Management console](tutorials/maxpatrol/console.md) - [Terraform](tutorials/maxpatrol/terraform.md) - [Searching for Yandex Cloud events in Yandex Query](tutorials/search-events-query.md) - [Yandex Cloud Postbox integration with external systems via webhooks](tutorials/postbox-webhook.md) - [Troubleshooting slow writes in Yandex Data Streams](tutorials/slow-writes-debug.md) - [Access management](security/index.md) - [Pricing policy](pricing.md) ## HTTP API compatible with Amazon Kinesis Data Streams - [Overview](kinesisapi/index.md) - [All methods](kinesisapi/api-ref.md) ### Methods - [CreateStream](kinesisapi/methods/createstream.md) - [DecreaseStreamRetentionPeriod](kinesisapi/methods/decreasetreamretentionperiod.md) - [DeleteStream](kinesisapi/methods/deletestream.md) - [DescribeStream](kinesisapi/methods/describestream.md) - [IncreaseStreamRetentionPeriod](kinesisapi/methods/increasestreamretentionperiod.md) - [GetRecords](kinesisapi/methods/getrecords.md) - [GetShardIterator](kinesisapi/methods/getsharditerator.md) - [ListStreams](kinesisapi/methods/liststreams.md) - [PutRecord](kinesisapi/methods/putrecord.md) - [PutRecords](kinesisapi/methods/putrecords.md) - [UpdateShardCount](kinesisapi/methods/updateshardcount.md) - [Common errors](kinesisapi/common-errors.md) - [Examples](kinesisapi/examples.md) ## Kafka API - [Overview](kafkaapi/index.md) - [Authenticating and connecting to the database](kafkaapi/auth.md) - [FAQ](qa/index.md)