[Yandex Cloud documentation](../index.md) > Yandex DataSphere > DataSphere

# Yandex DataSphere

Yandex DataSphere is a full-cycle ML development service that enables leveraging all cloud technology advantages. It combines an intuitive and easy-to-use web interface, familiar IDEs, and seamless integration of various Yandex Cloud computing resources.

Yandex DataSphere helps significantly reduce the cost of machine learning compared to computing on your own hardware or other cloud platforms.

The Yandex Cloud infrastructure is <a href="https://storage.yandexcloud.net/yc-compliance/conformance_ru_pdp.pdf">protected</a> pursuant to the Russian Federal Law 152-FZ on personal data.

This service is subject to a <a href="https://yandex.com/legal/cloud_sla">service level agreement</a>. The service level is set out in the document titled <a href="https://yandex.com/legal/cloud_sla_yds">Yandex DataSphere Service Level</a>.

# Yandex DataSphere

 - [Getting started](quickstart.md)

## Step-by-step guides

 - [All guides](operations/index.md)

### Community management

 - [Creating a community](operations/community/create.md)

 - [Adding a user to a community](operations/community/add-user.md)

 - [Managing community labels](operations/community/manage-community-labels.md)

 - [Managing community restrictions](operations/community/manage-community-config.md)

 - [Creating a service agent](operations/community/create-ssa.md)

 - [Adding a link for a community](operations/community/link-channel.md)

 - [Linking a billing account](operations/community/link-ba.md)

 - [Viewing a cost breakdown report](operations/community/billing-details.md)

 - [Deleting a community](operations/community/delete.md)

 - [Removing a user from a community](operations/community/delete-user.md)

### Project management

 - [Creating a project](operations/projects/create.md)

 - [Adding a user to a project](operations/projects/add-user.md)

 - [Managing project labels](operations/projects/manage-project-labels.md)

 - [Selecting a Python version](operations/projects/python-version.md)

 - [Resizing project storage](operations/projects/storage-resize.md)

 - [Changing project settings](operations/projects/update.md)

 - [Setting project limits](operations/projects/restrictions.md)

 - [Deleting a notebook or a project](operations/projects/delete.md)

 - [Removing a user from a project](operations/projects/delete-user.md)

 - [Using a shared resource](operations/projects/use-shared-resource.md)

 - [Troubleshooting](operations/projects/debugging-tools.md)

### DataSphere Notebook

 - [Connecting to JupyterLab from a local IDE](operations/projects/remote-connect.md)

 - [Selecting computing resources](operations/projects/control-compute-resources.md)

 - [Checking GPU load](operations/projects/gpu-performance-check.md)

 - [Getting a notebook ID](operations/projects/get-notebook-cell-ids.md)

 - [Installing packages](operations/projects/install-dependencies.md)

 - [Notebook code snippets](operations/projects/snippets.md)

 - [Clearing notebook cell outputs](operations/projects/clear-outputs.md)

 - [Working with Git](operations/projects/work-with-git.md)

 - [Setting up template-based notebook creation](operations/projects/templates.md)

### Working with resources

 - [Working with secrets](operations/data/secrets.md)

 - [Working with Yandex Data Processing templates](operations/data-processing-template.md)

 - [Working with Docker images](operations/user-images.md)

 - [Working with datasets](operations/data/dataset.md)

 - [Working with S3 connectors](operations/data/s3-connectors.md)

 - [Working with Spark connectors](operations/data/spark-connectors.md)

 - [Working with models](operations/data/models.md)

 - [File storage operations](operations/data/filestores.md)

### Connecting to data sources

 - [Connecting to S3 using boto3](operations/data/connect-to-s3.md)

 - [Connecting to a ClickHouse® database](operations/data/connect-to-clickhouse.md)

 - [Connecting to a PostgreSQL database](operations/data/connect-to-postgresql.md)

 - [Connecting to Yandex Disk](operations/data/connect-to-ya-disk.md)

 - [Connecting to Google Drive](operations/data/connect-to-google-drive.md)

### DataSphere Inference

 - [Creating a node](operations/deploy/node-create.md)

 - [Updating a node](operations/deploy/node-update.md)

 - [Deleting a node](operations/deploy/node-delete.md)

 - [Configuring a node environment](operations/deploy/node-customization.md)

 - [Sending a request to a node](operations/deploy/node-api.md)

 - [Suspending or resuming a node](operations/deploy/node-suspend-resume.md)

 - [Creating an alias](operations/deploy/alias-create.md)

 - [Updating an alias](operations/deploy/alias-update.md)

 - [Deleting an alias](operations/deploy/alias-delete.md)

 - [Sending a request to an alias](operations/deploy/alias-api.md)

### DataSphere Jobs

 - [Authentication in DataSphere Jobs](operations/projects/authentication.md)

 - [Running a job in DataSphere Jobs](operations/projects/work-with-jobs.md)

 - [Working with jobs from Visual Studio Code](operations/projects/jobs-toolkit.md)

 - [Using results of completed jobs](operations/projects/use-job-results.md)

 - [Working with a service agent from a job](operations/projects/jobs-with-ssa.md)

### Shared access

 - [Publishing a notebook](operations/projects/publication.md)

 - [Exporting a project](operations/projects/export.md)

 - [Opening a notebook in DataSphere](operations/projects/open-in-datasphere.md)

 - [Migrating a workflow to a new version](operations/migration.md)

## Concepts

 - [About Yandex DataSphere](concepts/index.md)

 - [DataSphere resource relationships](concepts/resource-model.md)

 - [Communities](concepts/community.md)

 - [Cost management](concepts/budget.md)

 - [Project](concepts/project.md)

 - [Computing resource configurations](concepts/configurations.md)

### DataSphere Notebook

 - [List of pre-installed software](concepts/preinstalled-packages.md)

 - [Available commands](concepts/magic.md)

#### Computing on Apache Spark™ clusters

 - [Ways to use Apache Spark™ clusters](concepts/data-processing.md)

 - [Computing on Apache Spark™ clusters](concepts/data-processing-operations.md)

 - [Specifics of working with temporary Yandex Data Processing clusters](concepts/temporary-data-processing-clusters.md)

### DataSphere Inference

 - [Nodes and aliases](concepts/deploy/index.md)

 - [Health checks and monitoring](concepts/deploy/monitoring.md)

 - [Node metrics](concepts/deploy/metrics.md)

### DataSphere Jobs

 - [Jobs](concepts/jobs/index.md)

 - [DataSphere CLI](concepts/jobs/cli.md)

 - [Docker images in jobs](concepts/jobs/docker.md)

 - [Job runtime environment](concepts/jobs/environment.md)

 - [Rerunning jobs](concepts/jobs/fork.md)

 - [Integration with Managed Service for Apache Airflow™](concepts/jobs/airflow.md)

 - [Working with Spark connectors](concepts/jobs/work-with-spark.md)

### Resources

 - [Overview](concepts/resources.md)

 - [Secrets](concepts/secrets.md)

 - [Docker images](concepts/docker.md)

 - [Datasets](concepts/dataset.md)

 - [Yandex Data Processing templates](concepts/data-processing-template.md)

 - [S3 connectors](concepts/s3-connector.md)

 - [Spark connectors](concepts/spark-connector.md)

 - [Models](concepts/models/index.md)

 - [File storages](concepts/filestores.md)

 - [Foundation models](concepts/models/foundation-models.md)

 - [Quotas and limits](concepts/limits.md)

 - [Special terms for educational institutions](concepts/freetier.md)

## Organizing a workflow in DataSphere

 - [Setting up a project to work with a cloud](tutorials/basics.md)

 - [Setting up a student community](tutorials/community-for-students.md)

 - [Automating project setup](tutorials/automation-community-settings.md)

 - [Integrating Yandex Data Processing](tutorials/data-processing-integration.md)

## Tutorials

 - [All tutorials](tutorials/index.md)

### Development

 - [Classification of images in video frames](tutorials/video-recognition.md)

 - [Running scheduled computations](tutorials/regular-launch.md)

 - [Running computations using the API](tutorials/batch-code-execution.md)

 - [Geocoding with the Yandex Maps API for data visualization in DataLens](tutorials/data-from-ch-geocoder.md)

 - [Training a model on data from Yandex Object Storage](tutorials/s3-to-datasphere.md)

 - [Creating an MLFlow server for logging experiments and artifacts](tutorials/mlflow-datasphere.md)

### Usage

 - [Deploying a service based on a Docker image](tutorials/node-from-docker.md)

 - [Deploying a service based on a Docker image with FastAPI](tutorials/node-from-docker-fast-api.md)

 - [Deploying a service based on an ONNX model](tutorials/node-from-model.md)

 - [Deploying a gRPC service based on a Docker image](tutorials/grpc-node.md)

 - [Image generation using the Stable Diffusion model](tutorials/stable-diffusion.md)

 - [Creating an AI assistant for Telegram](tutorials/tg-bot-assistant.md)

### Data analytics

 - [Web analytics with funnels and cohorts calculated based on Yandex Metrica data](tutorials/data-from-metrica-yc-visualization.md)

 - [AppMetrica: data export, post-processing, and visualization](tutorials/data-from-appmetrica-yc-visualization.md)

 - [Analyzing data with Query](tutorials/yq.md)

 - [Working with data in Object Storage](tutorials/yq-storage.md)

 - [Working with data in Managed Service for ClickHouse®](tutorials/yq-clickhouse.md)

 - [Working with data in Managed Service for PostgreSQL](tutorials/yq-postgre.md)

 - [Federated data queries](tutorials/yq-federative-queries.md)

 - [Using the service Yandex Managed Service for Apache Spark™](tutorials/spark-and-datasphere.md)

 - [Terraform reference](tf-ref.md)

## API reference

 - [Overview](api-ref/overview.md)

 - [API authentication](api-ref/authentication.md)

### gRPC

 - [Overview](api-ref/grpc/index.md)

#### Community

 - [Overview](api-ref/grpc/Community/index.md)

 - [Create](api-ref/grpc/Community/create.md)

 - [Get](api-ref/grpc/Community/get.md)

 - [Update](api-ref/grpc/Community/update.md)

 - [Delete](api-ref/grpc/Community/delete.md)

 - [List](api-ref/grpc/Community/list.md)

 - [ListAccessBindings](api-ref/grpc/Community/listAccessBindings.md)

 - [SetAccessBindings](api-ref/grpc/Community/setAccessBindings.md)

 - [UpdateAccessBindings](api-ref/grpc/Community/updateAccessBindings.md)

 - [AddResource](api-ref/grpc/Community/addResource.md)

 - [RemoveResource](api-ref/grpc/Community/removeResource.md)

 - [GetRestrictionsMeta](api-ref/grpc/Community/getRestrictionsMeta.md)

 - [GetRestrictions](api-ref/grpc/Community/getRestrictions.md)

 - [SetRestrictions](api-ref/grpc/Community/setRestrictions.md)

#### Dataset

 - [Overview](api-ref/grpc/Dataset/index.md)

 - [Activate](api-ref/grpc/Dataset/activate.md)

 - [Deactivate](api-ref/grpc/Dataset/deactivate.md)

#### DockerImage

 - [Overview](api-ref/grpc/DockerImage/index.md)

 - [Activate](api-ref/grpc/DockerImage/activate.md)

#### DockerImageV2

 - [Overview](api-ref/grpc/DockerImageV2/index.md)

 - [SetActive](api-ref/grpc/DockerImageV2/setActive.md)

#### Operation

 - [Overview](api-ref/grpc/Operation/index.md)

 - [Get](api-ref/grpc/Operation/get.md)

 - [Cancel](api-ref/grpc/Operation/cancel.md)

#### Project

 - [Overview](api-ref/grpc/Project/index.md)

 - [Create](api-ref/grpc/Project/create.md)

 - [Update](api-ref/grpc/Project/update.md)

 - [Delete](api-ref/grpc/Project/delete.md)

 - [Open](api-ref/grpc/Project/open.md)

 - [Get](api-ref/grpc/Project/get.md)

 - [List](api-ref/grpc/Project/list.md)

 - [GetUnitBalance](api-ref/grpc/Project/getUnitBalance.md)

 - [SetUnitBalance](api-ref/grpc/Project/setUnitBalance.md)

 - [Execute](api-ref/grpc/Project/execute.md)

 - [ListAccessBindings](api-ref/grpc/Project/listAccessBindings.md)

 - [SetAccessBindings](api-ref/grpc/Project/setAccessBindings.md)

 - [UpdateAccessBindings](api-ref/grpc/Project/updateAccessBindings.md)

 - [AddResource](api-ref/grpc/Project/addResource.md)

 - [RemoveResource](api-ref/grpc/Project/removeResource.md)

 - [ResizeDisk](api-ref/grpc/Project/resizeDisk.md)

 - [GetRestrictionsMeta](api-ref/grpc/Project/getRestrictionsMeta.md)

 - [GetRestrictions](api-ref/grpc/Project/getRestrictions.md)

 - [SetRestrictions](api-ref/grpc/Project/setRestrictions.md)

#### S3

 - [Overview](api-ref/grpc/S3/index.md)

 - [Activate](api-ref/grpc/S3/activate.md)

 - [Deactivate](api-ref/grpc/S3/deactivate.md)

#### DataSphere Jobs API v2

 - [Overview](jobs/api-ref/grpc/index.md)

##### Operation

 - [Overview](jobs/api-ref/grpc/Operation/index.md)

 - [Get](jobs/api-ref/grpc/Operation/get.md)

 - [Cancel](jobs/api-ref/grpc/Operation/cancel.md)

##### ProjectJob

 - [Overview](jobs/api-ref/grpc/ProjectJob/index.md)

 - [Create](jobs/api-ref/grpc/ProjectJob/create.md)

 - [Clone](jobs/api-ref/grpc/ProjectJob/clone.md)

 - [Execute](jobs/api-ref/grpc/ProjectJob/execute.md)

 - [Cancel](jobs/api-ref/grpc/ProjectJob/cancel.md)

 - [ReadStdLogs](jobs/api-ref/grpc/ProjectJob/readStdLogs.md)

 - [ReadLogs](jobs/api-ref/grpc/ProjectJob/readLogs.md)

 - [DownloadJobFiles](jobs/api-ref/grpc/ProjectJob/downloadJobFiles.md)

 - [List](jobs/api-ref/grpc/ProjectJob/list.md)

 - [Get](jobs/api-ref/grpc/ProjectJob/get.md)

 - [Delete](jobs/api-ref/grpc/ProjectJob/delete.md)

 - [DeleteData](jobs/api-ref/grpc/ProjectJob/deleteData.md)

 - [DeleteAllData](jobs/api-ref/grpc/ProjectJob/deleteAllData.md)

 - [SetDataTtl](jobs/api-ref/grpc/ProjectJob/setDataTtl.md)

### REST

 - [Overview](api-ref/index.md)

#### Community

 - [Overview](api-ref/Community/index.md)

 - [Create](api-ref/Community/create.md)

 - [Get](api-ref/Community/get.md)

 - [Update](api-ref/Community/update.md)

 - [Delete](api-ref/Community/delete.md)

 - [List](api-ref/Community/list.md)

 - [ListAccessBindings](api-ref/Community/listAccessBindings.md)

 - [SetAccessBindings](api-ref/Community/setAccessBindings.md)

 - [UpdateAccessBindings](api-ref/Community/updateAccessBindings.md)

 - [AddResource](api-ref/Community/addResource.md)

 - [RemoveResource](api-ref/Community/removeResource.md)

 - [GetRestrictionsMeta](api-ref/Community/getRestrictionsMeta.md)

 - [GetRestrictions](api-ref/Community/getRestrictions.md)

 - [SetRestrictions](api-ref/Community/setRestrictions.md)

#### Dataset

 - [Overview](api-ref/Dataset/index.md)

 - [Activate](api-ref/Dataset/activate.md)

 - [Deactivate](api-ref/Dataset/deactivate.md)

#### DockerImage

 - [Overview](api-ref/DockerImage/index.md)

 - [Activate](api-ref/DockerImage/activate.md)

#### Operation

 - [Overview](api-ref/Operation/index.md)

 - [Get](api-ref/Operation/get.md)

 - [Cancel](api-ref/Operation/cancel.md)

#### Project

 - [Overview](api-ref/Project/index.md)

 - [Create](api-ref/Project/create.md)

 - [Update](api-ref/Project/update.md)

 - [Delete](api-ref/Project/delete.md)

 - [Open](api-ref/Project/open.md)

 - [Get](api-ref/Project/get.md)

 - [List](api-ref/Project/list.md)

 - [GetUnitBalance](api-ref/Project/getUnitBalance.md)

 - [SetUnitBalance](api-ref/Project/setUnitBalance.md)

 - [Execute](api-ref/Project/execute.md)

 - [ListAccessBindings](api-ref/Project/listAccessBindings.md)

 - [SetAccessBindings](api-ref/Project/setAccessBindings.md)

 - [UpdateAccessBindings](api-ref/Project/updateAccessBindings.md)

 - [AddResource](api-ref/Project/addResource.md)

 - [RemoveResource](api-ref/Project/removeResource.md)

 - [GetRestrictionsMeta](api-ref/Project/getRestrictionsMeta.md)

 - [GetRestrictions](api-ref/Project/getRestrictions.md)

 - [SetRestrictions](api-ref/Project/setRestrictions.md)

#### S3

 - [Overview](api-ref/S3/index.md)

 - [Activate](api-ref/S3/activate.md)

 - [Deactivate](api-ref/S3/deactivate.md)

#### DataSphere Jobs API v2

 - [Overview](jobs/api-ref/index.md)

##### Operation

 - [Overview](jobs/api-ref/Operation/index.md)

 - [Get](jobs/api-ref/Operation/get.md)

 - [Cancel](jobs/api-ref/Operation/cancel.md)

 - [Audit Trails events](at-ref.md)

 - [Access management](security/index.md)

 - [Pricing policy](pricing.md)

 - [Public materials](public-talks.md)

 - [Release notes](release-notes.md)

## Troubleshooting

 - [Library installation issues](qa/environment-problems.md)

 - [Errors when using a Spark connector](troubleshooting/troubles-with-spark.md)

 - [FAQ](qa/index.md)