[Yandex Cloud documentation](../../index.md) > [Yandex Serverless Integrations](../index.md) > [Tutorials](index.md) > Automatic data upload to Yandex SpeechSense using Workflows # Automatic data upload to Yandex SpeechSense using Yandex Workflows {% note info %} Workflows is at the [Preview](../../overview/concepts/launch-stages.md) stage. {% endnote %} You can configure automatic loading of dialog files and their metadata from the Yandex Object Storage bucket to [SpeechSense space](https://aistudio.yandex.ru/docs/en/speechsense/concepts/resources-hierarchy#space). Supported formats are: * `MP3`, `WAV`, and `OggOpus`: For audio files. * `JSON`: For chat conversations. ![image](../../_assets/tutorials/auto-upload.svg) On the diagram: 1. [Trigger](../../functions/concepts/trigger/os-trigger.md) for Object Storage monitors for new JSON files with metadata as may appear in the selected [bucket](../../storage/concepts/bucket.md) directory or any of its subdirectories. 1. When new files appear in the directory, the trigger calls the `workflow-call` [function](../../functions/concepts/function.md), which starts the [Workflows workflow](../concepts/workflows/workflow.md). 1. The workflow retrieves the contents of JSON metadata files and checks their syntax using the `verify-file` function. 1. The workflow gets the SpeechSense connection settings from the relevant [Yandex Lockbox secret](../../lockbox/concepts/secret.md). 1. The path to the audio or text file and its metadata are provided to the `speechsense-upload` upload function. 1. `speechsense-upload` uploads the files and their metadata into the SpeechSense space. 1. At runtime, the workflow accesses the database with metadata: 1. Logging syntax errors in metadata files. 1. Logging entry syntax errors in metadata files. 1. Checking for duplicates: before calling the `speechsense-upload` function, the workflow checks whether a file has already been loaded into the SpeechSense space. 1. Logging the `speechsense-upload` function errors. 1. Logging the file metadata and unique identifier in SpeechSense space once the file is successfully uploaded. 1. WebSQL provides access to the metadata DB. One database user is used for browsing, and another one for uploading files. You can set up automatic data upload for several [SpeechSense connections](https://aistudio.yandex.ru/docs/en/speechsense/concepts/resources-hierarchy#connection) at once. To automate uploading data to SpeechSense, follow these steps: 1. [Get your cloud ready](#before-you-begin). 1. [Create an infrastructure for uploading files](#infra). 1. [Create a Yandex Lockbox secret](#create-secret). 1. [Create a Yandex Managed Service for PostgreSQL cluster data model](#create-table). 1. [In the Object Storage bucket, create directories to store files and their metadata](#create-folder). 1. [Prepare the metadata](#prepare-metadata). 1. [Upload the files to the Object Storage bucket](#upload-files). 1. [Check the result](#check-result). If you no longer need the resources you created, [delete them](#clear-out). ## Get your cloud ready {#before-you-begin} Sign up for Yandex Cloud and create a [billing account](../../billing/concepts/billing-account.md): 1. Navigate to the [management console](https://console.yandex.cloud) and log in to Yandex Cloud or create a new account. 1. On the **[Yandex Cloud Billing](https://center.yandex.cloud/billing/accounts)** page, make sure you have a billing account linked and it has the `ACTIVE` or `TRIAL_ACTIVE` [status](../../billing/concepts/billing-account-statuses.md). If you do not have a billing account, [create one](../../billing/quickstart/index.md) and [link](../../billing/operations/pin-cloud.md) a cloud to it. If you have an active billing account, you can create or select a [folder](../../resource-manager/concepts/resources-hierarchy.md#folder) for your infrastructure on the [cloud page](https://console.yandex.cloud/cloud). [Learn more about clouds and folders here](../../resource-manager/concepts/resources-hierarchy.md). ### Required paid resources {#paid-resources} * SpeechSense: duration of each two-channel audio file or number of characters in each chat transcript (see [SpeechSense pricing](https://aistudio.yandex.ru/docs/en/speechsense/pricing)). * Object Storage buckets: use of storage, data operations (see [Object Storage pricing](../../storage/pricing.md)). * Managed Service for PostgreSQL cluster: use of computing resources allocated to hosts, storage and backup size (see [Managed Service for PostgreSQL pricing](../../managed-postgresql/pricing.md)). * Yandex Cloud Functions instance: number of function calls, idle time of provisioned instances, and computing resources allocated for the function (see [Cloud Functions pricing](../../functions/pricing.md)). * Yandex Lockbox secret: number of stored secret versions and requests to them (see [Yandex Lockbox pricing](../../lockbox/pricing.md)). ### Create service accounts {#create-sa} Create two service accounts: * `deploy-sa`: This one will be used for creating the infrastructure. * `speechsense-sa`: This one will be used for invoking functions and starting the workflow. {% list tabs group=instructions %} - Management console {#console} 1. In the [management console](https://console.yandex.cloud), select the relevant folder. 1. [Navigate](../../console/operations/select-service.md#select-service) to **Identity and Access Management**. 1. Click **Create service account**. 1. Name the [service account](../../iam/concepts/users/service-accounts.md): `deploy-sa`. 1. Click ![image](../../_assets/console-icons/plus.svg) **Add role** and select the following roles: [functions.admin](../../functions/security/index.md#functions-admin), [storage.editor](../../storage/security/index.md#storage-editor), [iam.editor](../../iam/roles-reference.md#iam-editor), [mdb.admin](../../iam/roles-reference.md#mdb-admin), and `serverless.workflows.admin`. 1. Click **Create**. 1. Repeat the above steps and create a service account named `speechsense-sa` with the following roles: [storage.viewer](../../storage/security/index.md#storage-viewer), [functions.functionInvoker](../../functions/security/index.md#functions-functionInvoker), [functions.mdbProxiesUser](../../functions/security/index.md#functions-mdbProxiesUser), [lockbox.payloadViewer](../../lockbox/security/index.md#lockbox-payloadViewer), and `serverless.workflows.executor`. - Yandex Cloud CLI {#cli} If you do not have the Yandex Cloud CLI yet, [install and initialize it](../../cli/quickstart.md#install). The folder used by default is the one specified when [creating](../../cli/operations/profile/profile-create.md) the CLI profile. To change the default folder, use the `yc config set folder-id ` command. You can also specify a different folder for any command using `--folder-name` or `--folder-id`. If you access a resource by its name, the search will be limited to the default folder. If you access a resource by its ID, the search will be global, i.e., through all folders based on access permissions. 1. Create a service account named `deploy-sa`: ```bash yc iam service-account create deploy-sa ``` Result: ``` id: nfersamh4sjq******** folder_id: b1gc1t4cb638******** created_at: "2023-09-21T10:36:29.726397755Z" name: deploy-sa ``` Save the ID of the `deploy-sa` service account (`id`) and the ID of the folder where you created it (`folder_id`). For more information about the `yc iam service-account create` command, see the [CLI reference](../../cli/cli-ref/iam/cli-ref/service-account/create.md). 1. Assign the [functions.admin](../../functions/security/index.md#functions-admin), [storage.editor](../../storage/security/index.md#storage-editor), [iam.editor](../../iam/roles-reference.md#iam-editor), [mdb.admin](../../iam/roles-reference.md#mdb-admin), and `serverless.workflows.admin` roles for the folder to the `deploy-sa` service account by specifying the folder and service account IDs you previously saved: ```bash yc resource-manager folder add-access-binding \ --role \ --subject serviceAccount: ``` The command only accepts one role at a time. For more information about the `yc resource-manager folder add-access-binding` command, see the [CLI reference](../../cli/cli-ref/resource-manager/cli-ref/folder/add-access-binding.md). If you intend to create a Yandex Lockbox secret through the Yandex Cloud CLI under the `deploy-sa` service account, also assign the [lockbox.editor](../../lockbox/security/index.md#lockbox-editor) role to that account. 1. Repeat the above steps and create a service account named `speechsense-sa` with the following roles: [storage.viewer](../../storage/security/index.md#storage-viewer), [functions.functionInvoker](../../functions/security/index.md#functions-functionInvoker), [functions.mdbProxiesUser](../../functions/security/index.md#functions-mdbProxiesUser), [lockbox.payloadViewer](../../lockbox/security/index.md#lockbox-payloadViewer), and `serverless.workflows.executor`. - API {#api} To create a service account, use the [create](../../iam/api-ref/ServiceAccount/create.md) method for the [ServiceAccount](../../iam/api-ref/ServiceAccount/index.md) resource or the [ServiceAccountService.Create](../../iam/api-ref/grpc/ServiceAccount/create.md) gRPC API call. To assign the [functions.admin](../../functions/security/index.md#functions-admin), [storage.editor](../../storage/security/index.md#storage-editor), [iam.editor](../../iam/roles-reference.md#iam-editor), [mdb.admin](../../iam/roles-reference.md#mdb-admin), and `serverless.workflows.admin` roles to the `deploy-sa` service account, use the [setAccessBindings](../../iam/api-ref/ServiceAccount/setAccessBindings.md) method for the [ServiceAccount](../../iam/api-ref/ServiceAccount/index.md) resource or the [ServiceAccountService.SetAccessBindings](../../iam/api-ref/grpc/ServiceAccount/setAccessBindings.md) gRPC API call. In the same way, assign the following roles to the `speechsense-sa` service account: [storage.viewer](../../storage/security/index.md#storage-viewer), [functions.functionInvoker](../../functions/security/index.md#functions-functionInvoker), [functions.mdbProxiesUser](../../functions/security/index.md#functions-mdbProxiesUser), [lockbox.payloadViewer](../../lockbox/security/index.md#lockbox-payloadViewer), and `serverless.workflows.executor`. {% endlist %} ### Create an API key for the service account {#create-key} Create an API key for the `speechsense-sa` service account. {% list tabs group=instructions %} - Management console {#console} 1. In the [management console](https://console.yandex.cloud), select the folder with the service account. 1. [Navigate](../../console/operations/select-service.md#select-service) to **Identity and Access Management**. 1. In the left-hand panel, select ![FaceRobot](../../_assets/console-icons/face-robot.svg) **Service accounts**. 1. Select the `speechsense-sa` service account. 1. In the top panel, click ![image](../../_assets/console-icons/plus.svg) **Create new key** and select **Create API key**. 1. In the window that opens, select the `yc.speech-sense.use` [scope](../../iam/concepts/authorization/api-key.md#scoped-api-keys) in the **Scope** field. 1. Click **Create**. 1. Save the ID and the secret key. {% note alert %} After you close this dialog, the key value will no longer be available. {% endnote %} - Yandex Cloud CLI {#cli} Create an API key for the `speechsense-sa` service account and save the response to the `api_key.yaml` file: ```bash yc iam api-key create \ --service-account-name speechsense-sa \ > api_key.yaml ``` As a result, you will get the `api_key.yaml` file with the API key value in the `secret` field: ```yaml api_key: id: ajeke74kbp5b******** service_account_id: ajepg0mjt06s******** created_at: "2019-04-09T08:41:27Z" secret: AQVN1HHJReSrfo9jU3aopsXrJyfq_UHs******** ``` - API {#api} Create an API key using the [create](../../iam/api-ref/ApiKey/create.md) REST API method for the [ApiKey](../../iam/api-ref/ApiKey/index.md) resource: ```bash export SERVICEACCOUNT_ID= export IAM_TOKEN= curl \ --request POST \ --header "Content-Type: application/json" \ --header "Authorization: Bearer $IAM_TOKEN" \ --data "{ \"serviceAccountId\": \"$SERVICEACCOUNT_ID\" }" \ https://iam.api.cloud.yandex.net/iam/v1/apiKeys ``` Where: * `SERVICEACCOUNT_ID`: Service account [ID](../../iam/operations/sa/get-id.md). * `IAM_TOKEN`: [IAM token](../../iam/concepts/authorization/iam-token.md). You can also create an API key using the [ApiKeyService.Create](../../iam/api-ref/grpc/ApiKey/create.md) gRPC API call. {% endlist %} ### Create a space {#create-space} {% list tabs group=instructions %} - SpeechSense UI {#speechsense} 1. Open the SpeechSense [home page](https://speechsense.yandex.cloud/). 1. Click **Create space**. 1. Enter a name for the space. 1. Click **Create**. {% endlist %} ### Add the service account to the space {#add-sa-to-space} Add the `speechsense-sa` service account to the SpeechSense space. {% list tabs group=instructions %} - SpeechSense UI {#speechsense} 1. Open the SpeechSense [home page](https://speechsense.yandex.cloud/). 1. Go to your [new space](#create-space). 1. Click ![image](../../_assets/console-icons/person-plus.svg) **Add participant** → ![image](../../_assets/console-icons/persons.svg) **Add from organization**. 1. Copy the ID of the `speechsense-sa` service account you [created earlier](#create-sa) and paste it to the search bar. 1. Select the `speechsense-sa` service account and specify the [Data editor](https://aistudio.yandex.ru/docs/en/speechsense/security/#speechsense-data-editor) role. This role will allow `speechsense-sa` to upload data to SpeechSense. 1. Click **Add**. {% endlist %} ### Create a connection {#create-connection} Depending on the type of files to be uploaded to SpeechSense, create a connection for an audio or chat. #### Create a connection for an audio {#create-audio-connection} {% list tabs group=instructions %} - SpeechSense UI {#speechsense} 1. Open the SpeechSense [home page](https://speechsense.yandex.cloud/). 1. Go to the space of your choice. 1. In the top-right corner, click **More** → ![create](../../_assets/console-icons/thunderbolt.svg) **Create connection**. 1. Enter the connection name. 1. Select the **Two-channel audio** data type. 1. Under **Agent**, **Customer**: 1. Specify the channels with the agent's voice and customer's voice. 1. Specify agent and customer keys from the metadata file. This file contains the call information collected from CRM systems, PBXs, or other sources. By default, connections include keys with the name and ID of the agent and the customer. In the **Name in the system** field, enter a name the key will have in SpeechSense. To specify additional metadata for the agent and the customer, click **Add key**. 1. Under **Shared metadata**, provide the keys from the metadata file that are not related to the agent or the customer. By default, connections include keys with the date, direction, and language of the call. In the **Name in the system** field, enter a name the key will have in SpeechSense. To specify additional metadata, click **Add key**. 1. Click **Create connection**. {% endlist %} #### Create a connection for a chat {#create-chat-connection} {% list tabs group=instructions %} - SpeechSense UI {#speechsense} 1. Open the SpeechSense [home page](https://speechsense.yandex.cloud/). 1. Go to the space of your choice. 1. In the top-right corner, click **More** → ![create](../../_assets/console-icons/thunderbolt.svg) **Create connection**. 1. Enter the connection name. 1. Select the **Сhat** data type. 1. Under **Agent**, **Customer**, **Bot**, specify the keys from the metadata file. This file contains the dialog information collected from chats, CRM systems, or other sources. By default, connections include keys with agent's, customer's, and bot's names and IDs. In the **Name in the system** field, enter a name the key will have in SpeechSense. To specify additional agent, customer, and bot metadata, click **Add key**. 1. Under **Shared metadata**, provide the keys from the metadata file that are not related to the agent, customer, and bot. By default, keys with date, direction, and dialog language are added to the connection. In the **Name in the system** field, enter a name the key will have in SpeechSense. To specify additional metadata, click **Add key**. 1. Click **Create connection**. {% endlist %} ### Create a project {#create-project} {% list tabs group=instructions %} - SpeechSense UI {#speechsense} 1. Open the SpeechSense [home page](https://speechsense.yandex.cloud/). 1. Go to the space of your choice. 1. Click ![create](../../_assets/console-icons/folder-plus.svg) **Create project**. 1. Enter a name for your project. 1. Under **Connection**, click **Add connection** and select the connection you [created earlier](#create-connection). 1. Click **Create project**. {% endlist %} ## Create the infrastructure {#infra} 1. Clone the [yc-serverless-speechsense-workflows](https://github.com/yandex-cloud-examples/yc-serverless-speechsense-workflows) repository: ```bash git clone https://github.com/yandex-cloud-examples/yc-serverless-speechsense-workflows.git ``` The repository contains a script that will create in the cloud the infrastructure needed to upload files to SpeechSense: * Object Storage bucket. * Managed Service for PostgreSQL cluster. * Cloud Functions functions. * Trigger to invoke the Cloud Functions function. * Workflows workflow. * Connections to a Managed Service for PostgreSQL cluster database. 1. For the script to run successfully, configure the Yandex Cloud CLI authentication under the `deploy-sa` service account: {% list tabs group=instructions %} - Yandex Cloud CLI {#cli} 1. Create an [authorized key](../../iam/concepts/authorization/key.md) for the `deploy-sa` service account and save it to the file: ```bash yc iam key create --output --service-account-name deploy-sa ``` Where `--output` is the path to the file for saving the authorized key in JSON format. Result: ```bash id: aje4lue48687******** service_account_id: ajeb9l33h6m******** created_at: "2024-08-01T11:58:52.313177213Z" key_algorithm: RSA_2048 ``` For more information about the `yc iam key create` command, see the [CLI reference](../../cli/cli-ref/iam/cli-ref/service-account/create.md). 1. Create a profile to execute operations under the `deploy-sa` service account: ```bash yc config profile create ``` 1. Specify the `deploy-sa` service account’s authorized key in the profile configuration: ```bash yc config set service-account-key ``` {% endlist %} 1. Navigate to the repository directory and run the script: {% list tabs group=programming_language %} - Bash {#bash} ```bash cd deploy && bash deploy.sh ``` {% endlist %} In the command line, enter the [folder ID](../../resource-manager/operations/folder/get-id.md), `speechsense-sa` as the name of the service account that will call functions and run the workflow, and [bucket name](../../storage/concepts/bucket.md#naming). The script execution time is about 10-15 minutes. ## Create a secret {#create-secret} {% list tabs group=instructions %} - Management console {#console} 1. In the [management console](https://console.yandex.cloud), select the folder where you want to create a secret. 1. Navigate to **Lockbox**. 1. Click **Create secret**. 1. In the **Name** field, specify the secret name: `speechsense-secret`. 1. Under **Secret data**: 1. Select the **Custom** secret type. 1. Add the service account's API key: * In the **Key** field, specify: `speechsense_api_key`. * In the **Value** field, specify the value of the `speechsense-sa` service account's API key you [created earlier](#create-key). 1. Click **Add key/value** and add the SpeechSense connection ID: * In the **Key** field, specify: `speechsense_connection_id`. * In the **Value** field, specify the ID of the connection you [created earlier](#create-connection). 1. Click **Add key/value** and add the format for the dialog files that will be uploaded to SpeechSense: * In the **Key** field, specify: `speechsense_file_format`. * In the **Value** field, specify the file format. Acceptable values: `mp3`, `wav`, `ogg`, and `text`. 1. Click **Create**. - Yandex Cloud CLI {#cli} To create a secret, run this command: ```bash yc lockbox secret create --name speechsense-secret \ --payload "[{'key': 'speechsense_api_key', 'text_value': ''},{'key': 'speechsense_connection_id', 'text_value': ''}, {'key': 'speechsense_file_format', 'text_value': ''}]" ``` Result: ```text id: e6q2ad0j9b55******** folder_id: b1gktjk2rg49******** created_at: "2021-11-08T19:23:00.383Z" name: speechsense-secret status: ACTIVE current_version: id: g6q4fn3b6okj******** secret_id: e6e2ei4u9b55******** created_at: "2023-03-21T19:23:00.383Z" status: ACTIVE payload_entry_keys: - speechsense_api_key - speechsense_connection_id - speechsense_file_format ``` - API {#api} To create a secret, use the [create](../../lockbox/api-ref/Secret/create.md) REST API method for the [Secret](../../lockbox/api-ref/Secret/index.md) resource or the [SecretService.Create](../../lockbox/api-ref/grpc/Secret/create.md) gRPC API call. {% endlist %} ## Create a data model {#create-table} 1. Open the `pg_metadata.sql` file in the repository directory. 1. Under the section for inserting data into the `public.source_system` table, specify the values of the parameters: ```sql insert into public.source_system(source_system_id, lockbox_secret_id, source_system_desc) values ('', '', ''); ``` Where: * `source_system_id`: Data source ID to use in metadata. Specify any unique string value, e.g., `000001`. * `lockbox_secret_id`: ID of the Yandex Lockbox secret you [created earlier](#create-secret), e.g., `e6qigo0vbci2********`. * `source_system_desc`: Data source description. Here is an example: `Uploading telephony data`. 1. Copy the `pg_metadata.sql` file contents and run the resulting query with WebSQL. {% list tabs group=instructions %} - Management console {#console} 1. In the [management console](https://console.yandex.cloud), select the relevant folder. 1. Navigate to **Managed Service for PostgreSQL**. 1. Click the name of the cluster you [created earlier](#infra). By default, it is `speechsense-upload-metadata`. 1. Select the **WebSQL** tab. 1. Click the connection name that ends with `-uploader`. 1. On the WebSQL home page, click the database name: `uploader`. 1. Paste the query to the editor and click **Execute**. {% endlist %} ## Create directories to store files and their metadata {#create-folder} In the Object Storage bucket you [created earlier](#infra), create two directories as follows: * `client_data`: For dialog files. * `client_metadata`: For metadata files. Make sure the directories are not nested one inside the other. {% list tabs group=instructions %} - Management console {#console} To create a directory: 1. In the [management console](https://console.yandex.cloud), select the folder with the bucket. 1. Navigate to **Object Storage**. 1. Select the bucket you need. 1. Click **Create folder** and specify the directory name. 1. Click **Create**. - Yandex Cloud CLI {#cli} To create a directory, run this command: ```bash yc storage s3api put-object \ --bucket \ --key --key / ``` Result: ```bash { "ETag": "\"d41d8cd98f00b204e9800998********\"" } ``` - API {#api} To create a directory, use the [upload](../../storage/s3/api-ref/object/upload.md) S3 API method. {% endlist %} ## Prepare the metadata {#prepare-metadata} {% note info %} The dates are ISO 8601 UTC with zero time offset. For Moscow time, add `+03:00` instead of `Z` at the end of the line: `2025-04-24T14:34:19+03:00`. {% endnote %} To upload a file to SpeechSense, first prepare the file metadata in `JSON` format. Here is an example: ```json { "source_system_id": "000001", "bucket_folder": "bucket://client_data", "metadata": [ { "id": "my_audio.ogg", "operator_id": "42", "operator_name": "James Doe", "client_id": "327142", "client_name": "Jane Smith", "date": "2024-08-30T19:32:11Z", "direction_outgoing": "0", "language": "ru-ru", "file_name": "my_audio.ogg" } ] } ``` Where: * Parameters the `speechsense-upload` function uses to upload files: * `source_system_id`: Data source ID as specified in the [`public.source_system`](#create-table) table. * `bucket_folder`: Path to the directory you [created earlier](#create-folder) for audio or text files. * `file_name`: Name of the file to upload. * Parameters that have to be provided to SpeechSense: * `id`: File ID, unique across the SpeechSense space. * `operator_id`: Agent ID. * `operator_name`: Agent name. * `client_id`: Customer ID. * `client_name`: Client name. * `date`: Call date and time, in `YYYY-MM-DDTHH:MM:SSZ` format. * `direction_outgoing`: Call direction, `0` for outgoing call, `1` for incoming call. * `language`: Dialog language, `ru-ru` for the Russian language. * Additional parameters for analytics in SpeechSense: * `cpn_region_id`: Region ID. * `cpn_region_name`: Region name. Here, `cpn_region_id` and `cpn_region_name` are used as examples only. Additional parameters may vary. Metadata can contain a single entry or an array of entries. {% note warning %} Do not transmit more than 100 records at the same time: this may lead to a data loss, because the Cloud Functions function has an execution timeout. If there are more than 100 files to upload, split their metadata into separate JSON files of 100 entries each. {% endnote %} ## Upload your files {#upload-files} Import the dialog files into the `client_data` directory and the JSON metadata files, into the `client_metadata` directory. {% note warning %} Do not import any dialog files into the `client_metadata` directory or its subdirectories. New files appearing in the directory will start the workflow, but the dialog files will not pass the syntax check that the metadata files do, so the workflow will fail. {% endnote %} If there are more than 1,000 files, do not use the management console for uploading. {% list tabs group=instructions %} - Management console {#console} To upload your files: 1. In the [management console](https://console.yandex.cloud), select the relevant folder. 1. Navigate to **Object Storage**. 1. Go to the bucket you want to upload your files to. 1. In the left-hand panel, select ![image](../../_assets/console-icons/folder-tree.svg) **Objects**. 1. Click the directory name to go to that directory. 1. Within the directory you need, click ![image](../../_assets/console-icons/arrow-up-from-line.svg) **Upload** on the top panel. 1. In the window that opens, select the files and click **Open**. 1. The management console will display all the files you selected for uploading and prompt you to select a [storage class](../../storage/concepts/storage-class.md) for each of them. The [bucket configuration](../../storage/concepts/bucket.md#bucket-settings) determines the default storage class. 1. Click **Upload**. 1. Refresh the page. In the management console, the information about the number of objects and storage space used in the bucket is updated with a few minutes' delay. - Yandex Cloud CLI {#cli} To upload a file to a directory, run this command: ```bash yc storage s3api put-object \ --body \ --bucket \ --key / ``` Where: * `--body`: Path to the file you need to upload. * `--bucket`: Bucket name. * `--key`: Path to the file in the directory. Result: ```bash etag: '"d41d8cd98f00b204e980099********"' request_id: 3f2705f******** ``` - AWS CLI {#aws-cli} To upload a single file, run this command: ```bash aws --endpoint-url=https://storage.yandexcloud.net/ \ s3 cp s3://// ``` To upload all files from a local directory with its nested directories, use the following command: ```bash aws --endpoint-url=https://storage.yandexcloud.net/ \ s3 cp --recursive / s3://// ``` Result: ```bash upload: to ``` - API {#api} To upload a file, use the [upload](../../storage/s3/api-ref/object/upload.md) S3 API method. {% endlist %} {% note tip %} To process your audio recordings faster, use `OggOpus` files. To convert files in other formats to `OggOpus`, use the [FFmpeg](https://www.ffmpeg.org) or [SoX](https://sourceforge.net/projects/sox/) utilities. {% endnote %} ## Check the result {#check-result} To check on the workflow: {% list tabs group=instructions %} - Management console {#console} 1. In the [management console](https://console.yandex.cloud), select the relevant folder. 1. Navigate to **Serverless Integrations**. 1. In the left-hand panel, select ![GraphNode](../../_assets/console-icons/graph-node.svg) **Workflows**. 1. Click the workflow name. By default, it is `wf-speechsense-upload`. 1. Navigate to the **Executions** tab. 1. Make sure the workflow status is `Complete`. {% endlist %} To check that the files were successfully uploaded into SpeechSense: {% list tabs group=instructions %} - Management console {#console} 1. Open the [WebSQL](https://websql.yandex.cloud) home page. 1. Under ![image](../../_assets/console-icons/folder-tree.svg) **Connections**, select the `speechsense-upload-metadata` connection and the `uploader` database. 1. Select the `public` schema. 1. In the **Tables** group, select a table: * `talk`: To view metadata uploaded into SpeechSense. If a dialog file is uploaded, its metadata must include the `talk_id` ID. * `errors`: To view errors if files could not be uploaded. {% endlist %} ## Delete resources {#clear-out} Some resources are not free of charge. Delete the resources you no longer need to avoid paying for them. 1. [Delete](../../storage/operations/buckets/delete.md) objects from the Object Storage bucket and the bucket itself. 1. [Delete](../../managed-postgresql/operations/cluster-delete.md) the Managed Service for PostgreSQL cluster. 1. [Delete](../../functions/operations/trigger/trigger-delete.md) the trigger invoking the function in Cloud Functions. 1. [Delete](../../functions/operations/function/function-delete.md) the Cloud Functions functions. 1. Delete the Managed Service for PostgreSQL cluster database connection: 1. In the [management console](https://console.yandex.cloud), select the folder to delete a connection from. 1. Navigate to **Cloud Functions**. 1. In the left-hand panel, select ![image](../../_assets/console-icons/timestamps.svg) **Database connections**. 1. In the `speechsense-upload-metadata-connection` connection row, click ![image](../../_assets/console-icons/ellipsis.svg) and select ![image](../../_assets/console-icons/trash-bin.svg) **Delete**. 1. In the window that opens, click **Delete**. 1. Delete the Workflows workflow: 1. In the [management console](https://console.yandex.cloud), select the folder to delete a workflow from. 1. Navigate to **Serverless Integrations**. 1. In the left-hand panel, select ![GraphNode](../../_assets/console-icons/graph-node.svg) **Workflows**. 1. Click ![image](../../_assets/console-icons/ellipsis.svg) next to `wf-speechsense-upload` and select ![image](../../_assets/console-icons/trash-bin.svg) **Delete**. 1. In the window that opens, click **Delete**.