Agora Conversational AI

Agora Conversational AI

Author: plutoless
Version: 0.0.7
Type: extension

Description

Overview

This extension provides an endpoint to make Dify agents work with Agora’s Conversational AI Engine to easily turn your Dify agents into voice assistants.

Prerequisites

• Agora Account
  You need an Agora account to use the Agora Conversational AI service. You can sign up for a free account at Agora.
• Agora App ID / App Certificate / RESTful Customer ID / RESTful Customer Secret
  You need to create an Agora project and get the App ID, App Certificate, RESTful Customer ID and RESTful Customer Secret from Agora Console. Note to enable the Agora Conversational AI service in the Agora Console.
• TTS Vendor Account
  You need an account for the TTS vendor you choose. The TTS vendor provides the voice synthesis service for the voice assistant.

Configuration

• APP
  To turn a Dify agent into a voice assistant, choose one from your agent library.

• Agora App ID
  In the Agora Console, get your Agora App ID and enable the Conversational AI Engine service.

• Agora RESTful Customer ID
  In the Agora Console, get the Agora RESTful Customer ID.

• Agora RESTful Customer Secret
  In the Agora Console, get the Agora RESTful Customer Secret.

• TTS Vendor
  The TTS vendor to use for voice synthesis. Choose one from the list below.

  • Azure
  • ElevenLabs

• TTS Vendor Params
  The parameters for the TTS vendor. The parameters are different for each vendor, please refer to the vendor's documentation for more information.

  • Azure

  • ElevenLabs

• Greeting Message
  The message to greet the user when the conversation starts.

• Failure Message
  The message to tell the user when the conversation fails.

• Agora App Certificate
  The Agora App Certificate to use for RTC service. Get it from Agora Console. Only needed when security token is enabled for your Agora project.

• API Key
  The API Key to protect your Dify endpoint.

Usage

Once you finish the configuration, you'll fnd the APl in the endpoint as follows:

Replace with ,

Then you may navigate to the following URL to access the integrated Conversational Al web page.

Using API without Web Page

You can also use the API directly without the web page. The API endpoint is:

Start Conversation

API Endpoint:

Example cURL:

Stop Conversation

API Endpoint:

Example cURL: