get-started-app-chat-evaluations.md

title	description	ms.date	ms.topic	ms.subservice	ms.custom	ms.collection
Evaluating JavaScript chat apps with Azure OpenAI	Learn how to effectively evaluate answers in your JavaScript RAG-based chat app using Azure OpenAI. Generate sample prompts, run evaluations, and analyze results.	12/11/2024	get-started	intelligent-apps	devx-track-js, devx-track-js-ai, build-2024-intelligent-apps	ce-skilling-ai-copilot

Get started with evaluating answers in a chat app in JavaScript

[!INCLUDE evaluations-intro]

Prerequisites

• Azure subscription. Create one for free

• Deploy a chat app.

  • JavaScript
  • JavaScript with LangChain.js

• These chat apps load the data into the Azure AI Search resource. This resource is required for the evaluations app to work. Don't complete the Clean up resources section of the previous procedure.

  You need the following Azure resource information from that deployment, which is referred to as the chat app in this article:

  • Chat API URI: The service backend endpoint shown at the end of the azd up process.
  • Azure AI Search. The following values are required:
    • Resource name: The name of the Azure AI Search resource name, reported as Search service during the azd up process.
    • Index name: The name of the Azure AI Search index where your documents are stored. This can be found in the Azure portal for the Search service.

  The Chat API URL allows the evaluations to make requests through your backend application. The Azure AI Search information allows the evaluation scripts to use the same deployment as your backend, loaded with the documents.

  Once you have this information collected, you shouldn't need to use the chat app development environment again. It's referred to later in this article several times to indicate how the chat app is used by the Evaluations app. Don't delete the chat app resources until you complete the entire procedure in this article.

• A development container environment is available with all dependencies required to complete this article. You can run the development container in GitHub Codespaces (in a browser) or locally using Visual Studio Code.

  Codespaces (recommended)

  • GitHub account

  Visual Studio Code

  • Docker Desktop - start Docker Desktop if it's not already running
  • Visual Studio Code
  • Dev Container Extension

  ---

[!INCLUDE evaluations-procedure]