Creating An Application

In EXGPT, an "application" refers to a real-world scenario application built on large language models such as GPT. By creating an application, you can apply intelligent AI technology to specific needs. It encompasses both the engineering paradigms for developing AI applications and the specific deliverables.

In short, an application delivers to developers:

• A user-friendly, encapsulated LLM API that can be called directly by backend or frontend applications with token authentication

• A ready-to-use, beautiful, and hosted Web App that you can develop further using the Web App templates

• A set of easy-to-use interfaces for Prompt Engineering, context management, log analysis, and annotation

You can choose one or all of them to support your AI application development.

EXGPT offers two types of applications: text generation and conversational. More application paradigms may appear in the future (we should keep up-to-date), and the ultimate goal of EXGPT is to cover more than 80% of typical LLM application scenarios. The differences between text generation and conversational applications are shown in the table below:

	Text Generation	Conversational
WebApp Interface	Form + Results	Chat style
API Endpoint	chat-messages	completion-messages
Interaction Mode	One question and one answer	Multi-turn dialogue
Streaming results return	Supported	Supported
Context Preservation	Current time	Continuous
User input form	Supported	Supported
Datasets & Plugins	Supported	Supported
AI opening remarks	Not supported	Supported
Scenario example	Translation, judgment, indexing	Chat or everything

Steps to Create an Application

After logging in as an administrator in EXGPT, go to the main navigation application page Click "Create New Application" Choose a conversational or text generation application and give it a name (modifiable later)

We provide some templates in the application creation interface, and you can click to create from a template in the popup when creating an application. These templates will provide inspiration and reference for the application you want to develop.

Creating from a Configuration File

If you have obtained a template from the community or someone else, you can click to create from an application configuration file. Uploading the file will load most of the settings from the other party's application (but not the datasets at present).

Statistics show the usage, active user count, and LLM call consumption of the application over a period of time—enabling you to continually improve the cost-effectiveness of application operations. We will gradually provide more useful visualization capabilities; please let us know what you want.

1. 1.

   Total Messages: Daily AI interactions count; prompt engineering/debugging excluded.

2. 2.

   Active Users: Unique users engaging in Q&A with AI; prompt engineering/debugging excluded.

3. 3.

   Avg. Session Interactions: Continuous user-AI communication count; for conversation-based apps.

4. 4.

   User Satisfaction Rate: Likes per 1,000 messages; indicates satisfaction with AI answers.

5. 5.

   Avg. Response Time: Time (ms) for AI to process/respond; for text-based apps.

6. 6.

   Token Usage: Daily language model token usage; for cost control.

• Take a tour of the Configuration, Development, and Logs pages on the left

• Try configuring an application using a reference case

• If you have the ability to develop frontend applications, please consult the API documentation