---
title: Fine-Tune an Agent with an LLM
type: templates
category: LLM Fine-tuning
cat: llm-fine-tuning
order: 855
meta_description: Template for conversation-level evaluation when chatting with an LLM.
---



Run live, interactive chats with any OpenAI‑compatible LLM (including your own). Use this template to capture realistic, multi‑turn conversations for fine‑tuning. Help your agent specialize on key tasks, handle context shifts smoothly, and perform better under real‑world behavior.

While this template focuses on conversation-level evaluation, you can modify it to perform per-message evaluations. For examples, see our [other chat templates](gallery_chat). 

!!! error Enterprise
    This template requires Label Studio Enterprise. 

    Starter Cloud users can use the `Chat` tag, but have limited access to LLM integration. Instead, you can conduct a manual chat or import messages as predictions. See the [Chat tag documentation](/tags/chat#Prediction-format). 

    For Community users, see our [Conversation AI templates](gallery_conversational_ai) or the [Multi-Turn Chat Evaluation template](multi_turn_chat). 

## Labeling configuration

```xml


  
    
    
    
      
      
        
      
            
      
    

    
    
      


      

      
        
        
        
        
        
      

      

      
        
        
        
        
        
        
        
      

      

          </View>
  </View>
</View>
```
    
## About this labeling configuration

This labeling configuration is divided into two columns with the chat interface on the left and conversation-level evaluation on the right. 

### Style

The styling is applied through `<View>` tags, which are rendered as HTML `<div>` tags. 

You can apply styling using inline styles directly on `View` tags or by defining CSS rules for classes in a `<Style>` block. Those classes are then applied within the labeling configuration using the `className` parameter. 

For example, this `View` tag uses a combination of inline styles and `className`:

```xml
<View className="chat" style="flex: 2;">
```

The CSS rules for the `.chat` class are defined with the `<Style>` block.

!!!info Tip
    `.htx-chat` is a special Label Studio class that allows you to control the height of the chat portion of the interface. 

For more information, see the [Style tag](/tags/style).

### Text

Above the chat there are instructions guiding the user as to what they should try to achieve with the text. 

You can hard-code this into the labeling configuration (`<Text value="Your instruction text" />`), but if you are going to have multiple tasks within a project, you will likely want to specify the text as part of the imported data. 

In this example, we use `$text` because the input JSON uses `"text"`. See [input data](#Input-data) below. 

For more information, see the [Text tag](/tags/text).

### Chat 

The `Chat` tag provides an interface where the annotator can type and send messages. 

```xml
<Chat name="chat" value="$chat" 
            llm="openai/gpt-4.1-nano" 
            minMessages="4" 
            editable="true" />
```

* `name`: This is required, and when you want your control tags (choices, ratings, etc) to reference the chat element, you point to it using `toName="chat"`. You can use whichever name you like when customizing your own labeling configurations. 

* `value`: This is required, and should use a variable referencing your [input data](#Input-data). In this example, we use `$chat` because the input JSON uses `"chat"`.

* `llm`: Messages from the annotator will be sent to an LLM and the response returned within the chat area of the labeling configuration. For more information, see [Chat tag - Use with an LLM](/tags/chat#Use-with-an-LLM). 

* `minMessages`: The minimum number of messages users must submit to complete the task. You can also set a maximum. 

    Both minimum and maximum can also be set in the task data, allowing you to have different limits for each task. For an example, see [Chatbot Evaluation](chatbot#Chat).  

* `editable`: Messages from the annotator and from the LLM are editable. To modify this so that only messages from certain roles are editable, you can specify them (for example, `editable="user,assistant"`). 

For more information and additional parameters, see the [Chat tag](/tags/chat). 

### Choices and TextArea

In this template, the evaluation options are applied to the entire chat. For examples of per-message evaluation, see [Chatbot Evaluation](chatbot), LINK, LINK. 

For more information about modifying these options, see the [Choices tag](/tags/choices) and [TextArea tag](/tags/textarea). 

## Input data

The `Chat` tag accepts JSON data. 

### Empty chat

The following would provide an empty chat window and instruction text for the annotator:

```json
{
  "data": {
    "text": "Pretend you are a new user exploring our platform for the first time. Ask detailed questions about setup, configuration, and other features -- sometimes sticking to one topic, sometimes switching between multiple. Make the conversation realistic, as if you are trying to get actual work done.",
    "chat": []
  }
}
```
### Imported chat messages

You can also import demo chat messages as follows:

```json
{
  "data": {
    "text": "Pretend you are a new user exploring our platform for the first time. Ask detailed questions about setup, configuration, and other features -- sometimes sticking to one topic, sometimes switching between multiple. Make the conversation realistic, as if you are trying to get actual work done.",
    "chat": [
        {
            "role": "user",
            "content": "Demo chat message 1"
        },
        {
            "role": "assistant",
            "content": "Demo chat message 2"
        },
        {
            "role": "developer",
            "content": "Demo chat message 3 "
        }
    ]
  }
}
```

!!! attention
    The chat messages that you import are not selectable. This means that you cannot edit them or apply annotations (ratings, choices, etc) to them.

    You can only select and annotate messages that are added to the chat by an annotator or that are imported as [predictions](/tags/chat#Prediction-format).

## Related tags

* [Chat](/tags/chat)
* [Style](/tags/style)
* [Text](/tags/text)
* [View](/tags/view)
* [TextArea](/tags/textarea)
* [Choices](/tags/choices)</pre></div>
</div>
</div>






		</div>
		
		
		
        

        

        

        
    
		

		
				
	
	
	
	
	<!-- user fragment -->
	

	
	

		
		<!-- page footer -->
		<div class="container">
			<footer class="footer">
				<p class="pull-right">
					<a title="gitblit homepage" href="http://gitblit.com/">
						<span>v1.9.3</span>
					</a> 
				</p>
			</footer>
		</div>

		<!-- Override Bootstrap's responsive menu background highlighting -->
		<style>
		@media (max-width: 979px) {
			.nav-collapse .nav > li > a:hover, .nav-collapse .dropdown-menu a:hover {
				background-color: #002060;
			}
			
			.navbar div > ul .dropdown-menu li a {
				color: #ccc;
			}
		}
		</style>
		
		<!-- Include scripts at end for faster page loading -->
		<script type="text/javascript" src="../../../bootstrap/js/jquery.js"></script>
		<script type="text/javascript" src="../../../bootstrap/js/bootstrap.js"></script>	
		<script type="text/javascript" src="../../../gitblit/js/collapsible-table.js"></script>
		
	</body>
</html>