From 8f3e985979dbb3d2f41b7daa0683004ffddb764e Mon Sep 17 00:00:00 2001
From: Bruno Cardoso <bcardoso@gitlab.com>
Date: Wed, 15 Jan 2025 11:55:28 +0000
Subject: [PATCH] Update docs to mention the default endpoint used by vllm
---
doc/administration/self_hosted_models/configure_duo_features.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/doc/administration/self_hosted_models/configure_duo_features.md b/doc/administration/self_hosted_models/configure_duo_features.md
index d333fd3e3fe68..f8b3fce218c3b 100644
--- a/doc/administration/self_hosted_models/configure_duo_features.md
+++ b/doc/administration/self_hosted_models/configure_duo_features.md
@@ -100,7 +100,7 @@ To configure a self-hosted model:
- **Model family**: Select the model family the deployment belongs to. Only GitLab-approved models
are in this list.
- **Endpoint**: Enter the URL where the model is hosted.
- - For models hosted through vLLM, it is essential to suffix the URL with `/v1`.
+ - For models hosted through vLLM, you must suffix the URL with `/v1`. The default port is `8000`, so the default endpoint URL is `https://<hostname>:8000/v1`.
- **API key**: Optional. Add an API key if you need one to access the model.
- **Model identifier (optional)**: Optional. The model identifier is based on your deployment method:
--
GitLab