Skip to content
代码片段 群组 项目
未验证 提交 d091d0ec 编辑于 作者: Jon Glassman's avatar Jon Glassman 提交者: GitLab
浏览文件

Merge branch 'bcardoso--master-patch-b543' into 'master'

Update docs to mention the default endpoint used by vllm

See merge request https://gitlab.com/gitlab-org/gitlab/-/merge_requests/177725



Merged-by: default avatarJon Glassman <jglassman@gitlab.com>
Approved-by: default avatarSusie Bitters <sbitters@gitlab.com>
Approved-by: default avatarJon Glassman <jglassman@gitlab.com>
Co-authored-by: default avatarBruno Cardoso <bcardoso@gitlab.com>
No related branches found
No related tags found
无相关合并请求
...@@ -100,7 +100,7 @@ To configure a self-hosted model: ...@@ -100,7 +100,7 @@ To configure a self-hosted model:
- **Model family**: Select the model family the deployment belongs to. Only GitLab-approved models - **Model family**: Select the model family the deployment belongs to. Only GitLab-approved models
are in this list. are in this list.
- **Endpoint**: Enter the URL where the model is hosted. - **Endpoint**: Enter the URL where the model is hosted.
- For models hosted through vLLM, it is essential to suffix the URL with `/v1`. - For models hosted through vLLM, you must suffix the URL with `/v1`. The default port is `8000`, so the default endpoint URL is `https://<hostname>:8000/v1`.
- **API key**: Optional. Add an API key if you need one to access the model. - **API key**: Optional. Add an API key if you need one to access the model.
- **Model identifier (optional)**: Optional. The model identifier is based on your deployment method: - **Model identifier (optional)**: Optional. The model identifier is based on your deployment method:
......
0% 加载中 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册