Skip to content
GitLab
菜单
为什么选择 GitLab
定价
联系销售
探索
为什么选择 GitLab
定价
联系销售
探索
登录
获取免费试用
主导航
搜索或转到…
项目
GitLab
管理
动态
成员
标记
计划
议题
议题看板
里程碑
迭代
需求
代码
合并请求
仓库
分支
提交
标签
仓库图
比较修订版本
代码片段
锁定的文件
构建
流水线
作业
流水线计划
测试用例
产物
部署
发布
Package registry
Container registry
模型注册表
运维
环境
Terraform 模块
监控
事件
服务台
分析
价值流分析
贡献者分析
CI/CD 分析
仓库分析
代码评审分析
议题分析
洞察
模型实验
效能分析
帮助
帮助
支持
GitLab 文档
比较 GitLab 各版本
社区论坛
为极狐GitLab 提交贡献
提交反馈
隐私声明
快捷键
?
新增功能
4
代码片段
群组
项目
显示更多面包屑
gitlab-cn
GitLab
提交
246df42c
未验证
提交
246df42c
编辑于
1 month ago
作者:
Bruno Cardoso
提交者:
GitLab
1 month ago
浏览文件
操作
下载
补丁
差异文件
Add Llama 3 and 3.1 models
上级
936366ad
No related branches found
分支 包含提交
No related tags found
标签 包含提交
2 合并请求
!3031
Merge per-main-jh to main-jh by luzhiyuan
,
!3030
Merge per-main-jh to main-jh
变更
1
隐藏空白变更内容
行内
左右并排
显示
1 个更改的文件
doc/administration/gitlab_duo_self_hosted/supported_models_and_hardware_requirements.md
+5
-1
5 个添加, 1 个删除
...self_hosted/supported_models_and_hardware_requirements.md
有
5 个添加
和
1 个删除
doc/administration/gitlab_duo_self_hosted/supported_models_and_hardware_requirements.md
+
5
−
1
浏览文件 @
246df42c
...
@@ -40,7 +40,7 @@ Support for the following GitLab-supported large language models (LLMs) is gener
...
@@ -40,7 +40,7 @@ Support for the following GitLab-supported large language models (LLMs) is gener
| Model Family | Model | Supported Platforms | Code completion | Code generation | GitLab Duo Chat |
| Model Family | Model | Supported Platforms | Code completion | Code generation | GitLab Duo Chat |
|-------------|-------|---------------------|-----------------|-----------------|-----------------|
|-------------|-------|---------------------|-----------------|-----------------|-----------------|
| Mistral Codestral |
[
Codestral 22B v0.1
](
https://huggingface.co/mistralai/Codestral-22B-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | N
/A
|
| Mistral Codestral |
[
Codestral 22B v0.1
](
https://huggingface.co/mistralai/Codestral-22B-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | N
ot applicable
|
| Mistral |
[
Mistral 7B-it v0.3
](
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"dash-circle"
>
}} Not compatible |
| Mistral |
[
Mistral 7B-it v0.3
](
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"dash-circle"
>
}} Not compatible |
| Mistral |
[
Mixtral 8x7B-it v0.1
](
https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
,
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/mistral/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| Mistral |
[
Mixtral 8x7B-it v0.1
](
https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
,
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/mistral/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| Mistral |
[
Mixtral 8x22B-it v0.1
](
https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| Mistral |
[
Mixtral 8x22B-it v0.1
](
https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1
)
|
[
vLLM
](
supported_llm_serving_platforms.md#for-self-hosted-model-deployments
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
...
@@ -48,6 +48,10 @@ Support for the following GitLab-supported large language models (LLMs) is gener
...
@@ -48,6 +48,10 @@ Support for the following GitLab-supported large language models (LLMs) is gener
| GPT |
[
GPT-4 Turbo
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| GPT |
[
GPT-4 Turbo
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| GPT |
[
GPT-4o
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4o-and-gpt-4-turbo
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible |
| GPT |
[
GPT-4o
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4o-and-gpt-4-turbo
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible |
| GPT |
[
GPT-4o-mini
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4o-and-gpt-4-turbo
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| GPT |
[
GPT-4o-mini
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure#gpt-4o-and-gpt-4-turbo
)
|
[
Azure OpenAI
](
https://learn.microsoft.com/en-us/azure/ai-services/openai/overview
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-dashed"
>
}} Largely compatible |
| Llama |
[
Llama 3 8B
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
|
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/llama/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | Not applicable |
| Llama |
[
Llama 3.1 8B
](
https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct
)
|
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/llama/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | Not applicable |
| Llama |
[
Llama 3 70B
](
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
)
|
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/llama/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | Not applicable |
| Llama |
[
Llama 3.1 70B
](
https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct
)
|
[
AWS Bedrock
](
https://aws.amazon.com/bedrock/llama/
)
| {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | {{
<
icon
name=
"check-circle-filled"
>
}} Fully compatible | Not applicable |
### Experimental and beta models
### Experimental and beta models
...
...
此差异已折叠。
点击以展开。
预览
0%
加载中
请重试
或
添加新附件
.
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
保存评论
取消
想要评论请
注册
或
登录