学习思考
📘History of LLM
00 分钟
2023-4-4
2023-6-23
type
status
date
slug
summary
tags
category
icon
password
Property
Jun 23, 2023 11:48 AM
History of LLM
notion image

List of Basic Model

模型名称
发布时间
发布机构
参数规模
Token 规模
相关资料
是否开源
T5
2019-10
Google
13B
ㅤ
https://arxiv.org/pdf/1910.10683.pdf
Y
GPT-3
2020-05
OpenAI
175B
300B
https://arxiv.org/pdf/2005.14165.pdf
ㅤ
LaMDA
2021-05
Google
137B
2.8T
https://arxiv.org/pdf/2201.08239.pdf
ㅤ
OPT
2022-05
Meta
125M-175B
180B
https://arxiv.org/pdf/2205.01068.pdf https://github.com/facebookresearch/metaseq/tree/main/projects/OPT https://www.bilibili.com/video/BV1XT411v7c9
Y
GLM-130B
2022-08
THU
130B
400B
https://arxiv.org/pdf/2210.02414.pdf
Y
LLaMA
2023-02
Meta
7B-65B
1.4T
https://arxiv.org/pdf/2302.13971v1.pdf https://github.com/facebookresearch/llama https://zhuanlan.zhihu.com/p/618776565
Y
BLOOM
202-07
BigScience
176B
366B
https://arxiv.org/pdf/2211.05100.pdf https://huggingface.co/bigscience
Y
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ

List of Finetuned Model

模型名称
发布时间
发布机构
参数规模
基础模型
相关资料
是否开源
ㅤ
GPT-3.5
2021-06
OpenAI
175B
GPT-3
https://platform.openai.com/docs/models/gpt-3-5
ㅤ
ㅤ
T0
2021-10
Hugging Face
13B
T5
https://arxiv.org/pdf/2110.08207.pdf https://huggingface.co/bigscience/T0
Y
ㅤ
BLOOMZ
2022-11
Hugging Face
137B
BLOOM
https://arxiv.org/pdf/2211.01786.pdf
Y
ㅤ
ChatGPT
2022-11
OpenAI
173B
GPT-3.5
https://openai.com/blog/chatgpt
ㅤ
ㅤ
Alpaca
2023-03-14
Standford
7B
LLaMA
https://crfm.stanford.edu/2023/03/13/alpaca.html
Y
ㅤ
ChatGLM
2023-03-14
Tsinghua
6B/130B
GLM
https://chatglm.cn/blog
Y
ㅤ
Bard
2023-03-21
Google
137B
LaMDA
https://bard.google.com/
ㅤ
ㅤ
Dolly
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ
ㅤ
Vicuna
ㅤ
UCB
ㅤ
LLaMA-13b
Y
ㅤ
 
More
Dolly LLM
https://huggingface.co/databricks/dolly-v1-6b
Vicuna-13B
Vicuna, an open-source chatbot impressing GPT-4!
https://twitter.com/lmsysorg/status/1641529839038640128
https://twitter.com/AlphaSignalAI/status/1641854039187914765
https://zhuanlan.zhihu.com/p/619257262
上一篇
移动互联网安全实验1(WIFI AP的抓包和分析)
下一篇
实验 3：Attack Lab
评论
  • Twikoo