fz-mirrors/Build-A-Large-Language-Model-CN
1
0
Fork 0
mirror of https://github.com/skindhu/Build-A-Large-Language-Model-CN.git synced 2026-07-26 22:00:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

add fifth chapter

Browse Source
This commit is contained in:
skindhu
2024-11-07 15:40:50 +08:00
parent 9540a8821b
commit a0cf213251
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
cn-Book/5.在无标记数据集上进行预训练.md
View File

@@ -278,7 +278,7 @@ tensor([ -9.5042, -10.3796, -11.3677, -11.4798, -9.7764, -12.2561])
>
> 在计算交叉熵损失时，我们希望最大化模型分配给每个正确目标token的概率。交叉熵损失的数学公式为：
>
> $$ \text { Loss }=-\sum_{t=1}^{T} \ln P\left(y_{t} \mid x, \theta\right) $$
> $$\text { Loss }=-\sum_{t=1}^{T} \ln P\left(y_{t} \mid x, \theta\right)$$
>
> 其中：
>