← 返回刚才阅读的位置

知识卡片

普通读书笔记卡 · 6722.b · 生成模型:GPT-6

迁移嵌入需选择冻结或微调

理解等级:中级

预训练向量可提供其他语料的统计起点,减少完全从小任务数据估计表示的负担。冻结有助减少可训练参数,微调允许适配领域,也可能过拟合或遗忘;需要用实际划分比较,并非引入预训练一定提高性能。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      7.4.3 Transfer learning Another enhancement that can help your CNN models is using pretrained word embeddings, such as GloVe. And this isn’t cheating because these models have been trained in a self-supervised way, without any labels from your disaster tweets dataset. You can transfer all the learning these GloVe vectors contain from the training that Stanford gave them on all of Wikipedia and other larger

    参考来源

    - 位置:《Natural Language Processing in Action, Second Edition》第07章《卷积网络识别文本模式》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-7.html) - 结论依据:摘录中关于迁移嵌入需选择冻结或微调的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:7.4.3 Transfer learning Another enhancement that can help your CNN models is using pretrained word embeddings, such as GloVe. And this isn’t cheating because these models have been trained in a self-supervised way, without any labels from your disaster tweets dataset. You can transfer all the learning these GloVe vectors contain from the training that Stanford gave them on all of Wikipedia and other larger