关于pretrainedmodel问题

[xce1123]

您好，我在您代码的基础上在bertSequenceLabeling的基础上init初始化的时候添加了层，发现即使forward中不使用效果也会变差，请问这个load原始模型的过程是哪里需要修改吗？添加新的层是会影响其它层load的参数吗？不是太理解，期待回复，谢谢

[ArrowLuo]

Hi @xce1123, sorry for the delayed reply. I am not sure whether your weights are initialized. Maybe the log is useful if you can upload it. I do not think the new layers will affect other layers but you should be careful with the learning rate, bigger one for new layers and a smaller one for loaded weights. Best.