Untitled

参数相关¶

打印梯度更新的参数¶

for name, p in model.named_parameters():
    if p.requires_grad == True:
        print(name)

统计参数量¶

sum(p.numel() for p in model.parameters() if p.requires_grad

打印更新参数和大小¶

for name, param in model.named_parameters():
    if param.requires_grad:
        logging.info("{}: {}".format(name, param.numel()))