mark
参考：
pytorch(分布式)数据并行个人实践总结——DataParallel/DistributedDataParallel
https://zhuanlan.zhihu.com/p/39752167
https://ptorch.com/docs/8/cuda
https://www.cnblogs.com/yh-blog/p/12877922.html
https://www.zhihu.com/question/67726969?sort=created
https://blog.csdn.net/u013398034/article/details/83989808