I think you mean tauth
mjc619
2
Posts
1
Topics
A member registered Nov 17, 2020
Recent community posts
Dain-App 1.0 [Nvidia Only] community · Created a new topic Solving OOM issues with a modified pytorch that has Large Model Support
IBM and Microsoft have released libraries and conda packages that modify pytorch in order to escape out of memory issues when scaling up, some of which hopefully will be implemented in future versions of pytorch (https://github.com/pytorch/pytorch/issues/35633)
have you explored using any of these alternatives?
https://github.com/IBM/pytorch-large-model-support
https://github.com/microsoft/DeepSpeed