Inference mode
PyTorch Developer Podcast
English - May 10, 2021 13:00 - 14 minutes - 13.2 MB - ★★★★★ - 35 ratingsTechnology deep learning machine learning pytorch Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Previous Episode: Vectorization
Next Episode: Just enough CUDA to be dangerous
What's inference mode? Why doesn't my code run fast if I use no_grad or make sure requires_grad=False? How come inference mode is safe but AutoNonVariableTypeMode is not?
Further reading:
Inference mode RFC https://github.com/.../rfc0011/RFC-0011-InferenceMode.mdInference mode docs for C++ frontend users https://github.com/.../cpp/source/notes/inference_mode.rstTracking issue for Python frontend support https://github.com/pytorch/pytorch/issues/56608