Use this repository: https://github.com/otamajakusi/build_jetson_nano_libraries

jetson-package-build-python3.8

Build

time JETPACK_ROOT=/path/to/jetpack/mounted bash build.sh

real 82m47.834s
user 0m1.987s
sys 0m0.472s

time docker-compose build pytorch

real 257m21.193s user 0m1.335s sys 0m0.589s