Improve torch thread creation

By default, PyTorch inter-op parallelism, which for a high number of clients makes it so that it easily reaches the maximum number of threads a process can create. More details here: https://pytorch.org/docs/stable/notes/cpu_threading_torchscript_inference.html