1, version:

 GPU_Driver——>Cuda——>NCCL——>{Bazel—pip(default)}—>Tensorflow

2,speed of network:

http_server:nginx apache;

3,