-
Notifications
You must be signed in to change notification settings - Fork 93
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mixed usage with TL/UCP and TL/MLX5:create tl_mlx5 ctx failed #1009
Comments
Hi @yanminglai
Other remarks:
Hoping it will be useful. Let me know if you have further issues |
Thank you very much, it answers all my questions. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I am trying to mix with ucp and mlx5: use tl mlx5 for all2all and use tl ucp for all other collective operations.
how I configure ucc:
"${UCC_SRC_DIR}/configure" --with-ucx="${UCX_HOME}" \ --prefix="${UCC_INSTALL_DIR}" --with-mpi \ --with-ibverbs \ --with-rdmacm \ --with-tls=self,shm,ucp,mlx5 \
run command:
mpirun -x UCC_CLS=basic -x UCC_CL_BASIC_TLS=ucp,mlx5 -x UCC_TL_UCP_TUNE=alltoall:0 -x UCC_TL_MLX5_NET_DEVICES=mlx5_2:1 -np 4 ./ucc_test_mpi -c alltoall -o min
Then I also test use tl mlx5 only:
mpirun -x UCC_TLS=mlx5 -x UCC_TL_MLX5_NET_DEVICES=mlx5_2:1 -np 2 ./ucc_test_mpi -c alltoall
Also met the ctx create problem
here is my ib_dev and bw test
Two Questions:
The text was updated successfully, but these errors were encountered: