You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello,
first of all, thank you for sharing your work!
I am trying to reproduce your result, but i think i am suffering from enviroment issues shown as below (Looks like torchtext problem)
/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launch.py:181: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torchrun.
Note that --use-env is set by default in torchrun.
If your script expects `--local-rank` argument to be set, please
change it to read from `os.environ['LOCAL_RANK']` instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
further instructions
warnings.warn(
WARNING:torch.distributed.run:
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.
*****************************************
Traceback (most recent call last):
File "/home/jckim/MMN/train_net.py", line 10, in <module>
from mmn.data import make_data_loader
File "/home/jckim/MMN/mmn/data/__init__.py", line 5, in <module>
from . import datasets as D
File "/home/jckim/MMN/mmn/data/datasets/__init__.py", line 2, in <module>
from .tacos import TACoSDataset
File "/home/jckim/MMN/mmn/data/datasets/tacos.py", line 4, in <module>
from .utils import moment_to_iou2d, bert_embedding, get_vid_feat
File "/home/jckim/MMN/mmn/data/datasets/utils.py", line 7, in <module>
import torchtext
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torchtext/__init__.py", line 6, in <module>
from torchtext import _extension # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torchtext/_extension.py", line 7, in <module>
_LIB_DIR = Path(os.environ["SP_DIR"]) / "torch" / "lib"
~~~~~~~~~~^^^^^^^^^^
File "<frozen os>", line 679, in __getitem__
KeyError: 'SP_DIR'
Traceback (most recent call last):
File "/home/jckim/MMN/train_net.py", line 10, in <module>
from mmn.data import make_data_loader
File "/home/jckim/MMN/mmn/data/__init__.py", line 5, in <module>
from . import datasets as D
File "/home/jckim/MMN/mmn/data/datasets/__init__.py", line 2, in <module>
from .tacos import TACoSDataset
File "/home/jckim/MMN/mmn/data/datasets/tacos.py", line 4, in <module>
from .utils import moment_to_iou2d, bert_embedding, get_vid_feat
File "/home/jckim/MMN/mmn/data/datasets/utils.py", line 7, in <module>
import torchtext
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torchtext/__init__.py", line 6, in <module>
from torchtext import _extension # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torchtext/_extension.py", line 7, in <module>
_LIB_DIR = Path(os.environ["SP_DIR"]) / "torch" / "lib"
~~~~~~~~~~^^^^^^^^^^
File "<frozen os>", line 679, in __getitem__
KeyError: 'SP_DIR'
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 2494446) of binary: /home/jckim/mambaforge/envs/tan/bin/python
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launch.py", line 196, in <module>
main()
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launch.py", line 192, in main
launch(args)
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launch.py", line 177, in launch
run(args)
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/run.py", line 785, in run
elastic_launch(
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 134, in __call__
return launch_agent(self._config, self._entrypoint, list(args))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/jckim/mambaforge/envs/tan/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
============================================================
train_net.py FAILED
------------------------------------------------------------
Failures:
[1]:
time : 2023-08-17_19:55:32
host : vtt-server
rank : 1 (local_rank: 1)
exitcode : 1 (pid: 2494447)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
time : 2023-08-17_19:55:32
host : vtt-server
rank : 0 (local_rank: 0)
exitcode : 1 (pid: 2494446)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
so, can i have specific environment setting?
I tried to build env by following the repository you referenced as baseline, but it didn't helped.
(Errors like AttributeError: module 'torch' has no attribute '_six' occurs)
Hello,
first of all, thank you for sharing your work!
I am trying to reproduce your result, but i think i am suffering from enviroment issues shown as below (Looks like torchtext problem)
so, can i have specific environment setting?
I tried to build env by following the repository you referenced as baseline, but it didn't helped.
(Errors like AttributeError: module 'torch' has no attribute '_six' occurs)
my currrent enviroment is this
Thank you in advance!
The text was updated successfully, but these errors were encountered: