Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cannot run ssd_resnet34 int8 model with intel-tensorflow 2.5.0 #91

Open
Zongru-Wen opened this issue Sep 3, 2021 · 1 comment
Open

cannot run ssd_resnet34 int8 model with intel-tensorflow 2.5.0 #91

Zongru-Wen opened this issue Sep 3, 2021 · 1 comment

Comments

@Zongru-Wen
Copy link

Whe I ues intel-tensorflow==2.5.0 to run SSD_ResNet34 model for inference, it will get an error:

Traceback (most recent call last):
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1375, in _do_call
    return fn(*args)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1360, in _run_fn
    target_list, run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1453, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Missing 0-th output from {{node v/cg/resnet34_backbone/conv1/conv2d/Conv2D_eightbit_requantize}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "draft.py", line 53, in <module>
    results = sess.run(output_tensors, {input_tensor: image})
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 968, in run
    run_metadata_ptr)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1191, in _run
    feed_dict_tensor, options, run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1369, in _do_run
    run_metadata)
  File "/home/support/miniconda3/envs/vdms_streamer/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1394, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Missing 0-th output from node v/cg/resnet34_backbone/conv1/conv2d/Conv2D_eightbit_requantize (defined at draft.py:21)

Then I downgrade the intel-tensorflow to 2.4.0, problem solved.
ashahba pushed a commit that referenced this issue Apr 1, 2022
@dmsuehir
Adds the container package for ResNext 32x16d inference (PyTorch SPR) (…
5f32ec4 
…#91)

* Add dockerfile and documentation for ResNext101

* Update echos

* Small doc updates

* add shm-size

* add shm-size for maskrcnn

* Update to use env vars in build.sh

* Updating name for ResNext to be 'ResNext 32x16d'

* Update quickstart scripts

* Regenerate dockerfile after sync with develop

* Regenerate docs
@sramakintel
Copy link
Contributor

@Zongru-Wen can you try our latest intel optimizations for SSD-ResNet34 by following links here: https://www.intel.com/content/www/us/en/developer/articles/containers/cpu-reference-model-containers.html ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sramakintel @Zongru-Wen