Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to start server. Error: Unknown: 1 servable(s) did not become available #373

Open
cklogic opened this issue May 24, 2023 · 1 comment

Comments

@cklogic
Copy link

cklogic commented May 24, 2023

docker run -p 8501:8501 -p 8500:8500 --mount type=bind,source=/model/test,target=/models/test -e MODEL_NAME=test -t tensorflow/serving:2.1.0

2023-05-24 10:00:07.041263: I tensorflow_serving/util/retrier.cc:33] Retrying of Loading servable: {name: test version: 1} retry: 5
2023-05-24 10:00:07.049557: I external/org_tensorflow/tensorflow/cc/saved_model/reader.cc:31] Reading SavedModel from: /models/test/1
2023-05-24 10:00:07.071548: I external/org_tensorflow/tensorflow/cc/saved_model/reader.cc:54] Reading meta graph with tags { serve }
2023-05-24 10:00:07.071613: I external/org_tensorflow/tensorflow/cc/saved_model/loader.cc:264] Reading SavedModel debug info (if present) from: /models/test/1
2023-05-24 10:00:07.085314: I external/org_tensorflow/tensorflow/cc/saved_model/loader.cc:333] SavedModel load for tags { serve }; Status: fail: Not found: Op type not registered 'StatelessRandomGetKeyCounter' in binary running on 3e5ec75a2724. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) tf.contrib.resampler should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.. Took 35764 microseconds.
2023-05-24 10:00:07.085387: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: test version: 1} failed: Not found: Op type not registered 'StatelessRandomGetKeyCounter' in binary running on 3e5ec75a2724. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) tf.contrib.resampler should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
2023-05-24 10:00:07.085449: I tensorflow_serving/util/retrier.cc:46] Retrying of Loading servable: {name: test version: 1} exhausted max_num_retries: 5
2023-05-24 10:00:07.085536: I tensorflow_serving/core/loader_harness.cc:155] Encountered an error for servable version {name: test version: 1}: Not found: Op type not registered 'StatelessRandomGetKeyCounter' in binary running on 3e5ec75a2724. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) tf.contrib.resampler should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
2023-05-24 10:00:07.085573: E tensorflow_serving/core/aspired_versions_manager.cc:359] Servable {name: test version: 1} cannot be loaded: Not found: Op type not registered 'StatelessRandomGetKeyCounter' in binary running on 3e5ec75a2724. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) tf.contrib.resampler should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
Failed to start server. Error: Unknown: 1 servable(s) did not become available: {{{name: test version: 1} due to error: Not found: Op type not registered 'StatelessRandomGetKeyCounter' in binary running on 3e5ec75a2724. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) tf.contrib.resampler should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.}, }
2023-05-24 10:00:07.768893: I tensorflow_serving/core/basic_manager.cc:280] Unload all remaining servables in the manager.

@chengmengli06
Copy link
Collaborator

could not find the op StatelessRandomGetKeyCounter in official tensorflow, could you show the code for your model?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants