-
|
I'm trying to run the Meanwhile, in another terminal session, RabbitMQ continuously closes the connections as shown here: I eventually have to force quit the example because RabbitMQ just keeps accepting and closing connections. Any ideas on what's going on here? Update: Running |
Beta Was this translation helpful? Give feedback.
Replies: 5 comments 11 replies
-
|
This is interesting. I'm curious if this is a timeout issue, or if this is on the initial connection. If you do a fresh |
Beta Was this translation helpful? Give feedback.
-
|
Running |
Beta Was this translation helpful? Give feedback.
-
|
It shouldn't... but it seems like it unfortunately does (I thought it skipped those lines quietly if not installed). A good find! I think the easier fix would be to just install flowcept (https://github.com/ORNL/flowcept) OR you could temporarily squash flowcept by commenting out lines 13 and 76-78 in https://github.com/ORNL/Zambeze/blob/main/zambeze/orchestration/agent/message_handler.py |
Beta Was this translation helpful? Give feedback.
-
|
I added the log output from running zambeze agent to my original question. |
Beta Was this translation helpful? Give feedback.
-
|
We should make flowcept optional, not required, in Zambeze but right now
there is a strong dependency in the code that is not being catched as an
exception.
pip install flowcept[zambeze] should fix this issue.
You'll have to export FLOWCEPT_SETTINGS_PATH with the path to the
settings.yaml file in the resources directory in flowcept repository
…On Fri, Jan 26, 2024, 3:27 PM Gavin Wiggins ***@***.***> wrote:
Running zambeze stop gives an error about ModuleNotFoundError: No module
named 'flowcept'. I thought zambeze didn't require flowcept?
—
Reply to this email directly, view it on GitHub
<#131 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AANMOYU22CZJDOUX2IXMRSLYQQGT7AVCNFSM6AAAAABCMU4L52VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DENRRGMZTA>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
I'm wondering how to handle 'missing Flowcept' quietly. Should it be configurable in the zambeze.yaml file? Should it always try to import it and flush a warning to the logs if it can't be found? I'm open to either. |
Beta Was this translation helpful? Give feedback.
-
|
I'd suggest the following behavior to make FlowCept an optional dependency in Zambeze.
If TRUE, the user will need to install an optional dependency and set up the requirements to run FlowCept (settings.yaml and FlowCept's Docker Compose). The way I did in FlowCept was to use optional dependency management. We could do the same in Zambeze, that is, if one runs |
Beta Was this translation helpful? Give feedback.
-
|
Sounds good. This should be straightforward to implement as all of the changes can be captured in the message_handler. I'll get right on it. |
Beta Was this translation helpful? Give feedback.
-
|
will need flowcepts docker compose as well to run both systems together.
I think will need to change queue name in the flowcept settings.yaml
…On Fri, Jan 26, 2024, 3:37 PM Renan ***@***.***> wrote:
We should make flowcept optional, not required, in Zambeze but right now
there is a strong dependency in the code that is not being catched as an
exception.
pip install flowcept[zambeze] should fix this issue.
You'll have to export FLOWCEPT_SETTINGS_PATH with the path to the
settings.yaml file in the resources directory in flowcept repository
On Fri, Jan 26, 2024, 3:27 PM Gavin Wiggins ***@***.***>
wrote:
> Running zambeze stop gives an error about ModuleNotFoundError: No module
> named 'flowcept'. I thought zambeze didn't require flowcept?
>
> —
> Reply to this email directly, view it on GitHub
> <#131 (reply in thread)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AANMOYU22CZJDOUX2IXMRSLYQQGT7AVCNFSM6AAAAABCMU4L52VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DENRRGMZTA>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
|
Beta Was this translation helpful? Give feedback.
-
|
We do 3 things to run FlowCept with Zambeze:
Currently (only currently) there's an additional step which is to specify the queue name here: https://github.com/ORNL/flowcept/blob/main/resources/settings.yaml#L65 @tskluzac what's the current queue name we use in Zambeze+FlowCept? |
Beta Was this translation helpful? Give feedback.
-
|
The names of the queue channels are "CONTROL" and "ACTIVITIES" |
Beta Was this translation helpful? Give feedback.
-
|
As of now, Zambeze's adapter in Flowcept can only intercept one single queue. If both queues should be intercepted by Flowcept, we can either (i) launch two different Flowcept processes, without any change in the adapter code or (ii) change the adapter code. Or we can let Flowcept intercept one single queue in Zambeze. In this case, would it be the queue "ACTIVITIES"? Let me know what you think we should do. |
Beta Was this translation helpful? Give feedback.
-
|
I have just pushed a 'muting' capability for flowcept that checks the log for a flowcept 'active' flag and then if false (or nonexistent) don't load any of the flowcept libraries. My config now contains this block at the top level: Let me know if this helps! |
Beta Was this translation helpful? Give feedback.
-
|
Thanks, Tyler!
Not sure what you mean by checking the log. Do you mean "that checks zambeze's config file" ? |
Beta Was this translation helpful? Give feedback.
-
|
Yep, exactly. |
Beta Was this translation helpful? Give feedback.
-
|
Turns out there were several steps that I wasn't aware of to run the example. So to answer this question, I listed the steps below that successfully runs this example for me:
plugins:
All:
default_working_directory: /Users/gavin/Desktop
shell:
config: {}
rmq:
host: localhost
port: 5672
zmq:
host: 127.0.0.1
port: 60081
|
Beta Was this translation helpful? Give feedback.
Turns out there were several steps that I wasn't aware of to run the example. So to answer this question, I listed the steps below that successfully runs this example for me:
~/.zambeze/agent.yamlwith contents similar to the following:cd zambeze/exampleszambeze agent startpython imagemagick_files.pya.gifshoul…