From f4ba89510bd0cce5aa761cadf3945d9333cd23d0 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Fri, 8 Mar 2024 20:18:33 +0000 Subject: [PATCH 001/246] Add topicPrefix to docs for #961 --- docs/source/How2Guides/subscriber.rst | 7 ++++++- docs/source/Tutorials/Setup_a_remote_subscriber.rst | 1 + docs/source/fr/CommentFaire/subscriber.rst | 9 +++++++-- .../Tutoriel/Mettre_en_place_un_subscriber_distant.rst | 1 + 4 files changed, 15 insertions(+), 3 deletions(-) diff --git a/docs/source/How2Guides/subscriber.rst b/docs/source/How2Guides/subscriber.rst index 1b4f444f0..dd9aeb582 100644 --- a/docs/source/How2Guides/subscriber.rst +++ b/docs/source/How2Guides/subscriber.rst @@ -162,6 +162,7 @@ To view a configuration, give it to `sr3 list` as an argument:: # this is a feed of wmo bulletin (a set called AMIS in the old times) broker amqps://dd.weather.gc.ca/ + topicPrefix v02.post # instances: number of downloading processes to run at once. defaults to 1. Not enough for this case instances 5 @@ -386,6 +387,7 @@ Note the following:: $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post accept .*/observations/swob-ml/.* #write all SWOBS into the current working directory @@ -412,6 +414,7 @@ then the option mirror should be set:: $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post subtopic observations.swob-ml.# directory /tmp mirror True @@ -428,6 +431,7 @@ it will cause files to be placed relative to that directory:: $ sr3 edit subscribe/ddi_ninjo_part1.conf broker amqps://ddi.cmc.ec.gc.ca/ + topicPrefix v02.post subtopic ec.ops.*.*.ninjo-a.# directory /tmp/apps/ninjo/import/point/reports/in @@ -804,6 +808,7 @@ $ mknod /home/peter/test/.rxpipe p $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post subtopic observations.swob-ml.# rxpipe_name /home/peter/test/.rxpipe @@ -839,7 +844,7 @@ package, then one can add the following to a subscriber configuration file:: broker amqps://dd.weather.gc.ca - topicPredix v02.post + topicPrefix v02.post batch 1 callback clamav subtopic observations.swob-ml.# diff --git a/docs/source/Tutorials/Setup_a_remote_subscriber.rst b/docs/source/Tutorials/Setup_a_remote_subscriber.rst index a73818bff..31fd2b631 100644 --- a/docs/source/Tutorials/Setup_a_remote_subscriber.rst +++ b/docs/source/Tutorials/Setup_a_remote_subscriber.rst @@ -21,6 +21,7 @@ The *edit* command starts the user's configured editor on the file to be created $ sr3 edit subscribe/swob.conf broker amqps://anonymous@dd.weather.gc.ca subtopic observations.swob-ml.# + topicPrefix v02.post directory /tmp/swob_downloads accept .* $ mkdir /tmp/swob_downloads diff --git a/docs/source/fr/CommentFaire/subscriber.rst b/docs/source/fr/CommentFaire/subscriber.rst index 79cbd17dc..cbac34fb9 100644 --- a/docs/source/fr/CommentFaire/subscriber.rst +++ b/docs/source/fr/CommentFaire/subscriber.rst @@ -167,7 +167,8 @@ Pour afficher une configuration, donnez-la à `sr3 list` comme argument:: # il s’agit d’un flux de bulletin wmo (un ensemble appelé AMIS dans les temps anciens) broker amqps://dd.weather.gc.ca/ - + topicPrefix v02.post + # instances: nombre de processus de téléchargement à exécuter à la fois. la valeur par défaut est 1. Pas assez pour ce cas instances 5 @@ -388,6 +389,7 @@ Notez ce qui suit :: $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post accept .*/observations/swob-ml/.* #écrire tous les SWOBS dans le répertoire de travail actuel @@ -414,6 +416,7 @@ alors l’option miroir doit être définie:: $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post subtopic observations.swob-ml.# directory /tmp mirror True @@ -431,6 +434,7 @@ celles la entraîneront le placement de fichiers par rapport à ce répertoire : $ sr3 edit subscribe/ddi_ninjo_part1.conf broker amqps://ddi.cmc.ec.gc.ca/ + topicPrefix v02.post subtopic ec.ops.*.*.ninjo-a.# directory /tmp/apps/ninjo/import/point/reports/in @@ -778,6 +782,7 @@ un fichier de configuration sr3 :: $ sr3 edit subscribe/swob broker amqps://anonymous@dd.weather.gc.ca + topicPrefix v02.post subtopic observations.swob-ml.# rxpipe_name /home/peter/test/.rxpipe @@ -811,7 +816,7 @@ package, alors on peut ajouter ce qui suit à un fichier de configuration d'un abonné:: broker amqps://dd.weather.gc.ca - topicPredix v02.post + topicPrefix v02.post batch 1 callback clamav subtopic observations.swob-ml.# diff --git a/docs/source/fr/Tutoriel/Mettre_en_place_un_subscriber_distant.rst b/docs/source/fr/Tutoriel/Mettre_en_place_un_subscriber_distant.rst index 1f8f28d3e..db0d20138 100644 --- a/docs/source/fr/Tutoriel/Mettre_en_place_un_subscriber_distant.rst +++ b/docs/source/fr/Tutoriel/Mettre_en_place_un_subscriber_distant.rst @@ -23,6 +23,7 @@ La commande *edit* démarre l’éditeur configuré par l’utilisateur sur le f $ sr3 edit subscribe/swob.conf broker amqps://anonymous@dd.weather.gc.ca subtopic observations.swob-ml.# + topicPrefix v02.post directory /tmp/swob_downloads accept .* $ mkdir /tmp/swob_downloads From ffa34edd22b0d10b143e99c18e7633be02df8fe8 Mon Sep 17 00:00:00 2001 From: Mathew S <128190304+mshak2@users.noreply.github.com> Date: Wed, 28 Feb 2024 18:19:19 -0700 Subject: [PATCH 002/246] Edit for typos and clarity (in progress) --- docs/source/How2Guides/subscriber.rst | 50 +++++++++++++-------------- 1 file changed, 24 insertions(+), 26 deletions(-) diff --git a/docs/source/How2Guides/subscriber.rst b/docs/source/How2Guides/subscriber.rst index dd9aeb582..aa1b7f55c 100644 --- a/docs/source/How2Guides/subscriber.rst +++ b/docs/source/How2Guides/subscriber.rst @@ -26,11 +26,10 @@ view the tree with a web browser. For simple immediate needs, one can download data using the browser itself, or a standard tool such as wget. -The usual intent is to automatically download the data -wanted to a directory on a subscriber +The usual intent is to automatically download the dsesired data to a directory on a subscriber machine where other software can process it. Please note: -- The tool is entirely command line driven (there is no GUI) More accurately, it is mostly configuration file driven. +- The tool is entirely command line driven (there is no GUI). More accurately, it is mostly configuration file driven. Most of the *interface* involves using a text editor to modify configuration files. - While written to be compatible with other environments, the focus is on Linux usage. - The tool can be used as either an end-user tool, or a system-wide transfer engine. @@ -47,13 +46,13 @@ A data pump's web server will just expose web accessible folders and the root of the tree is the date, in YYYYMMDD format. These dates do not represent anything about the data other than when it was put into the pumping network, and since Sarracenia -always uses Universal Co-ordinated Time, the dates might not correspond +always uses Universal Co-ordinated Time, the dates might not correspond to the current date/time in the location of the subscriber:: Index of / Name Last modified Size Description - Parent Directory - + Parent Directory - 20151105/ 2015-11-27 06:44 - 20151106/ 2015-11-27 06:44 - 20151107/ 2015-11-27 06:44 - @@ -61,7 +60,7 @@ the current date/time in the location of the subscriber:: 20151109/ 2015-11-27 06:44 - 20151110/ 2015-11-27 06:44 - -A variable number of days are stored on each data pump, for those +A variable number of days are stored on each data pump; for those with an emphasis on real-time reliable delivery, the number of days will be shorter. For other pumps, where long term outages need to be tolerated, more days will be kept. @@ -74,7 +73,7 @@ way to the visible ones:: Index of /20151110 Name Last modified Size Description - Parent Directory - + Parent Directory - UNIDATA-UCAR/ 2015-11-27 06:44 - NOAAPORT/ 2015-11-27 06:44 - MSC-CMC/ 2015-11-27 06:44 - @@ -83,22 +82,22 @@ way to the visible ones:: NWS-OPSNET/ 2015-11-27 06:44 - The data under each of these directories was obtained from the named -source. In these examples, it is actually injected by DataInterchange +source. In these examples, it is actually injected by Data Interchange staff, and the names are chosen to represent the origin of the data. -The original Environment and Climate Change Canada data mart, is +The original Environment and Climate Change Canada data mart is one "source" in this sense, showing up on hpfx as WXO-DD, or the same tree being available at the root of:: https://dd.weather.gc.ca -once down to the viewing the content from a given source, +Once down to the viewing the content from a given source, products are organized in a way defined by the source:: Icon Name Last modified Size Description - [TXT] about_dd_apropos.txt 2021-05-17 13:23 1.0K + [TXT] about_dd_apropos.txt 2021-05-17 13:23 1.0K [DIR] air_quality/ 2020-12-10 14:47 - [DIR] alerts/ 2022-07-13 12:00 - [DIR] analysis/ 2022-07-13 13:17 - @@ -122,7 +121,7 @@ The configuration files are a few lines of configuration, and sr3 includes some examples. -To list the available configurations with *sr3 list* :: +You can list the available configurations with *sr3 list*:: $ sr3 list examples Sample Configurations: (from: /usr/lib/python3/dist-packages/sarracenia/examples ) @@ -142,7 +141,7 @@ broadcast system for weather data in the 1980's. It is a continuous stream of te and each message is limited to 14000 bytes. The service was transitioned to an internet streaming feed in the early 2000's, and the streaming version is still fed to those interested in air and maritime navigation across the country. -One can download a continuous feed of such traditional weather bulletins from the original datamart using the subscribe/dd_amis.conf +One can download a continuous feed of such traditional weather bulletins from the original data mart using the subscribe/dd_amis.conf configuration example:: $ sr3 add subscribe/dd_amis.conf @@ -175,24 +174,24 @@ To view a configuration, give it to `sr3 list` as an argument:: directory /tmp/dd_amis accept .* -Then it can be run interactively *sr3 foreground subscribe/dd_amis* or as a service -with *sr3 start subscribe/dd_amis* in both cases, files will be downloaded from +Then it can be run interactively with *sr3 foreground subscribe/dd_amis* or as a service +with *sr3 start subscribe/dd_amis*. In both cases, files will be downloaded from dd.weather.gc.ca into the local machine's /tmp/dd_amis directory. -more: +More information: * `CLI Introduction (Jupyter Notebook) <../Tutorials/1_CLI_introduction.html>`_ -* `Setup a Remote Subscriber <../Tutorials/Setup_a_remote_subscriber.html>`_ +* `Set up a Remote Subscriber <../Tutorials/Setup_a_remote_subscriber.html>`_ * `Options in the configuration file <../Reference/sr3_options.7.rst>`_ -Server Side Resources Allocated for Subscribers +Server-Side Resources Allocated for Subscribers ----------------------------------------------- Every configuration results in corresponding resources being declared on the broker, whose lifetime is controlled by the *expire* setting. The default *expire* is set to 300 seconds to avoid cluttering up servers with small experiments. Set *expire* -the the value that makes the most sense for your application (long enough to cover -outages you may experience.) In a configuration file, something like:: +to the value that makes the most sense for your application (long enough to cover +outages you may experience). In a configuration file, something like:: expire 3h @@ -210,7 +209,7 @@ subscriber starts up again, the queued notification messages are forwarded to th So when the *subtopic* option is changed, since it is already defined on the server, one ends up adding a binding rather than replacing it. For example, if one has a subtopic that contains SATELLITE, and then stops the subscriber, -edit the file and now the topic contains only RADAR, when the subscriber is +edits the file and now the topic contains only RADAR, when the subscriber is restarted, not only will all the queued satellite files be sent to the consumer, but the RADAR is added to the bindings, rather than replacing them, so the subscriber will get both the SATELLITE and RADAR data even though the configuration @@ -220,7 +219,7 @@ Also, if one is experimenting, and a queue is to be stopped for a very long time, it may accumulate a large number of notification messages. The total number of notification messages on a data pump has an effect on the pump performance for all users. It is therefore advisable to have the pump de-allocate resources when they will not be needed -for an extended periods, or when experimenting with different settings. +for an extended period, or when experimenting with different settings. Working with Multiple Configurations @@ -235,8 +234,7 @@ that directory: dd_amis.conf and hpfx_amis.conf, one could then run:: fractal% -to start the CMC downloading configuration. One can use by -using the sr3 command to start/stop multiple configurations at once. +to start the CMC downloading configuration. One can use the sr3 command to start/stop multiple configurations at once. The sr3 command will go through the default directories and start up all the configurations it finds:: @@ -264,11 +262,11 @@ all the configurations it finds:: will start up some sr3 processes as configured by CMC.conf and others to match hpfx_amis.conf. Sr3 stop will also do what you would expect. As will sr3 status. -Note that there are 5 sr_subscribe processes start with the CMC +Note that there are 5 sr_subscribe processes that start with the CMC configuration and 3 NWS ones. These are *instances* and share the same download queue. -more: +More information: * `Command line Guide <../Explanation/CommandLineGuide.html>`_ * `Sr3 Manual page <../Reference/sr3.1.html>`_ From cdecc1766b62af256c9a4a8e18d900a562d0ff12 Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Fri, 1 Mar 2024 18:27:24 +0000 Subject: [PATCH 003/246] Corrupted files... oops This reverts commit 68647138ef783ba04223b989f3d136e0a38a840e. --- .../source/Tutorials/1_CLI_introduction.ipynb | 37 ++++++++++++------- 1 file changed, 23 insertions(+), 14 deletions(-) diff --git a/docs/source/Tutorials/1_CLI_introduction.ipynb b/docs/source/Tutorials/1_CLI_introduction.ipynb index 179791c7f..405f291eb 100644 --- a/docs/source/Tutorials/1_CLI_introduction.ipynb +++ b/docs/source/Tutorials/1_CLI_introduction.ipynb @@ -7,7 +7,7 @@ "source": [ "# Downloading Using the Command Line\n", "\n", - "This [jupyter notebook](https://jupyter.org) introduces [Sarracenia version 3](https://metpx.github.io/sarracenia) usage from the command line (mostly on Linux, but should be similar on Windows and Mac also, main difference being different conventions for where preferences and logs are stored.) This is probably the easiest way to work with Sarracenia. You configure a flow to download files into a directory, and you can read the directory to process the files there.\n" + "This [jupyter notebook](https://jupyter.org) introduces [Sarracenia version 3](https://metpx.github.io/sarracenia) usage from the command line (mostly on Linux, but should be similar on Windows and Mac also, main difference being different conventions for where preferences and logs are stored. This is probably the easiest way to work with Sarracenia. You configure a flow to download files into a directory, and you can read the directory to process the files there.\n" ] }, { @@ -45,7 +45,7 @@ "\n", "The command line interface is called [sr3](../Reference/sr3.1.rst) (short for Sarracenia version 3). One defines\n", "flows to run using configuration files in a simple format: _keyword_ _value_ format.\n", - "There are example configurations to get you started:" + "there are example configurations to get you started:" ] }, { @@ -104,7 +104,7 @@ "id": "affecting-marking", "metadata": {}, "source": [ - "There are different kinds for flows: the examples are classified by flow type (poll, post, sarra, sender, shovel, etc.)\n", + "There are different kinds for flows: the examples are classified flow type (poll, post, sarra, sender, shovel...)\n", "A _subscribe_ is used by clients to download from a data pump. Let's pick one of those." ] }, @@ -134,15 +134,15 @@ "id": "overall-instruction", "metadata": {}, "source": [ - "The files that are active for you are placed in ~/.config/sr3/{{}}/config_name. You can browse there \n", - "and modify them with an editor if you like. You can also do that with _sr3 edit subscribe/hpfx_amis.conf_.\n", + "The files that are active for you are place in ~/.config/sr3//config_name. You can browse there \n", + "and modify them with an editor if you like. You can do that also with _sr3 edit subscribe/hpfx_amis.conf_\n", "\n", " # this is a feed of wmo bulletin (a set called AMIS in the old times)\n", "\n", " broker amqps://hpfx.collab.science.gc.ca/\n", " exchange xpublic\n", "\n", - " # instances: number of downloading processes to run at once. Defaults to 1. Not enough for this case\n", + " # instances: number of downloading processes to run at once. defaults to 1. Not enough for this case\n", " instances 5\n", " \n", " # expire, in operational use, should be longer than longest expected interruption\n", @@ -153,7 +153,7 @@ " mirror false\n", " directory /tmp/hpfx_amis/\n", "\n", - "Add the messageCountMax, so it doesn't run forever:" + "added the messageCountMax, so it doesn't run forever." ] }, { @@ -173,7 +173,7 @@ "metadata": {}, "source": [ "The root directory where files are to be placed needs to exist before you start.\n", - "The above commands are to configure on a Linux machine, you might need something else on a mac or windows.\n", + "the above commands are to configure on a linux machine, you might need something else on a mac or windows.\n", "\n", "You can then run a flow interactively with the _foreground_ action, and it will end quickly, like so:" ] @@ -273,7 +273,7 @@ "id": "foreign-european", "metadata": {}, "source": [ - "As you can see, it downloaded five files to /tmp/amis.\n", + "as you can see it downloaded five files to /tmp/amis.\n", "The _foreground_ action is intended to help with debugging, rather than real operations." ] }, @@ -312,7 +312,7 @@ "id": "rocky-unemployment", "metadata": {}, "source": [ - "Above, you can see there is 1 configuration in your list. You can have hundreds. The columns on the right refer to how many instances you have for each configuration. In the example above, _instances_ is set to 5, so one would expect to see 5 running instances when it would be running. You can start specifc configurations with _sr3 start subscribe\*_ or start all active instances with: _sr3 start_" + "There is 1 configuration in your list. You can have hundreds. The columns on the right refer to how many instances you have for each configuration. In the example above _instances_ is set to 5, so one would expect to see 5 running instances when it would be running. You can start specifc configuration with _sr3 start subscribe/*_ or start all active instances with: _sr3 start_" ] }, { @@ -344,11 +344,11 @@ "id": "leading-matthew", "metadata": {}, "source": [ - "When running in the background, output needs to go a log file. Since we have only ran this configuration file in the foreground, asking to see the log prints an error about the log being missing. This tells you that the logs are in the _~/.cache/sr3/log_ directory. Logs can be monitored in real-time with traditional tools such as _tail -f_ or _grep_.\n", + "When running in the background, output needs to go a log file. As we have only run this configuration file in the foreground, asking to see the log prints an error about the log being missing. This tells you that the logs are in the _~/.cache/sr3/log_ directory. Logs can be monitored in real-time with traditional tools such as _tail -f_ or _grep_.\n", "\n", "_sr3 stop_ does what you expect.\n", "\n", - "Processes can crash. In the _sr3 status_ output above, if the number of processes in the Run column is less than in the Exp (for Expected) one, then it means that some instances have crashed. You can repair it (just start the missing instances) with:\n", + "Processes can crash. In the _sr3 status_ output above, if the number of processes in the Run column is less than in the Exp (for Expected) one, then it means that some instances have crashed. you can repair it (just start the missing instances) with:\n", "\n", "_sr3 sanity_ -- start missing instances, also kill strays if any found.\n", "\n", @@ -357,13 +357,22 @@ "\n", "## Conclusion\n", "\n", - "If all you want to do is obtain data from a data pump in real-time, the easiest way to go is using the command line interface to control some processes that run all the time so that they dump files in a certain directory.\n", + "If all you want to do is obtain data from a data pump in real-time, using the command line interface to control some processes that run all the time, so that they dump files in a certain directory is the easiest way to go.\n", "\n", - "It isn't very efficient though. When dealing with a large number of files and aiming for high-speed processing, it’s more efficient to have your own application receive notifications about file arrivals rather than scanning a directory. This approach reduces CPU and I/O overhead while improving processing speed.\n", + "It isn't very efficient though. When you have large numbers of files to work with, and you want high speed processing, it is better, in the sense of lower cpu and i/o overhead, and in terms of speed of processing,\n", + "to have your own application informed of the arrival of files, rather than scanning a directory.\n", "\n", "The easiest way to do that is to add some callbacks to your flows. We'll cover that next." ] }, + { + "cell_type": "code", + "execution_count": null, + "id": "artistic-purple", + "metadata": {}, + "outputs": [], + "source": [] + } ], "metadata": { "kernelspec": { From 7fee8f29a17419a02beba305e5171622f159d41a Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Tue, 5 Mar 2024 23:13:29 +0000 Subject: [PATCH 004/246] Edit for typos and clarity --- .../source/Tutorials/1_CLI_introduction.ipynb | 1117 ++++++++++++++--- 1 file changed, 936 insertions(+), 181 deletions(-) diff --git a/docs/source/Tutorials/1_CLI_introduction.ipynb b/docs/source/Tutorials/1_CLI_introduction.ipynb index 405f291eb..10d525e3c 100644 --- a/docs/source/Tutorials/1_CLI_introduction.ipynb +++ b/docs/source/Tutorials/1_CLI_introduction.ipynb @@ -5,9 +5,9 @@ "id": "chubby-tenant", "metadata": {}, "source": [ - "# Downloading Using the Command Line\n", + "# Downloading Using the Command Line - Test\n", "\n", - "This [jupyter notebook](https://jupyter.org) introduces [Sarracenia version 3](https://metpx.github.io/sarracenia) usage from the command line (mostly on Linux, but should be similar on Windows and Mac also, main difference being different conventions for where preferences and logs are stored. This is probably the easiest way to work with Sarracenia. You configure a flow to download files into a directory, and you can read the directory to process the files there.\n" + "This [jupyter notebook](https://jupyter.org) introduces [Sarracenia version 3](https://metpx.github.io/sarracenia) usage from the command line (mostly on Linux, but should be similar on Windows and Mac also, main difference being different conventions for where preferences and logs are stored.) This is probably the easiest way to work with Sarracenia. You configure a flow to download files into a directory, and you can read the directory to process the files there.\n" ] }, { @@ -25,7 +25,9 @@ { "cell_type": "markdown", "id": "varying-armor", - "metadata": {}, + "metadata": { + "jp-MarkdownHeadingCollapsed": true + }, "source": [ "\n", "## Prerequisites\n", @@ -45,53 +47,52 @@ "\n", "The command line interface is called [sr3](../Reference/sr3.1.rst) (short for Sarracenia version 3). One defines\n", "flows to run using configuration files in a simple format: _keyword_ _value_ format.\n", - "there are example configurations to get you started:" + "There are example configurations to get you started:" ] }, { "cell_type": "code", - "execution_count": 1, + "execution_count": 2, "id": "drawn-opposition", - "metadata": { - "scrolled": false - }, + "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ - "Sample Configurations: (from: /home/peter/Sarracenia/sr3/sarracenia/examples )\r\n", - "cpump/cno_trouble_f00.inc flow/amserver.conf \r\n", - "flow/opg.conf flow/poll.inc \r\n", - "flow/post.inc flow/report.inc \r\n", - "flow/sarra.inc flow/sender.inc \r\n", - "flow/shovel.inc flow/subscribe.inc \r\n", - "flow/watch.inc flow/winnow.inc \r\n", - "poll/airnow.conf poll/aws-nexrad.conf \r\n", - "poll/copernicus_odata.conf poll/mail.conf \r\n", - "poll/nasa-mls-nrt.conf poll/nasa_cmr_opendap.conf \r\n", - "poll/nasa_cmr_other.conf poll/nasa_cmr_podaac.conf \r\n", - "poll/noaa.conf poll/soapshc.conf \r\n", - "poll/usgs.conf post/WMO_mesh_post.conf \r\n", - "sarra/wmo_mesh.conf sender/am_send.conf \r\n", - "sender/ec2collab.conf sender/pitcher_push.conf \r\n", - "shovel/no_trouble_f00.inc subscribe/aws-nexrad.conf \r\n", - "subscribe/dd_2mqtt.conf subscribe/dd_all.conf \r\n", - "subscribe/dd_amis.conf subscribe/dd_aqhi.conf \r\n", - "subscribe/dd_cacn_bulletins.conf subscribe/dd_citypage.conf \r\n", - "subscribe/dd_cmml.conf subscribe/dd_gdps.conf \r\n", - "subscribe/dd_radar.conf subscribe/dd_rdps.conf \r\n", - "subscribe/dd_swob.conf subscribe/ddc_cap-xml.conf \r\n", - "subscribe/ddc_normal.conf subscribe/download_all_nasa_earthdata.conf \r\n", - "subscribe/downloademail.conf subscribe/ec_ninjo-a.conf \r\n", - "subscribe/get_copernicus.conf subscribe/hpfxWIS2DownloadAll.conf \r\n", - "subscribe/hpfx_amis.conf subscribe/hpfx_citypage.conf \r\n", - "subscribe/local_sub.conf subscribe/ping.conf \r\n", - "subscribe/pitcher_pull.conf subscribe/sci2ec.conf \r\n", - "subscribe/subnoaa.conf subscribe/subsoapshc.conf \r\n", - "subscribe/subusgs.conf watch/master.conf \r\n", - "watch/pitcher_client.conf watch/pitcher_server.conf \r\n", - "watch/sci2ec.conf \r\n" + "2024-03-05 22:22:21,708 2062154 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "Sample Configurations: (from: /net/local/home/shakerm/sr3/sarracenia/examples )\n", + "cpump/cno_trouble_f00.inc flow/amserver.conf \n", + "flow/opg.conf flow/poll.inc \n", + "flow/post.inc flow/report.inc \n", + "flow/sarra.inc flow/sender.inc \n", + "flow/shovel.inc flow/subscribe.inc \n", + "flow/watch.inc flow/winnow.inc \n", + "poll/airnow.conf poll/aws-nexrad.conf \n", + "poll/copernicus_odata.conf poll/mail.conf \n", + "poll/nasa-mls-nrt.conf poll/nasa_cmr_opendap.conf \n", + "poll/nasa_cmr_other.conf poll/nasa_cmr_podaac.conf \n", + "poll/noaa.conf poll/soapshc.conf \n", + "poll/usgs.conf post/WMO_mesh_post.conf \n", + "sarra/wmo_mesh.conf sender/am_send.conf \n", + "sender/ec2collab.conf sender/pitcher_push.conf \n", + "shovel/no_trouble_f00.inc subscribe/aws-nexrad.conf \n", + "subscribe/dd_2mqtt.conf subscribe/dd_all.conf \n", + "subscribe/dd_amis.conf subscribe/dd_aqhi.conf \n", + "subscribe/dd_cacn_bulletins.conf subscribe/dd_citypage.conf \n", + "subscribe/dd_cmml.conf subscribe/dd_gdps.conf \n", + "subscribe/dd_radar.conf subscribe/dd_rdps.conf \n", + "subscribe/dd_swob.conf subscribe/ddc_cap-xml.conf \n", + "subscribe/ddc_normal.conf subscribe/download_all_nasa_earthdata.conf \n", + "subscribe/downloademail.conf subscribe/ec_ninjo-a.conf \n", + "subscribe/get_copernicus.conf subscribe/hpfxWIS2DownloadAll.conf \n", + "subscribe/hpfx_amis.conf subscribe/hpfx_citypage.conf \n", + "subscribe/local_sub.conf subscribe/ping.conf \n", + "subscribe/pitcher_pull.conf subscribe/sci2ec.conf \n", + "subscribe/subnoaa.conf subscribe/subsoapshc.conf \n", + "subscribe/subusgs.conf watch/master.conf \n", + "watch/pitcher_client.conf watch/pitcher_server.conf \n", + "watch/sci2ec.conf \n" ] } ], @@ -104,13 +105,13 @@ "id": "affecting-marking", "metadata": {}, "source": [ - "There are different kinds for flows: the examples are classified flow type (poll, post, sarra, sender, shovel...)\n", + "There are different kinds for flows: the examples are classified by flow type (poll, post, sarra, sender, shovel, etc.)\n", "A _subscribe_ is used by clients to download from a data pump. Let's pick one of those." ] }, { "cell_type": "code", - "execution_count": 2, + "execution_count": 3, "id": "egyptian-suicide", "metadata": { "scrolled": true @@ -120,8 +121,10 @@ "name": "stdout", "output_type": "stream", "text": [ - "add: 2024-01-12 15:47:53,081 127062 [INFO] sarracenia.sr add copying: /home/peter/Sarracenia/sr3/sarracenia/examples/subscribe/hpfx_amis.conf to /home/peter/.config/sr3/subscribe/hpfx_amis.conf \r\n", - "\r\n" + "2024-03-05 22:22:22,178 2062157 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "add: 2024-03-05 22:22:22,183 2062157 [INFO] root add matched existing ['subscribe/hpfx_amis']\n", + "2024-03-05 22:22:22,183 2062157 [ERROR] root add nothing specified to add\n", + "\n" ] } ], @@ -131,18 +134,18 @@ }, { "cell_type": "markdown", - "id": "overall-instruction", + "id": "d1179254-ac4c-49f8-b1a8-30f96d09290b", "metadata": {}, "source": [ - "The files that are active for you are place in ~/.config/sr3//config_name. You can browse there \n", - "and modify them with an editor if you like. You can do that also with _sr3 edit subscribe/hpfx_amis.conf_\n", + "The files that are active for you are placed in ~/.config/sr3/\\/config_name. You can browse there \n", + "and modify them with an editor if you like. You can also do that with _sr3 edit subscribe/hpfx_amis.conf_.\n", "\n", " # this is a feed of wmo bulletin (a set called AMIS in the old times)\n", "\n", " broker amqps://hpfx.collab.science.gc.ca/\n", " exchange xpublic\n", "\n", - " # instances: number of downloading processes to run at once. defaults to 1. Not enough for this case\n", + " # instances: number of downloading processes to run at once. Defaults to 1. Not enough for this case\n", " instances 5\n", " \n", " # expire, in operational use, should be longer than longest expected interruption\n", @@ -153,15 +156,23 @@ " mirror false\n", " directory /tmp/hpfx_amis/\n", "\n", - "added the messageCountMax, so it doesn't run forever." + "Add the messageCountMax, so it doesn't run forever:" ] }, { "cell_type": "code", - "execution_count": 3, + "execution_count": 4, "id": "primary-score", "metadata": {}, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "mkdir: cannot create directory ‘/tmp/hpfx_amis’: File exists\n" + ] + } + ], "source": [ "!mkdir /tmp/hpfx_amis\n", "!echo messageCountMax 10 >>~/.config/sr3/subscribe/hpfx_amis.conf" @@ -173,14 +184,14 @@ "metadata": {}, "source": [ "The root directory where files are to be placed needs to exist before you start.\n", - "the above commands are to configure on a linux machine, you might need something else on a mac or windows.\n", + "The above commands are to configure on a Linux machine, you might need something else on a mac or windows.\n", "\n", "You can then run a flow interactively with the _foreground_ action, and it will end quickly, like so:" ] }, { "cell_type": "code", - "execution_count": 4, + "execution_count": null, "id": "nominated-nerve", "metadata": {}, "outputs": [ @@ -188,79 +199,866 @@ "name": "stdout", "output_type": "stream", "text": [ - "2024-01-12 15:50:03,810 127223 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - ".2024-01-12 15:50:04,207 [INFO] 127226 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - "2024-01-12 15:50:04,213 [INFO] 127226 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - "2024-01-12 15:50:04,213 [INFO] 127226 sarracenia.flow loadCallbacks flowCallback plugins to load: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", - "2024-01-12 15:50:04,217 [INFO] 127226 sarracenia.flowcb.log __init__ subscribe initialized with: logEvents: {'after_work', 'after_accept', 'after_post', 'post', 'on_housekeeping'}, logMessageDump: False\n", - "2024-01-12 15:50:04,217 [INFO] 127226 sarracenia.flow run callbacks loaded: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", - "2024-01-12 15:50:04,217 [INFO] 127226 sarracenia.flow run pid: 127226 subscribe/hpfx_amis instance: 0\n", - "2024-01-12 15:50:04,631 [INFO] 127226 sarracenia.moth.amqp _queueDeclare queue declared q_anonymous_subscribe.hpfx_amis.08788568.39025730 (as: amqps://anonymous@hpfx.collab.science.gc.ca/), (messages waiting: 0)\n", - "2024-01-12 15:50:04,632 [INFO] 127226 sarracenia.moth.amqp getSetup binding q_anonymous_subscribe.hpfx_amis.08788568.39025730 with v02.post.*.WXO-DD.bulletins.alphanumeric.# to xpublic (as: amqps://anonymous@hpfx.collab.science.gc.ca/)\n", - "2024-01-12 15:50:04,683 [INFO] 127226 sarracenia.flow run now active on vip ['AnyAddressIsFine']\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 4.37 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRCN40_KWAL_122049___63558\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 4.37 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRMN70_KWAL_122049___30217\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 3.38 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRCN40_KWAL_122049___52919\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.36 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRCN40_KWAL_122049___9140\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.36 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRWA20_KWAL_122049___32706\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.36 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SX/KWAL/20/SXCN40_KWAL_122049___44658\n", - "2024-01-12 15:50:08,859 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.36 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SR/KWAL/20/SRND20_KWAL_122049___26354\n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_122049___63558 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRMN70_KWAL_122049___30217 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_122049___52919 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_122049___9140 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRWA20_KWAL_122049___32706 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SXCN40_KWAL_122049___44658 \n", - "2024-01-12 15:50:09,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRND20_KWAL_122049___26354 \n", - "2024-01-12 15:50:10,650 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.15 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS22_KWBC_122100_RRB__27489\n", - "2024-01-12 15:50:10,650 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.15 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/UB/KWBC/20/UBUS31_KWBC_122050___34623\n", - "2024-01-12 15:50:10,650 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.15 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS70_KWBC_122050___57193\n", - "2024-01-12 15:50:10,650 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.15 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAXX60_KWBC_122100___24162\n", - "2024-01-12 15:50:10,650 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.15 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS70_KWBC_122100___63650\n", - "2024-01-12 15:50:10,651 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 2.14 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS70_KWBC_122000_RRX__32907\n", - "2024-01-12 15:50:10,651 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.14 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAXX60_KWBC_122050___36318\n", - "2024-01-12 15:50:10,651 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.98 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SP/KWBC/20/SPXX60_KWBC_122050___51901\n", - "2024-01-12 15:50:10,651 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.98 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS23_KWBC_122100_RRB__25767\n", - "2024-01-12 15:50:10,651 [INFO] 127226 sarracenia.flowcb.log after_accept accepted: (lag: 1.98 ) https://hpfx.collab.science.gc.ca /20240112/WXO-DD/bulletins/alphanumeric/20240112/SA/KWBC/20/SAUS80_KWBC_122100___64188\n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS22_KWBC_122100_RRB__27489 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/UBUS31_KWBC_122050___34623 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS70_KWBC_122050___57193 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAXX60_KWBC_122100___24162 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS70_KWBC_122100___63650 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS70_KWBC_122000_RRX__32907 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAXX60_KWBC_122050___36318 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SPXX60_KWBC_122050___51901 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS23_KWBC_122100_RRB__25767 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SAUS80_KWBC_122100___64188 \n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flow please_stop ok, telling 4 callbacks about it.\n", - "2024-01-12 15:50:11,475 [INFO] 127226 sarracenia.flow run starting last pass (without gather) through loop for cleanup.\n", - "2024-01-12 15:50:11,480 [INFO] 127226 sarracenia.flow please_stop ok, telling 4 callbacks about it.\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.flow run on_housekeeping pid: 127226 subscribe/hpfx_amis instance: 0\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.flowcb.gather.message on_housekeeping messages: good: 17 bad: 0 bytes: 2.3 KiB average: 139 Bytes\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.000226\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.000119\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.5 system=0.04\n", - "2024-01-12 15:50:11,481 [INFO] 127226 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 92.2 MiB, accumulating count (17 or 17/100 so far) before self-setting threshold\n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flowcb.log stats version: 3.00.51rc5, started: 7 seconds ago, last_housekeeping: 7.3 seconds ago \n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flowcb.log stats messages received: 17, accepted: 17, rejected: 0 rate accepted: 100.0% or 2.3 m/s\n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flowcb.log stats files transferred: 17 bytes: 5.7 KiB rate: 808 Bytes/sec\n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flowcb.log stats lag: average: 2.21, maximum: 4.37 \n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flowcb.log on_housekeeping housekeeping\n", - "2024-01-12 15:50:11,482 [INFO] 127226 sarracenia.flow run clean stop from run loop\n", - "2024-01-12 15:50:11,503 [INFO] 127226 sarracenia.flowcb.gather.message on_stop closing\n", - "2024-01-12 15:50:11,503 [INFO] 127226 sarracenia.flow close flow/close completed cleanly pid: 127226 subscribe/hpfx_amis instance: 0\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "\r\n" + "2024-03-05 22:22:22,837 2062162 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + ".2024-03-05 22:22:23,092 [INFO] 2062166 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "2024-03-05 22:22:23,098 [INFO] 2062166 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "2024-03-05 22:22:23,098 [INFO] 2062166 sarracenia.flow loadCallbacks flowCallback plugins to load: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", + "2024-03-05 22:22:23,108 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:23,108 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flowcb.log __init__ subscribe initialized with: logEvents: {'after_accept', 'after_post', 'after_work', 'on_housekeeping'}, logMessageDump: False\n", + "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run callbacks loaded: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", + "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run pid: 2062166 subscribe/hpfx_amis instance: 0\n", + "2024-03-05 22:22:23,118 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:23,118 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:23,118 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run now active on vip ['AnyAddressIsFine']\n", + "2024-03-05 22:22:23,318 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:23,318 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:23,318 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:23,519 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:23,519 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:23,519 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:24,119 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:24,119 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:24,119 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:25,119 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:25,119 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:25,119 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:27,321 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:27,322 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:27,322 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:31,524 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:31,524 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:31,524 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:33,723 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:33,723 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:33,723 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:37,928 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:37,929 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:37,929 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:40,126 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:40,126 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:40,126 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:44,333 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:44,333 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:44,333 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:46,528 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:46,529 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:46,529 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:50,738 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:50,738 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:50,738 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:52,931 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:52,931 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:52,931 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:57,139 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:57,139 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:57,139 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:22:59,334 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:22:59,334 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:22:59,334 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:03,544 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:03,544 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:03,544 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:05,735 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:05,735 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:05,735 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:09,947 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:09,947 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:09,947 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:12,138 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:12,138 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:12,138 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:16,351 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:16,351 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:16,351 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:18,540 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:18,540 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:18,541 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:22,755 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:22,755 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:22,755 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:24,943 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:24,943 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:24,943 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:29,156 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:29,156 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:29,156 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:31,346 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:31,346 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:31,346 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:35,559 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:35,559 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:35,559 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:37,748 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:37,748 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:37,748 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:41,963 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:41,963 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:41,963 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:44,151 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:44,151 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:44,151 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:48,368 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:48,368 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:48,368 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:50,553 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:50,554 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:50,554 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:54,771 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:54,771 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:54,771 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:23:56,955 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:23:56,955 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:23:56,955 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:01,176 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:01,176 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:01,176 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:03,358 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:03,358 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:03,358 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:07,581 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:07,581 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:07,581 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:09,759 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:09,759 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:09,759 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:13,983 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:13,983 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:13,983 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:16,161 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:16,161 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:16,161 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:20,387 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:20,387 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:20,387 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:22,563 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:22,563 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:22,563 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:26,791 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:26,791 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:26,791 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:28,966 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:28,966 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:28,966 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:33,195 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:33,195 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:33,195 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:35,368 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:35,368 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:35,368 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:39,600 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:39,600 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:39,600 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:41,771 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:41,771 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:41,771 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:46,001 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:46,001 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:46,001 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:48,174 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:48,174 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:48,174 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:52,403 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:52,403 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:52,403 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:54,575 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:54,575 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:54,575 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:24:58,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:24:58,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:24:58,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:00,978 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:00,978 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:00,978 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:05,211 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:05,211 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:05,211 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:07,380 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:07,380 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:07,380 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:11,616 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:11,616 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:11,616 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:13,783 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:13,783 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:13,783 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:18,021 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:18,021 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:18,021 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:20,186 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:20,186 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:20,186 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:24,423 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:24,423 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:24,423 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:26,587 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:26,587 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:26,587 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:30,827 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:30,827 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:30,827 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:32,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:32,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:32,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:37,231 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:37,231 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:37,231 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:39,392 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:39,392 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:39,393 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:43,636 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:43,636 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:43,636 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:45,795 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:45,795 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:45,795 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:50,039 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:50,039 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:50,039 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:52,198 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:52,198 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:52,198 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:56,443 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:56,443 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:56,443 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:25:58,600 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:25:58,600 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:25:58,600 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:02,848 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:02,848 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:02,848 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:05,003 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:05,003 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:05,003 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:09,251 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:09,251 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:09,251 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:11,405 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:11,405 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:11,405 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:15,656 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:15,656 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:15,656 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:17,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:17,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:17,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:22,061 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:22,061 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:22,061 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:24,210 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:24,210 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:24,210 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:28,463 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:28,463 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:28,463 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:30,612 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:30,612 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:30,612 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:34,866 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:34,867 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:34,867 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:37,015 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:37,015 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:37,015 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:41,272 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:41,272 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:41,272 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:43,417 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:43,418 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:43,418 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:47,676 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:47,676 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:47,676 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:49,819 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:49,819 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:49,819 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:54,079 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:54,079 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:54,079 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:26:56,222 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:26:56,222 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:26:56,222 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:00,483 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:00,483 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:00,483 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:02,623 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:02,623 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:02,623 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:06,887 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:06,887 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:06,887 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:09,026 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:09,026 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:09,026 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:13,292 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:13,292 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:13,292 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:15,428 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:15,428 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:15,428 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:19,695 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:19,695 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:19,695 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:21,831 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:21,831 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:21,831 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:26,100 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:26,100 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:26,100 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.flow run on_housekeeping pid: 2062166 subscribe/hpfx_amis instance: 0\n", + "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", + "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", + "2024-03-05 22:27:26,103 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-05 22:27:26,104 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.003044\n", + "2024-03-05 22:27:26,104 [INFO] 2062166 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", + "2024-03-05 22:27:26,105 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.001927\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.18 system=0.04\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 68.2 MiB, accumulating count (0 or 0/100 so far) before self-setting threshold\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats version: 3.00.52rc2, started: 5 minutes ago, last_housekeeping: 303.0 seconds ago \n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats messages received: 0, accepted: 0, rejected: 0 rate accepted: 0.0% or 0.0 m/s\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats files transferred: 0 bytes: 0 Bytes rate: 0 Bytes/sec\n", + "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log on_housekeeping housekeeping\n", + "2024-03-05 22:27:28,239 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:28,239 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:28,239 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:32,505 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:32,505 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:32,505 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:34,642 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:34,642 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:34,642 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:38,909 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:38,910 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:38,910 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:41,044 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:41,044 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:41,045 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:45,315 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:45,315 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:45,315 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:47,447 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:47,447 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:47,447 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:51,719 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:51,719 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:51,719 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:53,850 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:53,850 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:53,850 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:27:58,124 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:27:58,124 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:27:58,124 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:00,252 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:00,252 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:00,252 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:04,529 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:04,529 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:04,529 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:06,655 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:06,655 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:06,655 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:10,933 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:10,933 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:10,933 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:13,055 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:13,055 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:13,055 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:17,335 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:17,335 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:17,335 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:19,458 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:19,458 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:19,458 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:23,739 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:23,739 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:23,739 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:25,861 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:25,861 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:25,861 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:30,144 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:30,144 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:30,144 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:32,263 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:32,263 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:32,263 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:36,549 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:36,549 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:36,549 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:38,666 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:38,666 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:38,666 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:42,951 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:42,951 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:42,951 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:45,068 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:45,068 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:45,068 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:49,356 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:49,356 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:49,356 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:51,471 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:51,471 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:51,471 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:55,759 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:55,759 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:55,759 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:28:57,873 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:28:57,874 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:28:57,874 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:02,164 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:02,164 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:02,164 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:04,276 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:04,276 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:04,276 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:08,569 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:08,569 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:08,569 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:10,679 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:10,679 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:10,679 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:14,971 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:14,971 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:14,971 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:17,081 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:17,081 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:17,081 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:21,375 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:21,375 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:21,375 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:23,483 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:23,483 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:23,483 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:27,779 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:27,779 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:27,779 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:29,886 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:29,886 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:29,886 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:34,183 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:34,183 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:34,183 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:36,288 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:36,288 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:36,288 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:40,586 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:40,586 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:40,586 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:42,691 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:42,691 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:42,691 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:46,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:46,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:46,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:49,093 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:49,093 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:49,093 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:53,391 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:53,391 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:53,392 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:55,495 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:55,495 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:55,495 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:29:59,796 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:29:59,796 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:29:59,796 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:01,898 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:01,898 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:01,898 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:06,201 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:06,201 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:06,201 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:08,300 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:08,300 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:08,300 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:12,606 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:12,606 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:12,606 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:14,703 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:14,703 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:14,703 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:19,010 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:19,010 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:19,010 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:21,105 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:21,105 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:21,105 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:25,415 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:25,415 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:25,415 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:27,507 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:27,507 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:27,507 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:31,820 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:31,820 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:31,820 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:33,910 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:33,910 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:33,910 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:38,223 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:38,223 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:38,223 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:40,312 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:40,312 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:40,312 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:44,627 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:44,627 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:44,627 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:46,715 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:46,715 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:46,715 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:51,031 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:51,031 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:51,031 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:53,117 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:53,117 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:53,117 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:57,436 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:57,436 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:57,436 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:30:59,520 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:30:59,520 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:30:59,520 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:03,839 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:03,839 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:03,839 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:05,922 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:05,922 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:05,922 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:10,240 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:10,240 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:10,240 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:12,323 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:12,323 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:12,323 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:16,643 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:16,643 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:16,643 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:18,726 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:18,726 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:18,726 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:23,044 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:23,044 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:23,044 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:25,127 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:25,127 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:25,127 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:29,451 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:29,451 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:29,451 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:31,530 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:31,530 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:31,530 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:35,856 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:35,856 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:35,856 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:37,931 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:37,931 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:37,931 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:42,261 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:42,261 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:42,261 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:44,333 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:44,333 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:44,333 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:48,663 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:48,663 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:48,663 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:50,735 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:50,735 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:50,735 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:55,068 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:55,068 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:55,068 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:31:57,138 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:31:57,138 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:31:57,138 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:01,471 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:01,471 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:01,471 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:03,540 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:03,540 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:03,540 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:07,875 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:07,875 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:07,875 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:09,943 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:09,943 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:09,943 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:14,279 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:14,279 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:14,279 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:16,345 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:16,346 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:16,346 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:20,684 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:20,684 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:20,684 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:22,747 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:22,747 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:22,747 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:27,089 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:27,089 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:27,089 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.flow run on_housekeeping pid: 2062166 subscribe/hpfx_amis instance: 0\n", + "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", + "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", + "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.002027\n", + "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.001937\n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.22 system=0.05\n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 68.2 MiB, accumulating count (0 or 0/100 so far) before self-setting threshold\n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.log stats version: 3.00.52rc2, started: 10 minutes ago, last_housekeeping: 301.0 seconds ago \n", + "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.log stats messages received: 0, accepted: 0, rejected: 0 rate accepted: 0.0% or 0.0 m/s\n", + "2024-03-05 22:32:27,095 [INFO] 2062166 sarracenia.flowcb.log stats files transferred: 0 bytes: 0 Bytes rate: 0 Bytes/sec\n", + "2024-03-05 22:32:27,095 [INFO] 2062166 sarracenia.flowcb.log on_housekeeping housekeeping\n", + "2024-03-05 22:32:29,154 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:29,154 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:29,155 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:33,491 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:33,491 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:33,491 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:35,555 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:35,555 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:35,555 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:39,896 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:39,896 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:39,896 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:41,958 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:41,958 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:41,958 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:46,299 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:46,299 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:46,299 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:48,359 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:48,359 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:48,359 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:52,704 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:52,704 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:52,704 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:54,762 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:54,762 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:54,762 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:32:59,107 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:32:59,107 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:32:59,107 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:01,164 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:01,164 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:01,164 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:05,511 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:05,511 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:05,511 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:07,567 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:07,567 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:07,567 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:11,916 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:11,916 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:11,916 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:13,969 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:13,969 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:13,969 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:18,321 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:18,321 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:18,321 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:20,372 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:20,372 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:20,372 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:24,726 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:24,726 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:24,726 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:26,774 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:26,774 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:26,774 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:31,130 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:31,130 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:31,130 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:33,175 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:33,175 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:33,175 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:37,536 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:37,536 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:37,536 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:39,578 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:39,578 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:39,578 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:43,940 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:43,940 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:43,940 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:45,979 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:45,979 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:45,979 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:50,343 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:50,343 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:50,343 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:52,382 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:52,382 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:52,382 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:56,747 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:56,747 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:56,747 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:33:58,784 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:33:58,784 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:33:58,784 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:03,151 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:03,151 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:03,151 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:05,185 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:05,186 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:05,186 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:09,555 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:09,555 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:09,555 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:11,587 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:11,587 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:11,587 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:15,959 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:15,959 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:15,959 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:17,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:17,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:17,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:22,363 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:22,364 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:22,364 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:24,391 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:24,391 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:24,391 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:28,768 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:28,768 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:28,768 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:30,794 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:30,794 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:30,794 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:35,173 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:35,173 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:35,173 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:37,195 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:37,195 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:37,195 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:41,575 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:41,575 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:41,575 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:43,598 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:43,598 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:43,598 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:47,979 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:47,979 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:47,979 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:50,000 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:50,000 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:50,000 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:54,384 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:54,384 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:54,384 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:34:56,403 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:34:56,403 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:34:56,403 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:00,789 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:00,789 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:00,789 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:02,805 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:02,805 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:02,805 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:07,194 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:07,194 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:07,194 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:09,207 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:09,208 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:09,208 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:13,596 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:13,596 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:13,596 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:15,610 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:15,610 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:15,610 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:20,001 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:20,001 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:20,001 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:22,012 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:22,012 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:22,013 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:26,405 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:26,406 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:26,406 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:28,414 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:28,414 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:28,414 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:32,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:32,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:32,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:34,816 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:34,816 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:34,817 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:39,212 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:39,212 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:39,212 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:41,219 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:41,219 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:41,219 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:45,618 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:45,618 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:45,618 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:47,621 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:47,621 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:47,621 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:52,023 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:52,023 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:52,023 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:54,024 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:54,024 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:54,024 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:35:58,427 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:35:58,427 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:35:58,427 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:00,426 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:00,426 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:00,426 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:04,832 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:04,832 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:04,832 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:06,828 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:06,828 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:06,828 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:11,237 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:11,237 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:11,237 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:13,230 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:13,230 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:13,230 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:17,639 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:17,639 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:17,639 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:19,631 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:19,631 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:19,631 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:24,043 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:24,043 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:24,043 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:26,034 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:26,034 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:26,034 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:30,444 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:30,444 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:30,444 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:32,435 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:32,435 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:32,435 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:36,849 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:36,849 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:36,849 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:38,838 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:38,838 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:38,838 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:43,254 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:43,254 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:43,254 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", + "2024-03-05 22:36:45,239 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", + "2024-03-05 22:36:45,239 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", + "2024-03-05 22:36:45,239 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n" ] } ], @@ -273,36 +1071,16 @@ "id": "foreign-european", "metadata": {}, "source": [ - "as you can see it downloaded five files to /tmp/amis.\n", + "As you can see, it downloaded five files to /tmp/amis.\n", "The _foreground_ action is intended to help with debugging, rather than real operations." ] }, { "cell_type": "code", - "execution_count": 5, + "execution_count": null, "id": "split-writing", - "metadata": { - "scrolled": false - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2024-01-12 15:50:20,026 127310 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\r\n", - "status: \r\n", - "Component/Config Processes Connection Lag Rates \r\n", - " State Run Retry msg data Queued LagMax LagAvg Last %rej pubsub messages RxData TxData \r\n", - " ----- --- ----- --- ---- ------ ------ ------ ---- ---- ------ -------- ------ ------ \r\n", - "subscribe/hpfx_amis stop 0/0 0 100% 16% 0 4.37s 2.21s 8.6s 0.0% 149 Bytes/s 1 msgs/s 371 Bytes/s 0 Bytes/s\r\n", - " Total Running Configs: 0 ( Processes: 0 missing: 0 stray: 0 )\r\n", - " Memory: uss:0 Bytes rss:0 Bytes vms:0 Bytes \r\n", - " CPU Time: User:0.00s System:0.00s \r\n", - "\t Pub/Sub Received: 1 msgs/s (149 Bytes/s), Sent: 0 msgs/s (0 Bytes/s) Queued: 0 Retry: 0, Mean lag: 2.21s\r\n", - "\t Data Received: 1 Files/s (371 Bytes/s), Sent: 0 Files/s (0 Bytes/s) \r\n" - ] - } - ], + "metadata": {}, + "outputs": [], "source": [ "!sr3 status" ] @@ -312,29 +1090,15 @@ "id": "rocky-unemployment", "metadata": {}, "source": [ - "There is 1 configuration in your list. You can have hundreds. The columns on the right refer to how many instances you have for each configuration. In the example above _instances_ is set to 5, so one would expect to see 5 running instances when it would be running. You can start specifc configuration with _sr3 start subscribe/*_ or start all active instances with: _sr3 start_" + "Above, you can see there is 1 configuration in your list. You can have hundreds. The columns on the right refer to how many instances you have for each configuration. In the example above, _instances_ is set to 5, so one would expect to see 5 running instances when it would be running. You can start specifc configurations (in this case a subscribe config) with _sr3 start subscribe/\\_, or start all active configs from all components (sarra, subscribe, watch, winnow, etc.) with _sr3 start_" ] }, { "cell_type": "code", - "execution_count": 6, + "execution_count": null, "id": "neural-laugh", - "metadata": { - "scrolled": false - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2024-01-12 15:50:30,719 127315 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\r\n", - "tail: cannot open '/home/peter/.cache/sr3/log/subscribe_hpfx_amis_01.log' for reading: No such file or directory\r\n", - "tail: no files remaining\r\n", - "2024-01-12 15:50:30,722 127315 [CRITICAL] root run_command subprocess.run failed err=Command '['tail', '-f', '/home/peter/.cache/sr3/log/subscribe_hpfx_amis_01.log']' returned non-zero exit status 1.\r\n", - "\r\n" - ] - } - ], + "metadata": {}, + "outputs": [], "source": [ "!sr3 log subscribe/hpfx_amis.conf" ] @@ -344,11 +1108,11 @@ "id": "leading-matthew", "metadata": {}, "source": [ - "When running in the background, output needs to go a log file. As we have only run this configuration file in the foreground, asking to see the log prints an error about the log being missing. This tells you that the logs are in the _~/.cache/sr3/log_ directory. Logs can be monitored in real-time with traditional tools such as _tail -f_ or _grep_.\n", + "When running in the background, output needs to go a log file. Since we have only ran this configuration file in the foreground, asking to see the log prints an error about the log being missing. This tells you that the logs are in the _~/.cache/sr3/log_ directory. Logs can be monitored in real-time with traditional tools such as _tail -f_ or _grep_.\n", "\n", "_sr3 stop_ does what you expect.\n", "\n", - "Processes can crash. In the _sr3 status_ output above, if the number of processes in the Run column is less than in the Exp (for Expected) one, then it means that some instances have crashed. you can repair it (just start the missing instances) with:\n", + "Processes can crash. In the _sr3 status_ output above, if the number of processes in the Run column is less than in the Exp (for Expected) one, then it means that some instances have crashed. You can repair it (just start the missing instances) with:\n", "\n", "_sr3 sanity_ -- start missing instances, also kill strays if any found.\n", "\n", @@ -357,21 +1121,12 @@ "\n", "## Conclusion\n", "\n", - "If all you want to do is obtain data from a data pump in real-time, using the command line interface to control some processes that run all the time, so that they dump files in a certain directory is the easiest way to go.\n", + "If all you want to do is obtain data from a data pump in real-time, the easiest way to go is using the command line interface to control some processes that run all the time so that they dump files in a certain directory.\n", "\n", - "It isn't very efficient though. When you have large numbers of files to work with, and you want high speed processing, it is better, in the sense of lower cpu and i/o overhead, and in terms of speed of processing,\n", - "to have your own application informed of the arrival of files, rather than scanning a directory.\n", + "It isn't very efficient though. When dealing with a large number of files and aiming for high-speed processing, it’s more efficient to have your own application receive notifications about file arrivals rather than scanning a directory. This approach reduces CPU and I/O overhead while improving processing speed.\n", "\n", "The easiest way to do that is to add some callbacks to your flows. We'll cover that next." ] - }, - { - "cell_type": "code", - "execution_count": null, - "id": "artistic-purple", - "metadata": {}, - "outputs": [], - "source": [] } ], "metadata": { From 2306b544357ad48047c16b62cc4ea488da8635be Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Wed, 6 Mar 2024 23:58:10 +0000 Subject: [PATCH 005/246] Edit for typos and clarity --- .../source/Tutorials/1_CLI_introduction.ipynb | 972 ++---------------- 1 file changed, 91 insertions(+), 881 deletions(-) diff --git a/docs/source/Tutorials/1_CLI_introduction.ipynb b/docs/source/Tutorials/1_CLI_introduction.ipynb index 10d525e3c..386cde566 100644 --- a/docs/source/Tutorials/1_CLI_introduction.ipynb +++ b/docs/source/Tutorials/1_CLI_introduction.ipynb @@ -60,7 +60,6 @@ "name": "stdout", "output_type": "stream", "text": [ - "2024-03-05 22:22:21,708 2062154 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", "Sample Configurations: (from: /net/local/home/shakerm/sr3/sarracenia/examples )\n", "cpump/cno_trouble_f00.inc flow/amserver.conf \n", "flow/opg.conf flow/poll.inc \n", @@ -113,17 +112,13 @@ "cell_type": "code", "execution_count": 3, "id": "egyptian-suicide", - "metadata": { - "scrolled": true - }, + "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ - "2024-03-05 22:22:22,178 2062157 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - "add: 2024-03-05 22:22:22,183 2062157 [INFO] root add matched existing ['subscribe/hpfx_amis']\n", - "2024-03-05 22:22:22,183 2062157 [ERROR] root add nothing specified to add\n", + "add: 2024-03-06 23:48:56,706 2118966 [INFO] sarracenia.sr add copying: /net/local/home/shakerm/sr3/sarracenia/examples/subscribe/hpfx_amis.conf to /net/local/home/shakerm/.config/sr3/subscribe/hpfx_amis.conf \n", "\n" ] } @@ -164,15 +159,7 @@ "execution_count": 4, "id": "primary-score", "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "mkdir: cannot create directory ‘/tmp/hpfx_amis’: File exists\n" - ] - } - ], + "outputs": [], "source": [ "!mkdir /tmp/hpfx_amis\n", "!echo messageCountMax 10 >>~/.config/sr3/subscribe/hpfx_amis.conf" @@ -191,7 +178,7 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 5, "id": "nominated-nerve", "metadata": {}, "outputs": [ @@ -199,866 +186,59 @@ "name": "stdout", "output_type": "stream", "text": [ - "2024-03-05 22:22:22,837 2062162 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - ".2024-03-05 22:22:23,092 [INFO] 2062166 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - "2024-03-05 22:22:23,098 [INFO] 2062166 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", - "2024-03-05 22:22:23,098 [INFO] 2062166 sarracenia.flow loadCallbacks flowCallback plugins to load: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", - "2024-03-05 22:22:23,108 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:23,108 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flowcb.log __init__ subscribe initialized with: logEvents: {'after_accept', 'after_post', 'after_work', 'on_housekeeping'}, logMessageDump: False\n", - "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run callbacks loaded: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", - "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run pid: 2062166 subscribe/hpfx_amis instance: 0\n", - "2024-03-05 22:22:23,118 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:23,118 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:23,118 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:23,118 [INFO] 2062166 sarracenia.flow run now active on vip ['AnyAddressIsFine']\n", - "2024-03-05 22:22:23,318 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:23,318 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:23,318 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:23,519 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:23,519 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:23,519 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:24,119 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:24,119 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:24,119 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:25,119 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:25,119 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:25,119 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:27,321 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:27,322 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:27,322 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:31,524 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:31,524 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:31,524 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:33,723 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:33,723 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:33,723 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:37,928 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:37,929 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:37,929 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:40,126 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:40,126 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:40,126 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:44,333 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:44,333 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:44,333 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:46,528 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:46,529 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:46,529 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:50,738 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:50,738 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:50,738 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:52,931 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:52,931 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:52,931 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:57,139 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:57,139 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:57,139 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:22:59,334 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:22:59,334 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:22:59,334 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:03,544 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:03,544 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:03,544 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:05,735 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:05,735 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:05,735 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:09,947 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:09,947 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:09,947 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:12,138 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:12,138 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:12,138 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:16,351 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:16,351 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:16,351 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:18,540 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:18,540 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:18,541 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:22,755 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:22,755 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:22,755 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:24,943 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:24,943 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:24,943 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:29,156 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:29,156 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:29,156 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:31,346 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:31,346 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:31,346 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:35,559 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:35,559 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:35,559 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:37,748 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:37,748 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:37,748 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:41,963 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:41,963 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:41,963 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:44,151 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:44,151 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:44,151 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:48,368 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:48,368 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:48,368 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:50,553 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:50,554 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:50,554 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:54,771 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:54,771 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:54,771 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:23:56,955 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:23:56,955 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:23:56,955 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:01,176 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:01,176 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:01,176 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:03,358 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:03,358 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:03,358 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:07,581 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:07,581 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:07,581 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:09,759 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:09,759 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:09,759 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:13,983 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:13,983 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:13,983 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:16,161 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:16,161 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:16,161 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:20,387 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:20,387 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:20,387 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:22,563 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:22,563 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:22,563 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:26,791 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:26,791 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:26,791 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:28,966 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:28,966 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:28,966 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:33,195 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:33,195 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:33,195 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:35,368 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:35,368 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:35,368 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:39,600 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:39,600 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:39,600 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:41,771 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:41,771 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:41,771 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:46,001 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:46,001 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:46,001 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:48,174 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:48,174 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:48,174 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:52,403 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:52,403 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:52,403 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:54,575 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:54,575 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:54,575 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:24:58,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:24:58,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:24:58,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:00,978 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:00,978 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:00,978 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:05,211 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:05,211 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:05,211 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:07,380 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:07,380 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:07,380 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:11,616 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:11,616 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:11,616 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:13,783 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:13,783 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:13,783 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:18,021 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:18,021 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:18,021 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:20,186 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:20,186 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:20,186 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:24,423 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:24,423 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:24,423 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:26,587 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:26,587 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:26,587 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:30,827 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:30,827 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:30,827 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:32,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:32,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:32,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:37,231 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:37,231 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:37,231 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:39,392 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:39,392 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:39,393 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:43,636 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:43,636 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:43,636 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:45,795 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:45,795 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:45,795 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:50,039 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:50,039 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:50,039 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:52,198 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:52,198 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:52,198 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:56,443 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:56,443 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:56,443 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:25:58,600 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:25:58,600 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:25:58,600 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:02,848 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:02,848 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:02,848 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:05,003 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:05,003 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:05,003 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:09,251 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:09,251 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:09,251 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:11,405 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:11,405 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:11,405 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:15,656 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:15,656 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:15,656 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:17,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:17,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:17,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:22,061 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:22,061 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:22,061 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:24,210 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:24,210 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:24,210 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:28,463 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:28,463 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:28,463 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:30,612 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:30,612 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:30,612 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:34,866 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:34,867 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:34,867 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:37,015 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:37,015 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:37,015 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:41,272 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:41,272 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:41,272 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:43,417 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:43,418 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:43,418 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:47,676 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:47,676 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:47,676 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:49,819 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:49,819 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:49,819 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:54,079 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:54,079 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:54,079 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:26:56,222 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:26:56,222 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:26:56,222 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:00,483 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:00,483 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:00,483 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:02,623 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:02,623 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:02,623 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:06,887 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:06,887 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:06,887 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:09,026 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:09,026 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:09,026 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:13,292 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:13,292 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:13,292 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:15,428 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:15,428 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:15,428 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:19,695 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:19,695 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:19,695 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:21,831 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:21,831 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:21,831 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:26,100 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:26,100 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:26,100 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.flow run on_housekeeping pid: 2062166 subscribe/hpfx_amis instance: 0\n", - "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", - "2024-03-05 22:27:26,100 [INFO] 2062166 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", - "2024-03-05 22:27:26,103 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-03-05 22:27:26,104 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.003044\n", - "2024-03-05 22:27:26,104 [INFO] 2062166 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", - "2024-03-05 22:27:26,105 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.001927\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.18 system=0.04\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 68.2 MiB, accumulating count (0 or 0/100 so far) before self-setting threshold\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats version: 3.00.52rc2, started: 5 minutes ago, last_housekeeping: 303.0 seconds ago \n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats messages received: 0, accepted: 0, rejected: 0 rate accepted: 0.0% or 0.0 m/s\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log stats files transferred: 0 bytes: 0 Bytes rate: 0 Bytes/sec\n", - "2024-03-05 22:27:26,106 [INFO] 2062166 sarracenia.flowcb.log on_housekeeping housekeeping\n", - "2024-03-05 22:27:28,239 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:28,239 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:28,239 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:32,505 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:32,505 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:32,505 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:34,642 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:34,642 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:34,642 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:38,909 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:38,910 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:38,910 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:41,044 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:41,044 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:41,045 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:45,315 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:45,315 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:45,315 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:47,447 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:47,447 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:47,447 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:51,719 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:51,719 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:51,719 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:53,850 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:53,850 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:53,850 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:27:58,124 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:27:58,124 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:27:58,124 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:00,252 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:00,252 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:00,252 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:04,529 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:04,529 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:04,529 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:06,655 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:06,655 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:06,655 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:10,933 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:10,933 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:10,933 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:13,055 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:13,055 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:13,055 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:17,335 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:17,335 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:17,335 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:19,458 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:19,458 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:19,458 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:23,739 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:23,739 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:23,739 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:25,861 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:25,861 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:25,861 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:30,144 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:30,144 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:30,144 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:32,263 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:32,263 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:32,263 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:36,549 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:36,549 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:36,549 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:38,666 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:38,666 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:38,666 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:42,951 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:42,951 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:42,951 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:45,068 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:45,068 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:45,068 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:49,356 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:49,356 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:49,356 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:51,471 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:51,471 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:51,471 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:55,759 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:55,759 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:55,759 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:28:57,873 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:28:57,874 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:28:57,874 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:02,164 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:02,164 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:02,164 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:04,276 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:04,276 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:04,276 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:08,569 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:08,569 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:08,569 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:10,679 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:10,679 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:10,679 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:14,971 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:14,971 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:14,971 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:17,081 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:17,081 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:17,081 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:21,375 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:21,375 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:21,375 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:23,483 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:23,483 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:23,483 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:27,779 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:27,779 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:27,779 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:29,886 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:29,886 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:29,886 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:34,183 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:34,183 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:34,183 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:36,288 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:36,288 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:36,288 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:40,586 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:40,586 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:40,586 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:42,691 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:42,691 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:42,691 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:46,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:46,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:46,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:49,093 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:49,093 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:49,093 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:53,391 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:53,391 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:53,392 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:55,495 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:55,495 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:55,495 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:29:59,796 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:29:59,796 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:29:59,796 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:01,898 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:01,898 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:01,898 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:06,201 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:06,201 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:06,201 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:08,300 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:08,300 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:08,300 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:12,606 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:12,606 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:12,606 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:14,703 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:14,703 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:14,703 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:19,010 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:19,010 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:19,010 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:21,105 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:21,105 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:21,105 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:25,415 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:25,415 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:25,415 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:27,507 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:27,507 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:27,507 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:31,820 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:31,820 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:31,820 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:33,910 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:33,910 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:33,910 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:38,223 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:38,223 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:38,223 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:40,312 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:40,312 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:40,312 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:44,627 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:44,627 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:44,627 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:46,715 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:46,715 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:46,715 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:51,031 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:51,031 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:51,031 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:53,117 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:53,117 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:53,117 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:57,436 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:57,436 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:57,436 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:30:59,520 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:30:59,520 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:30:59,520 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:03,839 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:03,839 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:03,839 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:05,922 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:05,922 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:05,922 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:10,240 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:10,240 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:10,240 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:12,323 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:12,323 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:12,323 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:16,643 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:16,643 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:16,643 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:18,726 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:18,726 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:18,726 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:23,044 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:23,044 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:23,044 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:25,127 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:25,127 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:25,127 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:29,451 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:29,451 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:29,451 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:31,530 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:31,530 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:31,530 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:35,856 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:35,856 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:35,856 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:37,931 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:37,931 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:37,931 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:42,261 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:42,261 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:42,261 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:44,333 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:44,333 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:44,333 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:48,663 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:48,663 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:48,663 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:50,735 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:50,735 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:50,735 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:55,068 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:55,068 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:55,068 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:31:57,138 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:31:57,138 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:31:57,138 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:01,471 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:01,471 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:01,471 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:03,540 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:03,540 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:03,540 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:07,875 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:07,875 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:07,875 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:09,943 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:09,943 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:09,943 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:14,279 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:14,279 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:14,279 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:16,345 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:16,346 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:16,346 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:20,684 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:20,684 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:20,684 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:22,747 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:22,747 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:22,747 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:27,089 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:27,089 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:27,089 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.flow run on_housekeeping pid: 2062166 subscribe/hpfx_amis instance: 0\n", - "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", - "2024-03-05 22:32:27,090 [INFO] 2062166 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", - "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.002027\n", - "2024-03-05 22:32:27,092 [INFO] 2062166 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.diskqueue on_housekeeping No retry in list\n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.001937\n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.22 system=0.05\n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 68.2 MiB, accumulating count (0 or 0/100 so far) before self-setting threshold\n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.log stats version: 3.00.52rc2, started: 10 minutes ago, last_housekeeping: 301.0 seconds ago \n", - "2024-03-05 22:32:27,094 [INFO] 2062166 sarracenia.flowcb.log stats messages received: 0, accepted: 0, rejected: 0 rate accepted: 0.0% or 0.0 m/s\n", - "2024-03-05 22:32:27,095 [INFO] 2062166 sarracenia.flowcb.log stats files transferred: 0 bytes: 0 Bytes rate: 0 Bytes/sec\n", - "2024-03-05 22:32:27,095 [INFO] 2062166 sarracenia.flowcb.log on_housekeeping housekeeping\n", - "2024-03-05 22:32:29,154 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:29,154 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:29,155 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:33,491 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:33,491 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:33,491 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:35,555 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:35,555 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:35,555 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:39,896 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:39,896 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:39,896 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:41,958 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:41,958 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:41,958 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:46,299 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:46,299 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:46,299 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:48,359 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:48,359 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:48,359 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:52,704 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:52,704 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:52,704 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:54,762 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:54,762 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:54,762 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:32:59,107 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:32:59,107 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:32:59,107 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:01,164 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:01,164 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:01,164 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:05,511 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:05,511 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:05,511 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:07,567 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:07,567 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:07,567 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:11,916 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:11,916 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:11,916 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:13,969 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:13,969 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:13,969 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:18,321 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:18,321 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:18,321 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:20,372 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:20,372 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:20,372 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:24,726 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:24,726 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:24,726 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:26,774 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:26,774 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:26,774 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:31,130 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:31,130 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:31,130 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:33,175 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:33,175 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:33,175 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:37,536 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:37,536 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:37,536 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:39,578 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:39,578 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:39,578 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:43,940 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:43,940 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:43,940 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:45,979 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:45,979 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:45,979 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:50,343 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:50,343 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:50,343 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:52,382 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:52,382 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:52,382 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:56,747 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:56,747 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:56,747 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:33:58,784 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:33:58,784 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:33:58,784 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:03,151 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:03,151 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:03,151 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:05,185 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:05,186 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:05,186 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:09,555 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:09,555 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:09,555 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:11,587 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:11,587 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:11,587 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:15,959 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:15,959 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:15,959 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:17,990 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:17,990 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:17,990 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:22,363 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:22,364 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:22,364 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:24,391 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:24,391 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:24,391 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:28,768 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:28,768 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:28,768 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:30,794 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:30,794 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:30,794 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:35,173 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:35,173 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:35,173 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:37,195 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:37,195 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:37,195 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:41,575 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:41,575 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:41,575 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:43,598 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:43,598 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:43,598 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:47,979 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:47,979 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:47,979 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:50,000 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:50,000 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:50,000 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:54,384 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:54,384 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:54,384 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:34:56,403 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:34:56,403 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:34:56,403 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:00,789 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:00,789 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:00,789 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:02,805 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:02,805 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:02,805 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:07,194 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:07,194 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:07,194 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:09,207 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:09,208 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:09,208 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:13,596 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:13,596 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:13,596 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:15,610 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:15,610 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:15,610 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:20,001 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:20,001 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:20,001 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:22,012 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:22,012 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:22,013 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:26,405 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:26,406 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:26,406 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:28,414 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:28,414 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:28,414 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:32,807 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:32,807 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:32,807 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:34,816 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:34,816 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:34,817 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:39,212 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:39,212 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:39,212 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:41,219 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:41,219 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:41,219 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:45,618 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:45,618 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:45,618 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:47,621 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:47,621 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:47,621 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:52,023 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:52,023 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:52,023 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:54,024 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:54,024 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:54,024 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:35:58,427 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:35:58,427 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:35:58,427 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:00,426 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:00,426 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:00,426 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:04,832 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:04,832 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:04,832 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:06,828 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:06,828 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:06,828 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:11,237 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:11,237 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:11,237 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:13,230 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:13,230 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:13,230 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:17,639 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:17,639 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:17,639 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:19,631 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:19,631 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:19,631 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:24,043 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:24,043 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:24,043 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:26,034 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:26,034 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:26,034 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:30,444 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:30,444 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:30,444 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:32,435 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:32,435 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:32,435 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:36,849 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:36,849 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:36,849 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:38,838 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:38,838 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:38,838 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:43,254 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:43,254 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:43,254 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n", - "2024-03-05 22:36:45,239 [WARNING] 2062166 sarracenia.flowcb.gather.message gather not connected. Trying to connect to amqps://anonymous@hpfx.collab.science.gc.ca/ None True True False False None None\n", - "2024-03-05 22:36:45,239 [CRITICAL] 2062166 sarracenia.moth ProtocolPresent Protocol scheme amqps unsupported for communications with message brokers\n", - "2024-03-05 22:36:45,239 [ERROR] 2062166 sarracenia.moth subFactory unknown broker scheme/protocol specified\n" + "2024-03-06 23:49:06,570 2118978 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + ".2024-03-06 23:49:06,841 [INFO] 2118981 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "2024-03-06 23:49:06,846 [INFO] 2118981 sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "2024-03-06 23:49:06,846 [INFO] 2118981 sarracenia.flow loadCallbacks flowCallback plugins to load: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", + "2024-03-06 23:49:06,855 [INFO] 2118981 sarracenia.flowcb.log __init__ subscribe initialized with: logEvents: {'after_post', 'on_housekeeping', 'after_work', 'after_accept'}, logMessageDump: False\n", + "2024-03-06 23:49:06,855 [INFO] 2118981 sarracenia.flow run callbacks loaded: ['sarracenia.flowcb.gather.message.Message', 'sarracenia.flowcb.retry.Retry', 'sarracenia.flowcb.housekeeping.resources.Resources', 'log']\n", + "2024-03-06 23:49:06,855 [INFO] 2118981 sarracenia.flow run pid: 2118981 subscribe/hpfx_amis instance: 0\n", + "2024-03-06 23:49:06,906 [INFO] 2118981 sarracenia.moth.amqp _queueDeclare queue declared q_anonymous_subscribe.hpfx_amis.16789186.78043112 (as: amqps://anonymous@hpfx.collab.science.gc.ca/), (messages waiting: 0)\n", + "2024-03-06 23:49:06,906 [INFO] 2118981 sarracenia.moth.amqp getSetup binding q_anonymous_subscribe.hpfx_amis.16789186.78043112 with v02.post.*.WXO-DD.bulletins.alphanumeric.# to xpublic (as: amqps://anonymous@hpfx.collab.science.gc.ca/)\n", + "2024-03-06 23:49:06,918 [INFO] 2118981 sarracenia.flow run now active on vip ['AnyAddressIsFine']\n", + "2024-03-06 23:49:15,332 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 4.84 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/WV/MMMX/23/WVMX31_MMMX_062348___03321\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 7.61 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRCN40_KWAL_062348___32108\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SX/KWAL/23/SXCN40_KWAL_062348___23784\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRCN40_KWAL_062348___45099\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRCN40_KWAL_062348___35424\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRCN40_KWAL_062348___47804\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRME20_KWAL_062348___48533\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 2.19 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRME20_KWAL_062348___768\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 1.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SR/KWAL/23/SRCN40_KWAL_062348___19124\n", + "2024-03-06 23:49:15,333 [INFO] 2118981 sarracenia.flowcb.log after_accept accepted: (lag: 1.43 ) https://hpfx.collab.science.gc.ca /20240306/WXO-DD/bulletins/alphanumeric/20240306/SO/KWAL/23/SOLC10_KWAL_062348___60057\n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/WVMX31_MMMX_062348___03321 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_062348___32108 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SXCN40_KWAL_062348___23784 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_062348___45099 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_062348___35424 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_062348___47804 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRME20_KWAL_062348___48533 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRME20_KWAL_062348___768 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SRCN40_KWAL_062348___19124 \n", + "2024-03-06 23:49:15,455 [INFO] 2118981 sarracenia.flowcb.log after_work downloaded ok: /tmp/hpfx_amis/SOLC10_KWAL_062348___60057 \n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flow please_stop ok, telling 4 callbacks about it.\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flow run starting last pass (without gather) through loop for cleanup.\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flow please_stop ok, telling 4 callbacks about it.\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flow run on_housekeeping pid: 2118981 subscribe/hpfx_amis instance: 0\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flowcb.gather.message on_housekeeping messages: good: 10 bad: 0 bytes: 1.4 KiB average: 138 Bytes\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.flowcb.retry on_housekeeping on_housekeeping\n", + "2024-03-06 23:49:15,456 [INFO] 2118981 sarracenia.diskqueue on_housekeeping work_retry_00 on_housekeeping\n", + "2024-03-06 23:49:15,458 [INFO] 2118981 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-06 23:49:15,458 [INFO] 2118981 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.002104\n", + "2024-03-06 23:49:15,458 [INFO] 2118981 sarracenia.diskqueue on_housekeeping post_retry_000 on_housekeeping\n", + "2024-03-06 23:49:15,460 [INFO] 2118981 sarracenia.diskqueue on_housekeeping No retry in list\n", + "2024-03-06 23:49:15,460 [INFO] 2118981 sarracenia.diskqueue on_housekeeping on_housekeeping elapse 0.001996\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.housekeeping.resources on_housekeeping Current Memory cpu_times: user=0.24 system=0.03\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.housekeeping.resources on_housekeeping Current mem usage: 79.3 MiB, accumulating count (10 or 10/100 so far) before self-setting threshold\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.log stats version: 3.00.52rc2, started: 8 seconds ago, last_housekeeping: 8.6 seconds ago \n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.log stats messages received: 10, accepted: 10, rejected: 0 rate accepted: 100.0% or 1.2 m/s\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.log stats files transferred: 10 bytes: 2.0 KiB rate: 243 Bytes/sec\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.log stats lag: average: 2.97, maximum: 7.61 \n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flowcb.log on_housekeeping housekeeping\n", + "2024-03-06 23:49:15,461 [INFO] 2118981 sarracenia.flow run clean stop from run loop\n", + "2024-03-06 23:49:15,462 [INFO] 2118981 sarracenia.flowcb.gather.message on_stop closing\n", + "2024-03-06 23:49:15,462 [INFO] 2118981 sarracenia.flow close flow/close completed cleanly pid: 2118981 subscribe/hpfx_amis instance: 0\n", + "\n" ] } ], @@ -1077,10 +257,28 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 6, "id": "split-writing", "metadata": {}, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "2024-03-06 23:49:30,243 2118998 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "status: \n", + "Component/Config Processes Connection Lag Rates \n", + " State Run Retry msg data Queued LagMax LagAvg Last %rej pubsub messages RxData TxData \n", + " ----- --- ----- --- ---- ------ ------ ------ ---- ---- ------ -------- ------ ------ \n", + "subscribe/hpfx_amis stop 0/0 - - - - - - -\n", + " Total Running Configs: 0 ( Processes: 0 missing: 0 stray: 0 )\n", + " Memory: uss:0 Bytes rss:0 Bytes vms:0 Bytes \n", + " CPU Time: User:0.00s System:0.00s \n", + "\t Pub/Sub Received: 0 msgs/s (0 Bytes/s), Sent: 0 msgs/s (0 Bytes/s) Queued: 0 Retry: 0, Mean lag: 0.00s\n", + "\t Data Received: 0 Files/s (0 Bytes/s), Sent: 0 Files/s (0 Bytes/s) \n" + ] + } + ], "source": [ "!sr3 status" ] @@ -1095,10 +293,22 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 7, "id": "neural-laugh", "metadata": {}, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "2024-03-06 23:45:56,401 2118802 [INFO] sarracenia.config finalize overriding batch for consistency with messageCountMax: {self.batch}\n", + "tail: cannot open '/net/local/home/shakerm/.cache/sr3/log/subscribe_hpfx_amis_01.log' for reading: No such file or directory\n", + "tail: no files remaining\n", + "2024-03-06 23:45:56,406 2118802 [CRITICAL] root run_command subprocess.run failed err=Command '['tail', '-f', '/net/local/home/shakerm/.cache/sr3/log/subscribe_hpfx_amis_01.log']' returned non-zero exit status 1.\n", + "\n" + ] + } + ], "source": [ "!sr3 log subscribe/hpfx_amis.conf" ] From 3f4731579f46043403b6b00409d6bde3391db4bd Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Thu, 7 Mar 2024 00:03:06 +0000 Subject: [PATCH 006/246] Edit for typos and clarity --- docs/source/Tutorials/1_CLI_introduction.ipynb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/Tutorials/1_CLI_introduction.ipynb b/docs/source/Tutorials/1_CLI_introduction.ipynb index 386cde566..22db81f07 100644 --- a/docs/source/Tutorials/1_CLI_introduction.ipynb +++ b/docs/source/Tutorials/1_CLI_introduction.ipynb @@ -5,7 +5,7 @@ "id": "chubby-tenant", "metadata": {}, "source": [ - "# Downloading Using the Command Line - Test\n", + "# Downloading Using the Command Line\n", "\n", "This [jupyter notebook](https://jupyter.org) introduces [Sarracenia version 3](https://metpx.github.io/sarracenia) usage from the command line (mostly on Linux, but should be similar on Windows and Mac also, main difference being different conventions for where preferences and logs are stored.) This is probably the easiest way to work with Sarracenia. You configure a flow to download files into a directory, and you can read the directory to process the files there.\n" ] From 2f4d6225db2771d43a5c94f7bdeaffd1c06f6414 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Sun, 10 Mar 2024 03:46:55 +0000 Subject: [PATCH 007/246] Remove threading from AMQP Consumer code --- sarracenia/moth/amqpconsumer.py | 81 +++++++++++---------------------- 1 file changed, 27 insertions(+), 54 deletions(-) diff --git a/sarracenia/moth/amqpconsumer.py b/sarracenia/moth/amqpconsumer.py index ecad199e8..b4dd58672 100755 --- a/sarracenia/moth/amqpconsumer.py +++ b/sarracenia/moth/amqpconsumer.py @@ -28,7 +28,6 @@ import time import queue -import threading logger = logging.getLogger(__name__) @@ -41,13 +40,17 @@ class AMQPConsumer(AMQP): TODO: - how does this work with the batch and prefetch options? + - set our own consumer tag + - make timeout configurable? """ def __init__(self, props, is_subscriber) -> None: super().__init__(props, is_subscriber) - self._raw_msg_q = queue.Queue() # Queue is thread safe - self._consumer_thread = None - self._thread_please_stop = False + self._raw_msg_q = None + # "The consumer tag is local to a connection, so two clients can use the same consumer tags. + # If this field is empty the server will generate a unique tag." + self._request_consumer_tag = '' # TODO set to something useful + self._active_consumer_tag = None # control log level in config file: # set sarracenia.moth.amqpconsumer.AMQPConsumer.logLevel debug @@ -58,33 +61,6 @@ def __init__(self, props, is_subscriber) -> None: if 'logLevel' in self.o['settings'][me]: logger.setLevel(self.o['logLevel'].upper()) - def __consumer_setup(self) -> None: - """ Start consuming from the queue. - """ - if not self.connection: - self.getSetup() - # docs.celeryq.dev/projects/amqp/en/latest/reference/amqp.channel.html#amqp.channel.Channel.basic_consume - self.channel.basic_consume(self.o['queueName'], no_ack=False, callback=self.__get_on_message) - self.__stop_thread() # make sure it's not already running - self._consumer_thread = threading.Thread(target=self.__drain_events) - self._consumer_thread.start() - - def __drain_events(self): - """ Calls drain_events on the connection until told to stop. - """ - logger.debug("thread starting") - while not self._thread_please_stop: - # This blocks until there's an event to deal with - try: - self.connection.drain_events(timeout=2) # TODO configurable timeout? - except TimeoutError: - pass - except Exception as e: - logger.error(f"exception occurred: {e}") - logger.debug('Exception details: ', exc_info=True) - logger.debug("thread stopping") - self._consumer_thread = None - def __get_on_message(self, msg): """ Callback for AMQP basic_consume, called when the broker sends a new message. """ @@ -92,22 +68,23 @@ def __get_on_message(self, msg): # This will block until the msg can be put in the queue self._raw_msg_q.put(msg) - def __stop_thread(self): - # need to stop consuming - tell the thread to stop, then join it and wait - self._thread_please_stop = True - if self._consumer_thread: - self._consumer_thread.join() - self._consumer_thread = None - self._thread_please_stop = False # if True, the thread won't start again - - def _amqp_setup_signal_handler(self, signum, stack): - logger.info("ok, asked to stop") - self.please_stop=True - self.__stop_thread() - def getCleanUp(self) -> None: - self.__stop_thread() + # TODO cancel consumer with basic_cancel(consumer_tag)? super().getCleanUp() + self._active_consumer_tag = None + + def getSetup(self) -> None: + super().getSetup() + # (re)create queue. Anything in the queue is invalid after re-creating a connection. + self._raw_msg_q = queue.Queue() + self._active_consumer_tag = self.channel.basic_consume(queue=self.o['queueName'], + consumer_tag=self._request_consumer_tag, + no_ack=False, + callback=self.__get_on_message) + logger.info(f"registered consumer with tag {self._active_consumer_tag}") + if self._request_consumer_tag != '' and self._request_consumer_tag != self._active_consumer_tag: + logger.warning(f"active consumer tag {self._active_consumer_tag} is different than " + + f"requested consumer tag {self._request_consumer_tag}") def getNewMessage(self) -> sarracenia.Message: """ Mostly a copy of moth.amqp.AMQP's getNewMessage. @@ -121,8 +98,11 @@ def getNewMessage(self) -> sarracenia.Message: if not self.connection: self.getSetup() - if not self._consumer_thread: - self.__consumer_setup() + # trigger incoming event processing + try: + self.connection.drain_events(timeout=0.1) # TODO configurable timeout? + except TimeoutError: + pass try: # don't block waiting for the queue to be available, better to just try again later @@ -162,10 +142,3 @@ def getNewMessage(self) -> sarracenia.Message: self.close() time.sleep(1) return None - - def close(self) -> None: - try: - self.__stop_thread() - except: - pass - super().close() From 491a6cac4c4b8b683efb37ec3bdf93aa4af543a8 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Sun, 10 Mar 2024 04:58:12 +0000 Subject: [PATCH 008/246] Handle socket.timeout exception that happens on Python 3.6 --- sarracenia/moth/amqpconsumer.py | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/sarracenia/moth/amqpconsumer.py b/sarracenia/moth/amqpconsumer.py index b4dd58672..2701b968e 100755 --- a/sarracenia/moth/amqpconsumer.py +++ b/sarracenia/moth/amqpconsumer.py @@ -26,6 +26,7 @@ import sarracenia from sarracenia.moth.amqp import AMQP, amqp_ss_maxlen, default_options +import socket import time import queue @@ -103,6 +104,10 @@ def getNewMessage(self) -> sarracenia.Message: self.connection.drain_events(timeout=0.1) # TODO configurable timeout? except TimeoutError: pass + # In newer Python versions, socket.timeout is "a deprecated alias of TimeoutError", but it's not on + # older versions (3.6) and needs to be handled separately + except socket.timeout: + pass try: # don't block waiting for the queue to be available, better to just try again later From 6426fd806b4ebb3310630007572db3d656620242 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 11 Mar 2024 19:32:28 +0000 Subject: [PATCH 009/246] Run housekeeping during long sleeps --- sarracenia/flow/__init__.py | 26 +++++++++++++++++--------- 1 file changed, 17 insertions(+), 9 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index 3b55fc76a..bed31b1d2 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -325,6 +325,18 @@ def _runCallbackMetrics(self): logger.error( f'flowCallback plugin {p}/metricsReport crashed: {ex}' ) logger.debug( "details:", exc_info=True ) + def _runHousekeeping(self, now) -> float: + """ Run housekeeping callbacks + Return the time when housekeeping should be run next + """ + logger.info(f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}') + self.runCallbacksTime('on_housekeeping') + self.metricsFlowReset() + self.metrics['flow']['last_housekeeping'] = now + + next_housekeeping = now + self.o.housekeeping + self.metrics['flow']['next_housekeeping'] = next_housekeeping + return next_housekeeping def has_vip(self) -> list: """ @@ -627,15 +639,7 @@ def run(self): # Run housekeeping based on time, and before stopping to ensure it's run at least once if now > next_housekeeping or stopping: - logger.info( - f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}' - ) - self.runCallbacksTime('on_housekeeping') - self.metricsFlowReset() - self.metrics['flow']['last_housekeeping'] = now - - next_housekeeping = now + self.o.housekeeping - self.metrics['flow']['next_housekeeping'] = next_housekeeping + next_housekeeping = self._runHousekeeping(now) if (self.o.messageRateMin > 0) and (current_rate < self.o.messageRateMin): @@ -678,6 +682,10 @@ def run(self): break else: stime -= 5 + # Run housekeeping during long sleeps + now_for_hk = nowflt() + if now_for_hk > next_housekeeping: + next_housekeeping = self._runHousekeeping(now_for_hk) last_time = now From dee6231a5cde2e790221b71abff079a71212784c Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 13 Mar 2024 13:53:03 -0400 Subject: [PATCH 010/246] weird code checking for member then removing dictionary item... cannot work --- sarracenia/flowcb/post/message.py | 3 --- 1 file changed, 3 deletions(-) diff --git a/sarracenia/flowcb/post/message.py b/sarracenia/flowcb/post/message.py index 20ec24228..5c8610d89 100755 --- a/sarracenia/flowcb/post/message.py +++ b/sarracenia/flowcb/post/message.py @@ -23,9 +23,6 @@ def __init__(self, options): props = sarracenia.moth.default_options props.update(self.o.dictify()) - if hasattr(self.o, 'topic' ): - del self.o['topic'] - # adjust settings post_xxx to be xxx, as Moth does not use post_ ones. for k in [ 'broker', 'exchange', 'topicPrefix', 'exchangeSplit', 'topic' ]: post_one='post_'+k From 8b316aeac7d53c42b8e77624d2c8315567758cf9 Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Wed, 13 Mar 2024 21:53:40 +0000 Subject: [PATCH 011/246] Reduced differences with Tom Kralidis' publisher --- sarracenia/postformat/wis.py | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/sarracenia/postformat/wis.py b/sarracenia/postformat/wis.py index 39b4df512..361a24044 100644 --- a/sarracenia/postformat/wis.py +++ b/sarracenia/postformat/wis.py @@ -136,7 +136,7 @@ def exportMine(body, options) -> (str, dict, str): """ for h in body: - if h not in [ 'geometry', 'properties', 'size', 'baseUrl', 'relPath', 'retrievePath', 'subtopic', 'pubTime' ]: + if h not in [ 'geometry', 'properties', 'size', 'baseUrl', 'relPath', 'retrievePath', 'subtopic', 'pubTime', 'to_clusters', 'from_cluster', 'filename', 'sundew_extension', 'mtime', 'atime' ]: GeoJSONBody['properties'][h] = body[h] t=body['pubTime'] @@ -145,13 +145,13 @@ def exportMine(body, options) -> (str, dict, str): if 'geometry' in body: GeoJSONBody['geometry'] = body['geometry'] - if 'data_id' not in body: - GeoJSONBody['properties']['data_id'] = str(uuid.uuid4()) + if 'id' not in body: + GeoJSONBody['properties']['id'] = str(uuid.uuid4()) if 'retrievePath' in body : - url = body['baseUrl'] + body['retrievePath'] + url = body['baseUrl'] + "/" + body['retrievePath'] else: - url = body['baseUrl'] + body['relPath'] + url = body['baseUrl'] + "/" + body['relPath'] if not 'links' in GeoJSONBody: From 3af2911af0a45a395975d576d60a8f16448b52d6 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Mon, 11 Mar 2024 13:27:02 -0400 Subject: [PATCH 012/246] fix #967 define hostname as a string option, and stuff works --- sarracenia/config.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/sarracenia/config.py b/sarracenia/config.py index 26e0078a7..3cf97b0bc 100755 --- a/sarracenia/config.py +++ b/sarracenia/config.py @@ -164,8 +164,8 @@ def __repr__(self) -> str: str_options = [ 'action', 'admin', 'baseDir', 'broker', 'cluster', 'directory', 'exchange', - 'exchange_suffix', 'feeder', 'filename', 'flatten', 'flowMain', 'header', 'identity', - 'inlineEncoding', 'logLevel', + 'exchange_suffix', 'feeder', 'filename', 'flatten', 'flowMain', 'header', + 'hostname', 'identity', 'inlineEncoding', 'logLevel', 'pollUrl', 'post_baseUrl', 'post_baseDir', 'post_broker', 'post_exchange', 'post_exchangeSuffix', 'post_format', 'post_topic', 'queueName', 'sendTo', 'rename', 'report_exchange', 'source', 'strip', 'timezone', 'nodupe_ttl', 'nodupe_driver', From 84b1826a1d55c00354cd25481dd993b55ece9768 Mon Sep 17 00:00:00 2001 From: Andre LeBlanc Date: Thu, 14 Mar 2024 13:47:21 +0000 Subject: [PATCH 013/246] Add missing tokIsYear method from Sundew. Prevents some erronous bulletins not being filtered --- sarracenia/bulletin.py | 30 ++++++++++++++++++++++++++++-- 1 file changed, 28 insertions(+), 2 deletions(-) diff --git a/sarracenia/bulletin.py b/sarracenia/bulletin.py index c92e7f408..d4f9ec840 100644 --- a/sarracenia/bulletin.py +++ b/sarracenia/bulletin.py @@ -14,6 +14,8 @@ class Bulletin: Modifying bulletin file contents Modifying bulletin filenames + Also holds some code used in CA bulletins uniquely. + Spawned from analysts realizing that lots of bulletin handlers/plugins use the same methods repeatedly. This is in turn will reduce duplicate code throughout. @@ -210,12 +212,18 @@ def getTime(self, data): try: parts = data.split(',') - if len(parts) < 4: return None - year = parts[1] jul = parts[2] hhmm = parts[3] + if parts[0][:2] == "CA": + # Need to verify time for CA bulletins. + if not self._verifyYear(year): + logger.error("Unable to verify year from julian time.") + return None + + if len(parts) < 4: return None + # passe-passe pour le jour julien en float parfois ? f = float(jul) i = int(f) @@ -248,3 +256,21 @@ def getTime(self, data): return ddHHMM except Exception as e: return None + + + def _verifyYear(self, bulletin_year): + """ Derived from missing https://github.com/MetPX/Sundew/blob/main/lib/bulletinAm.py -> tokIsYear + Checks if the year that was appended to the bulletin contents is valid or not. + This is only applicable for CA type bulletins (based on Sundew code). + """ + + ltime = time.localtime() + current_year = time.strftime("%Y",ltime ) + + if bulletin_year == current_year : return True + if len(bulletin_year) != 4 : return False + if bulletin_year[:1] != '2' : return False + + return True + + From fa56c568a3f6a1d7f916ce32a0036b0f75c8b390 Mon Sep 17 00:00:00 2001 From: Andre LeBlanc Date: Thu, 14 Mar 2024 15:58:52 +0000 Subject: [PATCH 014/246] We also want to check for the previous year, when the year changes --- sarracenia/bulletin.py | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/sarracenia/bulletin.py b/sarracenia/bulletin.py index d4f9ec840..4c70dd506 100644 --- a/sarracenia/bulletin.py +++ b/sarracenia/bulletin.py @@ -266,8 +266,10 @@ def _verifyYear(self, bulletin_year): ltime = time.localtime() current_year = time.strftime("%Y",ltime ) + previous_year = str(int(current_year) - 1) - if bulletin_year == current_year : return True + # Prevent all bulletins being rejected on a new year for a couple of minutes. Check for previous year as well + if bulletin_year == current_year or bulletin_year == previous_year : return True if len(bulletin_year) != 4 : return False if bulletin_year[:1] != '2' : return False From 705dda07268880f1cdfa73ea7ebc42a7b1e66cda Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 8 Feb 2024 12:15:07 -0500 Subject: [PATCH 015/246] tag version stable --- debian/changelog | 46 ---------------------------------------------- 1 file changed, 46 deletions(-) diff --git a/debian/changelog b/debian/changelog index 45730f780..14ffe646e 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,49 +1,3 @@ -metpx-sr3 (3.00.52rc4) unstable; urgency=medium - - * copernicus marine data store polling support ( #959 ) - * override baseUrl with message field ( for #951 ) - * os.kill for older python version instead of raise_signal #948 - * fix #955 error on cleanup when cache dir missing. - * gather/am fix to handle improperly parsed station names from getStation - - -- Peter Silva Thu, 07 Mar 2024 16:28:26 -0500 - -metpx-sr3 (3.00.52rc3) unstable; urgency=medium - - * fix #953 PRECONDITION FAILED error on busy winnows - * above fix breaks/reopens #649 (cannot see queue size anymore.) - * AM renamer moved to gather for simplicity, also fixes there. - * fix: sr3 declare would fail when no admin.conf configured. - * misc. fixes with AMQP message acknowledgement. - - -- peter Wed, 06 Mar 2024 09:42:57 -0500 - -metpx-sr3 (3.00.52rc2) unstable; urgency=medium - - * fix #934 found references to v2 documentation. Modernized. - * fix #942, #943 processing of rename and retrievePath headers. - * fix #940 display crash in sr3 overview - * fix #920 add _isRetry for duplicate suppression support in new retry - logic. - * more #918 bug fixes for AM renaming now matches Sundew perfectly. - - -- peter Wed, 14 Feb 2024 21:15:59 -0500 - -metpx-sr3 (3.00.52rc1) unstable; urgency=medium - - * nodupe_fileAgeX (X=Min or Max) name change to fileAgeX replacing inflight. - * fix #907 declare exchange in admin.conf wasn't working. - * fix #912 enable v2 style retry processing with new --retry_refilter flag. - * fix #918 plugin for AM to name files with incomplete headers properly. - * fix #920 fix inflight mtime not working in watch. - * fix #920 replaced nodupe_fileAge(Min and Max) with fileAge(Min and Max) - * fix #920 inflight mtime merged with fileMinAge - * fix #922 sr3 showing wrong exchange on status/show. - * processing of rename field in messages suppressed when download=False - * (required for common processing of messages.) - - -- peter Wed, 14 Feb 2024 09:00:18 -0500 - metpx-sr3 (3.00.51) unstable; urgency=medium * PR #910 detect v02 messages without content_type header. From 1b9e5c9a45cf9a8bf81d598ca4964cefaf662833 Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 14 Mar 2024 17:02:17 -0400 Subject: [PATCH 016/246] incrementing version merge --- debian/changelog | 37 +++++++++++++++++++++++++++++++++++++ sarracenia/_version.py | 2 +- 2 files changed, 38 insertions(+), 1 deletion(-) diff --git a/debian/changelog b/debian/changelog index 14ffe646e..46056027e 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,3 +1,40 @@ +metpx-sr3 (3.00.53) UNRELEASED; urgency=medium + + * increment away from release + + -- Peter Silva Thu, 14 Mar 2024 17:01:04 -0400 + +metpx-sr3 (3.00.52) unstable; urgency=medium + + * copernicus marine data store polling support ( #959 ) + * override baseUrl with message field ( for #951 ) + * os.kill for older python version instead of raise_signal #948 + * fix #955 error on cleanup when cache dir missing. + * gather/am fix to handle improperly parsed station names from getStation + * fix #953 PRECONDITION FAILED error on busy winnows + * above fix breaks/reopens #649 (cannot see queue size anymore.) + * AM renamer moved to gather for simplicity, also fixes there. + * fix: sr3 declare would fail when no admin.conf configured. + * misc. fixes with AMQP message acknowledgement. + * fix #934 found references to v2 documentation. Modernized. + * fix #942, #943 processing of rename and retrievePath headers. + * fix #940 display crash in sr3 overview + * fix #920 add _isRetry for duplicate suppression support in new retry + logic. + * more #918 bug fixes for AM renaming now matches Sundew perfectly. + * nodupe_fileAgeX (X=Min or Max) name change to fileAgeX replacing inflight. + * fix #907 declare exchange in admin.conf wasn't working. + * fix #912 enable v2 style retry processing with new --retry_refilter flag. + * fix #918 plugin for AM to name files with incomplete headers properly. + * fix #920 fix inflight mtime not working in watch. + * fix #920 replaced nodupe_fileAge(Min and Max) with fileAge(Min and Max) + * fix #920 inflight mtime merged with fileMinAge + * fix #922 sr3 showing wrong exchange on status/show. + * processing of rename field in messages suppressed when download=False + * (required for common processing of messages.) + + -- peter Wed, 14 Feb 2024 09:00:18 -0500 + metpx-sr3 (3.00.51) unstable; urgency=medium * PR #910 detect v02 messages without content_type header. diff --git a/sarracenia/_version.py b/sarracenia/_version.py index c48cc8fce..d5f3ca067 100755 --- a/sarracenia/_version.py +++ b/sarracenia/_version.py @@ -1 +1 @@ -__version__ = "3.00.52rc4" +__version__ = "3.00.52" From 743a17a190e8e3127c03824285796250eeb1ffc1 Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 14 Mar 2024 16:58:07 -0400 Subject: [PATCH 017/246] increment away from release --- debian/changelog | 2 +- sarracenia/_version.py | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/debian/changelog b/debian/changelog index 46056027e..52ab4f51b 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,4 +1,4 @@ -metpx-sr3 (3.00.53) UNRELEASED; urgency=medium +metpx-sr3 (3.00.53rc1) UNRELEASED; urgency=medium * increment away from release diff --git a/sarracenia/_version.py b/sarracenia/_version.py index d5f3ca067..ce1abc9a3 100755 --- a/sarracenia/_version.py +++ b/sarracenia/_version.py @@ -1 +1 @@ -__version__ = "3.00.52" +__version__ = "3.00.53rc1" From 64b71d551282db0b0304bbe33927f6ee7bf620b3 Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 14 Mar 2024 17:33:57 -0400 Subject: [PATCH 018/246] docs catching up to current state of branches --- debian/changelog | 6 ++++- docs/source/Contribution/Development.rst | 32 ++++++++++++++++-------- 2 files changed, 26 insertions(+), 12 deletions(-) diff --git a/debian/changelog b/debian/changelog index 52ab4f51b..83abddc63 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,6 +1,10 @@ metpx-sr3 (3.00.53rc1) UNRELEASED; urgency=medium - * increment away from release + * fix #967 define hostname as a string option (was defaulting to list.) + * docs: Add topicPrefix for #961 + * docs: some revisions for clarity/syntax. + * some fixes for misnaming of some (rare) files received by gather/am + -- Peter Silva Thu, 14 Mar 2024 17:01:04 -0400 diff --git a/docs/source/Contribution/Development.rst b/docs/source/Contribution/Development.rst index 66f3cfda8..cdf893b1c 100644 --- a/docs/source/Contribution/Development.rst +++ b/docs/source/Contribution/Development.rst @@ -117,18 +117,22 @@ To run the sr_insects tests, the repository must be cloned with the development A gate for merging to development is for a second developer to run the flow_tests. **For v03, these tests must run: static_flow, flakey_broker, dynamic_flow, transform_flow** -Planned by 2022/04/11: - * stable will be merged from (version 3) development, so the default version for new work is sr3. - * launchpad has recipes to produce metpx-sr3 packages from the stable branch. + * launchpad has recipes to produce metpx-sr3 packages from various branches. * The *MetPX Daily* repository is a snapshot of the development branch. * The *MetPX Pre-Release* repository should receive versions ending in rcX (release candidate) + The packages here from from pre-release branch which comes from snapshots of the development branch. + There is also a pre-release-py36 branch for building pre-release packages for older operating systems. - * The *MetPX* repository should only contain stable releases that have graduated from the rcX series. + * stable comes from on snapshots of (version 3) pre-release branch. + * The *MetPX* repository should only contain stable releases that have graduated from the rcX series. + there is a stable_py36 branch to build packages for older operating systems that have + python 3.6 (redhat 8, ubuntu 18, ubuntu 20) or are too old to use hatchling installer. + sr_insects ~~~~~~~~~~ @@ -342,17 +346,20 @@ The options are detailed below: Committing Code ~~~~~~~~~~~~~~~ -What should be done prior to committing to the stable branch? +What should be done prior to committing to the development branch? Checklist: - do development on some other branch. Usually the branch will be named after the issue being addressed. Example: issue240, if we give up on an initial approach and start another one, there may be issue240_2 for a second attempt. There may also be feature branches, such as v03. -- **sr_insects tests works** (See Testing) The stable branch should always be functional, do not commit code if the sr_insects tests are not working. + +- **sr_insects tests works** (See Testing) The development branch should always be functional, do not commit code if the sr_insects tests are not working. + - Natural consequence: if the code changes means tests need to change, include the test change in the commit. + - **update doc/** manual pages should get their updates ideally at the same time as the code. -Usually there will be many such cycles on a development branch before one is ready +Usually there will be many such cycles on an issueXXX branch before one is ready to issue a pull request. Eventually, we get to `Commits to the Development Branch`_ @@ -566,7 +573,7 @@ Running Flow Tests This section documents these steps in much more detail. Before one can run the sr_insects tests, some pre-requisites must be taken care of. -Note that there is Github Actions integration for at least the stable branch +Note that there is Github Actions integration for at least the development branch to verify functionality on a variety of python version. Consult:: https://github.com/MetPX/sarracenia/actions @@ -829,7 +836,7 @@ Then check show it went with flow_check.sh:: If the flow_check.sh passes, then one has a reasonable confidence in the overall functionality of the python application, but the test coverage is not exhaustive. This is the lowest gate for committing -changes to thy python code into the stable branch. It is more qualitative sampling of the most +changes to thy python code into the development branch. It is more qualitative sampling of the most common use cases rather than a thorough examination of all functionality. While not thorough, it is good to know the flows are working. @@ -1228,13 +1235,16 @@ Key Branches There is a long running discussion about `Which Version is stable `_ The current set up is that there are four principal branches: -* stable branch is the release version of sr3, merging from development. used to build sr3 packages in the +* stable branch is the release version of sr3, merging from pre-release. used to build sr3 packages in the `MetPX `_ repository. -* development ... The `version 3 `_ work in progress branch is a next version of sarracenia in development. +* development ... The `version 3 `_ work in progress branch is a next version of sarracenia. the development branch is used to build sr3 packages for the `Daily `_ and `Pre-Release `_ repositories on launchpad.net. +* stable_py36 and pre-relrease-36 are branched from stable and pre_release respectively to adjust for building + packages on older operating systems that have older versions of python (and no support for hatchling.) + * issue branches to be merged to development, it should be start with issueXXX or suggested branch names from github are ok also. * sometimes, multiple branches are needed for a single issue, say for variations of a fix, eg. issueXXX_2_do_it_this_way . From 844b09be0c90eec328111c6184e1845e4d418886 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 13 Mar 2024 13:57:30 +0000 Subject: [PATCH 019/246] fix #971 Add missing to list of possible process status --- sarracenia/sr.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sarracenia/sr.py b/sarracenia/sr.py index 60bd06dde..fc05a331c 100755 --- a/sarracenia/sr.py +++ b/sarracenia/sr.py @@ -1182,7 +1182,7 @@ def __init__(self, opt, config_fnmatches=None): 'sender', 'shovel', 'subscribe', 'watch', 'winnow' ] self.status_values = [ - 'disabled', 'hung', 'include', 'stopped', 'partial', 'running', 'waitVip', 'unknown' + 'disabled', 'hung', 'include', 'missing', 'stopped', 'partial', 'running', 'waitVip', 'unknown' ] self.bin_dir = os.path.dirname(os.path.realpath(__file__)) From c29252233e7bacc34f3e21e53c683066dc913ef9 Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 14 Mar 2024 17:38:11 -0400 Subject: [PATCH 020/246] changelog update from last pr merge --- debian/changelog | 1 + 1 file changed, 1 insertion(+) diff --git a/debian/changelog b/debian/changelog index 83abddc63..af9755456 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,6 +1,7 @@ metpx-sr3 (3.00.53rc1) UNRELEASED; urgency=medium * fix #967 define hostname as a string option (was defaulting to list.) + * fix #971 Add missing to list of possible process status * docs: Add topicPrefix for #961 * docs: some revisions for clarity/syntax. * some fixes for misnaming of some (rare) files received by gather/am From 46c9c72f9ab9dca6022a66f716386e541ca0287f Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Fri, 15 Mar 2024 17:41:45 +0000 Subject: [PATCH 021/246] No download message when not downloading --- sarracenia/flowcb/log.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/sarracenia/flowcb/log.py b/sarracenia/flowcb/log.py index f562916d1..97b0aab3e 100755 --- a/sarracenia/flowcb/log.py +++ b/sarracenia/flowcb/log.py @@ -176,6 +176,9 @@ def after_work(self, worklist): for msg in worklist.ok: if 'size' in msg: self.fileBytes += msg['size'] + + if not self.o.download: + continue if set(['after_work']) & self.o.logEvents: if 'fileOp' in msg : From f42f191d41821a0672529028cb9c464d27d29445 Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Wed, 13 Mar 2024 21:53:40 +0000 Subject: [PATCH 022/246] Reduced differences with Tom Kralidis' publisher --- sarracenia/postformat/wis.py | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/sarracenia/postformat/wis.py b/sarracenia/postformat/wis.py index 39b4df512..361a24044 100644 --- a/sarracenia/postformat/wis.py +++ b/sarracenia/postformat/wis.py @@ -136,7 +136,7 @@ def exportMine(body, options) -> (str, dict, str): """ for h in body: - if h not in [ 'geometry', 'properties', 'size', 'baseUrl', 'relPath', 'retrievePath', 'subtopic', 'pubTime' ]: + if h not in [ 'geometry', 'properties', 'size', 'baseUrl', 'relPath', 'retrievePath', 'subtopic', 'pubTime', 'to_clusters', 'from_cluster', 'filename', 'sundew_extension', 'mtime', 'atime' ]: GeoJSONBody['properties'][h] = body[h] t=body['pubTime'] @@ -145,13 +145,13 @@ def exportMine(body, options) -> (str, dict, str): if 'geometry' in body: GeoJSONBody['geometry'] = body['geometry'] - if 'data_id' not in body: - GeoJSONBody['properties']['data_id'] = str(uuid.uuid4()) + if 'id' not in body: + GeoJSONBody['properties']['id'] = str(uuid.uuid4()) if 'retrievePath' in body : - url = body['baseUrl'] + body['retrievePath'] + url = body['baseUrl'] + "/" + body['retrievePath'] else: - url = body['baseUrl'] + body['relPath'] + url = body['baseUrl'] + "/" + body['relPath'] if not 'links' in GeoJSONBody: From 55016b13c2d5123732a3966abc4067c128de5d60 Mon Sep 17 00:00:00 2001 From: Mathew Shaker Date: Fri, 15 Mar 2024 17:41:45 +0000 Subject: [PATCH 023/246] No download message when not downloading --- sarracenia/flowcb/log.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/sarracenia/flowcb/log.py b/sarracenia/flowcb/log.py index f562916d1..97b0aab3e 100755 --- a/sarracenia/flowcb/log.py +++ b/sarracenia/flowcb/log.py @@ -176,6 +176,9 @@ def after_work(self, worklist): for msg in worklist.ok: if 'size' in msg: self.fileBytes += msg['size'] + + if not self.o.download: + continue if set(['after_work']) & self.o.logEvents: if 'fileOp' in msg : From 039b9cb84a0721f6151cd38dccf8ca668ce0c43a Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Fri, 15 Mar 2024 18:40:25 +0000 Subject: [PATCH 024/246] Re-enable AMQP consumer flow tests --- .github/workflows/flow_amqp_consumer.yml | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/.github/workflows/flow_amqp_consumer.yml b/.github/workflows/flow_amqp_consumer.yml index a813b4a5a..6f3dfe114 100644 --- a/.github/workflows/flow_amqp_consumer.yml +++ b/.github/workflows/flow_amqp_consumer.yml @@ -5,7 +5,8 @@ on: types: [opened, edited, reopened] push: branches: - - issue_457_amqp_consumer + - development + - stable paths-ignore: - '.github/**' @@ -48,7 +49,7 @@ jobs: sudo sh -c 'echo "MaxStartups 750" >> /etc/ssh/sshd_config' sudo systemctl restart ssh echo "amqp_consumer True" >> ${HOME}/.config/sr3/default.conf - echo "set sarracenia.moth.amqpconsumer.AMQPConsumer.logLevel debug" >> ${HOME}/.config/sr3/default.conf + #echo "set sarracenia.moth.amqpconsumer.AMQPConsumer.logLevel debug" >> ${HOME}/.config/sr3/default.conf - name: Setup ${{ matrix.which_test }} test. run: | From 7f39a7f9e2c848fe383ba861ae414004a35c6c3a Mon Sep 17 00:00:00 2001 From: Andre LeBlanc Date: Mon, 18 Mar 2024 13:09:44 +0000 Subject: [PATCH 025/246] Reject float types for Julian day value in getTime --- sarracenia/bulletin.py | 9 ++++----- 1 file changed, 4 insertions(+), 5 deletions(-) diff --git a/sarracenia/bulletin.py b/sarracenia/bulletin.py index 4c70dd506..bb6414df6 100644 --- a/sarracenia/bulletin.py +++ b/sarracenia/bulletin.py @@ -224,11 +224,10 @@ def getTime(self, data): if len(parts) < 4: return None - # passe-passe pour le jour julien en float parfois ? - f = float(jul) - i = int(f) - jul = '%s' % i - # fin de la passe-passe + # Julian days shouldn't be float type. Reject them when found. They should only be integers. + if '.' in jul: + logger.error("Julian days can't be of float type.") + return None # strange 0 filler From 903faea20eea619cbd935476fda4aad608bf2be5 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Fri, 15 Mar 2024 19:20:32 +0000 Subject: [PATCH 026/246] Change some housekeeping logging --- sarracenia/diskqueue.py | 8 ++++---- sarracenia/flowcb/log.py | 2 +- sarracenia/flowcb/retry.py | 2 +- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/sarracenia/diskqueue.py b/sarracenia/diskqueue.py index cca81ca42..fedd17db2 100755 --- a/sarracenia/diskqueue.py +++ b/sarracenia/diskqueue.py @@ -359,7 +359,7 @@ def on_housekeeping(self): remove .new rename housekeeping to queue for next period. """ - logger.info("%s on_housekeeping" % self.name) + logger.debug("%s on_housekeeping" % self.name) # finish retry before reshuffling all retries entries @@ -440,7 +440,7 @@ def on_housekeeping(self): self.msg_count = N if N == 0: - logger.info("No retry in list") + logger.info("%s No retry in list" % self.name) try: os.unlink(self.housekeeping_path) except: @@ -449,7 +449,7 @@ def on_housekeeping(self): # housekeeping file becomes new retry else: - logger.info("Number of messages in retry list %d" % N) + logger.info("%s Number of messages in retry list %d" % (self.name, N)) try: os.rename(self.housekeeping_path, self.queue_file) except: @@ -463,4 +463,4 @@ def on_housekeeping(self): pass elapse = sarracenia.nowflt() - self.now - logger.info("on_housekeeping elapse %f" % elapse) + logger.debug("on_housekeeping elapse %f" % elapse) diff --git a/sarracenia/flowcb/log.py b/sarracenia/flowcb/log.py index f562916d1..c86fc2a78 100755 --- a/sarracenia/flowcb/log.py +++ b/sarracenia/flowcb/log.py @@ -244,5 +244,5 @@ def on_start(self): def on_housekeeping(self): if set(['on_housekeeping']) & self.o.logEvents: self.stats() - logger.info("housekeeping") + logger.debug("housekeeping") self.__reset() diff --git a/sarracenia/flowcb/retry.py b/sarracenia/flowcb/retry.py index 9cf47f04e..3c51e73b7 100755 --- a/sarracenia/flowcb/retry.py +++ b/sarracenia/flowcb/retry.py @@ -171,7 +171,7 @@ def on_cleanup(self) -> None: self.post_retry.cleanup() def on_housekeeping(self) -> None: - logger.info("on_housekeeping") + logger.debug("on_housekeeping") self.download_retry.on_housekeeping() self.post_retry.on_housekeeping() From 3dfc09b0acd8a3322cbf223fb991a7442cd04ac7 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 13:53:25 +0000 Subject: [PATCH 027/246] Downgrade more logs to debug --- sarracenia/flow/__init__.py | 2 +- sarracenia/flowcb/post/message.py | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index bed31b1d2..41be49741 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -329,7 +329,7 @@ def _runHousekeeping(self, now) -> float: """ Run housekeeping callbacks Return the time when housekeeping should be run next """ - logger.info(f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}') + logger.debug(f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}') self.runCallbacksTime('on_housekeeping') self.metricsFlowReset() self.metrics['flow']['last_housekeeping'] = now diff --git a/sarracenia/flowcb/post/message.py b/sarracenia/flowcb/post/message.py index 5c8610d89..c04c90e06 100755 --- a/sarracenia/flowcb/post/message.py +++ b/sarracenia/flowcb/post/message.py @@ -53,12 +53,12 @@ def metricsReport(self) -> dict: def on_housekeeping(self): if hasattr(self,'poster') and self.poster: m = self.poster.metricsReport() - logger.info( + logger.debug( f"messages: good: {m['txGoodCount']} bad: {m['txBadCount']} bytes: {m['txByteCount']}" ) self.poster.metricsReset() else: - logger.info( "no metrics available" ) + logger.debug( "no metrics available" ) def on_start(self): if hasattr(self,'poster') and self.poster: From 771a4f29a16b04e0fd46938146f84ce71e82ac74 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 13:53:55 +0000 Subject: [PATCH 028/246] Remove memory from log output where it doesn't belong, fix bug --- sarracenia/flowcb/housekeeping/resources.py | 13 ++++--------- 1 file changed, 4 insertions(+), 9 deletions(-) diff --git a/sarracenia/flowcb/housekeeping/resources.py b/sarracenia/flowcb/housekeeping/resources.py index 37373bdd1..96a82bed4 100755 --- a/sarracenia/flowcb/housekeeping/resources.py +++ b/sarracenia/flowcb/housekeeping/resources.py @@ -40,17 +40,15 @@ from sarracenia import naturalSize, naturalTime from sarracenia.featuredetection import features +logger = logging.getLogger(__name__) + if features['process']['present']: import psutil else: logger.error("missing psutil class cannot monitor process memory usage") - import sys -logger = logging.getLogger(__name__) - - class Resources(FlowCB): def __init__(self, options): super().__init__(options,logger) @@ -71,8 +69,7 @@ def on_housekeeping(self): mem = 0 ost = os.times() - logger.info( - f"Current Memory cpu_times: user={ost.user} system={ost.system}") + logger.info(f"Current cpu_times: user={ost.user} system={ost.system}") # We must set a threshold **after** the config file has been parsed. if self.threshold is None: @@ -94,9 +91,7 @@ def on_housekeeping(self): self.threshold = int(self.o.MemoryMultiplier * mem) - logger.info( - f"Memory threshold set to: {naturalSize(self.threshold)}" - ) + logger.info(f"Memory threshold set to: {naturalSize(self.threshold)}") logger.info( f"Current Memory usage: {naturalSize(mem)} / " From 6ab5020d7e438eb44ac097607399f050fb70b236 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 14:03:02 +0000 Subject: [PATCH 029/246] I missed changing this one --- sarracenia/diskqueue.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sarracenia/diskqueue.py b/sarracenia/diskqueue.py index fedd17db2..1bffd0c79 100755 --- a/sarracenia/diskqueue.py +++ b/sarracenia/diskqueue.py @@ -440,7 +440,7 @@ def on_housekeeping(self): self.msg_count = N if N == 0: - logger.info("%s No retry in list" % self.name) + logger.debug("%s No retry in list" % self.name) try: os.unlink(self.housekeeping_path) except: From 94a340c58fedf52e78754e15124f1c0fbfec37be Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 14:27:54 +0000 Subject: [PATCH 030/246] Change back to info for this log line --- sarracenia/flow/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index 41be49741..bed31b1d2 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -329,7 +329,7 @@ def _runHousekeeping(self, now) -> float: """ Run housekeeping callbacks Return the time when housekeeping should be run next """ - logger.debug(f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}') + logger.info(f'on_housekeeping pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}') self.runCallbacksTime('on_housekeeping') self.metricsFlowReset() self.metrics['flow']['last_housekeeping'] = now From 9c1fb0584e7ff31cc76021f203da6c2b97ba0377 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 14:28:14 +0000 Subject: [PATCH 031/246] Fix bug differently, by not logging --- sarracenia/flowcb/housekeeping/resources.py | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-) diff --git a/sarracenia/flowcb/housekeeping/resources.py b/sarracenia/flowcb/housekeeping/resources.py index 96a82bed4..75bec1900 100755 --- a/sarracenia/flowcb/housekeeping/resources.py +++ b/sarracenia/flowcb/housekeeping/resources.py @@ -35,20 +35,17 @@ import logging import os -import psutil from sarracenia.flowcb import FlowCB from sarracenia import naturalSize, naturalTime from sarracenia.featuredetection import features -logger = logging.getLogger(__name__) - if features['process']['present']: import psutil -else: - logger.error("missing psutil class cannot monitor process memory usage") import sys +logger = logging.getLogger(__name__) + class Resources(FlowCB): def __init__(self, options): super().__init__(options,logger) From d8d8c8c48d7ea45c4d99548f3f62263536a36bf7 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Mon, 18 Mar 2024 15:44:40 +0000 Subject: [PATCH 032/246] Rename tests to have consistent naming --- .github/workflows/flow.yml | 4 ++-- .github/workflows/flow_amqp_consumer.yml | 5 ++--- .github/workflows/flow_mqtt.yml | 4 ++-- .github/workflows/flow_redis.yml | 3 ++- 4 files changed, 8 insertions(+), 8 deletions(-) diff --git a/.github/workflows/flow.yml b/.github/workflows/flow.yml index 8e6fbc23b..3e64db865 100644 --- a/.github/workflows/flow.yml +++ b/.github/workflows/flow.yml @@ -1,4 +1,4 @@ -name: sr_insects Flow Tests. +name: Flow Tests / AMQP on: pull_request: @@ -36,7 +36,7 @@ jobs: runs-on: ${{ matrix.osver }} - name: ${{ matrix.which_test }} test on ${{ matrix.osver }} + name: ${{ matrix.which_test }} on ${{ matrix.osver }} timeout-minutes: 40 steps: diff --git a/.github/workflows/flow_amqp_consumer.yml b/.github/workflows/flow_amqp_consumer.yml index 6f3dfe114..a5d861bd5 100644 --- a/.github/workflows/flow_amqp_consumer.yml +++ b/.github/workflows/flow_amqp_consumer.yml @@ -1,4 +1,4 @@ -name: sr_insects Flow Tests using AMQP Consumer. +name: Flow Tests / AMQP Consumer on: pull_request: @@ -6,7 +6,6 @@ on: push: branches: - development - - stable paths-ignore: - '.github/**' @@ -34,7 +33,7 @@ jobs: runs-on: ${{ matrix.osver }} - name: ${{ matrix.which_test }} test on ${{ matrix.osver }} + name: ${{ matrix.which_test }} on ${{ matrix.osver }} timeout-minutes: 40 steps: diff --git a/.github/workflows/flow_mqtt.yml b/.github/workflows/flow_mqtt.yml index 097bd5694..e5f8d5921 100644 --- a/.github/workflows/flow_mqtt.yml +++ b/.github/workflows/flow_mqtt.yml @@ -1,4 +1,4 @@ -name: Sr3 sr_insects Flow Tests using MQTT. +name: Flow Tests / MQTT on: pull_request: @@ -33,7 +33,7 @@ jobs: runs-on: ${{ matrix.osver }} - name: ${{ matrix.which_test }} test on ${{ matrix.osver }} + name: ${{ matrix.which_test }} on ${{ matrix.osver }} timeout-minutes: 45 steps: diff --git a/.github/workflows/flow_redis.yml b/.github/workflows/flow_redis.yml index 242bfbad6..5502e0cda 100644 --- a/.github/workflows/flow_redis.yml +++ b/.github/workflows/flow_redis.yml @@ -1,4 +1,4 @@ -name: Flow Tests (with Redis). +name: Flow Tests / Redis on: pull_request: @@ -6,6 +6,7 @@ on: push: branches: - v03_disabled + paths-ignore: - '.github/**' - 'debian/changelog' From 9204cc0bac80e73d915a4755f767afc31c286718 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Tue, 19 Mar 2024 11:33:02 -0500 Subject: [PATCH 033/246] Add S3 Sender plugin (#983) --- sarracenia/flowcb/send/s3CloudSender.py | 243 ++++++++++++++++++++++++ 1 file changed, 243 insertions(+) create mode 100644 sarracenia/flowcb/send/s3CloudSender.py diff --git a/sarracenia/flowcb/send/s3CloudSender.py b/sarracenia/flowcb/send/s3CloudSender.py new file mode 100644 index 000000000..0d7177a74 --- /dev/null +++ b/sarracenia/flowcb/send/s3CloudSender.py @@ -0,0 +1,243 @@ +#!/usr/bin/python3 + +""" +S3 Cloud Sender - Plugin to send data into S3 buckets +====================================================== + +This plugin lets you send local data into S3 buckets. It is based on the S3CloudPublisher plugin by Tom Kralidis +and Tyson Kaufmann, found here: +https://github.com/MetPX/sr3-examples/blob/main/cloud-publisher-s3/config/sr3/plugins/s3CloudPublisher.py + +This version is refactored into a Sender plugin (instead of Subscribe), and uses Sarracenia's normal config parser +and credentials.conf file, instead of environment variables. It supports posting the URL where the file was uploaded +to, allows not specifying a region in the config, etc. + +The file to be uploaded must already exist on the local filesystem. + + +Configuration +-------------- + + +credentials.conf: +^^^^^^^^^^^^^^^^^ + +:: + + s3://access_key_id:secret_access_key@endpoint.example.com/ + s3://access_key_id:secret_access_key@None + + +sender config: +^^^^^^^^^^^^^^^^^ + +:: + + # sendTo + # Specify endpoint and credentials. + # - If you don't have an Access Key ID and/or endpoint URL, use None. + # - If you specify an endpoint URL, it will be prefixed with https:// when connecting. + # - List of endpoints: https://docs.aws.amazon.com/general/latest/gr/s3.html#s3_region + sendTo s3://access_key_id@endpoint.example.com/ + # No endpoint specified, boto3 will auto-select. + sendTo s3://access_key_id@None/ + # No endpoint, and no Access Key ID, for public buckets + sendTo s3://None@None/ + + # directory + # Where to send the files, like a normal sr3 sender. + directory first-thing-is-bucket-name/anything_else_is_a_path + # path is not mandatory + directory just-a-bucket-name + + # post_urlType + # Optional - sets the format of the posted URL. Can be https or s3_uri. If this post_urlType *and* post_baseUrl are + # both not set, s3_uri will be used. + # Important: this will override any post_baseUrl setting. You can choose to not use this option and manually set + # post_baseUrl to https://BUCKET_NAME.s3.REGION.amazonaws.com/ or s3:// + # When using https, BUCKET_NAME and REGION will automatically be replaced with the correct bucket name and region. + # + # https: baseUrl=https://BUCKET_NAME.s3.REGION.amazonaws.com/ relPath=path/to/object.file + # s3_uri: baseUrl=s3:// relPath=bucketname/path/to/object.file + post_urlType s3_uri + + # AWS_regionName + # Optional - specify a region name + AWS_regionName ca-central-1 + + # AWS_sessionToken + # Optional - set a session token to use with the Access Key ID and Secret Access Key + AWS_sessionToken your_very_long_token........ + +--- + +Authors: Tom Kralidis , Tyson Kaufmann, Reid Sunderland + +Copyright (c) 2021 Tom Kralidis + +Permission is hereby granted, free of charge, to any person +obtaining a copy of this software and associated documentation +files (the "Software"), to deal in the Software without +restriction, including without limitation the rights to use, +copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the +Software is furnished to do so, subject to the following +conditions: + +The above copyright notice and this permission notice shall be +included in all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, +EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES +OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND +NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT +HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, +WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING +FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR +OTHER DEALINGS IN THE SOFTWARE. +""" + + +import logging +import os +from sarracenia.credentials import Credential +from sarracenia.flowcb import FlowCB +import boto3 +from botocore.exceptions import ClientError + +logger = logging.getLogger(__name__) + +class S3CloudSender(FlowCB): + """ Sender to S3 destination. + """ + + def __init__(self, options): + """initialize""" + + super().__init__(options, logger) + + # Allow setting a logLevel *only* for this plugin in the config file: + # set send.s3CloudSender.logLevel debug + if hasattr(self.o, 'logLevel'): + logger.setLevel(self.o.logLevel.upper()) + + logger.debug("S3CloudSender starting up") + + # S3 sender specific config options + self.o.add_option('AWS_regionName', kind='str', default_value=None) # optional + self.o.add_option('AWS_sessionToken', kind='str', default_value=None) # optional + self.o.add_option("post_urlType", kind='str', default_value=None) # optional, overrides post_baseUrl + + # post_urlType must be https or s3, and handle unknown cases + if self.o.post_urlType and self.o.post_urlType not in ['https', 's3_uri']: + logger.warning(f"Unknown post_urlType: {self.o.post_urlType}") + elif self.o.post_urlType and self.o.post_urlType == 's3_uri': + self.o.post_baseUrl = "s3://" + elif self.o.post_urlType and self.o.post_urlType == 'https': + # a sender can send into multiple different buckets, the region gets set when the file is sent + self.o.post_baseUrl = "https://BUCKET_NAME.s3.REGION.amazonaws.com/" + elif not self.o.post_urlType and not self.o.post_baseUrl: + logger.info("post_urlType and post_baseUrl not set, using s3://") + self.o.post_baseUrl = "s3://" + else: + logger.debug(f"Using post_baseUrl {self.o.post_baseUrl}") + + # sendTo destination in config file sets the URL and access key ID + # - Access Key and Secret Access Key should be defined in credentials.conf + # - Just in case the user wants to use sendTo s3://None:None@None or s3://None@None, we add them to the + # credentials DB here, so s3://None:None@None doesn't have to exist in credentials.conf + cred_details = Credential(urlstr="s3://None:None@None") + self.o.credentials.add("s3://None@None", details=cred_details) + + # Find credentials matching the sendTo URL + ok, details = self.o.credentials.get(self.o.sendTo) + + if not ok: + error_msg = f"Failed to find credentials for sendTo URL {self.o.sendTo}" + logger.error(error_msg) + raise Exception(error_msg) + + if details.url.scheme != 's3': + logger.warning(f"Using credentials with scheme ({details.url.scheme}) that is not s3") + + netloc = details.url.netloc.rsplit(sep='@', maxsplit=1) # split on the rightmost @ + usr_pwd = netloc[0].split(':') + + # If any options are "None", make them None. This should allow creating a client using the default/auto settings. + self.s3_url = "https://"+netloc[1] if not (type(netloc[1]) == str and netloc[1] == "None") else None + self.access_key_id = usr_pwd[0] if not (type(usr_pwd[0]) == str and usr_pwd[0] == "None") else None + self.secret_access_key = usr_pwd[1] if not (type(usr_pwd[1]) == str and usr_pwd[1] == "None") else None + + logger.info(f"Successfully loaded credentials for sendTo URL {self.o.sendTo}") + + self.s3_client = boto3.client('s3', endpoint_url=self.s3_url, aws_access_key_id=self.access_key_id, + aws_secret_access_key=self.secret_access_key, + region_name=self.o.AWS_regionName, aws_session_token=self.o.AWS_sessionToken) + + def send(self, msg): + + logger.debug(f"Received msg: {msg}") + logger.debug(f"Received msg: format={msg['_format']}, baseUrl={msg['baseUrl']}, " + + f"relPath={msg['relPath']}, new_dir={msg['new_dir']}, new_file={msg['new_file']}") + + # Bucket name and (optional remote path) come from the directory setting in the config + # remote path should not start with / + new_dir_parts = msg['new_dir'].strip('/').split('/') + s3_bucket_name = new_dir_parts[0] + if len(new_dir_parts) > 1: # new_dir (directory in config file) has more parts than just the bucket name + remote_path = os.path.normpath(os.path.join(*new_dir_parts[1:], msg['new_file'])) + else: + remote_path = msg['new_file'] + + # Local file, from baseDir + relPath (relPath shouldn't start with a /) + local_file = os.path.join(self.o.baseDir, msg['relPath'].lstrip('/')) + if not os.path.isfile(local_file): + logger.error(f"File does not exist: {local_file} (baseDir: {self.o.baseDir}, relPath: {msg['relPath']})") + return False + + logger.debug(f"Going to upload local file: {local_file} to S3 bucket: {s3_bucket_name}, path: {remote_path}") + + try: + self.s3_client.upload_file(local_file, s3_bucket_name, remote_path) + except Exception as e: + # The exception gives a nice explanation already + logger.error(f"{e}") + logger.debug("Exception details:", exc_info=True) + return False + + logger.info(f"Sent {local_file} into S3 bucket: {s3_bucket_name}, path: {remote_path}") + + # Update the message + msg['new_baseUrl'] = self.o.post_baseUrl + + if 'BUCKET_NAME' in msg['new_baseUrl']: + msg['new_baseUrl'] = msg['new_baseUrl'].replace('BUCKET_NAME', s3_bucket_name) + + # Figure out the region when using https baseUrl + if 'REGION' in msg['new_baseUrl']: + try: + resp = self.s3_client.head_bucket(Bucket=s3_bucket_name) + region = resp['ResponseMetadata']['HTTPHeaders']['x-amz-bucket-region'] + msg['new_baseUrl'] = msg['new_baseUrl'].replace('REGION', region) + except Exception as e: + logger.error("Couldn't determine region for HTTPS URL, setting baseUrl = s3://") + logger.debug("Exception details", exc_info=True) + msg['new_baseUrl'] = "s3://" + + # relPath depends on the type of URL posted + if 's3://' in msg['new_baseUrl']: + msg['new_relPath'] = s3_bucket_name + '/' + remote_path + elif s3_bucket_name in msg['new_baseUrl']: + msg['new_relPath'] = remote_path + else: + msg['new_baseUrl'] = 's3://' + msg['new_relPath'] = remote_path + logger.error(f"Couldn't determine baseUrl type for {msg['new_baseUrl']}, set to s3:// with relPath {msg['new_relPath']}") + + logger.debug(f"Modified msg: {msg}") + + return True + + def __repr__(self): + return '' + From d34ecc30b41be36974bcc9e58505156818fb5dd6 Mon Sep 17 00:00:00 2001 From: Reid Sunderland Date: Wed, 20 Mar 2024 15:20:13 +0000 Subject: [PATCH 034/246] fix a possible problem found by @andreleblanc11, where a PODAAC source doesn't have an md5sum when first posted, then the md5sum becomes available later, it will re-post and re-download --- sarracenia/flowcb/poll/poll_NASA_CMR.py | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/sarracenia/flowcb/poll/poll_NASA_CMR.py b/sarracenia/flowcb/poll/poll_NASA_CMR.py index cacccae9b..8ade140ac 100644 --- a/sarracenia/flowcb/poll/poll_NASA_CMR.py +++ b/sarracenia/flowcb/poll/poll_NASA_CMR.py @@ -340,6 +340,11 @@ def poll(self) -> list: sumstr = {"method":"md5", "value":md5} except: logger.warning(f"Could not get MD5 Checksum for {data_url}, posting without it.") + sumstr = {"method":"cod", "value":"md5"} + # source is podaac but md5_url isn't available + elif self.o.dataSource == "podaac": + # tell downloads to use md5 + sumstr = {"method":"cod", "value":"md5"} # finally create the message! if data_url: From d3efb6190f68cd9c3b56b75bc3f7893698266dbd Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Fri, 15 Mar 2024 23:08:32 -0400 Subject: [PATCH 035/246] housekeeping check missing in wiski --- sarracenia/flowcb/scheduled/wiski.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sarracenia/flowcb/scheduled/wiski.py b/sarracenia/flowcb/scheduled/wiski.py index 256b036a5..44d17eb0f 100644 --- a/sarracenia/flowcb/scheduled/wiski.py +++ b/sarracenia/flowcb/scheduled/wiski.py @@ -138,7 +138,7 @@ def gather(self,messageCountMax): # placeholder self.wait_until_next() while (1): - if self.stop_requested: + if self.stop_requested or self.housekeeping_needed: return messages self.token = self.submit_tokenization_request() From 4bf27dd24d93e479008e8c46f0bd910965ae7bee Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Mon, 18 Mar 2024 03:21:26 -0400 Subject: [PATCH 036/246] allow gather to abort further gathers by changing return value to a tuple --- sarracenia/flow/__init__.py | 13 +++++++++++-- sarracenia/flowcb/__init__.py | 9 ++++++--- sarracenia/flowcb/gather/am.py | 2 +- sarracenia/flowcb/gather/file.py | 8 ++++---- sarracenia/flowcb/gather/message.py | 8 +++++--- sarracenia/flowcb/log.py | 2 +- sarracenia/flowcb/poll/__init__.py | 1 - sarracenia/flowcb/retry.py | 6 +++--- sarracenia/flowcb/run.py | 2 +- sarracenia/flowcb/scheduled/__init__.py | 4 ++-- sarracenia/flowcb/scheduled/wiski.py | 6 +++--- 11 files changed, 37 insertions(+), 24 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index bed31b1d2..13c87bda0 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -1093,9 +1093,18 @@ def filter(self) -> None: def gather(self) -> None: so_far=0 + keep_going=True for p in self.plugins["gather"]: try: - new_incoming = p(self.o.batch-so_far) + retval = p(self.o.batch-so_far) + + # To avoid having to modify all existing gathers, support old API. + if type(retval) == tuple: + keep_going, new_incoming = retval + elif type(retval) == list: + new_incoming = retval + else: + logger.error( f"flowCallback plugin gather routine {p} returned unexpected type: {type(retval)}. Expected tuple of boolean and list of new messages" ) except Exception as ex: logger.error( f'flowCallback plugin {p} crashed: {ex}' ) logger.debug( "details:", exc_info=True ) @@ -1106,7 +1115,7 @@ def gather(self) -> None: so_far += len(new_incoming) # if we gathered enough with a subset of plugins then return. - if so_far >= self.o.batch: + if not keep_going or so_far >= self.o.batch: return diff --git a/sarracenia/flowcb/__init__.py b/sarracenia/flowcb/__init__.py index 5ec2c94de..27587a07e 100755 --- a/sarracenia/flowcb/__init__.py +++ b/sarracenia/flowcb/__init__.py @@ -80,14 +80,17 @@ def ack(self,messagelist) -> None:: Task: acknowledge messages from a gather source. - def gather(self, messageCountMax) -> list:: + def gather(self, messageCountMax) -> (gather_more, messages) :: - Task: gather messages from a source... return a list of messages + Task: gather messages from a source... return a tuple: + + * gather_more ... bool whether to continue gathering + * messages ... list of messages in a poll, gather is always called, regardless of vip posession. in all other components, gather is only called when in posession of the vip. - return [] + return (True, []) def after_accept(self,worklist) -> None:: diff --git a/sarracenia/flowcb/gather/am.py b/sarracenia/flowcb/gather/am.py index a57cf7320..2897c5a77 100644 --- a/sarracenia/flowcb/gather/am.py +++ b/sarracenia/flowcb/gather/am.py @@ -485,4 +485,4 @@ def gather(self, messageCountMax): except Exception as e: logger.error(f"Unable to generate bulletin file. Error message: {e}") - return newmsg + return (True, newmsg) diff --git a/sarracenia/flowcb/gather/file.py b/sarracenia/flowcb/gather/file.py index 8238cb4dc..321daf0c6 100755 --- a/sarracenia/flowcb/gather/file.py +++ b/sarracenia/flowcb/gather/file.py @@ -692,19 +692,19 @@ def gather(self, messageCountMax): if len(self.queued_messages) > self.o.batch: messages = self.queued_messages[0:self.o.batch] self.queued_messages = self.queued_messages[self.o.batch:] - return messages + return (True, messages) elif len(self.queued_messages) > 0: messages = self.queued_messages self.queued_messages = [] if self.o.sleep < 0: - return messages + return (True, messages) else: messages = [] if self.primed: - return self.wakeup() + return (True, self.wakeup()) cwd = os.getcwd() @@ -740,4 +740,4 @@ def gather(self, messageCountMax): messages = messages[0:self.o.batch] self.primed = True - return messages + return (True, messages) diff --git a/sarracenia/flowcb/gather/message.py b/sarracenia/flowcb/gather/message.py index d155b8795..f6fcea4bb 100755 --- a/sarracenia/flowcb/gather/message.py +++ b/sarracenia/flowcb/gather/message.py @@ -30,14 +30,16 @@ def __init__(self, options) -> None: def gather(self, messageCountMax) -> list: """ - return a current list of messages. + return: + True ... you can gather from other sources. and: + a list of messages obtained from this source. """ if hasattr(self,'consumer') and hasattr(self.consumer,'newMessages'): - return self.consumer.newMessages() + return (True, self.consumer.newMessages()) else: logger.warning( f'not connected. Trying to connect to {self.o.broker}') self.consumer = sarracenia.moth.Moth.subFactory(self.od) - return [] + return (True, []) def ack(self, mlist) -> None: diff --git a/sarracenia/flowcb/log.py b/sarracenia/flowcb/log.py index c86fc2a78..aa57faedb 100755 --- a/sarracenia/flowcb/log.py +++ b/sarracenia/flowcb/log.py @@ -64,7 +64,7 @@ def gather(self, messageCountMax): if set(['gather']) & self.o.logEvents: logger.info( f' messageCountMax: {messageCountMax} ') - return [] + return (True, []) def _messageStr(self, msg): if self.o.logMessageDump: diff --git a/sarracenia/flowcb/poll/__init__.py b/sarracenia/flowcb/poll/__init__.py index 83d899402..6ae5ebfbe 100755 --- a/sarracenia/flowcb/poll/__init__.py +++ b/sarracenia/flowcb/poll/__init__.py @@ -115,7 +115,6 @@ class Poll(FlowCB): * options are passed to sarracenia.Transfer classes for their use as well. - Poll uses sarracenia.transfer (ftp, sftp, https, etc... )classes to requests lists of files using those protocols using built-in logic. diff --git a/sarracenia/flowcb/retry.py b/sarracenia/flowcb/retry.py index 3c51e73b7..2c12467ce 100755 --- a/sarracenia/flowcb/retry.py +++ b/sarracenia/flowcb/retry.py @@ -84,9 +84,9 @@ def gather(self, qty) -> None: """ if not features['retry']['present'] or not self.o.retry_refilter: - return [] + return (True, []) - if qty <= 0: return [] + if qty <= 0: return (True, []) message_list = self.download_retry.get(qty) @@ -99,7 +99,7 @@ def gather(self, qty) -> None: m['_deleteOnPost'] = set( [ '_isRetry' ] ) - return message_list + return (True, message_list) def after_accept(self, worklist) -> None: diff --git a/sarracenia/flowcb/run.py b/sarracenia/flowcb/run.py index c183522ab..d1a1c1a90 100755 --- a/sarracenia/flowcb/run.py +++ b/sarracenia/flowcb/run.py @@ -76,7 +76,7 @@ def gather(self, messageCountMax): if hasattr(self.o, 'run_gather') and self.o.run_gather is not None: self.run_script(self.o.run_gather) - return [] + return (True, []) def after_accept(self, worklist): """ diff --git a/sarracenia/flowcb/scheduled/__init__.py b/sarracenia/flowcb/scheduled/__init__.py index dd770e746..acc518bda 100644 --- a/sarracenia/flowcb/scheduled/__init__.py +++ b/sarracenia/flowcb/scheduled/__init__.py @@ -93,7 +93,7 @@ def gather(self,messageCountMax): self.wait_until_next() if self.stop_requested or self.housekeeping_needed: - return [] + return (True, []) logger.info('time to run') @@ -105,7 +105,7 @@ def gather(self,messageCountMax): m = sarracenia.Message.fromFileInfo(relPath, self.o, st) gathered_messages.append(m) - return gathered_messages + return (True, gathered_messages) def on_housekeeping(self): diff --git a/sarracenia/flowcb/scheduled/wiski.py b/sarracenia/flowcb/scheduled/wiski.py index 44d17eb0f..1f12b3083 100644 --- a/sarracenia/flowcb/scheduled/wiski.py +++ b/sarracenia/flowcb/scheduled/wiski.py @@ -139,7 +139,7 @@ def gather(self,messageCountMax): # placeholder while (1): if self.stop_requested or self.housekeeping_needed: - return messages + return (True, messages) self.token = self.submit_tokenization_request() authenticated_url = self.main_url @@ -172,7 +172,7 @@ def gather(self,messageCountMax): # placeholder for station_id in k.get_station_list().station_id: if self.stop_requested: - return messages + return (False, messages) timeseries = k.get_timeseries_list(station_id = station_id ).ts_id #logger.info( f"looping over the timeseries: {timeseries}" ) @@ -197,7 +197,7 @@ def gather(self,messageCountMax): # placeholder f.close() messages.append( sarracenia.Message.fromFileData( fname, self.o, os.stat(fname) ) ) - return messages + return (True, messages) if __name__ == '__main__': From fb052f7f9977ed0f3b28bb8e0262932ac14e9199 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Thu, 21 Mar 2024 08:00:14 -0400 Subject: [PATCH 037/246] implement #974 poll refactor to used scheduled flows --- sarracenia/config.py | 5 +++ sarracenia/flow/__init__.py | 24 +++++++++++-- sarracenia/flow/poll.py | 30 ++++------------ sarracenia/flowcb/__init__.py | 12 +++++-- sarracenia/flowcb/poll/airnow.py | 2 +- sarracenia/flowcb/scheduled/poll.py | 55 +++++++++++++++++++++++++++++ 6 files changed, 98 insertions(+), 30 deletions(-) create mode 100644 sarracenia/flowcb/scheduled/poll.py diff --git a/sarracenia/config.py b/sarracenia/config.py index 3cf97b0bc..f7e17d132 100755 --- a/sarracenia/config.py +++ b/sarracenia/config.py @@ -1984,6 +1984,11 @@ def finalize(self, component=None, config=None): if (component not in ['poll' ]): self.path = list(map( os.path.expanduser, self.path )) + else: + if self.sleep > 1: + self.scheduled_interval = self.sleep + self.sleep=1 + if self.vip and not features['vip']['present']: logger.critical( f"vip feature requested, but missing library: {' '.join(features['vip']['modules_needed'])} " ) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index 13c87bda0..da5bbc4e6 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -481,7 +481,6 @@ def run(self): spamming = False self.filter() - self._runCallbacksWorklist('after_accept') logger.debug( @@ -1115,9 +1114,30 @@ def gather(self) -> None: so_far += len(new_incoming) # if we gathered enough with a subset of plugins then return. - if not keep_going or so_far >= self.o.batch: + if not keep_going or (so_far >= self.o.batch): + if (self.o.component == 'poll' ): + self.worklist.poll_catching_up=True + return + # gather is an extended version of poll. + if self.o.component != 'poll': + return + + if len(self.worklist.incoming) > 0: + logger.info('ingesting %d postings into duplicate suppression cache' % len(self.worklist.incoming) ) + self.worklist.poll_catching_up = True + return + else: + self.worklist.poll_catching_up = False + + if self.have_vip: + for plugin in self.plugins['poll']: + new_incoming = plugin() + if len(new_incoming) > 0: + self.worklist.incoming.extend(new_incoming) + + def do(self) -> None: diff --git a/sarracenia/flow/poll.py b/sarracenia/flow/poll.py index f6dd49d32..bbdf16b9a 100644 --- a/sarracenia/flow/poll.py +++ b/sarracenia/flow/poll.py @@ -63,16 +63,17 @@ def __init__(self, options): else: logger.info( f"Good! post_exchange: {px} and exchange: {self.o.exchange} match so multiple instances to share a poll." ) - if not 'poll' in ','.join(self.plugins['load']): + if not 'scheduled' in ','.join(self.plugins['load']): + self.plugins['load'].append('sarracenia.flowcb.scheduled.poll.Poll') + + if not 'flowcb.poll.Poll' in ','.join(self.plugins['load']): logger.info( f"adding poll plugin, because missing from: {self.plugins['load']}" ) self.plugins['load'].append('sarracenia.flowcb.poll.Poll') if options.vip: - self.plugins['load'].insert( - 0, 'sarracenia.flowcb.gather.message.Message') + self.plugins['load'].insert( 0, 'sarracenia.flowcb.gather.message.Message') - self.plugins['load'].insert(0, - 'sarracenia.flowcb.post.message.Message') + self.plugins['load'].insert( 0, 'sarracenia.flowcb.post.message.Message') if self.o.nodupe_ttl < self.o.fileAgeMax: logger.warning( f"nodupe_ttl < fileAgeMax means some files could age out of the cache and be re-ingested ( see : https://github.com/MetPX/sarracenia/issues/904") @@ -97,22 +98,3 @@ def do(self): logger.debug('processing %d messages worked! (stop requested: %s)' % (len(self.worklist.incoming), self._stop_requested)) self.worklist.incoming = [] - - - def gather(self): - - super().gather() - - if len(self.worklist.incoming) > 0: - logger.info('ingesting %d postings into duplicate suppression cache' % len(self.worklist.incoming) ) - self.worklist.poll_catching_up = True - return - else: - self.worklist.poll_catching_up = False - - if self.have_vip: - for plugin in self.plugins['poll']: - new_incoming = plugin() - if len(new_incoming) > 0: - self.worklist.incoming.extend(new_incoming) - diff --git a/sarracenia/flowcb/__init__.py b/sarracenia/flowcb/__init__.py index 27587a07e..feee0808d 100755 --- a/sarracenia/flowcb/__init__.py +++ b/sarracenia/flowcb/__init__.py @@ -87,10 +87,16 @@ def gather(self, messageCountMax) -> (gather_more, messages) :: * gather_more ... bool whether to continue gathering * messages ... list of messages - in a poll, gather is always called, regardless of vip posession. - in all other components, gather is only called when in posession + or just return a list of messages. + + In a poll, gather is always called, regardless of vip posession. + + In all other components, gather is only called when in posession of the vip. - return (True, []) + + return (True, list) + OR + return list def after_accept(self,worklist) -> None:: diff --git a/sarracenia/flowcb/poll/airnow.py b/sarracenia/flowcb/poll/airnow.py index c814aab26..4e13edb8e 100755 --- a/sarracenia/flowcb/poll/airnow.py +++ b/sarracenia/flowcb/poll/airnow.py @@ -27,7 +27,7 @@ class Airnow(FlowCB): def poll(self): - sleep = self.o.sleep + sleep = self.o.scheduled_interval gathered_messages = [] for Hours in range(1, 3): diff --git a/sarracenia/flowcb/scheduled/poll.py b/sarracenia/flowcb/scheduled/poll.py new file mode 100644 index 000000000..c19be929c --- /dev/null +++ b/sarracenia/flowcb/scheduled/poll.py @@ -0,0 +1,55 @@ +import logging +import requests +import base64 + +import datetime +import os +import sys +import time + +from datetime import date + +import sarracenia +from sarracenia.flowcb.scheduled import Scheduled + +logger = logging.getLogger(__name__) + + + + +class Poll(Scheduled): + """ + + """ + + def gather(self,messageCountMax): # placeholder + """ + + This gather aborts further gathers if the next interval has not yet arrived. + + """ + logger.info( f"waiting for next poll") + self.wait_until_next() + + return not (self.stop_requested or self.housekeeping_needed), [] + + +if __name__ == '__main__': + + import sarracenia.config + import types + import sarracenia.flow + + options = sarracenia.config.default_config() + flow = sarracenia.flow.Flow(options) + flow.o.scheduled_interval= 5 + flow.o.pollUrl = "https://dd.weather.gc.ca/bulletins/alphanumeric/" + if sys.platform.startswith( "win" ): + flow.o.directory = "C:\\temp\poll" + else: + flow.o.directory = "/tmp/scheduled_poll/${%Y%m%d}" + logging.basicConfig(level=logging.DEBUG) + + me = Poll(flow.o) + me.gather(flow.o.batch) + logger.info("Done") From 4d36607858a4dfbfa1c7fccc705a826689d251c4 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 02:16:20 -0400 Subject: [PATCH 038/246] updating documentation of gather routine's new variable return formats --- docs/source/Explanation/SarraPluginDev.rst | 5 +++++ docs/source/How2Guides/FlowCallbacks.rst | 6 +++++- docs/source/fr/CommentFaire/FlowCallbacks.rst | 2 ++ docs/source/fr/Explication/SarraPluginDev.rst | 4 ++++ 4 files changed, 16 insertions(+), 1 deletion(-) diff --git a/docs/source/Explanation/SarraPluginDev.rst b/docs/source/Explanation/SarraPluginDev.rst index cc7364354..8927b46c5 100644 --- a/docs/source/Explanation/SarraPluginDev.rst +++ b/docs/source/Explanation/SarraPluginDev.rst @@ -585,12 +585,17 @@ for detailed information about call signatures and return values, etc... | | permanent name. | | | | | | return the new name for the downloaded/sent file. | +| | | +---------------------+----------------------------------------------------+ | download(self,msg) | replace built-in downloader return true on success | | | takes message as argument. | +---------------------+----------------------------------------------------+ | gather(self) | gather messages from a source, returns a list of | | | messages. | +| | can also return a tuple where the first element | +| | is a boolean flag keep_going indicating whether | +| | to stop gather processing. | +| | | +---------------------+----------------------------------------------------+ | | Called every housekeeping interval (minutes) | | | used to clean cache, check for occasional issues. | diff --git a/docs/source/How2Guides/FlowCallbacks.rst b/docs/source/How2Guides/FlowCallbacks.rst index 8469f2412..876a92f9e 100644 --- a/docs/source/How2Guides/FlowCallbacks.rst +++ b/docs/source/How2Guides/FlowCallbacks.rst @@ -215,7 +215,11 @@ Other entry_points, extracted from sarracenia/flowcb/__init__.py :: def gather(self): - Task: gather notification messages from a source... return a list of notification messages. + Task: gather notification messages from a source... return either: + * a list of notification messages, or + * a tuple, (bool:keep_going, list of messages) + * to curtail further gathers in this cycle. + return [] def metrics_report(self) -> dict: diff --git a/docs/source/fr/CommentFaire/FlowCallbacks.rst b/docs/source/fr/CommentFaire/FlowCallbacks.rst index ecf8fb931..70bff1dfe 100644 --- a/docs/source/fr/CommentFaire/FlowCallbacks.rst +++ b/docs/source/fr/CommentFaire/FlowCallbacks.rst @@ -182,6 +182,8 @@ Autres entry_points, extraits de sarracenia/flowcb/__init__.py :: def gather(self): Task: gather notification messages from a source... return a list of notification messages. + can also return tuple (keep_going, new_messages) where keep_going is a flag + that when False stops processing of further gather routines. return [] """ diff --git a/docs/source/fr/Explication/SarraPluginDev.rst b/docs/source/fr/Explication/SarraPluginDev.rst index d0e1056e5..0eb1ea4c1 100644 --- a/docs/source/fr/Explication/SarraPluginDev.rst +++ b/docs/source/fr/Explication/SarraPluginDev.rst @@ -554,6 +554,10 @@ pour des informations détaillées sur les signatures d’appel et les valeurs d +---------------------+----------------------------------------------------+ | gather(self) | Rassembler les messages a la source, retourne une | | | une liste de messages. | +| | on peut également retourner un tuple dont le | +| | première élément est une valeur booléen keep_going | +| | qui peut arreter l´execution des gather. | +| | | +---------------------+----------------------------------------------------+ | | Appelé à chaque intervalle housekeeping (minutes). | | | utilisé pour nettoyer le cache, vérifier les | From 3e4ba34c0efa600ba9fef274127b2f298f005228 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 23:22:15 -0400 Subject: [PATCH 039/246] Adding initial run on polls with scheduled intervals --- sarracenia/flowcb/scheduled/__init__.py | 5 +++++ sarracenia/flowcb/scheduled/poll.py | 4 +++- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/sarracenia/flowcb/scheduled/__init__.py b/sarracenia/flowcb/scheduled/__init__.py index acc518bda..e196b98d4 100644 --- a/sarracenia/flowcb/scheduled/__init__.py +++ b/sarracenia/flowcb/scheduled/__init__.py @@ -86,6 +86,7 @@ def __init__(self,options,logger=logger): now=datetime.datetime.fromtimestamp(time.time(),datetime.timezone.utc) self.update_appointments(now) + self.first_interval=True def gather(self,messageCountMax): @@ -166,6 +167,10 @@ def wait_until( self, appointment ): def wait_until_next( self ): if self.o.scheduled_interval > 0: + if self.first_interval: + self.first_interval=False + return + self.wait_seconds(datetime.timedelta(seconds=self.o.scheduled_interval)) return diff --git a/sarracenia/flowcb/scheduled/poll.py b/sarracenia/flowcb/scheduled/poll.py index c19be929c..92ef77b79 100644 --- a/sarracenia/flowcb/scheduled/poll.py +++ b/sarracenia/flowcb/scheduled/poll.py @@ -52,4 +52,6 @@ def gather(self,messageCountMax): # placeholder me = Poll(flow.o) me.gather(flow.o.batch) - logger.info("Done") + logger.info("first done") + me.gather(flow.o.batch) + logger.info("Second Done") From d4b006a0c3179dbcd4ebd5315b9a3c3ad2d1a3a9 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 23:34:46 -0400 Subject: [PATCH 040/246] fix bug where using localtime instead of utc can cause infinite loop --- sarracenia/flowcb/scheduled/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sarracenia/flowcb/scheduled/__init__.py b/sarracenia/flowcb/scheduled/__init__.py index e196b98d4..2507ae884 100644 --- a/sarracenia/flowcb/scheduled/__init__.py +++ b/sarracenia/flowcb/scheduled/__init__.py @@ -184,7 +184,7 @@ def wait_until_next( self ): if next_appointment is None: # done for the day... - tomorrow = datetime.date.today()+datetime.timedelta(days=1) + tomorrow = datetime.datetime.fromtimestamp(time.time(),datetime.timezone.utc)+datetime.timedelta(days=1) midnight = datetime.time(0,0,tzinfo=datetime.timezone.utc) midnight = datetime.datetime.combine(tomorrow,midnight) self.update_appointments(midnight) From 9ab99e5d18a691b97851cc69c9294451503d28e9 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 23:47:37 -0400 Subject: [PATCH 041/246] notice when appointments are in the past --- sarracenia/flowcb/scheduled/__init__.py | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/sarracenia/flowcb/scheduled/__init__.py b/sarracenia/flowcb/scheduled/__init__.py index 2507ae884..d2fd6d2de 100644 --- a/sarracenia/flowcb/scheduled/__init__.py +++ b/sarracenia/flowcb/scheduled/__init__.py @@ -177,10 +177,18 @@ def wait_until_next( self ): if ( len(self.o.scheduled_hour) > 0 ) or ( len(self.o.scheduled_minute) > 0 ): now = datetime.datetime.fromtimestamp(time.time(),datetime.timezone.utc) next_appointment=None + missed_appointments=[] for t in self.appointments: if now < t: next_appointment=t break + else: + logger.info( f'already too late to {t} skipping' ) + missed_appointments.append(t) + + if missed_appointments: + for ma in missed_appointments: + self.appointments.remove(ma) if next_appointment is None: # done for the day... From 71fe41d9e52947282398c1d0132771a778275933 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 14:34:08 -0400 Subject: [PATCH 042/246] refactoring Flow/run() to simplify --- sarracenia/flow/__init__.py | 158 ++++++++++++++++++------------------ 1 file changed, 79 insertions(+), 79 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index da5bbc4e6..c26a39585 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -470,8 +470,6 @@ def run(self): if not stopping: self.gather() - else: - self.worklist.incoming = [] last_gather_len = len(self.worklist.incoming) if (last_gather_len == 0): @@ -481,21 +479,6 @@ def run(self): spamming = False self.filter() - self._runCallbacksWorklist('after_accept') - - logger.debug( - 'B filtered incoming: %d, ok: %d (directories: %d), rejected: %d, failed: %d stop_requested: %s have_vip: %s' - % (len(self.worklist.incoming), len( - self.worklist.ok), len(self.worklist.directories_ok), - len(self.worklist.rejected), len( - self.worklist.failed), self._stop_requested, - self.have_vip)) - - self.ack(self.worklist.ok) - self.worklist.ok = [] - self.ack(self.worklist.rejected) - self.worklist.rejected = [] - self.ack(self.worklist.failed) # this for duplicate cache synchronization. if self.worklist.poll_catching_up: @@ -517,65 +500,7 @@ def run(self): os.unlink( self.o.novipFilename ) # normal processing, when you are active. - self.do() - - # need to acknowledge here, because posting will delete message-id - self.ack(self.worklist.ok) - self.ack(self.worklist.rejected) - self.ack(self.worklist.failed) - - # adjust message after action is done, but before 'after_work' so adjustment is possible. - for m in self.worklist.ok: - if ('new_baseUrl' in m) and (m['baseUrl'] != - m['new_baseUrl']): - m['old_baseUrl'] = m['baseUrl'] - m['_deleteOnPost'] |= set(['old_baseUrl']) - m['baseUrl'] = m['new_baseUrl'] - if ('new_retrievePath' in m) : - m['old_retrievePath'] = m['retrievePath'] - m['retrievePath'] = m['new_retrievePath'] - m['_deleteOnPost'] |= set(['old_retrievePath']) - - # if new_file does not match relPath, then adjust relPath so it does. - if 'relPath' in m and m['new_file'] != m['relPath'].split('/')[-1]: - if not 'new_relPath' in m: - if len(m['relPath']) > 1: - m['new_relPath'] = '/'.join( m['relPath'].split('/')[0:-1] + [ m['new_file'] ]) - else: - m['new_relPath'] = m['new_file'] - else: - if len(m['new_relPath']) > 1: - m['new_relPath'] = '/'.join( m['new_relPath'].split('/')[0:-1] + [ m['new_file'] ] ) - else: - m['new_relPath'] = m['new_file'] - - if ('new_relPath' in m) and (m['relPath'] != m['new_relPath']): - m['old_relPath'] = m['relPath'] - m['_deleteOnPost'] |= set(['old_relPath']) - m['relPath'] = m['new_relPath'] - m['old_subtopic'] = m['subtopic'] - m['_deleteOnPost'] |= set(['old_subtopic','subtopic']) - m['subtopic'] = m['new_subtopic'] - - if '_format' in m: - m['old_format'] = m['_format'] - m['_deleteOnPost'] |= set(['old_format']) - m['_format'] = m['post_format'] - - # restore adjustment to fileOp - if 'post_fileOp' in m: - m['fileOp'] = m['post_fileOp'] - - if self.o.download and 'retrievePath' in m: - # retrieve paths do not propagate after download. - del m['retrievePath'] - - - self._runCallbacksWorklist('after_work') - - self.ack(self.worklist.rejected) - self.worklist.rejected = [] - self.ack(self.worklist.failed) + self.work() if len(self.plugins["post"]) > 0: self.post() @@ -1086,9 +1011,21 @@ def filter(self) -> None: self.reject(m, 304, "unmatched pattern %s" % url) self.worklist.incoming = filtered_worklist - logger.debug( - 'end len(incoming)=%d, rejected=%d' % - (len(self.worklist.incoming), len(self.worklist.rejected))) + + logger.debug( 'end len(incoming)=%d, rejected=%d' % (len(self.worklist.incoming), len(self.worklist.rejected))) + + self._runCallbacksWorklist('after_accept') + + logger.debug( 'B filtered incoming: %d, ok: %d (directories: %d), rejected: %d, failed: %d stop_requested: %s have_vip: %s' + % (len(self.worklist.incoming), len(self.worklist.ok), len(self.worklist.directories_ok), + len(self.worklist.rejected), len(self.worklist.failed), self._stop_requested, self.have_vip)) + + self.ack(self.worklist.ok) + self.worklist.ok = [] + self.ack(self.worklist.rejected) + self.worklist.rejected = [] + self.ack(self.worklist.failed) + def gather(self) -> None: so_far=0 @@ -1150,6 +1087,69 @@ def do(self) -> None: logger.debug('processing %d messages worked!' % len(self.worklist.ok)) + def work(self) -> None: + + self.do() + + # need to acknowledge here, because posting will delete message-id + self.ack(self.worklist.ok) + self.ack(self.worklist.rejected) + self.ack(self.worklist.failed) + + # adjust message after action is done, but before 'after_work' so adjustment is possible. + for m in self.worklist.ok: + if ('new_baseUrl' in m) and (m['baseUrl'] != + m['new_baseUrl']): + m['old_baseUrl'] = m['baseUrl'] + m['_deleteOnPost'] |= set(['old_baseUrl']) + m['baseUrl'] = m['new_baseUrl'] + if ('new_retrievePath' in m) : + m['old_retrievePath'] = m['retrievePath'] + m['retrievePath'] = m['new_retrievePath'] + m['_deleteOnPost'] |= set(['old_retrievePath']) + + # if new_file does not match relPath, then adjust relPath so it does. + if 'relPath' in m and m['new_file'] != m['relPath'].split('/')[-1]: + if not 'new_relPath' in m: + if len(m['relPath']) > 1: + m['new_relPath'] = '/'.join( m['relPath'].split('/')[0:-1] + [ m['new_file'] ]) + else: + m['new_relPath'] = m['new_file'] + else: + if len(m['new_relPath']) > 1: + m['new_relPath'] = '/'.join( m['new_relPath'].split('/')[0:-1] + [ m['new_file'] ] ) + else: + m['new_relPath'] = m['new_file'] + + if ('new_relPath' in m) and (m['relPath'] != m['new_relPath']): + m['old_relPath'] = m['relPath'] + m['_deleteOnPost'] |= set(['old_relPath']) + m['relPath'] = m['new_relPath'] + m['old_subtopic'] = m['subtopic'] + m['_deleteOnPost'] |= set(['old_subtopic','subtopic']) + m['subtopic'] = m['new_subtopic'] + + if '_format' in m: + m['old_format'] = m['_format'] + m['_deleteOnPost'] |= set(['old_format']) + m['_format'] = m['post_format'] + + # restore adjustment to fileOp + if 'post_fileOp' in m: + m['fileOp'] = m['post_fileOp'] + + if self.o.download and 'retrievePath' in m: + # retrieve paths do not propagate after download. + del m['retrievePath'] + + self._runCallbacksWorklist('after_work') + + self.ack(self.worklist.rejected) + self.worklist.rejected = [] + self.ack(self.worklist.failed) + + + def post(self) -> None: # work-around for python3.5 not being able to copy re.match issue: From ac9b1026f4b260d256a7815a68971bf96e31bfe4 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 14:51:18 -0400 Subject: [PATCH 043/246] refactoring run further to make it shorter --- sarracenia/flow/__init__.py | 99 ++++++++++++++++++------------------- 1 file changed, 48 insertions(+), 51 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index c26a39585..e737af125 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -451,23 +451,20 @@ def run(self): if self._stop_requested: if stopping: logger.info('clean stop from run loop') - self.close() break else: - logger.info( - 'starting last pass (without gather) through loop for cleanup.' - ) + logger.info( 'starting last pass (without gather) through loop for cleanup.') stopping = True self.have_vip = self.has_vip() + self.worklist.incoming = [] + if (self.o.component == 'poll') or self.have_vip: if ( self.o.messageRateMax > 0 ) and (current_rate > 0.8*self.o.messageRateMax ): logger.info("current_rate (%.2f) vs. messageRateMax(%.2f)) " % (current_rate, self.o.messageRateMax)) - self.worklist.incoming = [] - if not stopping: self.gather() @@ -501,39 +498,7 @@ def run(self): # normal processing, when you are active. self.work() - - if len(self.plugins["post"]) > 0: - self.post() - self._runCallbacksWorklist('after_post') - - self._runCallbacksWorklist('report') - self._runCallbackMetrics() - - if hasattr(self.o, 'metricsFilename' ) and os.path.isdir(os.path.dirname(self.o.metricsFilename)): - metrics=json.dumps(self.metrics) - with open(self.o.metricsFilename, 'w') as mfn: - mfn.write(metrics+"\n") - if self.o.logMetrics: - if self.o.logRotateInterval >= 24*60*60: - tslen=8 - elif self.o.logRotateInterval > 60: - tslen=14 - else: - tslen=16 - timestamp=time.strftime("%Y%m%d-%H%M%S", time.gmtime()) - with open(self.o.metricsFilename + '.' + timestamp[0:tslen], 'a') as mfn: - mfn.write( f'\"{timestamp}\" : {metrics},\n') - - # removing old metrics files - logger.info( f"looking for old metrics for {self.o.metricsFilename}" ) - old_metrics=sorted(glob.glob(self.o.metricsFilename+'.*'))[0:-self.o.logRotateCount] - for o in old_metrics: - logger.info( f"removing old metrics file: {o} " ) - os.unlink(o) - - self.worklist.ok = [] - self.worklist.directories_ok = [] - self.worklist.failed = [] + self.post() now = nowflt() run_time = now - start_time @@ -1152,19 +1117,51 @@ def work(self) -> None: def post(self) -> None: - # work-around for python3.5 not being able to copy re.match issue: - # https://github.com/MetPX/sarracenia/issues/857 - if sys.version_info.major == 3 and sys.version_info.minor <= 6: - for m in self.worklist.ok: - if '_matches' in m: - del m['_matches'] + if len(self.plugins["post"]) > 0: - for p in self.plugins["post"]: - try: - p(self.worklist) - except Exception as ex: - logger.error( f'flowCallback plugin {p} crashed: {ex}' ) - logger.debug( "details:", exc_info=True ) + # work-around for python3.5 not being able to copy re.match issue: + # https://github.com/MetPX/sarracenia/issues/857 + if sys.version_info.major == 3 and sys.version_info.minor <= 6: + for m in self.worklist.ok: + if '_matches' in m: + del m['_matches'] + + for p in self.plugins["post"]: + try: + p(self.worklist) + except Exception as ex: + logger.error( f'flowCallback plugin {p} crashed: {ex}' ) + logger.debug( "details:", exc_info=True ) + + self._runCallbacksWorklist('after_post') + self._runCallbacksWorklist('report') + self._runCallbackMetrics() + + if hasattr(self.o, 'metricsFilename' ) and os.path.isdir(os.path.dirname(self.o.metricsFilename)): + metrics=json.dumps(self.metrics) + with open(self.o.metricsFilename, 'w') as mfn: + mfn.write(metrics+"\n") + if self.o.logMetrics: + if self.o.logRotateInterval >= 24*60*60: + tslen=8 + elif self.o.logRotateInterval > 60: + tslen=14 + else: + tslen=16 + timestamp=time.strftime("%Y%m%d-%H%M%S", time.gmtime()) + with open(self.o.metricsFilename + '.' + timestamp[0:tslen], 'a') as mfn: + mfn.write( f'\"{timestamp}\" : {metrics},\n') + + # removing old metrics files + logger.info( f"looking for old metrics for {self.o.metricsFilename}" ) + old_metrics=sorted(glob.glob(self.o.metricsFilename+'.*'))[0:-self.o.logRotateCount] + for o in old_metrics: + logger.info( f"removing old metrics file: {o} " ) + os.unlink(o) + + self.worklist.ok = [] + self.worklist.directories_ok = [] + self.worklist.failed = [] def write_inline_file(self, msg) -> bool: """ From 32b2554627e769f865ee088ea353302244982c0f Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 17:23:41 -0400 Subject: [PATCH 044/246] more run refactoring, trying to get it shorter --- sarracenia/flow/__init__.py | 47 +++++++++++++++++++++++-------------- 1 file changed, 30 insertions(+), 17 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index e737af125..473656a1f 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -402,6 +402,27 @@ def ack(self, mlist) -> None: logger.error( f'flowCallback plugin {p}/ack crashed: {ex}' ) logger.debug( "details:", exc_info=True ) + def _run_vip_update(self, had_vip) -> bool: + + self.have_vip = self.has_vip() + retval=had_vip + if (self.o.component == 'poll') and not self.have_vip: + if had_vip: + logger.info("now passive on vips %s" % self.o.vip ) + with open( self.o.novipFilename, 'w' ) as f: + f.write(str(nowflt()) + '\n' ) + retval=False + else: + if not had_vip: + logger.info("now active on vip %s" % self.have_vip ) + retval=True + if os.path.exists( self.o.novipFilename ): + os.unlink( self.o.novipFilename ) + return retval + + + + def run(self): """ This is the core routine of the algorithm, with most important data driven @@ -457,7 +478,11 @@ def run(self): logger.info( 'starting last pass (without gather) through loop for cleanup.') stopping = True - self.have_vip = self.has_vip() + if now > next_housekeeping or stopping: + next_housekeeping = self._runHousekeeping(now) + + had_vip = self._run_vip_update(had_vip) + self.worklist.incoming = [] if (self.o.component == 'poll') or self.have_vip: @@ -483,22 +508,10 @@ def run(self): self.worklist.incoming = [] continue - if (self.o.component == 'poll') and not self.have_vip: - if had_vip: - logger.info("now passive on vips %s" % self.o.vip ) - with open( self.o.novipFilename, 'w' ) as f: - f.write(str(nowflt()) + '\n' ) - had_vip=False - else: - if not had_vip: - logger.info("now active on vip %s" % self.have_vip ) - had_vip=True - if os.path.exists( self.o.novipFilename ): - os.unlink( self.o.novipFilename ) - - # normal processing, when you are active. - self.work() - self.post() + + # normal processing, when you are active. + self.work() + self.post() now = nowflt() run_time = now - start_time From 06fa2d36089634a02d9bd82c32a22cadc1499a44 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 19:07:47 -0400 Subject: [PATCH 045/246] move on_start to save some vip check logic --- sarracenia/flow/__init__.py | 31 +++++++++++-------------------- 1 file changed, 11 insertions(+), 20 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index 473656a1f..0cdf364a7 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -211,6 +211,7 @@ def __init__(self, cfg=None): # metrics - dictionary with names of plugins as the keys self.metricsFlowReset() + self.had_vip = False def metricsFlowReset(self) -> None: @@ -402,23 +403,21 @@ def ack(self, mlist) -> None: logger.error( f'flowCallback plugin {p}/ack crashed: {ex}' ) logger.debug( "details:", exc_info=True ) - def _run_vip_update(self, had_vip) -> bool: + def _run_vip_update(self) -> bool: self.have_vip = self.has_vip() - retval=had_vip if (self.o.component == 'poll') and not self.have_vip: - if had_vip: + if self.had_vip: logger.info("now passive on vips %s" % self.o.vip ) with open( self.o.novipFilename, 'w' ) as f: f.write(str(nowflt()) + '\n' ) - retval=False + self.had_vip=False else: - if not had_vip: + if not self.had_vip: logger.info("now active on vip %s" % self.have_vip ) - retval=True + self.had_vip=True if os.path.exists( self.o.novipFilename ): os.unlink( self.o.novipFilename ) - return retval @@ -440,7 +439,7 @@ def run(self): current_rate = 0 total_messages = 1 start_time = nowflt() - had_vip = False + now=start_time current_sleep = self.o.sleep last_time = start_time self.metrics['flow']['last_housekeeping'] = start_time @@ -453,15 +452,6 @@ def run(self): logger.info( f'pid: {os.getpid()} {self.o.component}/{self.o.config} instance: {self.o.no}' ) - if not self.has_vip(): - logger.info( f'starting up passive, as do not possess any vip from: {self.o.vip}' ) - with open( self.o.novipFilename, 'w' ) as f: - f.write(str(start_time) + '\n' ) - else: - if os.path.exists( self.o.novipFilename ): - os.unlink( self.o.novipFilename ) - - self.runCallbacksTime(f'on_start') spamming = True last_gather_len = 0 @@ -478,10 +468,12 @@ def run(self): logger.info( 'starting last pass (without gather) through loop for cleanup.') stopping = True + self._run_vip_update() + if now > next_housekeeping or stopping: next_housekeeping = self._runHousekeeping(now) - - had_vip = self._run_vip_update(had_vip) + elif now == start_time: + self.runCallbacksTime(f'on_start') self.worklist.incoming = [] @@ -508,7 +500,6 @@ def run(self): self.worklist.incoming = [] continue - # normal processing, when you are active. self.work() self.post() From 52219cd2194681826df755fd2deb2b34ae89f0ad Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 23:10:31 -0400 Subject: [PATCH 046/246] fixing indenting of code block moved in last commit --- sarracenia/flow/__init__.py | 29 +++++++++++++---------------- 1 file changed, 13 insertions(+), 16 deletions(-) diff --git a/sarracenia/flow/__init__.py b/sarracenia/flow/__init__.py index 0cdf364a7..e20b33f27 100644 --- a/sarracenia/flow/__init__.py +++ b/sarracenia/flow/__init__.py @@ -405,22 +405,19 @@ def ack(self, mlist) -> None: def _run_vip_update(self) -> bool: - self.have_vip = self.has_vip() - if (self.o.component == 'poll') and not self.have_vip: - if self.had_vip: - logger.info("now passive on vips %s" % self.o.vip ) - with open( self.o.novipFilename, 'w' ) as f: - f.write(str(nowflt()) + '\n' ) - self.had_vip=False - else: - if not self.had_vip: - logger.info("now active on vip %s" % self.have_vip ) - self.had_vip=True - if os.path.exists( self.o.novipFilename ): - os.unlink( self.o.novipFilename ) - - - + self.have_vip = self.has_vip() + if (self.o.component == 'poll') and not self.have_vip: + if self.had_vip: + logger.info("now passive on vips %s" % self.o.vip ) + with open( self.o.novipFilename, 'w' ) as f: + f.write(str(nowflt()) + '\n' ) + self.had_vip=False + else: + if not self.had_vip: + logger.info("now active on vip %s" % self.have_vip ) + self.had_vip=True + if os.path.exists( self.o.novipFilename ): + os.unlink( self.o.novipFilename ) def run(self): """ From 8596b76c873ae1d063b77cb920a6612c5021e566 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Thu, 21 Mar 2024 08:31:55 -0400 Subject: [PATCH 047/246] remove do stub, same as parent now --- sarracenia/flow/poll.py | 17 ----------------- 1 file changed, 17 deletions(-) diff --git a/sarracenia/flow/poll.py b/sarracenia/flow/poll.py index bbdf16b9a..bd5c80ba1 100644 --- a/sarracenia/flow/poll.py +++ b/sarracenia/flow/poll.py @@ -81,20 +81,3 @@ def __init__(self, options): if not features['ftppoll']['present']: if hasattr( self.o, 'pollUrl' ) and ( self.o.pollUrl.startswith('ftp') ): logger.critical( f"attempting to configure an FTP poll pollUrl={self.o.pollUrl}, but missing python modules: {' '.join(features['ftppoll']['modules_needed'])}" ) - - def do(self): - """ - stub to do the work: does nothing, marking everything done. - to be replaced in child classes that do transforms or transfers. - """ - - # mark all remaining messages as rejected. - if self.worklist.poll_catching_up: - # in catchup mode, just reading previously posted messages. - self.worklist.rejected = self.worklist.incoming - else: - self.worklist.ok = self.worklist.incoming - - logger.debug('processing %d messages worked! (stop requested: %s)' % - (len(self.worklist.incoming), self._stop_requested)) - self.worklist.incoming = [] From c41638899d2265970e51fe7d86c42c2a606de74e Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 15:02:02 -0400 Subject: [PATCH 048/246] #986 remove the convert in config.py already done in convert logic --- sarracenia/config.py | 2 -- 1 file changed, 2 deletions(-) diff --git a/sarracenia/config.py b/sarracenia/config.py index 3cf97b0bc..8267d2965 100755 --- a/sarracenia/config.py +++ b/sarracenia/config.py @@ -1447,8 +1447,6 @@ def parse_file(self, cfg, component=None): k = 'sendTo' elif k == 'broker' and component == 'poll' : k = 'post_broker' - elif k == 'directory' and component == 'poll' : - k = 'path' if (k in convert_to_v3): self.log_flowcb_needed |= '_log' in k From a9a3bffcb97cd4126f4b7ffaa9b0253767b6135f Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Tue, 19 Mar 2024 18:58:26 -0400 Subject: [PATCH 049/246] updating poll documentation to use path instead of directory --- docs/source/Explanation/CommandLineGuide.rst | 32 +++++----------- .../fr/Explication/GuideLigneDeCommande.rst | 37 ++++++------------- 2 files changed, 21 insertions(+), 48 deletions(-) diff --git a/docs/source/Explanation/CommandLineGuide.rst b/docs/source/Explanation/CommandLineGuide.rst index 9133b1ca5..42afb424b 100644 --- a/docs/source/Explanation/CommandLineGuide.rst +++ b/docs/source/Explanation/CommandLineGuide.rst @@ -934,8 +934,8 @@ POLLING Polling is doing the same job as a post, except for files on a remote server. In the case of a poll, the post will have its url built from the *pollUrl* -option, with the product's path (*directory*/"matched file"). There is one -post per file. The file's size is taken from the directory "ls"... but its +option, with the product's path (*path*/"matched file"). There is one +post per file. The file's size is taken from the directory "ls"... but its checksum cannot be determined, so the default identity method is "cod", asking clients to calculate the identity Checksum On Download. @@ -946,11 +946,10 @@ It can be given incomplete if it is well defined in the credentials.conf file. Refer to `sr3_post(1) <../Reference/sr3_post.1.html>`_ - to understand the complete notification process. Refer to `sr_post(7) <../Reference/sr_post.7.html>`_ - to understand the complete notification format. - These options set what files the user wants to be notified for and where it will be placed, and under which name. -- **directory (default: .)** +- **path (default: .)** - **accept [rename=] (must be set)** - **reject (optional)** - **permDefault (default: 0o400)** @@ -959,15 +958,7 @@ These options set what files the user wants to be notified for and where nodupe_fileAgeMax should be less than nodupe_ttl when using duplicate suppression, to avoid re-ingesting of files that have aged out of the nodupe cache. -The option *filename* can be used to set a global rename to the products. -Ex.: - -**filename rename=/naefs/grib2/** - -For all posts created, the *rename* option would be set to '/naefs/grib2/filename' -because I specified a directory (path that ends with /). - -The option *directory* defines where to get the files on the server. +The option *path* defines where to get the files on the server. Combined with **accept** / **reject** options, the user can select the files of interest and their directories of residence. @@ -975,12 +966,8 @@ The **accept** and **reject** options use regular expressions (regexp) to ma These options are processed sequentially. The URL of a file that matches a **reject** pattern is not published. Files matching an **accept** pattern are published. -Again a *rename* can be added to the *accept* option... matching products -for that *accept* option would get renamed as described... unless the *accept* matches -one file, the *rename* option should describe a directory into which the files -will be placed (prepending instead of replacing the file name). -The directory can have some patterns. These supported patterns concern date/time . +The path can have some patterns. These supported patterns concern date/time . They are fixed... **${YYYY} current year** @@ -995,14 +982,13 @@ They are fixed... :: - ex. directory /mylocaldirectory/myradars - accept .*RADAR.* + ex. path /mylocaldirectory/myradars + path /mylocaldirectory/mygribs + path /mylocaldirectory/${YYYYMMDD}/mydailies - directory /mylocaldirectory/mygribs + accept .*RADAR.* reject .*Reg.* accept .*GRIB.* - - directory /mylocaldirectory/${YYYYMMDD}/mydailies accept .*observations.* The **permDefault** option allows users to specify a linux-style numeric octal diff --git a/docs/source/fr/Explication/GuideLigneDeCommande.rst b/docs/source/fr/Explication/GuideLigneDeCommande.rst index a05d22dc7..89b91a635 100644 --- a/docs/source/fr/Explication/GuideLigneDeCommande.rst +++ b/docs/source/fr/Explication/GuideLigneDeCommande.rst @@ -941,9 +941,9 @@ SONDAGE (POLLING) On peut faire le même travail que post, sauf que les fichiers sont sur un serveur distant. Dans le cas d’un sondage (en anglais: poll), l’URL de la publication sera générée à partir de l´option *pollUrl*, -avec le chemin d’accès du produit (*directory*/« fichier correspondant »). Il y en a une publication +avec le chemin d’accès du produit (*path* « fichier correspondant »). Il y en a une publication par fichier. La taille du fichier est prise dans le répertoire « ls »... mais sa somme -de contrôle ne peut pas être déterminée, lors la stratégie de calcul de est ¨cod¨ qui signifie +de contrôle ne peut pas être déterminée, alors la stratégie de calcul de est ¨cod¨ qui signifie que ca devrait être calculé lors du transfert. Par défaut, sr_poll envoie son message de publication au courtier avec l'échange par défaut @@ -956,7 +956,7 @@ Référez `sr3_post(7) <../Reference/sr3_post.7.html>`_ - pour comprendre le for Ces options définissent les fichiers pour lesquels l’utilisateur souhaite être averti et où il sera placé, et sous quel nom. -- **directory (par défaut: .)** +- **path (par défaut: .)** - **accept [rename=] (doit être défini)** - **reject (facultatif)** - **permDefault (par défaut: 0o400)** @@ -965,15 +965,7 @@ Ces options définissent les fichiers pour lesquels l’utilisateur souhaite êt fileAgeMax doit être inférieur à nodupe_ttl lors de l'utilisation de la suppression des doublons, pour éviter la réingestion de fichiers obsolètes une fois partie du cache nodupe. -L’option *filename* peut être utilisée pour définir un changement de nom global pour les produits. -Ex.: - -**filename rename=/naefs/grib2/** - -Pour tous les messages créés, l’option *rename* serait définie à '/naefs/grib2/filename' -parce que j’ai spécifié un répertoire (chemin qui se termine par /). - -L’option *directory* définit où obtenir les fichiers sur le serveur. +L’option *path* définit où obtenir les fichiers sur le serveur. Combiné avec les options **accept** / **reject**, l’utilisateur peut sélectionner les fichiers d’intérêt et leurs répertoires de résidence. @@ -982,10 +974,6 @@ une correspondance avec l’URL. Ces options sont traitées séquentiellement. L’URL d’un fichier qui correspond à un modèle **reject** n’est pas publiée. Les fichiers correspondant à un modèle **accept** sont publiés. -Encore une fois, un *rename* peut être ajouté à l’option *accept*... les produits qui correspondent -a l'option *accept* seront renommé comme décrit... à moins que le *accept* corresponde à -un fichier, l’option *rename* doit décrire un répertoire dans lequel les fichiers -seront placé (en préfix au lieu de remplacer le nom du fichier). Le répertoire peut avoir des modèles. Ces modèles pris en charge concernent la date/l’heure. Ils sont fixes... @@ -1002,14 +990,14 @@ Ils sont fixes... :: - ex. directory /mylocaldirectory/myradars - accept .*RADAR.* + ex. path /mylocaldirectory/myradars + path /mylocaldirectory/mygribs + path /mylocaldirectory/${YYYYMMDD}/mydailies - directory /mylocaldirectory/mygribs + + accept .*RADAR.* reject .*Reg.* accept .*GRIB.* - - directory /mylocaldirectory/${YYYYMMDD}/mydailies accept .*observations.* L’option **permDefault** permet aux utilisateurs de spécifier un masque d'autorisation octal numérique @@ -1023,10 +1011,9 @@ Les options **permDefault** spécifient un masque, c’est-à-dire que les autor au moins ce qui est spécifié. Comme pour tous les autres composants, l’option **vip** peut être utilisée pour indiquer -qu’un poll doit être actif sur seulement un seul nœud d’un cluster. Notez que quand -d’autres nœuds participant au poll et wu’ils n’ont pas le vip, ils +qu’un poll doit être actif sur seulement un seul nœud d’un cluster. -les fichiers qui sont plus vieux que fileAgeMax sont ignorés. Cela +Les fichiers qui sont plus vieux que fileAgeMax sont ignorés. Cela peut être modifié à n’importe quelle limite de temps spécifiée dans les configurations en utilisant l’option *fileAgeMax *. Par défaut, dans les composants autre que poll, cette option est désactivé en étant défini à zéro (0). Comme il s’agit d’une @@ -1118,7 +1105,7 @@ informe qu'il y a nouveau produit. Le protocle de notification est défini ici `sr3_post(7) <../Reference/sr3_post.7.html>`_ **poll** se connecte à un *broker*. À toutes les secondes de *sleep*, il se connecte à -une *pollUrl* (sftp, ftp, ftps). Pour chacun des *directory* définis, les contenus sont listés. +une *pollUrl* (sftp, ftp, ftps). Pour chacun des *path* définis, les contenus sont listés. Le poll est seulement destinée à être utilisée pour les fichiers récemment modifiés. L’option *fileAgeMax* élimine les fichiers trop anciens. Lorsqu’un fichier correspondant à un modèle donné est trouvé by *accept*, **poll** crée un message de notification pour ce produit. From 1d4f5a55beca47bfd757024a67c2236590059536 Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 09:19:24 -0400 Subject: [PATCH 050/246] info message about directory option when it does not do anything --- sarracenia/config.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/sarracenia/config.py b/sarracenia/config.py index 8267d2965..e78b6eb01 100755 --- a/sarracenia/config.py +++ b/sarracenia/config.py @@ -1638,6 +1638,9 @@ def parse_file(self, cfg, component=None): logger.error( f'{self.files}:{lineno} invalid entry for {k}: {i}. Must be one of: {set_choices[k]}' ) elif k in str_options: + if ( k == 'directory' ) and not self.download: + logger.info( f"{self.files}:{lineno} if download is false, directory has no effect" ) + v = ' '.join(line[1:]) if v == 'None': v=None From 20e7914aa4aebfc0ab6e9d3a042cc6181804a1de Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 09:48:54 -0400 Subject: [PATCH 051/246] updating release note --- docs/source/How2Guides/UPGRADING.rst | 8 ++++++++ docs/source/fr/CommentFaire/MiseANiveau.rst | 9 +++++++++ 2 files changed, 17 insertions(+) diff --git a/docs/source/How2Guides/UPGRADING.rst b/docs/source/How2Guides/UPGRADING.rst index 3611a1696..dc93d8283 100644 --- a/docs/source/How2Guides/UPGRADING.rst +++ b/docs/source/How2Guides/UPGRADING.rst @@ -39,6 +39,14 @@ Installation Instructions git --- +3.0.53 +------ + +*CHANGE*: *directory* option in poll will no longer be converted to *path* silently. +Use *path* explicitly instead. It is still converted when upgrading from v2 with +*sr3 convert*, but in v3 configurations, *directory* now acts as it does in all other +components as a download specifier. + 3.0.52 ------ diff --git a/docs/source/fr/CommentFaire/MiseANiveau.rst b/docs/source/fr/CommentFaire/MiseANiveau.rst index 48ee92d4c..faa9c9750 100644 --- a/docs/source/fr/CommentFaire/MiseANiveau.rst +++ b/docs/source/fr/CommentFaire/MiseANiveau.rst @@ -38,6 +38,15 @@ Instructions d’installation git --- +3.0.53 +------ + +*CHANGEMENT* : l'option *directory* dans le sondage ne sera plus convertie en *path* silencieusement. +Utilisez *path* explicitement à la place. Il est toujours converti lors de la mise à niveau depuis la v2 avec +*sr3 convert*, mais dans les configurations v3, *directory* agit désormais comme dans tous les autres +composants comme spécificateur de chemin de destination de téléchargement. + + 3.0.52 ------ From 9b7399d0adae4920ad3708f71dbbd08ea7b5836c Mon Sep 17 00:00:00 2001 From: Peter Silva Date: Wed, 20 Mar 2024 12:49:16 -0400 Subject: [PATCH 052/246] removing idiosyncratic poll rename logic, and some other dead code, and a fixing a typo about identity --- sarracenia/flowcb/poll/__init__.py | 50 +++--------------------------- 1 file changed, 4 insertions(+), 46 deletions(-) diff --git a/sarracenia/flowcb/poll/__init__.py b/sarracenia/flowcb/poll/__init__.py index 83d899402..a39c55bed 100755 --- a/sarracenia/flowcb/poll/__init__.py +++ b/sarracenia/flowcb/poll/__init__.py @@ -422,12 +422,11 @@ def lsdir(self): return False, {}, {} def poll_directory(self, pdir): + #logger.debug("poll_directory %s %s" % (pdir)) - npost = 0 msgs = [] # cd to that directory - logger.debug(" cd %s" % pdir) ok = self.cd(pdir) if not ok: return [] @@ -463,12 +462,6 @@ def poll_directory(self, pdir): def poll_file_post(self, desc, destDir, remote_file): - FileOption = None - for mask in self.pulllst: - pattern, maskDir, maskFileOption, mask_regexp, accepting, mirror, strip, pstrip, flatten = mask - if mask_regexp.match(remote_file) and accepting: - FileOption = maskFileOption - path = destDir + '/' + remote_file # posting a localfile @@ -539,26 +532,11 @@ def poll_file_post(self, desc, destDir, remote_file): # If there is a file operation, and it isn't a rename, then some fields are irrelevant/wrong. if 'fileOp' in msg and 'rename' not in msg['fileOp']: - if 'Identity' in msg: - del msg['Indentity'] + if 'identity' in msg: + del msg['identity'] if 'size' in msg: del msg['size'] - this_rename = self.o.rename - - # FIX ME generalized fileOption - if FileOption is not None: - parts = FileOption.split('=') - option = parts[0].strip() - if option == 'rename' and len(parts) == 2: - this_rename = parts[1].strip() - - if this_rename is not None and this_rename[-1] == '/': - this_rename += remote_file - - if this_rename is not None: - msg['rename'] = this_rename - return [msg] def poll_list_post(self, destDir, desclst, filelst): @@ -582,20 +560,12 @@ def poll_list_post(self, destDir, desclst, filelst): def poll(self) -> list: - # General Attributes - - self.pulllst = [] - msgs = [] - # number of post files - - npost = 0 - - # connection did not work try: self.dest.connect() except: + # connection did not work logger.error("sr_poll/post_new_url: unable to connect to %s" % self.o.pollUrl) logger.debug('Exception details: ', exc_info=True) @@ -604,20 +574,8 @@ def poll(self) -> list: time.sleep(nap) return [] - # loop on all directories where there are pulls to do - for destDir in self.o.path: - # setup of poll directory info - - #self.pulllst = self.pulls[destDir] - - #path = destDir - #path = path.replace('${', '') - #path = path.replace('}', '') - #path = path.replace('/', '_') - #lsPath = self.o.cfg_run_dir + os.sep + 'ls' + path - currentDir = self.o.variableExpansion(destDir) if currentDir == '': currentDir = destDir From 306c86df880754d871fa166ede900e4189a431a3 Mon Sep 17 00:00:00 2001 From: petersilva Date: Thu, 21 Mar 2024 16:31:26 -0400 Subject: [PATCH 053/246] documenting use of scheduled_ settings over sleep for polls --- docs/source/Explanation/CommandLineGuide.rst | 18 ++++++++++--- docs/source/Reference/sr3_options.7.rst | 26 +++++++++++++++++-- .../fr/Explication/GuideLigneDeCommande.rst | 13 +++++++++- docs/source/fr/Reference/sr3_options.7.rst | 24 +++++++++++++++++ 4 files changed, 75 insertions(+), 6 deletions(-) diff --git a/docs/source/Explanation/CommandLineGuide.rst b/docs/source/Explanation/CommandLineGuide.rst index 9133b1ca5..9a8e3d9a8 100644 --- a/docs/source/Explanation/CommandLineGuide.rst +++ b/docs/source/Explanation/CommandLineGuide.rst @@ -935,10 +935,22 @@ POLLING Polling is doing the same job as a post, except for files on a remote server. In the case of a poll, the post will have its url built from the *pollUrl* option, with the product's path (*directory*/"matched file"). There is one -post per file. The file's size is taken from the directory "ls"... but its +post per file. The file's size is taken from the directory "ls"... but its checksum cannot be determined, so the default identity method is "cod", asking clients to calculate the identity Checksum On Download. +To set when to poll, use the *scheduled_interval* or *scheduled_hour* and *scheduled_minute* +settings. for example:: + + scheduled_interval 30m + +to poll the remote resources every thirty minutes. Alternatively:: + + scheduled_hour 1,13,19 + scheduled_minute 27 + +specifies that poll be run at 1:27, 13:27, and 19:27 each day. + By default, sr_poll sends its post notification message to the broker with default exchange (the prefix *xs_* followed by the broker username). The *post_broker* is mandatory. It can be given incomplete if it is well defined in the credentials.conf file. @@ -946,7 +958,6 @@ It can be given incomplete if it is well defined in the credentials.conf file. Refer to `sr3_post(1) <../Reference/sr3_post.1.html>`_ - to understand the complete notification process. Refer to `sr_post(7) <../Reference/sr_post.7.html>`_ - to understand the complete notification format. - These options set what files the user wants to be notified for and where it will be placed, and under which name. @@ -1115,7 +1126,8 @@ notify about the new product. The notification protocol is defined here `sr_post(7) <../Reference/sr_post.7.html>`_ -**poll** connects to a *broker*. Every *sleep* seconds, it connects to +**poll** connects to a *broker*. Every *scheduled_interval* seconds (or can used +combination of *scheduled_hour* and *scheduled_minute*) , it connects to a *pollUrl* (sftp, ftp, ftps). For each of the *directory* defined, it lists the contents. Polling is only intended to be used for recently modified files. The *fileAgeMax* option eliminates files that are too old diff --git a/docs/source/Reference/sr3_options.7.rst b/docs/source/Reference/sr3_options.7.rst index 3ef81e96e..db4111bb3 100644 --- a/docs/source/Reference/sr3_options.7.rst +++ b/docs/source/Reference/sr3_options.7.rst @@ -1578,6 +1578,25 @@ sanity_log_dead (default: 1.5*housekeeping) The **sanity_log_dead** option sets how long to consider too long before restarting a component. +scheduled_interval,scheduled_hour,scheduled_minute +-------------------------------------------------- + +When working with scheduled flows, such as polls, one can configure a duration +(no units defaults to seconds, suffixes: m-minute, h-hour) at which to run a +given activity:: + + scheduled_interval 30 + +run the flow or poll every 30 seconds. If no duration is set, then the +flowcb.scheduled.Scheduled class will look for the other two time specifiers:: + + scheduled_hour 1,4,5,23 + scheduled_minute 14,17,29 + + +which will have the poll run each day at: 01:14, 01:17, 01:29, then the same minutes +after each of 4h, 5h and 23h. + shim_defer_posting_to_exit (EXPERIMENTAL) ----------------------------------------- @@ -1613,11 +1632,14 @@ shim_skip_parent_open_files (EXPERIMENTAL) sleep