local queue variable undefined

[dax-westerman]

Within sequencer.py

clever-rockies/src/step2/sequencer.py

Lines 377 to 379 in 68972db

	if batch is None:
	self.queue.task_done()
	return

[dax-westerman]

Running step2.sh with --workers set to any value > 0 moves the code into a multithreaded mode. A reference to queue causes an error when hit, as it appears to be an un-initialized variable. Specifically, it's the line batch = queue.get(True) in the following:

def next_batch(self):
        if not isinstance(self.queue, str):
            try:
                batch = queue.get(True)
                if isinstance(batch, ExitProcess):
                    return None
                return batch
            except qmod.Empty:
                print("qmod empty")
                return []

Based on the code, it looks like this is a reference to the member variable self.queue.

I am trying this change in #83; if this resolves the issue, will update with comment here.

How to Replicate

Code called with the following:

python X:\_\Project - PERC\clever-rockies/src/step2/sequencer.py --lexicon "x:/_/Project - PERC/clever-rockies/res/dicts/dict.txt" --section-headers "x:/_/Project - PERC/clever-rockies/res/headers.txt" --main-targets LONELINESS --snippet-length 250 --snippets --notes "x:/_/Project - PERC/clever-rockies/tests/resources/test_notes/test_notes_with_metadata_one_line_tab_delim.txt" --workers 0 --output "x:/_/Project - PERC/clever-rockies/tests/output/LONELINESS" --left-gram-context 3 --right-gram-context 2 "

Results in infinite loop with error.