Skip to content

Commit

Permalink
listen to log error count
Browse files Browse the repository at this point in the history
  • Loading branch information
joergreichert committed Oct 11, 2023
1 parent 0ae8280 commit 97b23cb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion 1_read_paper_json.py
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,6 @@
process.crawl(crawler, **spargs)
process.start()

failed = crawler.stats.get_value('custom/failed_job')
failed = crawler.stats.get_value('log_count/ERROR')
if failed:
sys.exit(1)

0 comments on commit 97b23cb

Please sign in to comment.