Skip to content

Commit

Permalink
Fix
Browse files Browse the repository at this point in the history
  • Loading branch information
jarelllama authored Mar 22, 2024
1 parent 42a8544 commit f31f680
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 3 deletions.
4 changes: 1 addition & 3 deletions config/source_log.csv
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,5 @@ Time,Source,Item,Raw Count,Final Count,Whitelisted,Dead,Redundant,Toplist Count,
16:33:19 22-03-24,Google Search,"The shipment of your product is our highest priority and everyday we dispatch hundreds of products t...",0,0,0,0,0,0,,1,yes
16:33:19 22-03-24,Google Search,"Immediately, I realized there was something outstanding about Robert and his family, who’ve been bre...",0,0,0,0,0,0,,1,yes
16:33:19 22-03-24,Google Search,"We are an online retailer company. Our company sells thousands of products with guaranteed quality....",0,0,0,0,0,0,,1,yes
17:47:44 22-03-24,chainabuse.com,chainabuse.com,10,9,1,0,0,6,binance.com bitpay.com cex.io invity.io nexo.com paybis.com,0,no
17:47:44 22-03-24,dfpi.ca.gov,dfpi.ca.gov,135,133,2,0,0,1,antrush.com,0,no
18:12:04 22-03-24,Empty,Empty,135,133,2,0,0,0,,0,yes
18:12:04 22-03-24,Google Search,"*...",0,0,0,0,0,0,,0,yes
18:12:04 22-03-24,dfpi.ca.gov,dfpi.ca.gov,135,133,2,0,0,0,,0,yes
3 changes: 3 additions & 0 deletions retrieve.sh
Original file line number Diff line number Diff line change
Expand Up @@ -70,11 +70,14 @@ function retrieve_existing {
source="scam.directory" ;;
*scamadviser.com*)
source="scamadviser.com" ;;
*dfpi.ca.gov*)
source="dfpi.ca.gov" ;;
esac
[[ "$source" != 'Google Search' ]] && process_source "$source" "$source" "$temp_domains_file"
done
# Process Google search terms last
for temp_domains_file in data/pending/domains_google_search_*.tmp; do
[[ ! -f "$temp_domains_file" ]] && break
item=${temp_domains_file#data/pending/domains_google_search_} # Remove header from file name
item=${item%.tmp} # Remove file extension from file name
process_source "Google Search" "$item" "$temp_domains_file"
Expand Down

0 comments on commit f31f680

Please sign in to comment.