Deezer artists not added

[friki67]

Hello. I have

addDeezerTopArtists=true
addDeezerTopAlbumArtists=true

but I'm getting no new artists. An extract of the log:

2023-05-24 02:45:29 :: AutoArtistAdder :: 1.0.008 :: Finding Top Album Artists...
2023-05-24 02:45:29 :: AutoArtistAdder :: 1.0.008 :: 10 Top Album Artists Found...
2023-05-24 02:45:31 :: AutoArtistAdder :: 1.0.008 :: 1 of 10 :: KoЯn :: Searching Musicbrainz for Deezer artist id (1327)
jq: error (at <stdin>:1): Cannot iterate over null (null)
2023-05-24 02:45:37 :: AutoArtistAdder :: 1.0.008 :: 1 of 10 :: KoЯn :: ERROR :: Artist is on import exclusion block list, skipping....
2023-05-24 02:45:40 :: AutoArtistAdder :: 1.0.008 :: 2 of 10 :: Raí Saia Rodada :: Searching Musicbrainz for Deezer artist id (13534745)
jq: error (at <stdin>:1): Cannot iterate over null (null)
2023-05-24 02:45:46 :: AutoArtistAdder :: 1.0.008 :: 2 of 10 :: Raí Saia Rodada :: ERROR :: Artist is on import exclusion block list, skipping....
2023-05-24 02:45:49 :: AutoArtistAdder :: 1.0.008 :: 3 of 10 :: AC/DC :: Searching Musicbrainz for Deezer artist id (115)
jq: error (at <stdin>:1): Cannot iterate over null (null)
2023-05-24 02:45:54 :: AutoArtistAdder :: 1.0.008 :: 3 of 10 :: AC/DC :: ERROR :: Artist is on import exclusion block list, skipping....
2023-05-24 02:45:57 :: AutoArtistAdder :: 1.0.008 :: 4 of 10 :: Megadriver :: Searching Musicbrainz for Deezer artist id (5680366)

What am I missing?

EDIT: Sorry I forgot the version etc

2023-05-24 09:18:50 :: Audio :: 1.0.311 :: -----------------------------------------------------------------------------
2023-05-24 09:18:50 :: Audio :: 1.0.311 ::  |~) _ ._ _| _ ._ _ |\ |o._ o _ |~|_|_|
2023-05-24 09:18:50 :: Audio :: 1.0.311 ::  |~\(_|| |(_|(_)| | || \||| |_|(_||~| | |<
2023-05-24 09:18:50 :: Audio :: 1.0.311 ::  Presents: lidarr-extended (1.0.311)
2023-05-24 09:18:50 :: Audio :: 1.0.311 ::  Docker Version: amd64-1.0.34
2023-05-24 09:18:50 :: Audio :: 1.0.311 ::  May the beats be with you!
2023-05-24 09:18:50 :: Audio :: 1.0.311 :: -----------------------------------------------------------------------------
2023-05-24 09:18:50 :: Audio :: 1.0.311 :: Donate: https://github.com/sponsors/RandomNinjaAtk
2023-05-24 09:18:50 :: Audio :: 1.0.311 :: Project: https://github.com/RandomNinjaAtk/docker-lidarr-extended
2023-05-24 09:18:50 :: Audio :: 1.0.311 :: Support: https://github.com/RandomNinjaAtk/docker-lidarr-extended/discussions
2023-05-24 09:18:50 :: Audio :: 1.0.311 :: -----------------------------------------------------------------------------
2023-05-24 09:18:55 :: Audio :: 1.0.311 ::
2023-05-24 09:18:55 :: Audio :: 1.0.311 :: Lift off in...
2023-05-24 09:18:56 :: Audio :: 1.0.311 :: 5
2023-05-24 09:18:57 :: Audio :: 1.0.311 :: 4
2023-05-24 09:18:58 :: Audio :: 1.0.311 :: 3
2023-05-24 09:18:59 :: Audio :: 1.0.311 :: 2
2023-05-24 09:19:00 :: Audio :: 1.0.311 :: 1
2023-05-24 09:19:01 :: Audio :: 1.0.311 :: To kill script, use the following command:
2023-05-24 09:19:01 :: Audio :: 1.0.311 :: kill -9 261686
2023-05-24 09:19:03 :: Audio :: 1.0.311 :: Lidarr Version: 1.2.0.3183

[RandomNinjaAtk]

Looks like the script may be having problems connecting to musicbrainz website. Verify you have connectivity to musicbrainz from the container.

[RandomNinjaAtk]

Your error takes place somewhere in these lines:

docker-lidarr-extended/root/scripts/AutoArtistAdder.bash

Lines 81 to 127 in 782ff1b

	for id in ${!getDeezerArtistsIds[@]}; do
	currentprocess=$(( $id + 1 ))
	deezerArtistId="${getDeezerArtistsIds[$id]}"
	deezerArtistName="$(curl -s https://api.deezer.com/artist/$deezerArtistId | jq -r .name)"
	sleep $sleepTimer
	log "$currentprocess of $getDeezerArtistsIdsCount :: $deezerArtistName :: Searching Musicbrainz for Deezer artist id ($deezerArtistId)"
	if echo "$deezerArtistIds" | grep "^${deezerArtistId}$" | read; then
	log "$currentprocess of $getDeezerArtistsIdsCount :: $deezerArtistName :: $deezerArtistId already in Lidarr..."
	continue
	fi
	query_data=$(curl -s -A "$agent" "https://musicbrainz.org/ws/2/url?query=url:%22https://www.deezer.com/artist/${deezerArtistId}%22&fmt=json")
	count=$(echo "$query_data" | jq -r ".count")
	if [ "$count" == "0" ]; then
	sleep 1.5
	query_data=$(curl -s -A "$agent" "https://musicbrainz.org/ws/2/url?query=url:%22http://www.deezer.com/artist/${deezerArtistId}%22&fmt=json")
	count=$(echo "$query_data" | jq -r ".count")
	sleep 1.5
	fi
	if [ "$count" == "0" ]; then
	query_data=$(curl -s -A "$agent" "https://musicbrainz.org/ws/2/url?query=url:%22http://deezer.com/artist/${deezerArtistId}%22&fmt=json")
	count=$(echo "$query_data" | jq -r ".count")
	sleep 1.5
	fi
	if [ "$count" == "0" ]; then
	query_data=$(curl -s -A "$agent" "https://musicbrainz.org/ws/2/url?query=url:%22https://deezer.com/artist/${deezerArtistId}%22&fmt=json")
	count=$(echo "$query_data" | jq -r ".count")
	fi
	if [ "$count" != "0" ]; then
	musicbrainz_main_artist_id=$(echo "$query_data" | jq -r '.urls[]."relation-list"[].relations[].artist.id' | head -n 1)
	sleep 1.5
	artist_data=$(curl -s -A "$agent" "https://musicbrainz.org/ws/2/artist/$musicbrainz_main_artist_id?fmt=json")
	artist_sort_name="$(echo "$artist_data" | jq -r '."sort-name"')"
	artist_formed="$(echo "$artist_data" | jq -r '."begin-area".name')"
	artist_born="$(echo "$artist_data" | jq -r '."life-span".begin')"
	gender="$(echo "$artist_data" | jq -r ".gender")"
	matched_id=true
	data=$(curl -s "$lidarrUrl/api/v1/search?term=lidarr%3A$musicbrainz_main_artist_id" -H "X-Api-Key: $lidarrApiKey" | jq -r ".[]")
	artistName="$(echo "$data" | jq -r ".artist.artistName")"
	foreignId="$(echo "$data" | jq -r ".foreignId")"
	importListExclusionData=$(curl -s "$lidarrUrl/api/v1/importlistexclusion" -H "X-Api-Key: $lidarrApiKey" | jq -r ".[].foreignId")
	if echo "$importListExclusionData" | grep "^${foreignId}$" | read; then
	log "$currentprocess of $getDeezerArtistsIdsCount :: $deezerArtistName :: ERROR :: Artist is on import exclusion block list, skipping...."

Your error is likely one of the curl commands that pipes to JQ. You'd have to manually substitute variables and test....

Did you check to mare sure you haven't excluded the artists? Since that is a message your getting...

[friki67]

I did this from bash
curl -s -A "lidarr-extended ( https://github.com/RandomNinjaAtk/docker-lidarr-extended )" "https://musicbrainz.org/ws/2/url?query=url:%22https://www.deezer.com/artist/629%22&fmt=json"
and received this
{"error": "Your requests are being throttled by MusicBrainz because the application you are using has not identified itself. Please update your application, and see http://musicbrainz.org/doc/XML_Web_Service/Rate_Limiting for more information."}

I'll keep investigating this....

[RandomNinjaAtk]

maybe your hitting too many api queries. They only allow 1 query per second I think, that is why the script sleeps for 1.5 seconds after each query...

[friki67]

Well, right now I don't have any other app making musicbrainz queries AFAIK. I will try to begin from scratch and tell you what happens. Thank you for your time.

[friki67]

It makes no difference. I've tried returning to the VPN and changing node, just in case it was something involved with my ip, but nothing changes. Is it working for you?
Because I modified your script adding this after the musicbrainz query

              log "========"
               log "$query_data"
               log "========"

and I keep getting the same error in the query data.

2023-05-25 10:24:10 :: AutoArtistAdder :: 1.0.008 :: ========
2023-05-25 10:24:10 :: AutoArtistAdder :: 1.0.008 :: {"error": "Your requests are being throttled by MusicBrainz because the application you are using has not identified itself. Please update your application, and see http://musicbrainz.org/doc/XML_Web_Service/Rate_Limiting for more information."}
2023-05-25 10:24:10 :: AutoArtistAdder :: 1.0.008 :: ========

I'll begin from scratch again.

[RandomNinjaAtk]

FYI: The latest updates should resolve the musicbrainz connection issue...