Got error: "Sign in to confirm that you're not a bot" #3658

DuplicantWood · 2024-06-06T23:11:19Z

Official Instance

The bug is reproducible on the official hosted instance, or is API-related.

Describe the bug

On my private instance and with some others i have tested in the public list i am seeing "Got error: "Sign in to confirm that you're not a bot"" instead of a video

Here is a link from a public instance with the same problem:

https://piped.r4fo.com/watch?v=2G-L0u_L0qU

To Reproduce

Open this url on this instance

https://piped.r4fo.com/watch?v=2G-L0u_L0qU

See error

Expected behavior

Video to play normally

Logs/Errors

org.schabi.newpipe.extractor.exceptions.ContentNotAvailableException: Got error: "Sign in to confirm that you're not a bot" at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeStreamExtractor.checkPlayabilityStatus(YoutubeStreamExtractor.java:1016) at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeStreamExtractor.onFetchPage(YoutubeStreamExtractor.java:876) at org.schabi.newpipe.extractor.Extractor.fetchPage(Extractor.java:60) at org.schabi.newpipe.extractor.stream.StreamInfo.getInfo(StreamInfo.java:77) at org.schabi.newpipe.extractor.stream.StreamInfo.getInfo(StreamInfo.java:72) at org.schabi.newpipe.extractor.stream.StreamInfo.getInfo(StreamInfo.java:67) at me.kavin.piped.server.handlers.StreamHandlers.lambda$streamsResponse$0(StreamHandlers.java:54) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) at java.base/java.lang.VirtualThread.run(VirtualThread.java:309)

Browser, and OS with Version.

Happens on multiple browsers and devices

Additional context

I'm assuming it's related to something google/youtube have done as invidious instances are having similar issues.

iv-org/invidious#4734

The text was updated successfully, but these errors were encountered:

opusforlife2 · 2024-06-07T20:01:42Z

Some instances are working, some aren't. But it's probably gonna spread to all of them.

milutinke · 2024-06-09T13:07:31Z

Is there any solution for this?

00-kat · 2024-06-09T13:09:32Z

Is there any solution for this?

Cobalt implemented OAuth, but other than that there's not been much in terms of solving this issue...

milutinke · 2024-06-09T13:13:03Z

Is there any solution for this?

Cobalt implemented OAuth, but other than that there's not been much in terms of solving this issue...

Well, maybe it would be good implementing it as an optional feature, so instances could continue running until there is a better solution.

Anoerak · 2024-06-17T20:32:32Z

Restarting all containers fixed it for me tonight.

AndrewHoang1995 · 2024-06-18T02:24:17Z

Restarting all containers fixed it for me tonight.

Really !!!

LivingWithHippos · 2024-06-18T08:50:02Z

Restarting all containers fixed it for me tonight.

Didn't work for me, you probably got "B" tested ;D

jokes aside, I have another request that may warrant a separate issue:
I opened a page to use the share button and copy the original youtube link, but the error message "eats" away all the UI, I think it would be nice if a partial interface could still be shown in this case

Tamarindo94 · 2024-06-21T14:07:40Z

This is happening to me on the majority of videos (~8 out of 10) and on different instances, to the point I had to go back to using vanilla youtube.
Sadly, I dont know enough about piped or youtube's inner workings to be able to help, but I hope I can bring more attention to this issue. My fear is that this change could make piped and other frontends unusable sooner than we think if a solution isn't found

alimovlex · 2024-06-22T21:22:10Z

Is there any solution for this?

Yes. Just obtain youtube API keys and paste the API_SECRET to src/main.js function at 127th line.

getAuthToken() {
            return this.getPreferenceString("authToken" + this.hashCode(this.authApiUrl()));
},

Everything works.

alimovlex · 2024-06-22T21:25:38Z

This is happening to me on the majority of videos (~8 out of 10) and on different instances, to the point I had to go back to using vanilla youtube. Sadly, I dont know enough about piped or youtube's inner workings to be able to help, but I hope I can bring more attention to this issue. My fear is that this change could make piped and other frontends unusable sooner than we think if a solution isn't found

You can host your own instance instead and paste the token as I have written above.

AndrewHoang1995 · 2024-06-24T02:48:42Z

You can host your own instance instead and paste the token as I have written above.

If I use Docker, how can I rebuild it? I am looking forward to an update from the team regarding documentation and Docker for this temporary solution

clot27 · 2024-06-25T18:16:20Z

This is coming so often on official (piped.video) instance, approximately 7 of 10 videos. I haven't tried to change instance yet, I have switched to invidious.

opusforlife2 · 2024-06-25T18:24:07Z

I haven't tried to change instance yet

This is the best workaround though. Works 100% of the time. You rarely have to change it twice.

danl76 · 2024-06-25T18:45:57Z

Your modify the main.js like this?

getAuthToken() { return this.getPreferenceString("authToken" + this.hashCode(API_KEY)); },

Where API_KEY = your yt api key

Also how do get into the docker container to modify main.js? I tried bash but that'd didn't work.

alimovlex · 2024-06-26T00:20:16Z

Your modify the main.js like this?

getAuthToken() { return this.getPreferenceString("authToken" + this.hashCode(API_KEY)); },

Where API_KEY = your yt api key

Also how do get into the docker container to modify main.js? I tried bash but that'd didn't work.

Unfortunately, no.

getAuthToken() {
            return this.getPreferenceString("YOUR_API_TOKEN_HERE" + this.hashCode(this.authApiUrl()));
},

API_KEY is API_SECRET in your profile.

alimovlex · 2024-06-26T00:25:09Z

You can host your own instance instead and paste the token as I have written above.

If I use Docker, how can I rebuild it? I am looking forward to an update from the team regarding documentation and Docker for this temporary solution

I am not facile with Docker, unfortunately. Instead, I host my own private instance on a VPS.

LivingWithHippos · 2024-06-26T07:16:20Z

Your modify the main.js like this?

getAuthToken() { return this.getPreferenceString("authToken" + this.hashCode(API_KEY)); },

Where API_KEY = your yt api key

Also how do get into the docker container to modify main.js? I tried bash but that'd didn't work.

When bash doesn't work try sh ;D (or ash for alpine)

Where is the file located BTW?

edit:

I use these aliases in bash (or remove function for zsh) to quickly find and then enter a container with bash or sh (yeah I should env I know)

# get the container name if you don't remember, example: "dclist piped"
function dclist() {
    if [ -z "$1" ]; then
        docker ps -a --format "table {{.ID}}\t{{.Names}}" | (read -r; printf "%s\n" ""; sort -k 2);
    else
        docker ps -a --format "table {{.ID}}\t{{.Names}}" | (read -r; printf "%s\n" ""; sort -k 2) | grep "$1";
    fi
}

# enter a container with bash or sh, example: "dcsh piped"
function dcbash() { docker exec -it "$1" /bin/bash; }
function dcsh() { docker exec -it "$1" /bin/sh; }

LivingWithHippos · 2024-06-26T14:50:01Z

Partial docker instructions, untested, try only if you know what this means:

open your piped instance
right click -> view page source or whatever your browser calls it
find out the name of the javascript bundled file, mine is <script type="module" crossorigin src="/assets/index-WHXXydFZ.js"></script>

At this point you can either extract it from the container, change it and mount it back (easier, persist across restarts, may break the frontend if the containers are updated) or manually edit it in place (no time so will do this for now, may need restart of the container, may break anyway or just not work) or add the sed command to the start script (it's already doing something similar for the instance name)

enter the piped frontend container with its name, I used docker exec -it "piped-frontend" /bin/sh;
enter the assets folder with cd /usr/share/nginx/html/assets
swap the authToken with sed -i 's/"authToken"/"YOUR_TOKEN"/g' index-YOUR_FILE.js
???
If you force refresh the page and check the sources again you can click on the js file and see if it has been changed or not

enticedwanderer · 2024-07-18T06:20:54Z

I've tried to do what above was suggested with the substitution of the authToken with an API key for Youtube Data v3 (plain API key not OAuth) and it just results in completely broken piped frontend. No trace or any message in the console. I have confirmed that it is substituted correctly in the browser with cache disabled (just in case).

What's supposed to happen when you swap out the hardcoded authToken string? Can someone provide clearer instructions on how to do this?

I'm also confused what "API_SECRET" referenced above is. Is it not the value of the API key?

Bnyro · 2024-07-18T16:08:50Z

Everything written above about patching getAuthToken() is not true, that authToken is only used to authenticate at Piped instances with your Piped account, it's not related to the visitor tokens used for extracting data from YouTube.

Obtaining YouTube API keys and only setting them in the frontend doesn't solve the problem at all, because the YouTube API key would need to be used at the Piped backend anyways ...

Bnyro · 2024-07-18T16:09:38Z

You probably want to save yourself that time and either get a new IP address that's not blocked from YouTube or put a proxy / VPN in front of your instance.

milutinke · 2024-07-19T09:14:58Z

You probably want to save yourself that time and either get a new IP address that's not blocked from YouTube or put a proxy / VPN in front of your instance.

Invidious made a IPv6 rotation tool, so that is another way of solving the issue. It needs a bit of setup, but works pretty good on a couple of instances I saw using it.

bonswouar · 2024-07-19T09:42:26Z

Invidious made a IPv6 rotation tool, so that is another way of solving the issue. It needs a bit of setup, but works pretty good on a couple of instances I saw using it.

Unfortunately lots of instances had their whole IPV6 /64 range blocked recently. I guess it depends of the provider

Bnyro · 2024-07-19T11:13:16Z

Unfortunately lots of instances had their whole IPV6 /64 range blocked recently. I guess it depends of the provider

Yes, all my Hetzner IPv6 ranges are blocked too since some days :/

milutinke · 2024-07-19T11:29:38Z

I heard https://stylenhost.com/ still works.
Maybe we should compile a list of providers that work and don't work.

voidplayer · 2024-09-05T07:25:03Z

libretube is working again now too

bonswouar · 2024-09-05T13:35:15Z

@kubo6472 On (some) private instances, Piped still work, always.
If the IP is clean you shouldn't have any problem

voidplayer · 2024-09-09T21:28:08Z

Is it possible to add the video to a playlist despite having this error in the browser?

The button is not showing despite being able to load comments (and thus acknowledging the url is okay)

Should i open a separate bug for this?

Bnyro · 2024-09-10T10:17:01Z

That's the same issue, so no.

bonswouar · 2024-09-10T13:04:37Z

Could you guys please stop commenting this issue with no new information, many people are following I guess and it's annoying to get useless notifications.
If you've got the same problem (and you probably do), just add a thumb up 👍 to the first post of this thread and hope & wait

And if you wanna chat about workarounds or whatever, the matrix channel is still here

kubo6472 · 2024-09-13T12:45:27Z

Re this:

I wonder if it was affected by these changed, or does something very WebKit/Safari specific, that allows them to get the HTML5 player working...always.

Apparently, the Vinegar itself used Innertube and suffered from the same issues (the clicked link leads to this issue):

But the extension "Vinegar Extract" does something else. It doesn't use Innertube, and it replaces the YouTube video player, with the HTML5 player, but with ads, too.

I have currently still zero idea how they do it, but shall Piped be able to extract videos in all cases, even with ads, then let us block them/sponsorblock server-side ads, when that'll come/ well I'm willing to live with that, if it's possible.

DWolf-19 · 2024-09-13T15:33:39Z

Why my comment was marked as off-topic? I think it contains some new info/my guess about issue solving.

VitoItalianGamer · 2024-09-16T22:38:23Z

What piped instances are still working?

aryaoffixial · 2024-09-17T07:11:54Z

Will this Spoof Streaming Data patch work for Piped Too? I don't think anybody mentioned this before Revanced Patches#3582

Revanced Extended working fine with this patch. I know piped using IOS spoofing too but revanced doesn't get "ios player response invalid" errors...

mycodedoesnotcompile2 · 2024-09-23T11:40:18Z

Sad news: iv-org/invidious#4734 (comment)

Tip for people hosting in cloud: setup a (free) cloudflare WARP connection, and tunnel the trafic inside it. Youtube does not block, so far, Cloudflare IPs:
#3658 (comment)

bnjbvr · 2024-09-23T13:36:48Z

Regarding previous comment: it seems the code of piped-proxy supports setting up a PROXY env variable to reroute external traffic to it. I've tried using an instance of https://github.com/kingcc/warproxy or https://github.com/cmj2002/warp-docker alongside the piped-proxy instance, then changed the docker-compose section for the piped-proxy to include PROXY=warp:1080 in the env variable section, but it doesn't appear the traffic is getting routed through it. Am I missing something?

[edit] solution pointed to in the previous comment works great, thanks @mycodedoesnotcompile2!

Silther · 2024-09-25T07:31:20Z

please fix it

You are asking a group of people developing this project in their spare time to beat the countermeasures of a multi-billion dollar corporation.

lilcheti · 2024-09-26T13:02:53Z

Ok so which instances are working rn?

mpeter50 · 2024-09-26T13:31:39Z

Those that you or your friends run for yourself. Public ones are being taken down by google.
Yeah it sucks, even more so that now even Invidious has fallen.

My solution for the meantime has been to either not watch youtube, or if the video would be useful, I download it with yt-dlp. That way I also preserve it for when the video would become unavailable, as we all know thats the fate of a lot of videos on youtube, for various reasons.

lilcheti · 2024-09-26T15:37:13Z

So if it's working with warp we better start developing an api to run on cloudflare workers

mpeter50 · 2024-09-26T20:33:33Z

I'm not familiar with Cloudflare's services, but I would expect that workers running youtube proxies would get shut down, maybe even with penalties for the owner account.

However, using CF Warp may be helpful in itself, but of course we will see if a larger instance starts to use it. Apparently they are not forwarding the user's IP address to the destination anymore.
Does anyone know if a Piped/Invidious instance has tried doing this already?

Seeing the reactions to my previous comment, if anyong reading this is interested in downloading the videos for yourself, here is the yt-dlp config file I use. I hope it will be useful.

voidplayer · 2024-09-26T20:47:18Z

would it be possible to add a local .js extractor as an option? libretube has the option to do the extraction locally and thats how they bypassed this issue

Yes, it gives away the privacy temporarly but it also makes more difficult/impossible to block

noodlejetski · 2024-09-29T11:03:12Z

I got the same issue recently.

might wanna read the recent replies before notifying everyone participating in the discussion.

DuplicantWood added the bug Something isn't working label Jun 6, 2024

Bnyro pinned this issue Jun 7, 2024

00-kat mentioned this issue Jun 8, 2024

[FIXED] YouTube is sometimes unreachable because of A/B testing of forced log in imputnet/cobalt#551

Closed

Extravi mentioned this issue Jun 15, 2024

yt.extravi.dev doesn't show videos Extravi/araa-search#142

Closed

Bellisario mentioned this issue Jun 17, 2024

Error "All APIs are down" 'try again later' Bellisario/musicale#252

Closed

This comment was marked as spam.

Sign in to view

This comment was marked as off-topic.

Sign in to view

felschr mentioned this issue Sep 11, 2024

Option to play video stream without Piped proxy #2817

Open

3 tasks

This comment was marked as spam.

Sign in to view

This comment was marked as off-topic.

Sign in to view

This comment was marked as spam.

Sign in to view

Bnyro mentioned this issue Sep 23, 2024

it is saying this I am logged in Got error: "Sign in to confirm that you're not a bot" #3794

Closed

1 task

Guru322 mentioned this issue Sep 24, 2024

Alternative Guru322/Any-dl#4

Closed

This comment was marked as off-topic.

Sign in to view

This comment was marked as spam.

Sign in to view

Got error: "Sign in to confirm that you're not a bot" #3658

Got error: "Sign in to confirm that you're not a bot" #3658

Comments

DuplicantWood commented Jun 6, 2024 • edited Loading

Official Instance

Describe the bug

To Reproduce

Expected behavior

Logs/Errors

Browser, and OS with Version.

Additional context

opusforlife2 commented Jun 7, 2024

milutinke commented Jun 9, 2024

00-kat commented Jun 9, 2024

milutinke commented Jun 9, 2024

Anoerak commented Jun 17, 2024

AndrewHoang1995 commented Jun 18, 2024

LivingWithHippos commented Jun 18, 2024

Tamarindo94 commented Jun 21, 2024

alimovlex commented Jun 22, 2024 • edited Loading

alimovlex commented Jun 22, 2024

AndrewHoang1995 commented Jun 24, 2024

clot27 commented Jun 25, 2024

opusforlife2 commented Jun 25, 2024

danl76 commented Jun 25, 2024

alimovlex commented Jun 26, 2024 • edited Loading

alimovlex commented Jun 26, 2024 • edited Loading

LivingWithHippos commented Jun 26, 2024 • edited Loading

LivingWithHippos commented Jun 26, 2024 • edited Loading

enticedwanderer commented Jul 18, 2024 • edited Loading

Bnyro commented Jul 18, 2024

Bnyro commented Jul 18, 2024

milutinke commented Jul 19, 2024

bonswouar commented Jul 19, 2024 • edited Loading

Bnyro commented Jul 19, 2024

milutinke commented Jul 19, 2024 • edited Loading

voidplayer commented Sep 5, 2024

bonswouar commented Sep 5, 2024

voidplayer commented Sep 9, 2024

Bnyro commented Sep 10, 2024

This comment was marked as spam.

This comment was marked as off-topic.

bonswouar commented Sep 10, 2024

This comment was marked as spam.

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as spam.

kubo6472 commented Sep 13, 2024

DWolf-19 commented Sep 13, 2024

VitoItalianGamer commented Sep 16, 2024

aryaoffixial commented Sep 17, 2024

mycodedoesnotcompile2 commented Sep 23, 2024 • edited Loading

bnjbvr commented Sep 23, 2024 • edited Loading

This comment was marked as off-topic.

Silther commented Sep 25, 2024

lilcheti commented Sep 26, 2024

mpeter50 commented Sep 26, 2024 • edited Loading

lilcheti commented Sep 26, 2024

mpeter50 commented Sep 26, 2024

voidplayer commented Sep 26, 2024

This comment was marked as off-topic.

noodlejetski commented Sep 29, 2024

This comment was marked as spam.

DuplicantWood commented Jun 6, 2024 •

edited

Loading

alimovlex commented Jun 22, 2024 •

edited

Loading

alimovlex commented Jun 26, 2024 •

edited

Loading

alimovlex commented Jun 26, 2024 •

edited

Loading

LivingWithHippos commented Jun 26, 2024 •

edited

Loading

LivingWithHippos commented Jun 26, 2024 •

edited

Loading

enticedwanderer commented Jul 18, 2024 •

edited

Loading

bonswouar commented Jul 19, 2024 •

edited

Loading

milutinke commented Jul 19, 2024 •

edited

Loading

mycodedoesnotcompile2 commented Sep 23, 2024 •

edited

Loading

bnjbvr commented Sep 23, 2024 •

edited

Loading

mpeter50 commented Sep 26, 2024 •

edited

Loading