Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOH, DOH/3, and DOQ all randomly stop accepting DNS queries... #1114

Open
32bitx64bit opened this issue Nov 18, 2024 · 12 comments
Open

DOH, DOH/3, and DOQ all randomly stop accepting DNS queries... #1114

32bitx64bit opened this issue Nov 18, 2024 · 12 comments

Comments

@32bitx64bit
Copy link

Hi, currently having this weird issue where all but DoT will stop accepting DNS queries.
I'm on the latest technitium dns server build.
Running on Debian 12.
It only fixes itself when I restart the server completely.
2024-11-18(1).log
Here's the latest log if it helps.

@32bitx64bit 32bitx64bit changed the title DOH, DOH/3, and DOQ all randomly stop accepting DNS queries at random. DOH, DOH/3, and DOQ all randomly stop accepting DNS queries... Nov 18, 2024
@ShreyasZare
Copy link
Member

Thanks for the post. The logs shared do not have any error log related to the issue you are mentioning. The errors in there are related to failure to resolve a specific domain name due to some network issues.

I am not sure why this could happen since I have these deployed in production and its working well on Debian 12. I would suggest that you debug the issue when it occurs.

To do that, you should first check if the service ports are open using sudo netstat -nlptu command which should list all the open ports. If you see the ports are open then the services are running. If not, then check the DNS logs to see if there are any error logs.

If ports are open, try using the DNS Client tool on the admin panel to test if the DNS server responds over the selected protocol. Since these are encrypted DNS services, you will need to use the full DoH URL with the domain name used to generate the TLS certificate. To test DoH/3, use h3 as the URL scheme instead of https. Test all the services, DoH, DoH/3, DoQ, and DoT and share your results here.

@32bitx64bit
Copy link
Author

Alright I'll give it a shot

@32bitx64bit
Copy link
Author

Hm weird. All the UDP ports aren't listening anymore. That explains why protocols but TLS is failing. Would you happen to know anyway to fix this?

@ShreyasZare
Copy link
Member

Hm weird. All the UDP ports aren't listening anymore. That explains why protocols but TLS is failing. Would you happen to know anyway to fix this?

If you do not see any port belonging to the DNS server listening then the server may have stopped working. Do post the output of command you ran so that I can understand it better.

@32bitx64bit
Copy link
Author

32bitx64bit commented Nov 19, 2024

Hm weird. All the UDP ports aren't listening anymore. That explains why protocols but TLS is failing. Would you happen to know anyway to fix this?

If you do not see any port belonging to the DNS server listening then the server may have stopped working. Do post the output of command you ran so that I can understand it better.

Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:853 0.0.0.0:* LISTEN 402/dotnet
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 424/sshd: /usr/sbin
tcp 0 0 0.0.0.0:53 0.0.0.0:* LISTEN 402/dotnet
tcp6 0 0 :::443 :::* LISTEN 402/dotnet
tcp6 0 0 :::853 :::* LISTEN 402/dotnet
tcp6 0 0 :::53443 :::* LISTEN 402/dotnet
tcp6 0 0 :::80 :::* LISTEN 402/dotnet
tcp6 0 0 :::22 :::* LISTEN 424/sshd: /usr/sbin
tcp6 0 0 :::53 :::* LISTEN 402/dotnet
udp 0 0 0.0.0.0:53 0.0.0.0:* 402/dotnet
udp 0 0 159.100.250.108:68 0.0.0.0:* 363/systemd-network
udp6 0 0 :::853 :::* 402/dotnet
udp6 0 0 :::443 :::* 402/dotnet
udp6 0 0 :::53 :::* 402/dotnet
udp6 0 0 :::53443 :::* 402/dotnet

As for running DoQ DNS resolve it works fine on server. On my secondary separate server it gives a connection error.

@ShreyasZare
Copy link
Member

Thanks for the details. It looks like all the services ports are open indicating that DoH. DoT, DoQ, and plain DNS over TCP/UDP is all working. Try testing with the DNS Client tool on the admin panel and see if the service is responding to queries for all protocols.

If you see an error anywhere, just check the DNS Logs on the admin panel and share the complete error log entry so that I will be able to understand the error better.

@32bitx64bit
Copy link
Author

32bitx64bit commented Nov 20, 2024

Thanks for the details. It looks like all the services ports are open indicating that DoH. DoT, DoQ, and plain DNS over TCP/UDP is all working. Try testing with the DNS Client tool on the admin panel and see if the service is responding to queries for all protocols.

If you see an error anywhere, just check the DNS Logs on the admin panel and share the complete error log entry so that I will be able to understand the error better.

It works just fine on server. No errors.
Issue it outside the web server, outside connections.

@ShreyasZare
Copy link
Member

Thanks for the details. It looks like all the services ports are open indicating that DoH. DoT, DoQ, and plain DNS over TCP/UDP is all working. Try testing with the DNS Client tool on the admin panel and see if the service is responding to queries for all protocols.
If you see an error anywhere, just check the DNS Logs on the admin panel and share the complete error log entry so that I will be able to understand the error better.

It works just fine on server. No errors. Issue it outside the web server, outside connections.

Then it seems that the DNS server is working well but there is some network issue that you need to figure out. It could be an issue with Firewall on the server or on the network preventing clients from accessing those services.

@AceBlade258
Copy link

AceBlade258 commented Nov 21, 2024

Not sure what the issue is, but I came here to report this bug. It affects every socket except the webserver, not just secure services. It is worth noting that I am running the app in the container, so it could perhaps be a configuration issue with the container. That said, using an older version (i.e. 13.1) resolves the issue.

Logs currently provide no useful information; system, podman, container, or app - but I may not be looking in the right places.

This graph demonstrates the issue occurring. Restarting the container resolves it temporarily, but it keeps happening at this point.

image

Edit: An important clarification - DNS resolutions is what stops functioning; the DoH/DoQ servers are live, they just do not respond to queries (and the DNS server does not respond on 53).

@32bitx64bit
Copy link
Author

Ima just upload a bunch of logs from my NA server to see if theirs any useful information, as this is deff a technitium issue, it happens on two separate VPS providers
2024-11-19.log

2024-11-20.log

2024-11-18(2).log

@ShreyasZare
Copy link
Member

Not sure what the issue is, but I came here to report this bug. It affects every socket except the webserver, not just secure services. It is worth noting that I am running the app in the container, so it could perhaps be a configuration issue with the container. That said, using an older version (i.e. 13.1) resolves the issue.

Logs currently provide no useful information; system, podman, container, or app - but I may not be looking in the right places.

This graph demonstrates the issue occurring. Restarting the container resolves it temporarily, but it keeps happening at this point.

Edit: An important clarification - DNS resolutions is what stops functioning; the DoH/DoQ servers are live, they just do not respond to queries (and the DNS server does not respond on 53).

Thanks for the feedback. I am not sure what could be the issue since there was no significant change in the way the DNS server works in between 13.1 and current release. The change were a few bug fixes and other minor things that should not have any such effect.

From the screenshot, it looks like you are hosting zones. Do you have any of the zones signed with DNSSEC? If yes, are you using NSEC3?

@ShreyasZare
Copy link
Member

Ima just upload a bunch of logs from my NA server to see if theirs any useful information, as this is deff a technitium issue, it happens on two separate VPS providers 2024-11-19.log

2024-11-20.log

2024-11-18(2).log

Thanks for the logs. The errors in these logs are just related to network unreachable issue which means that the network was down and thus the DNS server failed to resolve domain names. Also, it seems you have enabled Prefer IPv6 option. Do you have IPv6 connectivity? If no, then disable that option since it will cause issues with resolution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants