dnfdaemon do_transaction error

[anaselli]

Using dnfdragora I often have a noreply from dbus after a do_transaction call.

Called at
2025-01-02 17:09:52,987 [dnfdaemon.client]{dnfd_client.py:424}(DEBUG) __async_thread_loop proxy org.rpm.dnf.v0.Goal method do_transaction

Then i had some download signals and next:

2025-01-02 17:10:18,320 [dnfdaemon.client]{dnfd_client.py:478}(ERROR) __async_thread_loop (RunTransaction) proxy org.rpm.dnf.v0.Goal, method do_transaction - Exception org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.

[anaselli]

I should say that this is issue is blocking. It happens very often here. Can we talk about this as we had for list_fd? i experienced it in both fedora and mageia

[m-blaha]

Hmm, this sounds like the do_transaction() call doesn’t have a proper timeout set. By default, the D-Bus call timeout is around 30 seconds, but running the transaction (which also involves downloading the required packages) can easily take much longer. Have you tried setting a longer timeout? For example:
iface_goal.do_transaction(dbus.Dictionary({}, signature='sv'), timeout=600)

[anaselli]

I haven't found that option described, anyway it seems not to work:

2025-01-14 19:38:31,366 [dnfdragora.ui]{ui.py:2549}(DEBUG) Event received BuildTransaction - status DNFDragoraStatus.RUNNING
2025-01-14 19:38:31,366 [dnfdragora.ui]{ui.py:2569}(DEBUG) Event received BuildTransaction, {'result': (0, [['Package', 'Upgrade', 'External User', {'replaces': [117]}, {'arch': 'x86_64', 'download_size': 143273889, 'epoch': '0', 'evr': '1.96.3-1736454428.el8', 'from_repo_id': '', 'full_nevra': 'code-0:1.96.3-1736454428.el8.x86_64', 'id': 46564, 'install_size': 400269215, 'name': 'code', 'reason': 'External User', 'release': '1736454428.el8', 'repo_id': 'code', 'version': '1.96.3'}], ['Package', 'Upgrade', 'External User', {'replaces': [247]}, {'arch': 'x86_64', 'download_size': 71657644, 'epoch': '0', 'evr': '128.6.0-1.mga9', 'from_repo_id': '', 'full_nevra': 'firefox-0:128.6.0-1.mga9.x86_64', 'id': 35404, 'install_size': 232953672, 'name': 'firefox', 'reason': 'External User', 'release': '1.mga9', 'repo_id': 'updates-x86_64', 'version': '128.6.0'}], ['Package', 'Upgrade', 'External User', {'replaces': [248]}, {'arch': 'noarch', 'download_size': 525503, 'epoch': '0', 'evr': '128.6.0-1.mga9', 'from_repo_id': '', 'full_nevra': 'firefox-it-0:128.6.0-1.mga9.noarch', 'id': 36186, 'install_size': 584354, 'name': 'firefox-it', 'reason': 'External User', 'release': '1.mga9', 'repo_id': 'updates-x86_64', 'version': '128.6.0'}], ['Package', 'Upgrade', 'External User', {'replaces': [3991]}, {'arch': 'x86_64', 'download_size': 79917962, 'epoch': '0', 'evr': '128.6.0-1.mga9', 'from_repo_id': '', 'full_nevra': 'thunderbird-0:128.6.0-1.mga9.x86_64', 'id': 44204, 'install_size': 266805293, 'name': 'thunderbird', 'reason': 'External User', 'release': '1.mga9', 'repo_id': 'updates-x86_64', 'version': '128.6.0'}], ['Package', 'Upgrade', 'External User', {'replaces': [3993]}, {'arch': 'noarch', 'download_size': 631078, 'epoch': '0', 'evr': '128.6.0-1.mga9', 'from_repo_id': '', 'full_nevra': 'thunderbird-it-0:128.6.0-1.mga9.noarch', 'id': 44939, 'install_size': 697093, 'name': 'thunderbird-it', 'reason': 'External User', 'release': '1.mga9', 'repo_id': 'updates-x86_64', 'version': '128.6.0'}], ['Package', 'Replaced', 'External User', {}, {'arch': 'x86_64', 'download_size': 0, 'epoch': '0', 'evr': '1.96.2-1734607808.el8', 'from_repo_id': '<unknown>', 'full_nevra': 'code-0:1.96.2-1734607808.el8.x86_64', 'id': 117, 'install_size': 400268926, 'name': 'code', 'reason': 'External User', 'release': '1734607808.el8', 'repo_id': '@System', 'version': '1.96.2'}], ['Package', 'Replaced', 'External User', {}, {'arch': 'x86_64', 'download_size': 0, 'epoch': '0', 'evr': '128.5.0-1.mga9', 'from_repo_id': '<unknown>', 'full_nevra': 'firefox-0:128.5.0-1.mga9.x86_64', 'id': 247, 'install_size': 232867394, 'name': 'firefox', 'reason': 'External User', 'release': '1.mga9', 'repo_id': '@System', 'version': '128.5.0'}], ['Package', 'Replaced', 'External User', {}, {'arch': 'noarch', 'download_size': 0, 'epoch': '0', 'evr': '128.5.0-1.mga9', 'from_repo_id': '<unknown>', 'full_nevra': 'firefox-it-0:128.5.0-1.mga9.noarch', 'id': 248, 'install_size': 584359, 'name': 'firefox-it', 'reason': 'External User', 'release': '1.mga9', 'repo_id': '@System', 'version': '128.5.0'}], ['Package', 'Replaced', 'External User', {}, {'arch': 'x86_64', 'download_size': 0, 'epoch': '0', 'evr': '128.5.2-1.mga9', 'from_repo_id': '<unknown>', 'full_nevra': 'thunderbird-0:128.5.2-1.mga9.x86_64', 'id': 3991, 'install_size': 266716775, 'name': 'thunderbird', 'reason': 'External User', 'release': '1.mga9', 'repo_id': '@System', 'version': '128.5.2'}], ['Package', 'Replaced', 'External User', {}, {'arch': 'noarch', 'download_size': 0, 'epoch': '0', 'evr': '128.5.2-1.mga9', 'from_repo_id': '<unknown>', 'full_nevra': 'thunderbird-it-0:128.5.2-1.mga9.noarch', 'id': 3993, 'install_size': 697097, 'name': 'thunderbird-it', 'reason': 'External User', 'release': '1.mga9', 'repo_id': '@System', 'version': '128.5.2'}]]), 'error': None} - status DNFDragoraStatus.RUNNING
2025-01-14 19:38:38,385 [dnfdaemon.client]{dnfd_client.py:492}(DEBUG) run_dbus_async RunTransaction (return=0) args: (({'timeout': 600},))
2025-01-14 19:38:38,385 [dnfdaemon.client]{dnfd_client.py:421}(DEBUG) __async_thread_loop Command RunTransaction(({'timeout': 600},)) requested 
2025-01-14 19:38:38,575 [dnfdaemon.client]{dnfd_client.py:424}(DEBUG) __async_thread_loop proxy org.rpm.dnf.v0.Goal method do_transaction
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2728}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:46564', 'description': 'code-0:1.96.3-1736454428.el8.x86_64', 'total_to_download': 143273889}
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2222}(DEBUG) OnDownloadStart(/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f) ('package:46564', 'code-0:1.96.3-1736454428.el8.x86_64', 143273889)
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2728}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:35404', 'description': 'firefox-0:128.6.0-1.mga9.x86_64', 'total_to_download': 71657644}
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2222}(DEBUG) OnDownloadStart(/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f) ('package:35404', 'firefox-0:128.6.0-1.mga9.x86_64', 71657644)
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2728}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:36186', 'description': 'firefox-it-0:128.6.0-1.mga9.noarch', 'total_to_download': 525503}
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2222}(DEBUG) OnDownloadStart(/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f) ('package:36186', 'firefox-it-0:128.6.0-1.mga9.noarch', 525503)
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2728}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:44204', 'description': 'thunderbird-0:128.6.0-1.mga9.x86_64', 'total_to_download': 79917962}
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2222}(DEBUG) OnDownloadStart(/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f) ('package:44204', 'thunderbird-0:128.6.0-1.mga9.x86_64', 79917962)
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2728}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:44939', 'description': 'thunderbird-it-0:128.6.0-1.mga9.noarch', 'total_to_download': 631078}
2025-01-14 19:38:48,317 [dnfdragora.ui]{ui.py:2222}(DEBUG) OnDownloadStart(/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f) ('package:44939', 'thunderbird-it-0:128.6.0-1.mga9.noarch', 631078)
2025-01-14 19:38:48,318 [dnfdragora.ui]{ui.py:2253}(WARNING) Dimension does not match for object [package:46564]:[code-0:1.96.3-1736454428.el8.x86_64]
2025-01-14 19:38:49,917 [dnfdragora.ui]{ui.py:2733}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:46564', 'status': 0, 'error': ''}
2025-01-14 19:38:49,918 [dnfdragora.ui]{ui.py:2277}(DEBUG) OnDownloadEnd ('package:46564', 'code-0:1.96.3-1736454428.el8.x86_64', 0, '')
2025-01-14 19:38:49,918 [dnfdragora.ui]{ui.py:2284}(DEBUG) Downloaded : package:46564 - code-0:1.96.3-1736454428.el8.x86_64
2025-01-14 19:38:51,517 [dnfdragora.ui]{ui.py:2733}(DEBUG) {'session_object_path': '/org/rpm/dnf/v0/4c4c9d354359040c32a61efcb32bf53f', 'download_id': 'package:36186', 'status': 0, 'error': ''}
2025-01-14 19:38:51,517 [dnfdragora.ui]{ui.py:2277}(DEBUG) OnDownloadEnd ('package:36186', 'firefox-it-0:128.6.0-1.mga9.noarch', 0, '')
2025-01-14 19:38:51,517 [dnfdragora.ui]{ui.py:2284}(DEBUG) Downloaded : package:36186 - firefox-it-0:128.6.0-1.mga9.noarch
2025-01-14 19:39:03,840 [dnfdaemon.client]{dnfd_client.py:478}(ERROR) __async_thread_loop (RunTransaction) proxy org.rpm.dnf.v0.Goal, method do_transaction - Exception org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.
2025-01-14 19:39:03,917 [dnfdaemon.client]{dnfd_client.py:369}(DEBUG) return_handler RunTransaction
2025-01-14 19:39:04,117 [dnfdaemon.client]{dnfd_client.py:391}(DEBUG) get_result RunTransaction
2025-01-14 19:39:04,256 [dnfdaemon.client]{dnfd_client.py:382}(DEBUG) Quit return_handler error org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.
2025-01-14 19:39:04,317 [dnfdragora.ui]{ui.py:2556}(ERROR) Event received RunTransaction, org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. - status DNFDragoraStatus.RUN_TRANSACTION
2025-01-14 19:39:42,607 [dnfdragora]{dnfdragora:101}(ERROR) Unexpected error: <class 'dbus.exceptions.DBusException'> 

[m-blaha]

The timeout option is not specific to dnfdaemon. It's the option of the dbus Python library to set number of seconds to wait for the message reply. In case you use a different library to communicate with D-Bus, the specific option can be different. From your log I can see that the do_transaction failed after cca 25 seconds which is consistent with the default timeout set in dbus library (see https://gitlab.freedesktop.org/dbus/dbus/-/blob/dbus-1.14/dbus/dbus-connection-internal.h#L46)

Let me share the whole testing script, not only the line which set the timeout. I used made up long_running package package which simulates long running rpm transaction (so that the transaction took at least 5 minutes to complete) by having sleeps in post install scriptlet.

import dbus

DNFDAEMON_BUS_NAME = 'org.rpm.dnf.v0'
DNFDAEMON_OBJECT_PATH = '/' + DNFDAEMON_BUS_NAME.replace('.', '/')

IFACE_SESSION_MANAGER = '{}.SessionManager'.format(DNFDAEMON_BUS_NAME)
IFACE_RPM = '{}.rpm.Rpm'.format(DNFDAEMON_BUS_NAME)
IFACE_GOAL = '{}.Goal'.format(DNFDAEMON_BUS_NAME)


bus = dbus.SystemBus()
iface_session = dbus.Interface(
    bus.get_object(DNFDAEMON_BUS_NAME, DNFDAEMON_OBJECT_PATH),
    dbus_interface=IFACE_SESSION_MANAGER)

session = iface_session.open_session(
    dbus.Dictionary({}, signature=dbus.Signature('sv')))

iface_rpm = dbus.Interface(
    bus.get_object(DNFDAEMON_BUS_NAME, session),
    dbus_interface=IFACE_RPM)
iface_goal = dbus.Interface(
    bus.get_object(DNFDAEMON_BUS_NAME, session),
    dbus_interface=IFACE_GOAL)

iface_rpm.install(['long_running'], dbus.Dictionary({}, signature='sv'))

# resolve the transaction
resolved, result = iface_goal.resolve({})

# now you can print the transaction table and ask the user for confirmation
print("Resolved.")

if result == 0:
    print("Running the transaction")
    iface_goal.do_transaction(dbus.Dictionary({}, signature='sv'), timeout=600)
    print("Installed")

[anaselli]

I maybe wrong in something, my patch is:

diff --git a/dnfdragora/dnfd_client.py b/dnfdragora/dnfd_client.py
index 9da9ed9..0f92fc9 100644
--- a/dnfdragora/dnfd_client.py
+++ b/dnfdragora/dnfd_client.py
@@ -469,6 +469,9 @@ class Client:
 
                 #no needs to unpack results
                 self._return_handler(pkglist, data)
+            elif method == "do_transaction":
+                result = func(dbus.Dictionary({*args}, signature='sv'), timeout=600)
+                self._return_handler(unpack_dbus(result), data)
             else:
                 result = func(*args)
                 self._return_handler(unpack_dbus(result), data)

Same issue. I wonder if i can trap the exception and connect to daemon again. The transaction finishes correctly as far as i can say.

[m-blaha]

Thank you, I'll check out the dnfdragora sources.

[anaselli]

I also created a test case by using a single script.
However that does not fail always, just from now and then. I've so realized that if i disable logging from dnfdragora, this issue happens less (with more packages or at the end of the transaction).
Anyway btanks is long enough to make do_transaction reply always failing in dnfdragora with logging at debug level enabled.