I have a problem occurring on several RHEL 8.7 systems, since last night.
Snapd autorefresh fails to remove oldest snap, resulting in this error
# systemctl --failed
UNIT LOAD ACTIVE SUB DESCRIPTION
● var-lib-snapd-snap-snapd-18596.mount not-found failed failed var-lib-snapd-snap-snapd-18596.mount
1 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.There is no mount or snap to be found anywhere and current situation is
# snap list snapd --all
Name Version Rev Tracking Publisher Notes
snapd 2.59.1 18933 latest/stable canonical✓ snapd,disabled
snapd 2.59.2 19122 latest/stable canonical✓ snapd,disabled
snapd 2.59.4 19361 latest/stable canonical✓ snapdStatus for this snap is
# systemctl status var-lib-snapd-snap-snapd-18596.mount
● var-lib-snapd-snap-snapd-18596.mount
Loaded: not-found (Reason: Unit var-lib-snapd-snap-snapd-18596.mount not found.)
Active: failed (Result: exit-code) since Wed 2023-05-31 03:10:37 CEST; 20h ago
May 02 19:35:26 hostname systemd[1]: Mounting Mount unit for snapd, revision 18596...
May 02 19:35:26 hostname systemd[1]: Mounted Mount unit for snapd, revision 18596.
May 31 03:10:37 hostname systemd[1]: Unmounting Mount unit for snapd, revision 18596...
May 31 03:10:37 hostname umount[315707]: umount: /var/lib/snapd/snap/snapd/18596: not mounted.
May 31 03:10:37 hostname systemd[1]: var-lib-snapd-snap-snapd-18596.mount: Mount process exited, code=exited status=32
May 31 03:10:37 hostname systemd[1]: var-lib-snapd-snap-snapd-18596.mount: Failed with result 'exit-code'.
May 31 03:10:37 hostname systemd[1]: Unmounted Mount unit for snapd, revision 18596.And excerpt from the journalctl
May 31 03:10:27 hostname snapd[1739]: storehelpers.go:769: cannot refresh: snap has no updates available: "core20", "lxd"
May 31 03:10:36 hostname systemd[1]: Reloading.
May 31 03:10:36 hostname systemd[1]: /usr/lib/systemd/system/irqbalance.service:6: Unknown lvalue 'ConditionCPUs' in section 'Unit'
May 31 03:10:36 hostname systemd[1]: Starting dnf makecache...
May 31 03:10:36 hostname systemd[1]: Mounting Mount unit for snapd, revision 19361...
May 31 03:10:36 hostname systemd[1]: Mounted Mount unit for snapd, revision 19361.
May 31 03:10:36 hostname dnf[315621]: Updating Subscription Management repositories.
May 31 03:10:36 hostname snapd[1739]: daemon.go:521: gracefully waiting for running hooks
May 31 03:10:36 hostname snapd[1739]: daemon.go:523: done waiting for running hooks
May 31 03:10:36 hostname snapd[1739]: overlord.go:512: Released state lock file
May 31 03:10:36 hostname systemd[1]: snapd.service: Succeeded.
May 31 03:10:36 hostname systemd[1]: snapd.service: Service RestartSec=100ms expired, scheduling restart.
May 31 03:10:36 hostname systemd[1]: snapd.service: Scheduled restart job, restart counter is at 1.
May 31 03:10:36 hostname systemd[1]: Stopped Snap Daemon.
May 31 03:10:36 hostname systemd[1]: Starting Snap Daemon...
May 31 03:10:36 hostname snapd[315645]: overlord.go:268: Acquiring state lock file
May 31 03:10:36 hostname snapd[315645]: overlord.go:273: Acquired state lock file
May 31 03:10:36 hostname snapd[315645]: daemon.go:247: started snapd/2.58.3-1.el8 (series 16; classic; devmode) rhel/8.7 (amd64) linux/4.18.0-425.19.2.el8_7.x86.
May 31 03:10:36 hostname kernel: loop10: detected capacity change from 0 to 4096
May 31 03:10:36 hostname systemd[1]: tmp-syscheck\x2dmountpoint\x2d967325581.mount: Succeeded.
May 31 03:10:36 hostname snapd[315645]: daemon.go:340: adjusting startup timeout by 45s (pessimistic estimate of 30s plus 5s per snap)
May 31 03:10:36 hostname snapd[315645]: backends.go:58: AppArmor status: apparmor not enabled
May 31 03:10:36 hostname systemd[1]: Started Snap Daemon.
May 31 03:10:36 hostname dbus-daemon[1601]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' requested by ':1.115616' (uid=0 pid=315645 comm="/usr/libexec/snapd/snapd ")
May 31 03:10:36 hostname systemd[1]: Starting System clock and RTC settings service...
May 31 03:10:36 hostname dbus-daemon[1601]: [system] Successfully activated service 'org.freedesktop.timedate1'
May 31 03:10:36 hostname systemd[1]: Started System clock and RTC settings service.
May 31 03:10:37 hostname systemd[1]: Unmounting Mount unit for snapd, revision 18596...
May 31 03:10:37 hostname umount[315707]: umount: /var/lib/snapd/snap/snapd/18596: not mounted.
May 31 03:10:37 hostname systemd[1]: var-lib-snapd-snap-snapd-18596.mount: Mount process exited, code=exited status=32
May 31 03:10:37 hostname systemd[1]: var-lib-snapd-snap-snapd-18596.mount: Failed with result 'exit-code'.
May 31 03:10:37 hostname systemd[1]: Unmounted Mount unit for snapd, revision 18596.
May 31 03:10:37 hostname systemd[1]: Reloading.
May 31 03:10:37 hostname systemd[1]: /usr/lib/systemd/system/irqbalance.service:6: Unknown lvalue 'ConditionCPUs' in section 'Unit'
May 31 03:10:37 hostname snapd[315645]: storehelpers.go:769: cannot refresh snap "snapd": snap has no updates availableAnyone have an idea what happened and how to fix the issue / avoid in the future?
Thanks in advance