View Issue Details

IDProjectCategoryView StatusLast Update
0006337Rocky-Linux-8kernelpublic2024-04-16 22:23
ReporterStephen Mirowski Assigned To 
PrioritynormalSeverityminorReproducibilityalways
Status newResolutionopen 
Platformx86_64OS8OS Version8.9
Summary0006337: Kernel not bootable - missing files
DescriptionEvery few releases of kernels for CentOS 8/RockyLinux 8.x are not bootable. Been seeing this over a period of years. Have to boot to previous kernel until next kernel is released. This makes automated updates challenging as a Host can become un-automatically bootable after running updates. This affects more than one computer.

Screenshot attached shows attempted boot with new kernel last week.
Steps To ReproduceInstall dnf updates
approx 1 out of 4 new kernels will be missing img


In text below you will notice that images are missing for both
4.18.0-513.11.1.el8_9.0.1.x86_64
and
4.18.0-513.24.1.el8_9.x86_64

uninstalling and reinstalling the new kernel doesn't produce a bootable kernel.
Additional Information$ ls -al /boot
total 292504
dr-xr-xr-x. 5 root root 4096 Apr 13 05:01 .
dr-xr-xr-x. 17 root root 224 Mar 2 2023 ..
-rw-r--r--. 1 root root 202133 Feb 11 02:53 config-4.18.0-513.11.1.el8_9.0.1.x86_64
-rw-r--r--. 1 root root 202129 Jan 10 15:09 config-4.18.0-513.11.1.el8_9.x86_64
-rw-r--r--. 1 root root 202129 Feb 21 13:45 config-4.18.0-513.18.1.el8_9.x86_64
-rw-r--r--. 1 root root 202129 Apr 4 11:23 config-4.18.0-513.24.1.el8_9.x86_64
-rw-r--r--. 1 root root 202110 Nov 29 11:05 config-4.18.0-513.9.1.el8_9.x86_64
drwx------. 3 root root 4096 Dec 31 1969 efi
drwx------. 2 root root 21 Apr 4 10:41 grub2
-rw-------. 1 root root 92088612 Mar 2 2023 initramfs-0-rescue-213a66710d824c3189e88d1add5f9eb0.img
-rw-------. 1 root root 30749131 Jan 13 05:04 initramfs-4.18.0-513.11.1.el8_9.x86_64.img
-rw-------. 1 root root 28315648 Feb 3 05:00 initramfs-4.18.0-513.11.1.el8_9.x86_64kdump.img
-rw-------. 1 root root 30745946 Mar 1 11:21 initramfs-4.18.0-513.18.1.el8_9.x86_64.img
-rw-------. 1 root root 28303872 Mar 2 05:00 initramfs-4.18.0-513.18.1.el8_9.x86_64kdump.img
drwxr-xr-x. 3 root root 21 Mar 2 2023 loader
lrwxrwxrwx. 1 root root 56 Feb 17 05:01 symvers-4.18.0-513.11.1.el8_9.0.1.x86_64.gz -> /lib/modules/4.18.0-513.11.1.el8_9.0.1.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Jan 13 05:03 symvers-4.18.0-513.11.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.11.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Mar 1 11:20 symvers-4.18.0-513.18.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.18.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Apr 13 05:01 symvers-4.18.0-513.24.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.24.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 51 Dec 2 05:01 symvers-4.18.0-513.9.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.9.1.el8_9.x86_64/symvers.gz
-rw-------. 1 root root 4488642 Feb 11 02:53 System.map-4.18.0-513.11.1.el8_9.0.1.x86_64
-rw-------. 1 root root 4488642 Jan 10 15:09 System.map-4.18.0-513.11.1.el8_9.x86_64
-rw-------. 1 root root 4489217 Feb 21 13:45 System.map-4.18.0-513.18.1.el8_9.x86_64
-rw-------. 1 root root 4489165 Apr 4 11:23 System.map-4.18.0-513.24.1.el8_9.x86_64
-rw-------. 1 root root 4487570 Nov 29 11:05 System.map-4.18.0-513.9.1.el8_9.x86_64
-rwxr-xr-x. 1 root root 10740016 Mar 2 2023 vmlinuz-0-rescue-213a66710d824c3189e88d1add5f9eb0
-rwxr-xr-x. 1 root root 11032216 Feb 11 02:53 vmlinuz-4.18.0-513.11.1.el8_9.0.1.x86_64
-rw-r--r--. 1 root root 177 Feb 11 02:52 .vmlinuz-4.18.0-513.11.1.el8_9.0.1.x86_64.hmac
-rwxr-xr-x. 1 root root 11032216 Jan 10 15:09 vmlinuz-4.18.0-513.11.1.el8_9.x86_64
-rw-r--r--. 1 root root 173 Jan 10 15:09 .vmlinuz-4.18.0-513.11.1.el8_9.x86_64.hmac
-rwxr-xr-x. 1 root root 11036312 Feb 21 13:45 vmlinuz-4.18.0-513.18.1.el8_9.x86_64
-rw-r--r--. 1 root root 173 Feb 21 13:44 .vmlinuz-4.18.0-513.18.1.el8_9.x86_64.hmac
-rwxr-xr-x. 1 root root 11036312 Apr 4 11:23 vmlinuz-4.18.0-513.24.1.el8_9.x86_64
-rw-r--r--. 1 root root 173 Apr 4 11:23 .vmlinuz-4.18.0-513.24.1.el8_9.x86_64.hmac
-rwxr-xr-x. 1 root root 10913432 Nov 29 11:05 vmlinuz-4.18.0-513.9.1.el8_9.x86_64
-rw-r--r--. 1 root root 172 Nov 29 11:04 .vmlinuz-4.18.0-513.9.1.el8_9.x86_64.hmac
TagsNo tags attached.
Attached Files

Activities

Akemi Yagi

Akemi Yagi

2024-04-16 00:57

reporter   ~0006733

> uninstalling and reinstalling the new kernel doesn't produce a bootable kernel.

Just wanted to ask -- are you absolutely certain that the kernel install process was not interrupted? To be sure, wait for a few minutes before rebooting, maybe?
Stephen Mirowski

Stephen Mirowski

2024-04-16 22:23

reporter   ~0006766

I do have automatic updates in crontab in CentOS 7 (yum), 8, Rocky 8, 9 like this:

* 5 * * 6 dnf -y update && /sbin/shutdown -r now

but the issue can occur when doing updates manually. I just uninstalled the latest affected kernel and reinstalled manually and img missing again. 4.18.0-513.11.1.el8_9.0.1.x86_64 failed to make img when installing manually or via cron job in March.

Boot after kernel reinstall

# ls -l /boot
total 292480
-rw-r--r--. 1 root root 202133 Feb 11 02:53 config-4.18.0-513.11.1.el8_9.0.1.x86_64
-rw-r--r--. 1 root root 202129 Jan 10 15:09 config-4.18.0-513.11.1.el8_9.x86_64
-rw-r--r--. 1 root root 202129 Feb 21 13:45 config-4.18.0-513.18.1.el8_9.x86_64
-rw-r--r--. 1 root root 202129 Apr 4 11:23 config-4.18.0-513.24.1.el8_9.x86_64
-rw-r--r--. 1 root root 202110 Nov 29 11:05 config-4.18.0-513.9.1.el8_9.x86_64
drwx------. 3 root root 4096 Dec 31 1969 efi
drwx------. 2 root root 21 Apr 4 10:41 grub2
-rw-------. 1 root root 92088612 Mar 2 2023 initramfs-0-rescue-213a66710d824c3189e88d1add5f9eb0.img
-rw-------. 1 root root 30749131 Jan 13 05:04 initramfs-4.18.0-513.11.1.el8_9.x86_64.img
-rw-------. 1 root root 28315648 Feb 3 05:00 initramfs-4.18.0-513.11.1.el8_9.x86_64kdump.img
-rw-------. 1 root root 30745946 Mar 1 11:21 initramfs-4.18.0-513.18.1.el8_9.x86_64.img
-rw-------. 1 root root 28303872 Mar 2 05:00 initramfs-4.18.0-513.18.1.el8_9.x86_64kdump.img
drwxr-xr-x. 3 root root 21 Mar 2 2023 loader
lrwxrwxrwx. 1 root root 56 Feb 17 05:01 symvers-4.18.0-513.11.1.el8_9.0.1.x86_64.gz -> /lib/modules/4.18.0-513.11.1.el8_9.0.1.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Jan 13 05:03 symvers-4.18.0-513.11.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.11.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Mar 1 11:20 symvers-4.18.0-513.18.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.18.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 52 Apr 13 05:01 symvers-4.18.0-513.24.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.24.1.el8_9.x86_64/symvers.gz
lrwxrwxrwx. 1 root root 51 Dec 2 05:01 symvers-4.18.0-513.9.1.el8_9.x86_64.gz -> /lib/modules/4.18.0-513.9.1.el8_9.x86_64/symvers.gz
-rw-------. 1 root root 4488642 Feb 11 02:53 System.map-4.18.0-513.11.1.el8_9.0.1.x86_64
-rw-------. 1 root root 4488642 Jan 10 15:09 System.map-4.18.0-513.11.1.el8_9.x86_64
-rw-------. 1 root root 4489217 Feb 21 13:45 System.map-4.18.0-513.18.1.el8_9.x86_64
-rw-------. 1 root root 4489165 Apr 4 11:23 System.map-4.18.0-513.24.1.el8_9.x86_64
-rw-------. 1 root root 4487570 Nov 29 11:05 System.map-4.18.0-513.9.1.el8_9.x86_64
-rwxr-xr-x. 1 root root 10740016 Mar 2 2023 vmlinuz-0-rescue-213a66710d824c3189e88d1add5f9eb0
-rwxr-xr-x. 1 root root 11032216 Feb 11 02:53 vmlinuz-4.18.0-513.11.1.el8_9.0.1.x86_64
-rwxr-xr-x. 1 root root 11032216 Jan 10 15:09 vmlinuz-4.18.0-513.11.1.el8_9.x86_64
-rwxr-xr-x. 1 root root 11036312 Feb 21 13:45 vmlinuz-4.18.0-513.18.1.el8_9.x86_64
-rwxr-xr-x. 1 root root 11036312 Apr 4 11:23 vmlinuz-4.18.0-513.24.1.el8_9.x86_64
-rwxr-xr-x. 1 root root 10913432 Nov 29 11:05 vmlinuz-4.18.0-513.9.1.el8_9.x86_64


End of dnf log after manually reinstalling.

# less /var/log/dnf.log


Installing:
 ESC[1mESC[32mkernel ESC(BESC[m x86_64 4.18.0-513.24.1.el8_9 baseos 10 M

Transaction Summary
===============================================================================================================================================================
Install 1 Package

2024-04-16T15:10:06-0700 INFO Total size: 10 M
2024-04-16T15:10:06-0700 INFO Installed size: 0
2024-04-16T15:10:07-0700 INFO Downloading Packages:
2024-04-16T15:10:07-0700 DEBUG Using rpmkeys executable at /bin/rpmkeys to verify signatures
2024-04-16T15:10:08-0700 INFO Running transaction check
2024-04-16T15:10:11-0700 INFO Transaction check succeeded.
2024-04-16T15:10:11-0700 INFO Running transaction test
2024-04-16T15:10:12-0700 INFO Transaction test succeeded.
2024-04-16T15:10:12-0700 DDEBUG timer: transaction test: 1066 ms
2024-04-16T15:10:12-0700 INFO Running transaction
2024-04-16T15:10:12-0700 DDEBUG RPM transaction start.
2024-04-16T15:10:13-0700 DDEBUG RPM transaction over.
2024-04-16T15:10:13-0700 DDEBUG timer: verify transaction: 425 ms
2024-04-16T15:10:13-0700 DDEBUG timer: transaction: 1723 ms
2024-04-16T15:10:13-0700 DEBUG Completion plugin: Generating completion cache...
2024-04-16T15:10:14-0700 DEBUG Installed: kernel-4.18.0-513.24.1.el8_9.x86_64
2024-04-16T15:10:14-0700 INFO Complete!
2024-04-16T15:10:14-0700 DDEBUG Cleaning up.
2024-04-16T15:10:14-0700 DDEBUG /var/cache/dnf/baseos-3e608afeebc9a90b/packages/kernel-4.18.0-513.24.1.el8_9.x86_64.rpm removed
2024-04-16T15:10:14-0700 DDEBUG Plugins were unloaded.

Issue History

Date Modified Username Field Change
2024-04-15 22:24 Stephen Mirowski New Issue
2024-04-15 22:24 Stephen Mirowski File Added: Screenshot 2024-04-14 093931.png
2024-04-16 00:57 Akemi Yagi Note Added: 0006733
2024-04-16 22:23 Stephen Mirowski Note Added: 0006766