View Issue Details

IDProjectCategoryView StatusLast Update
0008086CloudGeneralpublic2024-10-18 13:38
ReporterJohn O'Brien Assigned To 
PrioritynormalSeveritymajorReproducibilityalways
Status newResolutionopen 
PlatformEC2OSRockyOS Version9.4 aarch64
Summary0008086: EC2 instance bricked after updating kernel to 5.14.0-427.40.1
DescriptionAn AWS EC2 instance of Rocky 9.4 on aarch64 becomes unresponsive on next boot after updating the kernel packages to 5.14.0-427.40.1.
Steps To Reproduce1. In us-east-2, launch AMI ID ami-018925a289077b035 ("Rocky-9-EC2-Base-9.4-20240509.0.aarch64") on a t4g.medium instance
2. Observe that the initial kernel version is 5.14.0-427.13.1
3. Run `dnf update -y` and confirm that the kernel is updated to 5.14.0-427.40.1 (or later, presumably)
4. Reboot the instance
5. Instance is bricked
Additional InformationDuring the update, the kernel-core scriptlet emits this error:

dracut-install: Failed to find module 'xen_netfront'
dracut: FAILED: /usr/lib/dracut/dracut-install -D /var/tmp/dracut.NZeuPh/initramfs --kerneldir /lib/modules/5.14.0-427.40.1.el9_4.aarch64/ -m xen_netfront xen-blkfront
dracut-install: Failed to find module 'xen_netfront'
dracut: FAILED: /usr/lib/dracut/dracut-install -D /var/tmp/dracut.Tk4Tzu/initramfs --kerneldir /lib/modules/5.14.0-427.40.1.el9_4.aarch64/ -m xen_netfront xen-blkfront

The xen-netfront and xen-blkfront modules are not present on aarch64 as confirmed by searching in /lib/modules and inspecting the output of `lsinitrd` on a newly-launched instance. Deleting /etc/dracut.conf.d/xen.conf prior to updating the kernel makes the error go away but does not prevent the instance from becoming bricked.

To avoid the problem, run the following before upgrading the kernel.

sudo dnf install -y python3-dnf-plugin-versionlock
sudo dnf versionlock kernel kernel-core kernel-modules kernel-modules-core
TagsNo tags attached.

Activities

John O'Brien

John O'Brien

2024-10-18 13:38

reporter   ~0008515

Also, I was unable to reproduce this with Rocky 9.4 x86_64, and RHEL 9.4 on either architecture.

Issue History

Date Modified Username Field Change
2024-10-18 13:26 John O'Brien New Issue
2024-10-18 13:38 John O'Brien Note Added: 0008515