View Issue Details

IDProjectCategoryView StatusLast Update
0008647Rocky-Linux-9Generalpublic2025-08-11 16:06
ReporterBenedikt Steinbusch Assigned ToMustafa Gezen  
PrioritynormalSeverityminorReproducibilityalways
Status confirmedResolutionopen 
Summary0008647: Rocky 9.5 devel repository repodata out of sync with repo content
DescriptionThe (modular) repodata for the Rocky 9.5 devel repositories contains packages which cannot be downloaded and instead return an HTTP 404 code, e.g.:

$ dnf --repofrompath devel,https://download.rockylinux.org/pub/rocky/9.5/devel/aarch64/os/ --repo devel repoquery --disable-modular-filtering jansi-javadoc
[...]
jansi-javadoc-0:2.3.3-7.el9_5.aarch64
jansi-javadoc-0:2.4.0-7.module+el9.5.0+29736+f35c064b.noarch
jansi-javadoc-0:2.4.0-9.module+el9.4.0+20023+657f08ea.noarch

Yet there is no https://download.rockylinux.org/pub/rocky/9.5/devel/aarch64/os/Packages/j/jansi-javadoc-0:2.4.0-7.module+el9.5.0+29736+f35c064b.noarch.rpm

I also reported this via Mattermost, but I understand that this is a time when people have other things to do, so I am leaving this as a more permanent report.

Happy holidays!
TagsNo tags attached.

Relationships

has duplicate 0008746 closedNeil Hanlon package missing from Rocky Linux Developer Repo 
has duplicate 0008779 closedNeil Hanlon Rocky 9 devel repo missing package 

Activities

Ian Hodgson

Ian Hodgson

2025-01-08 20:45

reporter   ~0009280

This also appear to be the case in the x86_64 repo https://download.rockylinux.org/pub/rocky/9/devel/x86_64/os/
Neil Hanlon

Neil Hanlon

2025-01-10 18:43

administrator   ~0009340

Hi all,

We have identified the problem and are working to rectify it. Due to a known inefficiency/deficiency with the storage subsystem (yumrepofs) within Peridot (our build system), fixing problems with modular packages in the final repositories is tricky. Specifically, modules have to be processed serially and the locking mechanism is not optimized. There's work underway (https://github.com/rocky-linux/peridot/discussions/120) to rework the underlying storage and locking process to be not only much faster but fix the nondeterministic behavior seen in this ticket.

The precise cause of the issue here is that both the `javapackages-bootstrap` and `maven` modules both provide `jansi-javadoc`. One of these was properly updated with the 9.5 version, but the other was not and, because multiple package versions (NEVRA) cannot be represented in a single repository in yumrepofs at this time, this nondeterministic behavior is seen. Additionally, we don't test the devel repository as it is a best-effort production out of the buildroot, and thus this mismatch was not noticed.

We're working on the fix which is including some of the performance improvements mentioned early, and I'll provide further updates as they become available. Thank you for your patience.
Mustafa Gezen

Mustafa Gezen

2025-01-10 20:14

manager   ~0009341

This should be resolved next compose
Matthias Sitte

Matthias Sitte

2025-01-16 14:19

reporter   ~0009373

Any idea when next compose will happen?
Will Twomey

Will Twomey

2025-02-27 14:25

reporter   ~0009604

Wanted to follow up here as this is still an issue, any ETA on the next compose?
Benedikt Steinbusch

Benedikt Steinbusch

2025-06-02 09:08

reporter   ~0010297

This issue still affects the fresh Rocky 9.6 repositories.
Matthias Sitte

Matthias Sitte

2025-06-02 09:17

reporter   ~0010298

I believe as of now (June 2, 11:15 AM CEST), the 9.6 repos aren't released yet, so the https://download.rockylinux.org/pub/rocky/9/devel/x86_64/os/Packages/ still points to the "old" 9.5 packages with the issue.
Right now, https://download.rockylinux.org/pub/rocky/9.6/ responds with a HTTP 403 to me. I guess the 9.6 release is right around the corner.
Benedikt Steinbusch

Benedikt Steinbusch

2025-06-02 09:56

reporter   ~0010330

As I understand it, 9.6 is being synced to mirrors at the moment. The official release has not happened, but the repositories are accessible in the staging environment. The metadata now refers to a package jansi-javadoc-0:2.4.0-7.module+el9.5.0+29736+f35c064b.noarch which does not exist in the repository.
Kevin Smith

Kevin Smith

2025-07-09 17:19

reporter   ~0010561

A month has gone since the above response and the problem is still occurring when I try to sync the DEVEL 9.6 repo, the repos can't still be syncing?

404, message='Not Found', url=URL('https://download.rockylinux.org/pub/rocky/9.6/devel/x86_64/os/Packages/j/jansi-javadoc-2.4.0-7.module%2Bel9.5.0%2B29736%2Bf35c064b.noarch.rpm')
Robert Ruggiero

Robert Ruggiero

2025-07-14 14:33

reporter   ~0010627

This has been an open issue for 6 months? Is there any update on when a resolution will be forthcoming?
Ali Visram

Ali Visram

2025-08-06 11:05

reporter   ~0010957

Any update please? - we cannot promote to new release on foreman
Louis Abel

Louis Abel

2025-08-07 20:46

administrator   ~0010991

There are no updates at this time.

Please note: The devel repository is not a default enabled repository (buildroot only) and is not recommended to be enabled or used in the general case. As such, primary repositories (non-devel) receive the utmost priority.

As peridot/yumrepofs is in maintenance only mode and this is a volunteer effort, our priorities are currently in other places of our infrastructure. While I understand that this is an issue for you (and others), the devel repository as well as the maintenance-only nature of yfs and peridot puts this issue on the back burner for the time being.

In the meantime, I can ask Mustafa and Neil to look into it and provide an update, but I cannot guarantee a response or a shift in priority for this issue as devel is build root only and not meant for general usage.

Thank you.
Ali Visram

Ali Visram

2025-08-11 16:06

reporter   ~0011056

Ok thanks - we have changed the policy on foreman from "immediate" to "on demand" to get round it for now

Issue History

Date Modified Username Field Change
2024-12-23 10:44 Benedikt Steinbusch New Issue
2024-12-23 14:23 Neil Hanlon Assigned To => Neil Hanlon
2024-12-23 14:23 Neil Hanlon Status new => assigned
2025-01-07 16:10 Neil Hanlon Assigned To Neil Hanlon => Mustafa Gezen
2025-01-07 16:10 Neil Hanlon Status assigned => acknowledged
2025-01-08 20:38 Neil Hanlon Relationship added has duplicate 0008746
2025-01-08 20:45 Ian Hodgson Note Added: 0009280
2025-01-09 14:30 Neil Hanlon Relationship added has duplicate 0008779
2025-01-10 18:43 Neil Hanlon Status acknowledged => confirmed
2025-01-10 18:43 Neil Hanlon Note Added: 0009340
2025-01-10 20:14 Mustafa Gezen Note Added: 0009341
2025-01-16 14:19 Matthias Sitte Note Added: 0009373
2025-02-27 14:25 Will Twomey Note Added: 0009604
2025-06-02 09:08 Benedikt Steinbusch Note Added: 0010297
2025-06-02 09:17 Matthias Sitte Note Added: 0010298
2025-06-02 09:56 Benedikt Steinbusch Note Added: 0010330
2025-07-09 17:19 Kevin Smith Note Added: 0010561
2025-07-14 14:33 Robert Ruggiero Note Added: 0010627
2025-08-06 11:05 Ali Visram Note Added: 0010957
2025-08-07 20:46 Louis Abel Note Added: 0010991
2025-08-11 16:06 Ali Visram Note Added: 0011056