Details
Description
Hi,
We receive some alerts of our users about missing rpm in yum index of nexus.
The problem seems to occurs since the upgrade of nexus 3.26.1 ( we were previously in 3.24 )
Notes :
- Most of the time, rpms are correctly added to the index.
- No exception are raised in the logs when the problem occurs.
- we have 2 rpm repositories :
- release rpm repository :
- repodata depth : 0
- layout policy : permissive
- deployment policy : disable redeployed
- Strict content type validation : unchecked
- snapshots rpm repository :
- we don't use the yum index on this repository => don't know if the pb occurs on it.
- release rpm repository :
Here is an example of the problem :
- 18:01:39,409 : the rpm is published in nexus
- 18:02:39,409 : the rebuild of the index is triggered
- 18:02:58,631 : the task see the rpm : aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm
- 5 days later : the user raise the problem :
- the rpm is visible in the Nexus UI and searchable without issue.
- the primary.xml.tar.gz file doesn't contain the rpm aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm
Curent workarround found :
- try to repair the index with the task : Repair - Rebuild Yum repository metadata
- if not successful, delete the folder repodata and relaunch the same task ( take 30min on our side to rebuild everything )
I have activated the following log in debug : org.sonatype.nexus.repository.yum.internal.createrepo
Here is the log :
2020-08-28 18:01:39,409+0200 INFO [event-13-thread-6134] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Scheduling rebuild of yum metadata to start in 60 seconds 2020-08-28 18:02:39,409+0200 INFO [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Rebuilding yum metadata for repository rpms-releases 2020-08-28 18:02:39,410+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Calculating directories for generating Yum metadata for repository rpms-releases 2020-08-28 18:02:55,096+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Writing non-repomd metadata for repository rpms-releases and directory 2020-08-28 18:02:55,097+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Directory is marked as use cache, appending metadata from existing cached files 2020-08-28 18:02:58,631+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm to metadata for repository rpms-releases and directory 2020-08-28 18:03:27,783+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Building repomd.xml for repository rpms-releases and directory 2020-08-28 18:03:27,784+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/filelists8162901877983537299xml.gz from directory to get checksums 2020-08-28 18:03:29,927+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/primary41351989893611260xml.gz from directory to get checksums 2020-08-28 18:03:33,783+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/other6644496962076866325xml.gz from directory to get checksums 2020-08-28 18:03:34,298+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Searching for comps.xml to add to metadata for directory 2020-08-28 18:03:37,705+0200 INFO [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Rebuilding yum metadata for repository rpms-snapshots 2020-08-28 18:03:37,706+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Calculating directories for generating Yum metadata for repository rpms-snapshots 2020-08-28 18:03:54,829+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Writing non-repomd metadata for repository rpms-snapshots and directory 2020-08-28 18:03:54,829+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Directory is marked as use cache, appending metadata from existing cached files 2020-08-28 18:03:55,120+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.3-SNAPSHOT/eeeeee-batch-2009.37.3-20200828.160326-1.rpm to metadata for repository rpms-snapshots and directory 2020-08-28 18:03:58,431+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/fffffff/ggggggg-batch/1.0.95-SNAPSHOT/ggggggg-batch-1.0.95-20200828.160058-3785.rpm to metadata for repository rpms-snapshots and directory 2020-08-28 18:04:01,982+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temp files used in Yum metadata generation 2020-08-28 18:04:01,982+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/filelists8162901877983537299xml.gz 2020-08-28 18:04:01,984+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/primary41351989893611260xml.gz 2020-08-28 18:04:01,986+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/other6644496962076866325xml.gz 2020-08-28 18:04:01,987+0200 DEBUG [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/repomd6951237412623915173xml 2020-08-28 18:04:02,206+0200 INFO [event-13-thread-6163] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Finished rebuilding yum metadata for repository rpms-releases 2020-08-28 18:04:53,596+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/filelists8203537981418061738xml.gz from directory to get checksums 2020-08-28 18:05:06,697+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/primary884396891467141071xml.gz from directory to get checksums 2020-08-28 18:05:13,124+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/other3049668733710604194xml.gz from directory to get checksums 2020-08-28 18:05:13,230+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Searching for comps.xml to add to metadata for directory 2020-08-28 18:05:35,594+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temp files used in Yum metadata generation 2020-08-28 18:05:35,594+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/filelists8203537981418061738xml.gz 2020-08-28 18:05:35,603+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/primary884396891467141071xml.gz 2020-08-28 18:05:35,609+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/other3049668733710604194xml.gz 2020-08-28 18:05:35,610+0200 DEBUG [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/repomd8839387859266120903xml 2020-08-28 18:05:35,831+0200 INFO [event-13-thread-6166] nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Finished rebuilding yum metadata for repository rpms-snapshots
Any question, please, don't hesitate
Regards
Aldric
Attachments
Issue Links
- is related to
-
NEXUS-24901 some rpms in a yum hosted repo are not added to a rebuilt hosted repo primary.xml metadata file due to OrientAsyncHelper$QueueFeedingResultListener Timed out adding query result to queue
-
- Closed
-