Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-25159

Missing rpm in yum index

    XMLWordPrintable

    Details

      Description

      Hi,

      We receive some alerts of our users about missing rpm in yum index of nexus.

      The problem seems to occurs since the upgrade of nexus 3.26.1 ( we were previously in 3.24 )

      Notes :

      • Most of the time, rpms are correctly added to the index.
      • No exception are raised in the logs when the problem occurs.
      • we have 2 rpm repositories :
        • release rpm repository :
          • repodata depth : 0
          • layout policy : permissive
          • deployment policy : disable redeployed
          • Strict content type validation : unchecked
        • snapshots rpm repository :
          • we don't use the yum index on this repository => don't know if the pb occurs on it.

      Here is an example of the problem :

      • 18:01:39,409 : the rpm is published in nexus
      • 18:02:39,409 : the rebuild of the index is triggered
      • 18:02:58,631 : the task see the rpm : aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm
      • 5 days later : the user raise the problem :
      • the rpm is visible in the Nexus UI and searchable without issue.
      • the primary.xml.tar.gz file doesn't contain the rpm aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm

      Curent workarround found :

      • try to repair the index with the task : Repair - Rebuild Yum repository metadata
      • if not successful, delete the folder repodata and relaunch the same task ( take 30min on our side to rebuild everything )

      I have activated the following log in debug : org.sonatype.nexus.repository.yum.internal.createrepo
      Here is the log :

      	2020-08-28 18:01:39,409+0200 INFO  [event-13-thread-6134]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Scheduling rebuild of yum metadata to start in 60 seconds
	2020-08-28 18:02:39,409+0200 INFO  [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Rebuilding yum metadata for repository rpms-releases
	2020-08-28 18:02:39,410+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Calculating directories for generating Yum metadata for repository rpms-releases
	2020-08-28 18:02:55,096+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Writing non-repomd metadata for repository rpms-releases and directory
	2020-08-28 18:02:55,097+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Directory  is marked as use cache, appending metadata from existing cached files
	2020-08-28 18:02:58,631+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.2/eeeeee-batch-2009.37.2.rpm to metadata for repository rpms-releases and directory
	2020-08-28 18:03:27,783+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Building repomd.xml for repository rpms-releases and directory
	2020-08-28 18:03:27,784+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/filelists8162901877983537299xml.gz from directory  to get checksums
	2020-08-28 18:03:29,927+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/primary41351989893611260xml.gz from directory  to get checksums
	2020-08-28 18:03:33,783+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/other6644496962076866325xml.gz from directory  to get checksums
	2020-08-28 18:03:34,298+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Searching for comps.xml to add to metadata for directory
	2020-08-28 18:03:37,705+0200 INFO  [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Rebuilding yum metadata for repository rpms-snapshots
	2020-08-28 18:03:37,706+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Calculating directories for generating Yum metadata for repository rpms-snapshots
	2020-08-28 18:03:54,829+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Writing non-repomd metadata for repository rpms-snapshots and directory
	2020-08-28 18:03:54,829+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Directory  is marked as use cache, appending metadata from existing cached files
	2020-08-28 18:03:55,120+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/bbb/cccc/dd/eeeeee-batch/2009.37.3-SNAPSHOT/eeeeee-batch-2009.37.3-20200828.160326-1.rpm to metadata for repository rpms-snapshots and directory
	2020-08-28 18:03:58,431+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Adding RPM aaaa/fffffff/ggggggg-batch/1.0.95-SNAPSHOT/ggggggg-batch-1.0.95-20200828.160058-3785.rpm to metadata for repository rpms-snapshots and directory
	2020-08-28 18:04:01,982+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temp files used in Yum metadata generation
	2020-08-28 18:04:01,982+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/filelists8162901877983537299xml.gz
	2020-08-28 18:04:01,984+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/primary41351989893611260xml.gz
	2020-08-28 18:04:01,986+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/other6644496962076866325xml.gz
	2020-08-28 18:04:01,987+0200 DEBUG [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/repomd6951237412623915173xml
	2020-08-28 18:04:02,206+0200 INFO  [event-13-thread-6163]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Finished rebuilding yum metadata for repository rpms-releases
	2020-08-28 18:04:53,596+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/filelists8203537981418061738xml.gz from directory  to get checksums
	2020-08-28 18:05:06,697+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/primary884396891467141071xml.gz from directory  to get checksums
	2020-08-28 18:05:13,124+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Reading metadata file ../sonatype-work/nexus3/tmp/other3049668733710604194xml.gz from directory  to get checksums
	2020-08-28 18:05:13,230+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Searching for comps.xml to add to metadata for directory
	2020-08-28 18:05:35,594+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temp files used in Yum metadata generation
	2020-08-28 18:05:35,594+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/filelists8203537981418061738xml.gz
	2020-08-28 18:05:35,603+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/primary884396891467141071xml.gz
	2020-08-28 18:05:35,609+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/other3049668733710604194xml.gz
	2020-08-28 18:05:35,610+0200 DEBUG [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoServiceImpl - Removing temporary Yum metadata file ../sonatype-work/nexus3/tmp/repomd8839387859266120903xml
	2020-08-28 18:05:35,831+0200 INFO  [event-13-thread-6166]  nexususer org.sonatype.nexus.repository.yum.internal.createrepo.CreateRepoFacetImpl - Finished rebuilding yum metadata for repository rpms-snapshots

      Any question, please, don't hesitate
      Regards
      Aldric

        Attachments

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. NEXUS-24901 some rpms in a yum hosted repo are not added to a rebuilt hosted repo primary.xml metadata file due to OrientAsyncHelper$QueueFeedingResultListener Timed out adding query result to queue

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              aldric.berges@cetelem.fr Aldric Berges
              Last Updated By:
              Michael Prescott Michael Prescott
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title