Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-33294

logged reason missing when components and assets are filtered during postgresql migration

    Details

    • Story Points:
      1
    • Sprint:
      NXRM Sentinels Sprint 41
    • Notability:
      2
    • InvestmentLayer:
      support-escalated
    • Aha Concept:
      non-concept

      Description

      ISSUE:

      Customer migrating Nexus 3.39.0.1 from OrientDB to Postgresql and found docker layers are missing post upgrade.

       

      Below are some of the missing docker images

      explore-ui-v2:latest

      explore-api-v2:latest

       

      CAUSE:

      DB Migration log shows the missing docker layers were filtered

       

      16:12:10 [main] INFO  c.s.n.d.m.p.c.ComponentProcessor - Filtered docker Component record ComponentRecord(bucket=#49:0, format=docker, attributes={docker={imageName=explore-ui-v2, imageTag=latest}}, group=null, name=explore-ui-v2, version=latest, tags=[], lastUpdated=1564478297150)
      
      16:15:44 [main] INFO  c.s.n.d.m.p.c.ComponentProcessor - Filtered docker Component record ComponentRecord(bucket=#49:0, format=docker, attributes={docker={imageName=explore-api-v2, imageTag=latest}}, group=null, name=explore-api-v2, version=latest, tags=[], lastUpdated=1565079009427)
      
      $ rg -c 'Filtered docker Component' db-migrator-2022-06-08T16-10.log
      1628 
      
      

       

      We can see most of the assets are filtered for this migration.

      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - Migration job took 9 minutes to execute
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - 500507 records were processed
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - 292682 records were filtered
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - 14 records were skipped
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - 207811 records were migrated
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - Created 'Rebuild repository browse' and 'Rebuild repository search' tasks. They will automatically one-time run after starting your Nexus Repository instance.
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - Migrated only early access formats: [APT, COCOAPODS, CONAN, CONDA, DOCKER, GITLFS, GO, HELM, MAVEN2, NPM, NUGET, P2, PYPI, R, RAW, RUBYGEMS, YUM]
      16:20:28 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - Cleaning orient temporary files...16:20:29 [main] INFO  c.s.n.d.m.l.ProvidingJobInfoListener - Cleaning finished
      

      CURRENT BEHAVIOR:

      Assets are missing post upgrade. Reverting back to OrientDB, assets are accessible.

       

      EXPECTED BEHAVIOR:

      Need more details on why assets are filtered to be printed in the db migrator log, so customer can take any remedial action or workaround. 

       

       

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              orudyk Oleksii Rudyk
              Reporter:
              sappusamy Srinivasan Appusamy
              CC:
              Danny Kitchen
              Last Updated By:
              Peter Lynch Peter Lynch
              Team:
              NXRM - Sentinels
              Owner:
              Oleksii Rudyk Oleksii Rudyk
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title