Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-12809

upgrading a large audit db can take a long time and provide no useful log messages

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 3.2.1
    • Fix Version/s: None
    • Component/s: Logging, Upgrade
    • Labels:

      Description

      A customer upgraded from Nexus 3.1.0 to Nexus 3.2.1.

      During the upgrade, Nexus 3.2.1 was unavailable for close to 2 hours while the upgrade was being performed. The bulk of the time was during upgrade of the audit database from 1.0 to 1.1.

      2017-03-31 16:20:49,005+0200 INFO  [FelixStartLevel] *SYSTEM org.sonatype.nexus.upgrade.internal.UpgradeServiceImpl - Upgrade audit from 1.0 to 1.1
      2017-03-31 16:20:49,451+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
      2017-03-31 18:16:34,507+0200 INFO  [FelixStartLevel] *SYSTEM org.sonatype.nexus.upgrade.internal.UpgradeServiceImpl - Upgrade component from 1.1 to 1.2
      

      Turns out the audit database in this case was 61GB in size.

      /usr/local/sonatype-work/nexus3/db$ du -h
      25M ./security
      61G ./audit
      776M ./component
      19M ./analytics
      104M ./config
      18M ./OSystem
      82M ./accesslog
      62G .

      Expected

      • long running upgrade steps should provide useful log messages indicating progress on regular basis
      • the ERROR messages that were logged should be investigated and explained/corrected Dealt with on linked ticket
      • possibly address this slowness of this particular upgrade step by making it perform better

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              jhill Joshua Hill
              Reporter:
              plynch Peter Lynch
              Last Updated By:
              Peter Lynch Peter Lynch
              Team:
              NXRM - Morpheus
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title