[NEXUS-12809] upgrading a large audit db can take a long time and provide no useful log messages - Sonatype JIRA

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Won't Fix
Affects Version/s: 3.2.1
Fix Version/s: None
Component/s: Logging, Upgrade
Labels:
- lhf
- performance

Description

A customer upgraded from Nexus 3.1.0 to Nexus 3.2.1.

During the upgrade, Nexus 3.2.1 was unavailable for close to 2 hours while the upgrade was being performed. The bulk of the time was during upgrade of the audit database from 1.0 to 1.1.

2017-03-31 16:20:49,005+0200 INFO  [FelixStartLevel] *SYSTEM org.sonatype.nexus.upgrade.internal.UpgradeServiceImpl - Upgrade audit from 1.0 to 1.1
2017-03-31 16:20:49,451+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,461+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 16:20:49,462+0200 ERROR [Finalizer] *SYSTEM com.orientechnologies.orient.core.storage.cache.OCachePointer - OCachePointer.finalize: readers != 0
2017-03-31 18:16:34,507+0200 INFO  [FelixStartLevel] *SYSTEM org.sonatype.nexus.upgrade.internal.UpgradeServiceImpl - Upgrade component from 1.1 to 1.2

Turns out the audit database in this case was 61GB in size.

/usr/local/sonatype-work/nexus3/db$ du -h
25M ./security
61G ./audit
776M ./component
19M ./analytics
104M ./config
18M ./OSystem
82M ./accesslog
62G .

Expected

long running upgrade steps should provide useful log messages indicating progress on regular basis
~~the ERROR messages that were logged should be investigated and explained/corrected~~ Dealt with on linked ticket
possibly address this slowness of this particular upgrade step by making it perform better

Attachments

Issue Links

mentioned in: Page Loading...

Activity

People

Assignee:: Joshua Hill

Reporter:: Peter Lynch

Last Updated By:: Peter Lynch

Team:: NXRM - Morpheus

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 03/31/17 04:58 PM

Updated:: 10/15/18 03:12 PM

Resolved:: 10/15/18 03:08 PM

Date of First Response:: 03/Apr/17 9:38 AM