Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-14636

allow customizing maven metadata rebuild db query buffer size and timeout values to mitigate IllegalStateException Timed out reading result from queue

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 3.6.0
    • Fix Version/s: 3.6.1
    • Component/s: Maven
    • Story Points:
      1
    • Sprint:
      Core Sprint 106, Core Sprint 107

      Description

      Customers with large databases can have issues with the maven metadata rebuild with timeouts. Maven metadata can be rebuilt with the explicit task or as a side effect of snapshot removal tasks.

      Currently this implementation uses an asynchronous Orient query where Orient is feeding results into the backing queue faster than the metadata code can process them. Ultimately once the limits of the backing queue are hit (defaults are size 128, timeout 1 minute) then an error is thrown:

      IllegalStateException: Timed out reading query result from queue 511695dd after 60 seconds

      One of the approaches to alleviate this issue without looking at larger re-writes is that we want to make these values configurable

      Acceptance:

      • The MetadataRebuilder.browseGAVs query needs to ultimately use OrientAsyncHelper.asyncIterable with the bufferSize and timeoutSeconds options. This will require adding a StorageTx.browse that exposes these two params.
      • Configuration option for the buffer size in browseGAVs query. Default should be 1000
      • Configuration option for the timeout in the browseGAVs query. Default should be 60 seconds

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              bradbeck Brad Beck
              Reporter:
              cpeters Collin Peters
              Last Updated By:
              Peter Lynch
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title