Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-19089

large set of dirs/files under directpath/nexus-repository-docker dir

    XMLWordPrintable

    Details

    • Notability:
      3

      Description

      We use Nexus OSS 3.14.0-04 currently in prod and have TB's worth of data on the repository across multiple nodes. We are noticing a lot of empty directories + dir with files left behind under nexus blob directory /blobs/default/content/directpath/nexus-repository-docker.  Lot of them dated older by months and they had reached a point where directory listing and any du commands on blobs directory is hung due to directory listing failing to scan 2 million dir's underneath directpath.

      The blob directory itself is hosted on a NAS drive

      Are these dirs/files left out behind from delete/cleanup activities?

      If so anyway to safely clean them up without impacting any current stored data?

      We do periodically perform clean up tasks for deleting unused images and compaction, but none of them seems to help removing these dirs/files. Even though there are lot of empty dirs, dirs do take some minimal space on disk and impacts us operationally. 

      /opt/app/swm/aftswmrepository/repository/nexus/zlp11275/blobs/default/content/directpath/nexus-repository-docker
      [nexus-repository-docker]$ ls -f -1 | wc -l
      2065810

      /opt/app/aft/aftswmrepository/repository/nexus/zlp11274/blobs/default/content/directpath/nexus-repository-docker/
      [nexus-repository-docker]$ ls -f -1 | wc -l
      2086317

      /opt/app/aft/aftswmrepository/repository/nexus/zlp11313/blobs/default/content/directpath/nexus-repository-docker/
      [nexus-repository-docker]$ ls -f -1 | wc -l

      2032479

       

      Posting some of the dir and file contents as well

      cat 839f63f2-bf30-473c-bdc4-61a05c8eb27b/0.properties
      #2018-08-20 03:58:27,834+0000
      #Mon Aug 20 03:58:27 UTC 2018
      @BlobStore.direct-path=true
      @docker-name=com.att.swm-nexus/com.nexus.perftest_delete_3xxwy7c_11
      @BlobStore.created-by=nexus-repository-docker
      size=0
      creationTime=1534737507833
      @docker-range=null
      @BlobStore.blob-name=nexus-repository-docker/839f63f2-bf30-473c-bdc4-61a05c8eb27b/0
      sha1=da39a3ee5e6b4b0d3255bfef95601890afd80709
      $ cat f6e4a588-7a00-48fd-92f8-fb8b53b35fcc/
      1) 0.bytes
      2) 0.properties
      $ cat f6e4a588-7a00-48fd-92f8-fb8b53b35fcc/0.properties
      #2018-08-20 03:58:48,443+0000
      #Mon Aug 20 03:58:48 UTC 2018
      @BlobStore.direct-path=true
      @docker-name=com.att.swm-nexus/com.nexus.perftest_3xxwy7c_51
      @BlobStore.created-by=nexus-repository-docker
      size=0
      creationTime=1534737528438
      @docker-range=null
      @BlobStore.blob-name=nexus-repository-docker/f6e4a588-7a00-48fd-92f8-fb8b53b35fcc/0
      sha1=da39a3ee5e6b4b0d3255bfef95601890afd80709

       

      $ ls -alrt 314839b0-09b4-46cf-821b-f4c1e863e1cb
      total 14952
      drwxr-xr-x 2 aft aft 4096 Dec 2 17:04 .
      drwxr-xr-x 148820 aft aft 15241216 Feb 10 13:03 ..
      $ ls -alrt ea622807-34a0-4606-9a30-01518fd4bd3e
      total 14952
      drwxr-xr-x 2 aft aft 4096 Dec 2 17:04 .
      drwxr-xr-x 148820 aft aft 15241216 Feb 10 13:03 ..

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              mbucher Michael Bucher
              Reporter:
              Thaniga Thaniga Siva
              Last Updated By:
              Peter Lynch Peter Lynch
              Votes:
              5 Vote for this issue
              Watchers:
              15 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title