Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-25386

APT repository inconsistent during uploads

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.27.0
    • Fix Version/s: None
    • Component/s: APT
    • Labels:

      Description

      During upload of APT packages, the repository becomes inconsistent, especially when performing parallel uploads. Sometimes the consumer receives broken files rendering its cache corrupt. The situation can then be cleared with apt-get clean or (sometimes) deleting the cached files manually only.

      Looks like NXRM does not update the repo atomically.

      This happens while uploads to the repos are running:

      # rm -rf /var/cache/apt/* /var/lib/apt/lists/* && apt update
      Get:1 https://repo.lab.hcsd.de:50443/repository/apt-bionic bionic InRelease [2102 B]
      Get:2 https://repo.lab.hcsd.de:50443/repository/apt-bionic bionic/main all Packages [66.3 kB]
      Get:3 https://repo.lab.hcsd.de:50443/repository/apt-bionic bionic/main amd64 Packages [173 kB]
      Err:3 https://repo.lab.hcsd.de:50443/repository/apt-bionic bionic/main amd64 Packages
        Hash Sum mismatch
        Hashes of expected file:
         - Filesize:172725 [weak]
         - SHA256:c2a1af7e95d483a17f9e9156b4f3a5bed84b2fa5104ec060a16edb936448b731
         - MD5Sum:bee78b92531385970e3d88d3f9820c1a [weak]
        Hashes of received file:
         - SHA256:d628b622e4a4a1ae04564678e57dce146756f0f1a7a0da94a27f7bccd96da466
         - MD5Sum:60a3737c86f6d00875dbe38d3c582828 [weak]
         - Filesize:172725 [weak]
        Last modification reported: Fri, 25 Sep 2020 08:39:16 +0000
        Release file created at: Fri, 25 Sep 2020 08:39:15 +0000
      Fetched 241 kB in 0s (1362 kB/s)                
      Reading package lists... Done
      N: Skipping acquire of configured file 'main/binary-i386/Packages' as repository 'https://repo.lab.hcsd.de:50443/repository/apt-bionic bionic InRelease' doesn't support architecture 'i386'
      E: Failed to fetch https://repo.lab.hcsd.de:50443/repository/apt-bionic/dists/bionic/main/binary-amd64/Packages.bz2  Hash Sum mismatch
         Hashes of expected file:
          - Filesize:172725 [weak]
          - SHA256:c2a1af7e95d483a17f9e9156b4f3a5bed84b2fa5104ec060a16edb936448b731
          - MD5Sum:bee78b92531385970e3d88d3f9820c1a [weak]
         Hashes of received file:
          - SHA256:d628b622e4a4a1ae04564678e57dce146756f0f1a7a0da94a27f7bccd96da466
          - MD5Sum:60a3737c86f6d00875dbe38d3c582828 [weak]
          - Filesize:172725 [weak]
         Last modification reported: Fri, 25 Sep 2020 08:39:16 +0000
         Release file created at: Fri, 25 Sep 2020 08:39:15 +0000
      E: Some index files failed to download. They have been ignored, or old ones used instead.
      

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              Stephan_A Stephan Austermühle
              Last Updated By:
              Joe Tom Joe Tom
              Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Date of First Response:

                  tigCommentSecurity.panel-title