Uploaded image for project: 'Dev - Nexus Repo'
  1. Dev - Nexus Repo
  2. NEXUS-10154

OrientDb allocates massive disk cache on large systems

    XMLWordPrintable

    Details

    • Story Points:
      3
    • Sprint:
      Sprint 75

      Description

      OrientDB uses an automatic tuning algorithm to determine the upper size of its native memory disk cache. This algorithm assumes that serving Orient is the primary function of the box, and on larger system can end up allocating gigantic caches (on a system with a 1TB drive and 32Gb memory, Orient set an upper cache size of 29Gb).

      A pmap will show a large number of 'anon' segments:

      {{00007f67dc000000 65508K rw--- [ anon ]
      00007f67dfff9000 28K ----- [ anon ]
      00007f67e0000000 65508K rw--- [ anon ]
      00007f67e3ff9000 28K ----- [ anon ]
      00007f67e4000000 65508K rw--- [ anon ]
      00007f67e7ff9000 28K ----- [ anon ]
      00007f67e8000000 65508K rw--- [ anon ]
      00007f67ebff9000 28K ----- [ anon ]
      00007f67ec000000 65504K rw--- [ anon ]
      00007f67efff8000 32K ----- [ anon ]
      }}

      Stuart McCulloch points out that a system property can be used to set an explicit cache size (in Mb):

      storage.diskCache.bufferSize=4096

      We should consider:

      • Setting an appropriate maximum
      • Writing an algorithm that will replace Orient's tuning calculation, given that we're using Orient in an embedded mode
      • Documenting this property as something clients might tune on large installations

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              mprescott Michael Prescott
              Last Updated By:
              Peter Lynch
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Date of First Response:

                  tigCommentSecurity.panel-title