Uploaded image for project: 'DC/OS'
  1. DC/OS
  2. DCOS_OSS-633

navstar heavy cpu usage on agents

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: DC/OS 1.8.0
    • Fix Version/s: None
    • Component/s: navstar

      Description

      NavStar's beam.smp has been constantly and frequently peaked at 100% CPU about 10s duration for roughly every minute. from the top below its cpu time is 25x of mesos-agent.

      ```
      top - 20:36:47 up 98 days, 2:43, 1 user, load average: 2.23, 1.85, 1.66
      Tasks: 180 total, 3 running, 177 sleeping, 0 stopped, 0 zombie
      %Cpu(s): 34.4 us, 44.2 sy, 5.3 ni, 11.7 id, 0.0 wa, 1.4 hi, 2.9 si, 0.0 st
      KiB Mem: 15404012 total, 6387308 used, 9016704 free, 339952 buffers
      KiB Swap: 0 total, 0 used, 0 free. 3113908 cached Mem

      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      2082 root 20 0 3670976 258244 6720 S 97.7 1.7 32887:01 beam.smp
      22756 root 39 19 3548 2888 844 R 83.7 0.0 0:15.22 du
      22723 root 39 19 6084 5192 768 R 82.4 0.0 0:29.77 du
      1839 root 20 0 4044888 337876 6636 S 35.2 2.2 9193:49 beam.smp
      24712 root 20 0 747224 65440 15164 S 22.3 0.4 2623:47 cadvisor
      22450 root 20 0 47564 15300 5324 S 8.0 0.1 0:04.00 haproxy
      2201 root 20 0 1069124 50128 33040 S 2.0 0.3 1278:42 mesos-agent
      ```
      $ ps 2082
      PID TTY STAT TIME COMMAND
      2082 ? Sl 32887:34 /opt/mesosphere/packages/navstar--a8b11d176a5985f9c448b2077e16465d93c427fb/navstar/erts-8.0/bin/beam.smp -Bd -K true -A 64 -P 256000 -C multi_time
      ```

        Attachments

          Activity

            People

            • Assignee:
              dgoel Deepak Goel
              Reporter:
              uschen Chen Liang
              Team:
              DELETE Networking Team
              Watchers:
              Albert Strasheim (Inactive), Avinash Sridharan (Inactive), Chen Liang, Deepak Goel
            • Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Zendesk Support

                  NextupJiraPlusStatus

                  Error rendering 'slack.nextup.jira:nextup-jira-plus-status'. Please contact your JIRA administrators.