MENU
      Cloud Hadoop (VPC) metrics

        Cloud Hadoop (VPC) metrics


        Article summary

        Available in VPC

        This section provides information on the performance and operational metrics of the Cloud Hadoop service. Performance/operational metrics can be managed in an integrated manner through NAVER Cloud Platform's Cloud Insight service and can be used for various monitoring purposes.

        Note

        See the Cloud Insight API Guide for information on how to use performance/operational metrics for monitoring.

        Basic information

        The following is the basic information of the Cloud Hadoop service for using performance/operational metrics.

        • Product name (prodName)
          • System/Cloud Hadoop(VPC)
        • Product key (cw_key)
          • 564076991498817536
        • Metric type

        Performance/operation metrics

        The performance/operational metrics of the Cloud Hadoop service are as follows.

        CPU

        CPU-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          user_rtoFLOAT%Basicuser ratio (%)Min1,Min5,Min30,Hour2,Day1
          idle_rtoFLOAT%Basicidle ratio (%)Min1,Min5,Min30,Hour2,Day1
          sys_rtoFLOAT%Basicsystem ratio (%)Min1,Min5,Min30,Hour2,Day1
          used_rtoFLOAT%Basicused ratio (%)Min1,Min5,Min30,Hour2,Day1
          nice_rto (Linux)FLOAT%Basicnice ratio (%)Min1,Min5,Min30,Hour2,Day1
          irq_rto (Linux)FLOAT%Basicinterrupt ratio (%)Min1,Min5,Min30,Hour2,Day1
          softirq_rto (Linux)FLOAT%Basicsoft interrupt ratio (%)Min1,Min5,Min30,Hour2,Day1
          io_wait_rto (Linux)FLOAT%BasicIO wait ratio (%)Min1,Min5,Min30,Hour2,Day1
          prv_mde_exec_tm_rto (Windows)FLOAT%BasicCPU used ratio in the privileged mode (%)Min1,Min5,Min30,Hour2,Day1
          dly_pcd_call_tm_rto (Windows)FLOAT%BasicCPU used ratio for deferred procedure calls (DPCs) (%)Min1,Min5,Min30,Hour2,Day1
          interrupt_tm_rto (Windows)FLOAT%BasicCPU used ratio for interrupts (%)Min1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          cpu_idx

        Memory

        Memory-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          mem_mbFLOATMBBasictotal memory (MB)Min1,Min5,Min30,Hour2,Day1
          used_mem_mbFLOATMBBasicused memory (MB), used_mem_mb = total_mem_mb - free_mem_mb - bffr_mb - cache_mbMin1,Min5,Min30,Hour2,Day1
          free_mem_mbFLOATMBBasicfree memory (MB)Min1,Min5,Min30,Hour2,Day1
          mem_usertFLOAT%Basic, DefaultMemory Utilization(%), mem_usert = used_mem_mb / total_mem_mb * 100Min1,Min5,Min30,Hour2,Day1
          shared_mem_mb (Linux)FLOATMBBasicshared memory (MB)Min1,Min5,Min30,Hour2,Day1
          bffr_mb (Linux)FLOATMBBasicbuffers (MB)Min1,Min5,Min30,Hour2,Day1
          cache_mb (Linux)FLOATMBBasiccache (MB)Min1,Min5,Min30,Hour2,Day1
          pgin_mbFLOATMBBasicpage in (MB)Min1,Min5,Min30,Hour2,Day1
          pgout_mbFLOATMBBasicpage out (MB)Min1,Min5,Min30,Hour2,Day1
          pgfault_tcnt (Linux)LONGnum/secBasicpage fault count per secondMin1,Min5,Min30,Hour2,Day1
          pgfault_rto (Windows)FLOAT%Basicpage fault ratio (%)Min1,Min5,Min30,Hour2,Day1
          swap_mbFLOATMBBasicswap (MB)Min1,Min5,Min30,Hour2,Day1
          swap_used_mbFLOATMBBasicswap used (MB)Min1,Min5,Min30,Hour2,Day1
          swap_free_mbFLOATMBBasicswap free (MB)Min1,Min5,Min30,Hour2,Day1
          swap_usertFLOAT%Basicswap used ratio (%)Min1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo

        Disk

        Disk-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          read_byt_cntFLOATbytes/secBasicread bytesMin1,Min5,Min30,Hour2,Day1
          write_byt_cntFLOATbytes/secBasicwrite bytesMin1,Min5,Min30,Hour2,Day1
          read_cntFLOATnum/secBasicdisk read count per secondMin1,Min5,Min30,Hour2,Day1
          write_cntFLOATnum/secBasicdisk write count per secondMin1,Min5,Min30,Hour2,Day1
          avgrq_szFLOATnumBasicThe average size (in sectors) of the requests that were issued to the deviceMin1,Min5,Min30,Hour2,Day1
          avgqu_szFLOATnum/secBasicThe average queue length of the requests that were issued to the deviceMin1,Min5,Min30,Hour2,Day1
          await_tmFLOATmillisecondBasicThe average time (in milliseconds) for I/O requests issued to the device to be served including the time spent by the requests in queue and the time spent servicing themMin1,Min5,Min30,Hour2,Day1
          svc_tmFLOATmillisecondBasicThe average service time (in milliseconds) for I/O requests that were issued to the deviceMin1,Min5,Min30,Hour2,Day1
          used_rtoFLOAT%BasicPercentage of elapsed time during which I/O requests were issued to the device (bandwidth utilization for the device). Device saturation occurs when this value is close to 100%.Min1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          disk_idx

        File System

        File system-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          all_byt_cntFLOATMBBasicfs bytesMin1,Min5,Min30,Hour2,Day1
          used_byt_cntFLOATMBBasicused bytesMin1,Min5,Min30,Hour2,Day1
          free_byt_cntFLOATMBBasicfree bytesMin1,Min5,Min30,Hour2,Day1
          fs_usertFLOAT%Basicused ratioMin1,Min5,Min30,Hour2,Day1
          ind_usertFLOAT%Basicinodes usage(Linux)Min1,Min5,Min30,Hour2,Day1
          dev_nmSTRING-Basicdevice nameMin1
          mnt_stat_cdINTEGER-Basicmount state(1: mounted, 0: unmounted)Min1
          fs_type_nmSTRING-Basicfile system typeMin1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          mnt_nm

        Network

        Network-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          snd_bpsFLOATbits/secBasicsend bits per secondMin1,Min5,Min30,Hour2,Day1
          rcv_bpsFLOATbits/secBasicreceive bits per secondMin1,Min5,Min30,Hour2,Day1
          snd_ppsFLOATpackets/secBasicsend packets per secondMin1,Min5,Min30,Hour2,Day1
          rcv_ppsFLOATpackets/secBasicreceive packets per secondMin1,Min5,Min30,Hour2,Day1
          snd_fail_packt_cntINTEGERnumBasicsend fail packetsMin1,Min5,Min30,Hour2,Day1
          rcv_fail_packt_cntINTEGERnumBasicreceive fail packetsMin1,Min5,Min30,Hour2,Day1
          clsn_packt_cnt (Linux)INTEGERnumBasiccollisions packetsMin1,Min5,Min30,Hour2,Day1
          nic_ipSTRING-BasicIP AddressMin1
          macaddrSTRING-BasicMAC AddressMin1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          nic_desc

        Process

        Process-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          cpu_usertFLOAT%Basicper process CPU used ratio (%)Min1,Min5,Min30,Hour2,Day1
          p_proc_mem_usertFLOAT%Basicper process memory used ratio (%)Min1,Min5,Min30,Hour2,Day1
          vir_mem_byt_cntFLOATKBBasicvirtual memory sizeMin1,Min5,Min30,Hour2,Day1
          cpu_tm_ssFLOAT-Basiccpu timeMin1,Min5,Min30,Hour2,Day1
          prit_rnkINTEGER-BasicpriorityMin1,Min5,Min30,Hour2,Day1
          nice_val (Linux)INTEGER-BasicniceMin1,Min5,Min30,Hour2,Day1
          thd_cntINTEGERnumBasicthreads countMin1,Min5,Min30,Hour2,Day1
          proc_t_cpu_usert (Linux)FLOAT%Basiccpu usage (%)Min1,Min5,Min30,Hour2,Day1
          pf (Windows)LONGnum/secBasicpage fault countMin1,Min5,Min30,Hour2,Day1
          proc_idINTEGER-Basicprocess IDMin1
          parent_pidINTEGER-Basicparent process IDMin1
          proc_nmSTRING-Basicprocess nameMin1
          proc_cpu_cntINTEGERnumBasiccpu core count being usedMin1,Min5,Min30,Hour2,Day1
          proc_stat_cdSTRING-Basicprocess stateMin1
          strt_ymdt (Linux)STRING-Basicprocess start timeMin1
        • Dimension
          Dimension nameData type
          type
          instanceNo

        Server

        Server-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          boot_timeLONGsecBasicboot time (sec)Min1
          time_deviationLONGmillisecondBasictime deviation with NTP serverMin1
          user_cntINTEGERnumBasicuser countMin1
          is_onINTEGERflagBasic(deprecated) 1 if server is alive, 0 otherwiseMin1
          is_rebootedINTEGERflagBasic1 if reboot is detected, 0 otherwiseMin1
          avg_cpu_used_rtoFLOAT%Basic, DefaultCPU Utilization AverageMin1,Min5,Min30,Hour2,Day1
          max_cpu_used_rtoFLOAT%BasicCPU used ratio maximum (%)Min1,Min5,Min30,Hour2,Day1
          avg_cpu_idle_rtoFLOAT%BasicCPU idle ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_cpu_user_rtoFLOAT%BasicCPU user ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_cpu_sys_rto (Linux)FLOAT%BasicCPU system ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_nice_rto (Linux)FLOAT%BasicCPU nice ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_irq_rto (Linux)FLOAT%BasicCPU interrupt ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_softirq_rto (Linux)FLOAT%BasicCPU soft interrupt ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_io_wait_rto (Linux)FLOAT%BasicCPU IO wait ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_prv_mde_exec_tm_rto (Windows)FLOAT%BasicCPU used ratio in the privileged modeMin1,Min5,Min30,Hour2,Day1
          avg_dly_pcd_call_tm_rto (Windows)FLOAT%BasicCPU used ratio for deferred procedure calls (DPCs) (%)Min1,Min5,Min30,Hour2,Day1
          avg_interrup_tm_rto (Windows)FLOAT%BasicCPU used ratio for interrupts (%)Min1,Min5,Min30,Hour2,Day1
          avg_read_byt_cntFLOATbytes/secBasicdisk read bytes averageMin1,Min5,Min30,Hour2,Day1
          avg_write_byt_cntFLOATbytes/secBasicdisk write bytes averageMin1,Min5,Min30,Hour2,Day1
          avg_read_cntFLOATnum/secBasicdisk read count per second averageMin1,Min5,Min30,Hour2,Day1
          avg_write_cntFLOATnum/secBasicdisk write count per second averageMin1,Min5,Min30,Hour2,Day1
          max_read_byt_cntINTEGERbytes/secBasicdisk read bytes maximumMin1,Min5,Min30,Hour2,Day1
          max_write_byt_cntINTEGERbytes/secBasicdisk write bytes maximumMin1,Min5,Min30,Hour2,Day1
          max_read_cntINTEGERnum/secBasicdisk read count per second maximumMin1,Min5,Min30,Hour2,Day1
          max_write_cntINTEGERnum/secBasicdisk write count per second maximumMin1,Min5,Min30,Hour2,Day1
          fs_all_mbFLOATMBBasicall block file systems size (MB)Min1,Min5,Min30,Hour2,Day1
          fs_used_mbFLOATMBBasicall block file systems used (MB)Min1,Min5,Min30,Hour2,Day1
          fs_free_mbFLOATMBBasicall block file systems used ratio (%)Min1,Min5,Min30,Hour2,Day1
          avg_fs_usertFLOAT%Basic, DefaultFile System Utilization AverageMin1,Min5,Min30,Hour2,Day1
          max_fs_usertFLOAT%Basicfile system used ratio maximum (%)Min1,Min5,Min30,Hour2,Day1
          avg_ind_usert (Linux)FLOAT%Basicfile system inodes used ratio average (%)Min1,Min5,Min30,Hour2,Day1
          avg_snd_bpsFLOATbits/secBasic, DefaultNetwork Out AverageMin1,Min5,Min30,Hour2,Day1
          max_snd_bpsFLOATbits/secBasicnetwork send bits/sec maximumMin1,Min5,Min30,Hour2,Day1
          avg_rcv_bpsFLOATbits/secBasic, DefaultNetwork In AverageMin1,Min5,Min30,Hour2,Day1
          max_rcv_bpsFLOATbits/secBasicnetwork receive bits/sec maximumMin1,Min5,Min30,Hour2,Day1
          avg_snd_ppsFLOATpackets/secBasicnetwork send packets/sec averageMin1,Min5,Min30,Hour2,Day1
          max_snd_ppsFLOATpackets/secBasicnetwork send packets/sec maximumMin1,Min5,Min30,Hour2,Day1
          avg_rcv_ppsFLOATpackets/secBasicnetwork receive packets/sec averageMin1,Min5,Min30,Hour2,Day1
          max_rcv_ppsFLOATpackets/secBasicnetwork receive packets/sec maximumMin1,Min5,Min30,Hour2,Day1
          avg_snd_fail_packt_cntFLOATnumBasicnetwork send fail packets averageMin1,Min5,Min30,Hour2,Day1
          avg_rcv_fail_packt_cntFLOATnumBasicnetwork receive fail packets averageMin1,Min5,Min30,Hour2,Day1
          avg_clsn_packt_cnt (Linux)FLOATnumBasicnetwork collisions packets averageMin1,Min5,Min30,Hour2,Day1
          proc_cntINTEGERnumBasicprocesses countMin1,Min5,Min30,Hour2,Day1
          run_que_lenINTEGERnumBasicrunning processesMin1,Min5,Min30,Hour2,Day1
          proc_mem_usertFLOAT%Basicall processes memory used ratio (%)Min1,Min5,Min30,Hour2,Day1
          load_average_1mFLOAT%BasicCPU load 1 minute (%)Min1,Min5,Min30,Hour2,Day1
          load_average_5mFLOAT%BasicCPU load 5 minute average (%)Min1,Min5,Min30,Hour2,Day1
          load_average_15mFLOAT%BasicCPU load 15 minute average (%)Min1,Min5,Min30,Hour2,Day1
          gpu_countINTEGERcountBasicTotal GPU CountMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo

        GPU

        GPU-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          vmem_usageINTEGER%BasicCurrent GPU MEM UsageMin1,Min5,Min30,Hour2,Day1
          vmem_usage_mibINTEGERMiBBasicCurrent GPU MEM UsageMin1,Min5,Min30,Hour2,Day1
          usageINTEGER%BasicCurrent GPU UsageMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          gpu_idx

        Plugin Process

        Plugin process-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          is_process_upINTEGERflagBasic1 if process is up, 0 otherwiseMin1,Min5,Min30,Hour2,Day1
          process_countINTEGERnumBasicprocess countMin1,Min5,Min30,Hour2,Day1
          avg_cpu_usertFLOAT%Basicprocess used AverageMin1,Min5,Min30,Hour2,Day1
          avg_mem_usertFLOAT%Basicaverage memory usage %Min1,Min5,Min30,Hour2,Day1
          avg_mem_byt_cntFLOATKBBasicmemory usageMin1,Min5,Min30,Hour2,Day1
          avg_thd_cntFLOATnumBasicthread thread countMin1,Min5,Min30,Hour2,Day1
          tot_cpu_usertFLOAT%Basictotal cpu usage %Min1,Min5,Min30,Hour2,Day1
          tot_mem_usertFLOAT%Basictotal memory usage %Min1,Min5,Min30,Hour2,Day1
          tot_mem_byt_cntFLOATKBBasictotal memory usageMin1,Min5,Min30,Hour2,Day1
          tot_thd_cntINTEGERnumBasictotal thread countMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          proc_name

        Plugin File

        Plugin file-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          file_modifiedINTEGERflagBasic1: modified, 0: not modifiedMin1,Min5,Min30,Hour2,Day1
          file_existINTEGERflagBasic1: exist, 0: not existMin1,Min5,Min30,Hour2,Day1
          file_sizeLONGbytesBasicfile size(byte)Min1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          path

        Plugin Port

        Plugin port-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          is_port_upINTEGERflagBasic1: port is up, 0: is downMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData type
          type
          instanceNo
          port

        Agent

        Agent-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          agent_versionINTEGER-Basic-Min1
        • Dimension
          Dimension nameData type
          type
          instanceNo

        Hadoop

        Hadoop-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          active_nodesINTEGERnumBasic, Defaultactive_nodesMin1,Min5,Min30,Hour2,Day1
          allocated_containerINTEGERnumBasicallocated_containerMin1,Min5,Min30,Hour2,Day1
          allocated_mbINTEGERMBBasic, Defaultallocated_mbMin1,Min5,Min30,Hour2,Day1
          allocated_v_coresINTEGERnumBasicallocated_v_coresMin1,Min5,Min30,Hour2,Day1
          apps_completedINTEGERnumBasic, Defaultapps_completedMin1,Min5,Min30,Hour2,Day1
          apps_failedINTEGERnumBasic, Defaultapps_failedMin1,Min5,Min30,Hour2,Day1
          apps_killedINTEGERnumBasic, Defaultapps_killedMin1,Min5,Min30,Hour2,Day1
          apps_pendingINTEGERnumBasic, Defaultapps_pendingMin1,Min5,Min30,Hour2,Day1
          apps_runningINTEGERnumBasic, Defaultapps_runningMin1,Min5,Min30,Hour2,Day1
          apps_submittedINTEGERnumBasic, Defaultapps_submittedMin1,Min5,Min30,Hour2,Day1
          available_mbINTEGERMBBasic, Defaultavailable_mbMin1,Min5,Min30,Hour2,Day1
          capacity_remaining_gbINTEGERGBBasic, Defaultcapacity_remaining_gbMin1,Min5,Min30,Hour2,Day1
          corrupt_blocksINTEGERnumBasiccorrupt_blocksMin1,Min5,Min30,Hour2,Day1
          decommissioned_nodesINTEGERnumBasicdecommissioned_nodesMin1,Min5,Min30,Hour2,Day1
          hdfs_bytes_readINTEGERbytesBasichdfs_bytes_readMin1,Min5,Min30,Hour2,Day1
          hdfs_bytes_writtenINTEGERbytesBasichdfs_bytes_writtenMin1,Min5,Min30,Hour2,Day1
          hdfs_utilizationFLOAT%Basic, Defaulthdfs_utilizationMin1,Min5,Min30,Hour2,Day1
          lost_nodesINTEGERnumBasic, Defaultlost_nodesMin1,Min5,Min30,Hour2,Day1
          missing_blocksINTEGERnumBasic, Defaultmissing_blocksMin1,Min5,Min30,Hour2,Day1
          num_live_data_nodesINTEGERnumBasic, Defaultnum_live_data_nodesMin1,Min5,Min30,Hour2,Day1
          pending_containersINTEGERnumBasicpending_containersMin1,Min5,Min30,Hour2,Day1
          pending_deletion_blocksINTEGERnumBasicpending_deletion_blocksMin1,Min5,Min30,Hour2,Day1
          pending_replication_blocksINTEGERnumBasicpending_replication_blocksMin1,Min5,Min30,Hour2,Day1
          pending_v_coresINTEGERnumBasicpending_v_coresMin1,Min5,Min30,Hour2,Day1
          rebooted_nodesINTEGERnumBasicrebooted_nodesMin1,Min5,Min30,Hour2,Day1
          reserved_containersINTEGERnumBasicreserved_containersMin1,Min5,Min30,Hour2,Day1
          reserved_mbINTEGERMBBasicreserved_mbMin1,Min5,Min30,Hour2,Day1
          total_loadINTEGERnumBasictotal_loadMin1,Min5,Min30,Hour2,Day1
          total_mbINTEGERMBBasic, Defaulttotal_mbMin1,Min5,Min30,Hour2,Day1
          total_nodesINTEGERnumBasic, Defaulttotal_nodesMin1,Min5,Min30,Hour2,Day1
          under_replicated_blocksINTEGERnumBasicunder_replicated_blocksMin1,Min5,Min30,Hour2,Day1
          unhealthy_nodesINTEGERnumBasic, Defaultunhealthy_nodesMin1,Min5,Min30,Hour2,Day1
          yarn_memory_available_percentageFLOAT%Basic, Defaultyarn_memory_available_percentageMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData typeidDimension
          typeSTRING
          instanceNoSTRING
          clusterNameSTRING

        Queue

        Queue-related performance/operational metrics are as follows.

        • Metric
          Metric nameData typeUnitMetric typeDescriptionIntervalAggregation
          queue_used_memoryFLOATGBBasic, Defaultqueue_used_memoryMin1,Min5,Min30,Hour2,Day1
          queue_used_memory_percentFLOAT%Basic, Defaultqueue_used_memory_percentMin1,Min5,Min30,Hour2,Day1
          queue_used_v_coresINTEGERnumBasic, Defaultqueue_used_v_coresMin1,Min5,Min30,Hour2,Day1
          queue_used_v_cores_percentFLOAT%Basic, Defaultqueue_used_v_cores_percentMin1,Min5,Min30,Hour2,Day1
        • Dimension
          Dimension nameData typeidDimension
          typeSTRING
          mbrNoSTRING
          instanceNoSTRING
          clusterNameSTRING
          queueNameSTRING

        Was this article helpful?

        Changing your password will log you out immediately. Use the new password to log back in.
        First name must have atleast 2 characters. Numbers and special characters are not allowed.
        Last name must have atleast 1 characters. Numbers and special characters are not allowed.
        Enter a valid email
        Enter a valid password
        Your profile has been successfully updated.