What Is Resolution (Digits) Mean in DMM Specification?

Updated Nov 7, 2023

Reported In

Hardware

  • PXI-4065
  • PXI-4071
  • PXI-4072
  • PXIe-4081
  • PXIe-4082
  • PXIe-4080
  • PXI-4070
  • PCI-4065
  • PCI-4070
  • PCIe-4065
  • USB-4065
  • Digital Multimeter Device

Issue Details

I am using the NI PXIe-4065. I would like to know what the meaning of resolution (digit) in the specification. What does resolution mean like 6 ½, 5 ½, 4 ½?

Solution

Typically, a digit such as 5 ½ indicates the number of digits displayed on the digital multimeter's readings. The first digit, 5 digits, means you can display up to 5 digits. For 5 digits, 00000 ~ 99999 can be displayed, but for 5 ½, this can be displayed when 000000 ~ 199999 are displayed. In other words, if ½ is used, it is used when the first digit is represented by only 0,1.

Additional Information

Digits can be defined as :
Digits of resolution = log10 (total span/absolute unit of resolution)
For more information about the digits of resolution, please refer to the following documentation page: Resolution.