UM-0046-A0 - DT500 Concise Users Manual - dataTaker

Appendix — Accuracy of the Datataker Data LoggersPage 35ABSOLUTE ACCURACYTolerance at 25°C Tolerance –20 to 70°CFull % of Plus % of PlusRange Scale Units Resolution Units Full Scale Offset Units Full Scale Offset UnitsABSOLUTE ACCURACYTolerance at 25°C Tolerance –20 to 70°CFull % of Plus % of PlusRange Scale Units Resolution Units Full Scale Offset Units Full Scale Offset UnitsVOLTAGE100V ▲ 642 V 28.0 mV ±0.26% ±150 mV ±0.31% ±150 mV50V ◆ 64.2 V 2.8 mV ±0.26% ±14 mV ±0.31% ±14 mV5V 6.42 V 0.28 mV ±0.26% ±1.2 mV ±0.31% ±1.2 mV2.5V 3000 mV 130 µV ±0.06% ±700 µV ±0.16% ±700 µV250mV 300 mV 13 µV ±0.06% ±63 µV ±0.17% ±63 µV25mV 30 mV 1.3 µV ±0.06% ±5.7 µV ±0.16% ±5.7 µVRESISTANCE7KΩ (4W,I) 8 kΩ 0.52 Ω ±0.20% ±2.0 Ω ±0.31% ±2.0 Ω1KΩ (4W,I) 1.2 kΩ 0.052 Ω ±0.15% ±0.26 Ω ±0.24% ±0.26 Ω100Ω (4W,I) 0.12 kΩ 0.0052 Ω ±0.10% ±0.023 Ω ±0.17% ±0.023 Ω500Ω (4W,II) 800 Ω 52 mΩ ±0.15% ±280 mΩ ±0.24% ±280 mΩ100Ω (4W,II) 120 Ω 5.2 mΩ ±0.10% ±26 mΩ ±0.17% ±26 mΩ10Ω (4W,II) 12 Ω 0.52 mΩ ±0.15% ±2.3 mΩ ±0.24% ±2.3 mΩRESISTANCE, 3-Wire Compensation (Lead Resistance 10Ω)7KΩ (3W,I) 8 kΩ 0.52 Ω ±0.20% ±2.9 Ω ±0.31% ±2.9 Ω1KΩ (3W,I) 1.2 kΩ 0.052 Ω ±0.15% ±0.32 Ω ±0.24% ±0.32 Ω100Ω (3W,I) 0.12 kΩ 0.0052 Ω ±0.10% ±0.09 Ω ±0.17% ±0.09 Ω500Ω (3W,II) 800 Ω 52 mΩ ±0.15% ±320 mΩ ±0.24% ±320 mΩ100Ω (3W,II) 120 Ω 5.2 mΩ ±0.10% ±66.0 mΩ ±0.17% ±66.0 mΩ10Ω (3W,II) 12 Ω 0.52 mΩ ±0.15% ±43 mΩ ±0.24% ±43 mΩCURRENT25mA 30 mA 1.3 µA ±0.16% ±7 µA ±0.25% ±7 µA2.5mA 3 mA 0.13 µA ±0.16% ±0.7 µA ±0.26% ±0.7 µA0.25mA 0.3 mA 0.013 µA ±0.16% ±0.06 µA ±0.25% ±0.06 µAFREQUENCY300kHz 300 kHz 0.0022 % ±0.052% ±6.5 Hz ±0.061% ±6.5 Hz30kHz 30 kHz 0.0022 % ±0.052% ±0.65 Hz ±0.061% ±0.65 Hz3kHz 3 kHz 0.0022 % ±0.052% ±0.065 Hz ±0.061% ±0.065 Hz300Hz 0.3 kHz 0.0022 % ±0.052% ±0.007 Hz ±0.061% ±0.007 HzTIMETEMPERATURE (LM35)24 hrs 1 sec 0.03 sec per day 6.3 sec per day0.78 sec per month 3.16 min per month°C 0.013 °C ±0.00% ±1.5 °C ±2.00% ±1.5 °CTHERMOCOUPLES, Reference Un-Trimmed25mV range °C 0.04 °C ±0.06% ±2.7 °C ±0.16% ±2.7 °C250mV range °C 0.43 °C ±0.06% ±4.6 °C ±0.17% ±4.6 °CTHERMOCOUPLES, Reference Trimmed25mV range °C 0.04 °C ±0.06% ±1.2 °C ±0.16% ±1.2 °C250mV range °C 0.43 °C ±0.06% ±3.1 °C ±0.17% ±3.1 °CRTDs, 3-WirePt100 (100Ω)