When digitizing the samples, the voltage at each sample time is converted to a number. This is done by comparing the voltage with a number of levels. The resulting number is the number of the highest level that's still lower than the voltage. The number of levels is determined by the resolution. The higher the resolution, the more levels are available and the more accurate the input signal can be reconstructed. In the image below, the same signal is digitized, using three different amounts of levels: 16, 32 and 64.
The number of available levels is determined by the resolution:
number of levels = 2 resolution in bits
The used resolutions in the previous image are respectively: 4 bits, 5 bits and 6 bits.
The smallest detectable voltage difference depends on the resolution and the input range. This voltage can be calculated as:
minimum voltage = full scale range / number of levels
In the 200 mV range, the full scale ranges from -200 mV to +200 mV, the full range is 400 mV. When a 12 bit resolution is used, there are 212 = 4096 levels. This results in a smallest detectable voltage step of 0.400 V / 4096 = 97.7 µV. In 16 bit resolution this step is 0.400 V / 65536 = 6.1 µV
Changing the resolution of an instrument in the Multi Channel software can be done in various different ways:
and
on the instrument toolbar
on the instrument toolbar and
selecting the required value from the popup menu.
on the channel toolbar and selecting the required resolution from the
popup menu
The Handyscope HS3 has a native resolution of 12 bits. It also has user selectable resolutions of 8 bits, 14 bits and 16 bits. That results in the full range being divided in 256 levels (8 bits), 4096 levels (12 bits), 16384 levels (14 bits) or 65536 levels (16 bits). The smallest detectable voltage steps are then:
| Input range | Smallest voltage step | |||
|---|---|---|---|---|
| 8 bits | 12 bits | 14 bits | 16 bits | |
| 80 V | 625.0 mV | 39.06 mV | 9.7656 mV | 2.44141 mV |
| 40 V | 312.5 mV | 19.53 mV | 4.8828 mV | 1.22070 mV |
| 20 V | 156.3 mV | 9.766 mV | 2.4414 mV | 610.352 µV |
| 8 V | 62.50 mV | 3.906 mV | 976.56 µV | 244.141 µV |
| 4 V | 31.25 mV | 1.953 mV | 488.28 µV | 122.070 µV |
| 2 V | 15.63 mV | 0.976 mV | 244.14 µV | 61.0352 µV |
| 800 mV | 6.250 mV | 390.6 µV | 97.656 µV | 24.4141 µV |
| 400 mV | 3.125 mV | 195.3 µV | 48.828 µV | 12.2070 µV |
| 200 mV | 1.563 mV | 97.66 µV | 24.414 µV | 6.10352 µV |
Selecting a different resolution changes the maximum sampling frequency for the Handyscope HS3:
| Resolution | Maximum sampling rate |
|---|---|
| 8 bits | 100 MS/s (depending on model) |
| 12 bits | 50 MS/s (depending on model) |
| 14 bits | 3.125 MS/s |
| 16 bits | 195 kS/s |