Releases
Lifecycle: Beta. Updated 2020-12-16
Releases are verified against the checklist below. This checklist is copied into a new release. To run the tests, you should flash debug and default versions of firmware to devices under test. Debug version runs integration tests and prints results to RTT terminal and it fills the log space faster to test log reads.
Default version is used for all other tests than integration test and log read test.
Test checklist
Power-on
Action | How to test | Verified by |
Tag stays in bootloader mode / begins DFU if application commanded tag into DFU mode. | System test "DFU test". | |
Tag stays in bootloader mode if button "B" is pressed on boot. | Manually, hold down "B", press and release "R", release "R". | |
Tag initializes watchdog. | Unit test test_main.c | |
Tag turns RED LED on for self-test duration. | Manually, visual check | |
Tag runs self-tests to detect installed sensors. | Unit tests test_main.c test_app_sensor.c | |
Tag erases settings stored to flash file system and reboots if flash file system cannot be initialized. | TODO | |
Tag erases old log entries to prevent data with corrupted timestamps | Check app_log:app_log_init() | |
Tag turns GREEN LED on for one second if no errors were detected in self-test phase. Missing sensors are allowed. | Manually, visual check. | |
Tag advertises at 100 ms interval for 5 seconds at boot. Duplicate data is allowed, but every packet must be valid. Initial dataformat is RAWv2. | Unit test test_app_heartbeat.c. __Check power profile manually. | |
All data fields of advertisement are valid RAWv2 values. | Manually, check that Ruuvi Station Android displays temperature, humidity, pressure, acceleration, voltage. Check MAC address, TX power +4, and measurement sequence counter bytes with nRF Connect captured data. | |
After reset GATT profile is in secure mode with no DFU service or serial number readable. | Connect to GATT after boot, verify that DFU service is not listed and DIS doesn't list Serial Number characteristic. |
Integration test
Integration tests are run on debug-variants of firmware. They print test results on RTT terminal as JSON.
Button
Action | How to test | Verified by |
Short press enters configuration mode. | ||
Long press erases flash settings and logs, enters bootloader. |
NFC
Action | How to test | Verified by |
NFC read enables configuration until next GATT connection or timeout. | Apply a NFC field and configure settings via GATT. Check that configuration fails on next connection. Check that configuration is diabled after timeout | |
NFC has 4 UTF-8 text fields: "ad", "id", "sw", "dt". Fields can be in any order. | Read the tag with e.g. NFC Tools | |
"ad" field has text "MAC: " and upper-case, ':' separated MAC address, as reported by BLE scanner. | Check "ad" field and compare to BLE scanner results. | |
"id" field has text "ID: " and upper-case, ':' separated unique identifier, 8 bytes. | Check "id" field. | |
"sw" field has text "SW: " and a firmware revision string. | Check "sw" field | |
"dt" field has binary content | Check "dt" field. |
Usage
Action | How to test | Verified by |
Data is sent at 1285 ms interval in RAWv2 format, all fields have valid and reasonable data. | Send data to hookbin (or similar) with Ruuvi Station Android Gateway feature. Check the field values. | |
Tag accepts GATT connection and starts pushing data through NUS TX characteristic notifications. | Connect to tag with nRF Connect, register to GATT notifications. | |
GATT server has Device Information Service with Manufacturer Name String, Model Number String Hardware Revision String and Firmware revision String. Serial Number String is not viewable unless configuration mode is on. | Connect to tag with nRF Connect, check fields manually. | |
Manufacturer Name String is "Ruuvi Innovations Ltd" | Manually | |
Model Number String is "RuuviTag B" | Manually | |
Serial Number String is viewable only in configuration mode and has the same ID as NFC scan. | Manually | |
Hardware revision string has text "Check PCB" | Manually | |
Firmware revision string has same version as NFC read | Manually | |
Environmental history log can be read by sending "0x3A 3A 11 TIMESTAMP 00000000" to NUS RX characteristic. Timestamp is current time in seconds after Unix epoch, 4 bytes. | Manually, or with Ruuvi Station iOS sync graphs button. For the test a debug version of firmware should be used, tag must be running at least for 2 and there should be data point for each second up to max number of samples. | |
Tag continues broadcasting data while connected by GATT. | Connect with one device, scan with other. Manually. Note: Some scanners will not report advertisements from connected devices, so 2 scanners are required. | |
When not connected, tag has a scan responce which advertise Nordic UART Service and a complete local name "Ruuvi XXXX", where "XXXX" matches last 4 characters of MAC address. | Manually with nRF Connect | |
When connected, tag does not have a scan responce. | Manually with nRF Connect |
Firmware updates
Action | How to test | Verified by |
Firmware 2.5.9 can be updated with SDK_UPDATE package. | System tests in GitHub. | |
Firmware can enter bootloader after update and another 3.x firmware can be flashed. | System tests in GitHub |
Power consumption
Power consumption is tested with Nordic Power Profiler kit at 2.4, 3.0 and 3.6 V voltages.
State | Value | Verified by |
Broadcasting, connectable | ||
Broadcasting, connected | ||
Transferring logs. |
Last updated