kumquat-buildroot/support/testing
Julien Olivain 9592b990d5 support/testing: improve python-magic-wormhole test reliability
The python-magic-wormhole runtime test can randomly fail on slow
runners, see [1].

The issue is that the sending command is started first in background
_without_ redirecting its output to /dev/null. The receiving command
is started after, expecting the message to be printed on the first
standard output line. On slower systems, the sending command still
print messages while the test controller expect output from the
receiving command. The expected string finally appear, but not on the
first line. This makes the test fail.

This commit fixes the issue by redirecting all outputs (stdout, stderr)
of the sending command to /dev/null. To help even more, the sleep time
is moved from the emulator to the test controller. The sleep time is
also multiplied by the timeout_multiplier.

Fixes: [1]

[1] https://gitlab.com/buildroot.org/buildroot/-/jobs/6888691508

Signed-off-by: Julien Olivain <ju.o@free.fr>
Signed-off-by: Romain Naour <romain.naour@smile.fr>
(cherry picked from commit 9a734700d7)
Signed-off-by: Peter Korsgaard <peter@korsgaard.com>
2024-06-08 15:50:17 +02:00
..
conf support/testing: add systemd tests for factory and overlayfs 2023-10-08 20:15:13 +02:00
infra support/testing: bump prebuilt kernel to 5.10.202 2023-12-09 21:35:28 +01:00
tests support/testing: improve python-magic-wormhole test reliability 2024-06-08 15:50:17 +02:00
run-tests support/testing: bump prebuilt kernel to 5.10.202 2023-12-09 21:35:28 +01:00