[gnutls-devel] GnuTLS | make check suite FAIL: several test fails when /bin/sh is not symlinked to bash (#1509)

Read-only notification of GnuTLS library development activities gnutls-devel at lists.gnutls.org
Fri Oct 13 12:58:49 CEST 2023

Adrian Wijaya created an issue: https://gitlab.com/gnutls/gnutls/-/issues/1509

## Description of problem:
Whenever I try to run `make check` or `make check suite`, there are several test case on suite that fails.

## Version of gnutls used:

## Distributor of gnutls (e.g., Ubuntu, Fedora, RHEL)
Arch Linux

## How reproducible:

Steps to Reproduce:

 * Set the default shell into another shell that is not bash. In this case I use `sudo ln -sfT dash /usr/bin/sh`
 * run `make check` (of course we have to build the program beforehand)

## Actual results:
PASS: chain.sh
SKIP: testrng.sh
SKIP: testcompat-polarssl-serv.sh
SKIP: testcompat-polarssl-serv-compat.sh
SKIP: testcompat-polarssl-serv-no-etm.sh
SKIP: testcompat-openssl-cli.sh
SKIP: testcompat-openssl-cli-compat.sh
SKIP: testcompat-openssl-cli-no-etm.sh
SKIP: testcompat-openssl-serv.sh
SKIP: testcompat-openssl-serv-compat.sh
SKIP: testcompat-openssl-serv-no-etm.sh
SKIP: testcompat-openssl-serv-no-tickets.sh
SKIP: testcompat-openssl-serv-no-safe-renegotiation.sh
SKIP: testcompat-openssl-serv-safe-renegotiation.sh
PASS: testrandom.sh
PASS: test-ciphersuite-names.sh
FAIL: tls-fuzzer/tls-fuzzer-nocert.sh
FAIL: tls-fuzzer/tls-fuzzer-cert.sh
FAIL: tls-fuzzer/tls-fuzzer-alpn.sh
FAIL: tls-fuzzer/tls-fuzzer-nocert-tls13.sh
FAIL: tls-fuzzer/tls-fuzzer-psk.sh
FAIL: tls-fuzzer/tls-fuzzer-nolimit.sh
FAIL: tls-fuzzer/tls-fuzzer-nolimit-tls13.sh
PASS: multi-ticket-reception.sh
FAIL: testcompat-openssl-tls13-cli.sh
FAIL: testcompat-openssl-tls13-serv.sh
PASS: testdane.sh
PASS: eagain.sh
PASS: prime-check
Testsuite summary for GnuTLS 3.8.1
# TOTAL: 29
# PASS:  7
# SKIP:  13
# XFAIL: 0
# FAIL:  9
# XPASS: 0
# ERROR: 0

On `tests/suite/tls-fuzzer/tls-fuzzer-cert.log`:

reserved port 41039
./tls-fuzzer/tls-fuzzer-cert.sh: 39: ./tls-fuzzer/tls-fuzzer-common.sh: pushd: not found
sed: can't read ../gnutls-cert.json: No such file or directory
/usr/bin/python: can't open file '/home/adrian/Public/gnutls/tests/suite/tests/scripts_retention.py': [Errno 2] No such file or directory
./tls-fuzzer/tls-fuzzer-cert.sh: 56: ./tls-fuzzer/tls-fuzzer-common.sh: popd: not found
unreserved port 41039
FAIL tls-fuzzer/tls-fuzzer-cert.sh (exit status: 2)

On `tests/suite/testcompat-openssl-tls13-serv.log`:

./testcompat-openssl-tls13-serv.sh: 65: Syntax error: redirection unexpected
FAIL testcompat-openssl-tls13-serv.sh (exit status: 2)
If we see the log, we can see that the tests can't recognize some of the bash syntax even
though the test script begin with `#!/bin/bash`

## Expected results:
The test pass without any problems (assume bash is installed)

## Misc:
I suspect this issue can be reproduced on fedora or debian if we change the default shell.

Reply to this email directly or view it on GitLab: https://gitlab.com/gnutls/gnutls/-/issues/1509
You're receiving this email because of your account on gitlab.com.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.gnupg.org/pipermail/gnutls-devel/attachments/20231013/0771618a/attachment.html>

More information about the Gnutls-devel mailing list