xref: /aosp_15_r20/external/llvm/utils/lit/tests/shtest-format.py (revision 9880d6810fe72a1726cb53787c6711e909410d58)
1*9880d681SAndroid Build Coastguard Worker# Check the various features of the ShTest format.
2*9880d681SAndroid Build Coastguard Worker#
3*9880d681SAndroid Build Coastguard Worker# RUN: not %{lit} -j 1 -v %{inputs}/shtest-format > %t.out
4*9880d681SAndroid Build Coastguard Worker# RUN: FileCheck < %t.out %s
5*9880d681SAndroid Build Coastguard Worker#
6*9880d681SAndroid Build Coastguard Worker# END.
7*9880d681SAndroid Build Coastguard Worker
8*9880d681SAndroid Build Coastguard Worker# CHECK: -- Testing:
9*9880d681SAndroid Build Coastguard Worker
10*9880d681SAndroid Build Coastguard Worker# CHECK: PASS: shtest-format :: argv0.txt
11*9880d681SAndroid Build Coastguard Worker# CHECK: FAIL: shtest-format :: external_shell/fail.txt
12*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: *** TEST 'shtest-format :: external_shell/fail.txt' FAILED ***
13*9880d681SAndroid Build Coastguard Worker# CHECK: Command Output (stdout):
14*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
15*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: line 1: failed test output on stdout
16*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: line 2: failed test output on stdout
17*9880d681SAndroid Build Coastguard Worker# CHECK: Command Output (stderr):
18*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
19*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: cat: does-not-exist: No such file or directory
20*9880d681SAndroid Build Coastguard Worker# CHECK: --
21*9880d681SAndroid Build Coastguard Worker
22*9880d681SAndroid Build Coastguard Worker# CHECK: FAIL: shtest-format :: external_shell/fail_with_bad_encoding.txt
23*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: *** TEST 'shtest-format :: external_shell/fail_with_bad_encoding.txt' FAILED ***
24*9880d681SAndroid Build Coastguard Worker# CHECK: Command Output (stdout):
25*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
26*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: a line with bad encoding:
27*9880d681SAndroid Build Coastguard Worker# CHECK: --
28*9880d681SAndroid Build Coastguard Worker
29*9880d681SAndroid Build Coastguard Worker# CHECK: PASS: shtest-format :: external_shell/pass.txt
30*9880d681SAndroid Build Coastguard Worker
31*9880d681SAndroid Build Coastguard Worker# CHECK: FAIL: shtest-format :: fail.txt
32*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: *** TEST 'shtest-format :: fail.txt' FAILED ***
33*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: Script:
34*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
35*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: printf "line 1
36*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: false
37*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
38*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: Exit Code: 1
39*9880d681SAndroid Build Coastguard Worker#
40*9880d681SAndroid Build Coastguard Worker# CHECK: Command Output (stdout):
41*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
42*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: $ "printf"
43*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: # command output:
44*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: line 1: failed test output on stdout
45*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: line 2: failed test output on stdout
46*9880d681SAndroid Build Coastguard Worker
47*9880d681SAndroid Build Coastguard Worker# CHECK: UNRESOLVED: shtest-format :: no-test-line.txt
48*9880d681SAndroid Build Coastguard Worker# CHECK: PASS: shtest-format :: pass.txt
49*9880d681SAndroid Build Coastguard Worker# CHECK: UNSUPPORTED: shtest-format :: requires-any-missing.txt
50*9880d681SAndroid Build Coastguard Worker# CHECK: PASS: shtest-format :: requires-any-present.txt
51*9880d681SAndroid Build Coastguard Worker# CHECK: UNSUPPORTED: shtest-format :: requires-missing.txt
52*9880d681SAndroid Build Coastguard Worker# CHECK: PASS: shtest-format :: requires-present.txt
53*9880d681SAndroid Build Coastguard Worker# CHECK: UNSUPPORTED: shtest-format :: unsupported_dir/some-test.txt
54*9880d681SAndroid Build Coastguard Worker# CHECK: XFAIL: shtest-format :: xfail-feature.txt
55*9880d681SAndroid Build Coastguard Worker# CHECK: XFAIL: shtest-format :: xfail-target.txt
56*9880d681SAndroid Build Coastguard Worker# CHECK: XFAIL: shtest-format :: xfail.txt
57*9880d681SAndroid Build Coastguard Worker# CHECK: XPASS: shtest-format :: xpass.txt
58*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: *** TEST 'shtest-format :: xpass.txt' FAILED ***
59*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: Script
60*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
61*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: true
62*9880d681SAndroid Build Coastguard Worker# CHECK-NEXT: --
63*9880d681SAndroid Build Coastguard Worker# CHECK: Testing Time
64*9880d681SAndroid Build Coastguard Worker
65*9880d681SAndroid Build Coastguard Worker# CHECK: Unexpected Passing Tests (1)
66*9880d681SAndroid Build Coastguard Worker# CHECK: shtest-format :: xpass.txt
67*9880d681SAndroid Build Coastguard Worker
68*9880d681SAndroid Build Coastguard Worker# CHECK: Failing Tests (3)
69*9880d681SAndroid Build Coastguard Worker# CHECK: shtest-format :: external_shell/fail.txt
70*9880d681SAndroid Build Coastguard Worker# CHECK: shtest-format :: external_shell/fail_with_bad_encoding.txt
71*9880d681SAndroid Build Coastguard Worker# CHECK: shtest-format :: fail.txt
72*9880d681SAndroid Build Coastguard Worker
73*9880d681SAndroid Build Coastguard Worker# CHECK: Expected Passes    : 5
74*9880d681SAndroid Build Coastguard Worker# CHECK: Expected Failures  : 3
75*9880d681SAndroid Build Coastguard Worker# CHECK: Unsupported Tests  : 3
76*9880d681SAndroid Build Coastguard Worker# CHECK: Unresolved Tests   : 1
77*9880d681SAndroid Build Coastguard Worker# CHECK: Unexpected Passes  : 1
78*9880d681SAndroid Build Coastguard Worker# CHECK: Unexpected Failures: 3
79