blob: b9a8fb33aec56a16d4eb3237d3f21d9454047d19 [file] [log] [blame]
Neels Hofmeyr3531a192017-03-28 14:30:28 +02001- non-existing suite dir
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +02002cnf -: DBG: Found config file paths.conf as [PATH]/selftest/suite_test/paths.conf in ./suite_test which is [PATH]/selftest/suite_test
3cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path ./test_work/state_dir is [PATH]/selftest/suite_test/test_work/state_dir
4cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path . is [PATH]/selftest/suite_test
5cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
6--- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test
Neels Hofmeyr3531a192017-03-28 14:30:28 +02007- no suite.conf
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +02008cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
Neels Hofmeyr3531a192017-03-28 14:30:28 +02009cnf empty_dir: DBG: reading suite.conf [empty_dirempty_dir]
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020010--- [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf]
Neels Hofmeyr3531a192017-03-28 14:30:28 +020011- valid suite dir
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020012cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
Neels Hofmeyr3531a192017-03-28 14:30:28 +020013cnf test_suite: DBG: reading suite.conf [test_suitetest_suite]
14defaults:
15 timeout: 60s
16resources:
17 bts:
18 - times: '1'
Neels Hofmeyr76d81032017-05-18 18:35:32 +020019 ip_address:
20 - times: '1'
Neels Hofmeyr3531a192017-03-28 14:30:28 +020021 modem:
22 - times: '2'
Neels Hofmeyr3531a192017-03-28 14:30:28 +020023
24- run hello world test
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020025cnf -: DBG: Found config file resources.conf as [PATH]/selftest/suite_test/resources.conf in ./suite_test which is [PATH]/selftest/suite_test
26cnf -: DBG: Found path state_dir as [PATH]/selftest/suite_test/test_work/state_dir
Neels Hofmeyr2694a9d2017-04-27 19:48:09 +020027tst test_suite: Suite run start
Neels Hofmeyr7e2e8f12017-05-14 03:37:13 +020028tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ...
Neels Hofmeyr2694a9d2017-04-27 19:48:09 +020029tst test_suite: DBG: {combining='resources'} [test_suitetest_suite]
Neels Hofmeyr76d81032017-05-18 18:35:32 +020030tst test_suite: DBG: {definition_conf={bts=[{'times': '1'}], ip_address=[{'times': '1'}], modem=[{'times': '2'}]}} [test_suite↪(combining_scenarios='resources')↪test_suite]
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020031tst test_suite: Reserving 1 x bts (candidates: 3) [test_suitetest_suite]
32tst test_suite: DBG: Picked - _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
Neels Hofmeyr17c139e2017-04-12 02:42:02 +020033 addr: 10.42.42.114
34 band: GSM-1800
35 ipa_unit_id: '1'
36 label: sysmoBTS 1002
37 type: sysmo
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020038 [test_suitetest_suite]
Neels Hofmeyr76d81032017-05-18 18:35:32 +020039tst test_suite: Reserving 1 x ip_address (candidates: 3) [test_suitetest_suite]
40tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
41 addr: 10.42.42.1
42 [test_suitetest_suite]
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020043tst test_suite: Reserving 2 x modem (candidates: 16) [test_suitetest_suite]
44tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
Neels Hofmeyr17c139e2017-04-12 02:42:02 +020045 imsi: '901700000007801'
46 ki: D620F48487B1B782DA55DF6717F08FF9
47 label: m7801
48 path: /wavecom_0
49- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
50 imsi: '901700000007802'
51 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
52 label: m7802
53 path: /wavecom_1
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020054 [test_suitetest_suite]
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +020055tst hello_world.py:[LINENR] START [test_suitehello_world.py]
56tst hello_world.py:[LINENR]: hello world [test_suitehello_world.py:[LINENR]]
57tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suitehello_world.py:[LINENR]]
58tst hello_world.py:[LINENR]: one [test_suitehello_world.py:[LINENR]]
59tst hello_world.py:[LINENR]: two [test_suitehello_world.py:[LINENR]]
60tst hello_world.py:[LINENR]: three [test_suitehello_world.py:[LINENR]]
61tst hello_world.py:[LINENR] PASS [test_suitehello_world.py]
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +020062tst test_suite: PASS
63pass: all 6 tests passed (5 skipped).
Neels Hofmeyr3531a192017-03-28 14:30:28 +020064
65- a test with an error
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +020066tst test_suite: Suite run start [suite.py:[LINENR]]
67tst test_error.py:[LINENR] START [test_suitetest_error.py] [suite.py:[LINENR]]
68tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suitetest_error.py:[LINENR]] [test_error.py:[LINENR]]
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +020069tst test_error.py:[LINENR]: ERR: AssertionError: [test_error.py:[LINENR]: assert False]
70tst test_error.py:[LINENR] FAIL (AssertionError) [test_suitetest_error.py] [suite.py:[LINENR]]
71tst test_suite: FAIL [suite.py:[LINENR]]
72
73- a test with a failure
74tst test_suite: Suite run start [suite.py:[LINENR]]
75tst test_fail.py:[LINENR] START [test_suitetest_fail.py] [suite.py:[LINENR]]
76tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suitetest_fail.py:[LINENR]] [test_fail.py:[LINENR]]
77tst test_fail.py:[LINENR] FAIL (EpicFail) [test_suitetest_fail.py] [suite.py:[LINENR]]
78tst test_suite: FAIL [suite.py:[LINENR]]
79
80- a test with a raised failure
81tst test_suite: Suite run start [suite.py:[LINENR]]
82tst test_fail_raise.py:[LINENR] START [test_suitetest_fail_raise.py] [suite.py:[LINENR]]
83tst test_fail_raise.py:[LINENR]: I am 'test_suite' / 'test_fail_raise.py:[LINENR]' [test_suitetest_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]]
84tst test_fail_raise.py:[LINENR]: ERR: Failure: ('EpicFail', 'This failure is expected') [test_fail_raise.py:[LINENR]: raise Failure('EpicFail', 'This failure is expected')]
85tst test_fail_raise.py:[LINENR] FAIL (EpicFail) [test_suitetest_fail_raise.py] [suite.py:[LINENR]]
86tst test_suite: FAIL [suite.py:[LINENR]]
Neels Hofmeyr3531a192017-03-28 14:30:28 +020087
88- graceful exit.