blob: fd4d74335adfbead0942ed45a740f979f0c42d36 [file] [log] [blame]
Neels Hofmeyr3531a192017-03-28 14:30:28 +02001- non-existing suite dir
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +02002cnf -: DBG: Found config file paths.conf as [PATH]/selftest/suite_test/paths.conf in ./suite_test which is [PATH]/selftest/suite_test
3cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path ./test_work/state_dir is [PATH]/selftest/suite_test/test_work/state_dir
4cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path . is [PATH]/selftest/suite_test
5cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
6--- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test
Neels Hofmeyr3531a192017-03-28 14:30:28 +02007- no suite.conf
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +02008cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
Neels Hofmeyr31e83202017-06-06 19:44:32 +02009cnf empty_dir: DBG: reading suite.conf
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020010--- [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf]
Neels Hofmeyr3531a192017-03-28 14:30:28 +020011- valid suite dir
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020012cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test
Neels Hofmeyr31e83202017-06-06 19:44:32 +020013cnf test_suite: DBG: reading suite.conf
Neels Hofmeyr3531a192017-03-28 14:30:28 +020014defaults:
15 timeout: 60s
16resources:
17 bts:
18 - times: '1'
Neels Hofmeyr76d81032017-05-18 18:35:32 +020019 ip_address:
20 - times: '1'
Neels Hofmeyr3531a192017-03-28 14:30:28 +020021 modem:
22 - times: '2'
Neels Hofmeyr3531a192017-03-28 14:30:28 +020023
24- run hello world test
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +020025cnf -: DBG: Found config file resources.conf as [PATH]/selftest/suite_test/resources.conf in ./suite_test which is [PATH]/selftest/suite_test
26cnf -: DBG: Found path state_dir as [PATH]/selftest/suite_test/test_work/state_dir
Neels Hofmeyr2694a9d2017-04-27 19:48:09 +020027tst test_suite: Suite run start
Neels Hofmeyr7e2e8f12017-05-14 03:37:13 +020028tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ...
Neels Hofmeyr31e83202017-06-06 19:44:32 +020029tst test_suite: DBG: {combining='resources'}
Neels Hofmeyr76d81032017-05-18 18:35:32 +020030tst test_suite: DBG: {definition_conf={bts=[{'times': '1'}], ip_address=[{'times': '1'}], modem=[{'times': '2'}]}} [test_suite↪(combining_scenarios='resources')↪test_suite]
Neels Hofmeyr31e83202017-06-06 19:44:32 +020031tst test_suite: Reserving 1 x bts (candidates: 3)
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020032tst test_suite: DBG: Picked - _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
Neels Hofmeyr17c139e2017-04-12 02:42:02 +020033 addr: 10.42.42.114
34 band: GSM-1800
35 ipa_unit_id: '1'
36 label: sysmoBTS 1002
37 type: sysmo
Neels Hofmeyr31e83202017-06-06 19:44:32 +020038tst test_suite: Reserving 1 x ip_address (candidates: 3)
Neels Hofmeyr76d81032017-05-18 18:35:32 +020039tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
40 addr: 10.42.42.1
Neels Hofmeyr31e83202017-06-06 19:44:32 +020041tst test_suite: Reserving 2 x modem (candidates: 16)
Neels Hofmeyrcccbe592017-05-07 01:16:07 +020042tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
Neels Hofmeyr17c139e2017-04-12 02:42:02 +020043 imsi: '901700000007801'
44 ki: D620F48487B1B782DA55DF6717F08FF9
45 label: m7801
46 path: /wavecom_0
47- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
48 imsi: '901700000007802'
49 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
50 label: m7802
51 path: /wavecom_1
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +020052tst hello_world.py:[LINENR] START [test_suitehello_world.py]
53tst hello_world.py:[LINENR]: hello world [test_suitehello_world.py:[LINENR]]
54tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suitehello_world.py:[LINENR]]
55tst hello_world.py:[LINENR]: one [test_suitehello_world.py:[LINENR]]
56tst hello_world.py:[LINENR]: two [test_suitehello_world.py:[LINENR]]
57tst hello_world.py:[LINENR]: three [test_suitehello_world.py:[LINENR]]
58tst hello_world.py:[LINENR] PASS [test_suitehello_world.py]
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +020059tst test_suite: PASS
60pass: all 6 tests passed (5 skipped).
Neels Hofmeyr3531a192017-03-28 14:30:28 +020061
62- a test with an error
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +020063tst test_suite: Suite run start [suite.py:[LINENR]]
64tst test_error.py:[LINENR] START [test_suitetest_error.py] [suite.py:[LINENR]]
65tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suitetest_error.py:[LINENR]] [test_error.py:[LINENR]]
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +020066tst test_error.py:[LINENR]: ERR: AssertionError: [test_error.py:[LINENR]: assert False]
67tst test_error.py:[LINENR] FAIL (AssertionError) [test_suitetest_error.py] [suite.py:[LINENR]]
68tst test_suite: FAIL [suite.py:[LINENR]]
69
70- a test with a failure
71tst test_suite: Suite run start [suite.py:[LINENR]]
72tst test_fail.py:[LINENR] START [test_suitetest_fail.py] [suite.py:[LINENR]]
73tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suitetest_fail.py:[LINENR]] [test_fail.py:[LINENR]]
74tst test_fail.py:[LINENR] FAIL (EpicFail) [test_suitetest_fail.py] [suite.py:[LINENR]]
75tst test_suite: FAIL [suite.py:[LINENR]]
76
77- a test with a raised failure
78tst test_suite: Suite run start [suite.py:[LINENR]]
79tst test_fail_raise.py:[LINENR] START [test_suitetest_fail_raise.py] [suite.py:[LINENR]]
80tst test_fail_raise.py:[LINENR]: I am 'test_suite' / 'test_fail_raise.py:[LINENR]' [test_suitetest_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]]
81tst test_fail_raise.py:[LINENR]: ERR: Failure: ('EpicFail', 'This failure is expected') [test_fail_raise.py:[LINENR]: raise Failure('EpicFail', 'This failure is expected')]
82tst test_fail_raise.py:[LINENR] FAIL (EpicFail) [test_suitetest_fail_raise.py] [suite.py:[LINENR]]
83tst test_suite: FAIL [suite.py:[LINENR]]
Neels Hofmeyr3531a192017-03-28 14:30:28 +020084
85- graceful exit.