Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 1 | - non-existing suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 2 | cnf -: DBG: Found config file paths.conf as [PATH]/selftest/suite_test/paths.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 3 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path ./test_work/state_dir is [PATH]/selftest/suite_test/test_work/state_dir |
| 4 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path . is [PATH]/selftest/suite_test |
| 5 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
| 6 | --- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 7 | - no suite.conf |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 8 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 9 | cnf empty_dir: DBG: reading suite.conf [empty_dir↪empty_dir] |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 10 | --- [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf] |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 11 | - valid suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 12 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 13 | cnf test_suite: DBG: reading suite.conf [test_suite↪test_suite] |
| 14 | defaults: |
| 15 | timeout: 60s |
| 16 | resources: |
| 17 | bts: |
| 18 | - times: '1' |
| 19 | modem: |
| 20 | - times: '2' |
| 21 | nitb_iface: |
| 22 | - times: '1' |
| 23 | |
| 24 | - run hello world test |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 25 | cnf -: DBG: Found config file resources.conf as [PATH]/selftest/suite_test/resources.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 26 | cnf -: DBG: Found path state_dir as [PATH]/selftest/suite_test/test_work/state_dir |
Neels Hofmeyr | 2694a9d | 2017-04-27 19:48:09 +0200 | [diff] [blame] | 27 | tst test_suite: Suite run start |
Neels Hofmeyr | 7e2e8f1 | 2017-05-14 03:37:13 +0200 | [diff] [blame] | 28 | tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... |
Neels Hofmeyr | 2694a9d | 2017-04-27 19:48:09 +0200 | [diff] [blame] | 29 | tst test_suite: DBG: {combining='resources'} [test_suite↪test_suite] |
| 30 | tst test_suite: DBG: {definition_conf={bts=[{'times': '1'}], modem=[{'times': '2'}], nitb_iface=[{'times': '1'}]}} [test_suite↪(combining_scenarios='resources')↪test_suite] |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 31 | tst test_suite: Reserving 1 x bts (candidates: 3) [test_suite↪test_suite] |
| 32 | tst test_suite: DBG: Picked - _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9 |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 33 | addr: 10.42.42.114 |
| 34 | band: GSM-1800 |
| 35 | ipa_unit_id: '1' |
| 36 | label: sysmoBTS 1002 |
| 37 | type: sysmo |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 38 | [test_suite↪test_suite] |
| 39 | tst test_suite: Reserving 2 x modem (candidates: 16) [test_suite↪test_suite] |
| 40 | tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 41 | imsi: '901700000007801' |
| 42 | ki: D620F48487B1B782DA55DF6717F08FF9 |
| 43 | label: m7801 |
| 44 | path: /wavecom_0 |
| 45 | - _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254 |
| 46 | imsi: '901700000007802' |
| 47 | ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3 |
| 48 | label: m7802 |
| 49 | path: /wavecom_1 |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 50 | [test_suite↪test_suite] |
| 51 | tst test_suite: Reserving 1 x nitb_iface (candidates: 3) [test_suite↪test_suite] |
| 52 | tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4 |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 53 | addr: 10.42.42.1 |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 54 | [test_suite↪test_suite] |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 55 | tst hello_world.py:[LINENR] START [test_suite↪hello_world.py] |
| 56 | tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] |
| 57 | tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] |
| 58 | tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] |
| 59 | tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] |
| 60 | tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] |
| 61 | tst hello_world.py:[LINENR] PASS [test_suite↪hello_world.py] |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame^] | 62 | tst test_suite: PASS |
| 63 | pass: all 6 tests passed (5 skipped). |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 64 | |
| 65 | - a test with an error |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 66 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 67 | tst test_error.py:[LINENR] START [test_suite↪test_error.py] [suite.py:[LINENR]] |
| 68 | tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]] |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame^] | 69 | tst test_error.py:[LINENR]: ERR: AssertionError: [test_error.py:[LINENR]: assert False] |
| 70 | tst test_error.py:[LINENR] FAIL (AssertionError) [test_suite↪test_error.py] [suite.py:[LINENR]] |
| 71 | tst test_suite: FAIL [suite.py:[LINENR]] |
| 72 | |
| 73 | - a test with a failure |
| 74 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 75 | tst test_fail.py:[LINENR] START [test_suite↪test_fail.py] [suite.py:[LINENR]] |
| 76 | tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]] |
| 77 | tst test_fail.py:[LINENR] FAIL (EpicFail) [test_suite↪test_fail.py] [suite.py:[LINENR]] |
| 78 | tst test_suite: FAIL [suite.py:[LINENR]] |
| 79 | |
| 80 | - a test with a raised failure |
| 81 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 82 | tst test_fail_raise.py:[LINENR] START [test_suite↪test_fail_raise.py] [suite.py:[LINENR]] |
| 83 | tst test_fail_raise.py:[LINENR]: I am 'test_suite' / 'test_fail_raise.py:[LINENR]' [test_suite↪test_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]] |
| 84 | tst test_fail_raise.py:[LINENR]: ERR: Failure: ('EpicFail', 'This failure is expected') [test_fail_raise.py:[LINENR]: raise Failure('EpicFail', 'This failure is expected')] |
| 85 | tst test_fail_raise.py:[LINENR] FAIL (EpicFail) [test_suite↪test_fail_raise.py] [suite.py:[LINENR]] |
| 86 | tst test_suite: FAIL [suite.py:[LINENR]] |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 87 | |
| 88 | - graceful exit. |