Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 1 | - non-existing suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 2 | cnf -: DBG: Found config file paths.conf as [PATH]/selftest/suite_test/paths.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 3 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path ./test_work/state_dir is [PATH]/selftest/suite_test/test_work/state_dir |
| 4 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path . is [PATH]/selftest/suite_test |
| 5 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
| 6 | --- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 7 | - no suite.conf |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 8 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 9 | cnf empty_dir: DBG: reading suite.conf |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 10 | --- [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf] |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 11 | - valid suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 12 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 13 | cnf test_suite: DBG: reading suite.conf |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 14 | defaults: |
| 15 | timeout: 60s |
| 16 | resources: |
| 17 | bts: |
| 18 | - times: '1' |
Neels Hofmeyr | 76d8103 | 2017-05-18 18:35:32 +0200 | [diff] [blame] | 19 | ip_address: |
| 20 | - times: '1' |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 21 | modem: |
| 22 | - times: '2' |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 23 | |
| 24 | - run hello world test |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 25 | cnf -: DBG: Found config file resources.conf as [PATH]/selftest/suite_test/resources.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 26 | cnf -: DBG: Found path state_dir as [PATH]/selftest/suite_test/test_work/state_dir |
Neels Hofmeyr | 2694a9d | 2017-04-27 19:48:09 +0200 | [diff] [blame] | 27 | tst test_suite: Suite run start |
Neels Hofmeyr | 7e2e8f1 | 2017-05-14 03:37:13 +0200 | [diff] [blame] | 28 | tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 29 | tst test_suite: DBG: {combining='resources'} |
Neels Hofmeyr | 76d8103 | 2017-05-18 18:35:32 +0200 | [diff] [blame] | 30 | tst test_suite: DBG: {definition_conf={bts=[{'times': '1'}], ip_address=[{'times': '1'}], modem=[{'times': '2'}]}} [test_suite↪(combining_scenarios='resources')↪test_suite] |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 31 | tst test_suite: Reserving 1 x bts (candidates: 3) |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 32 | tst test_suite: DBG: Picked - _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9 |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 33 | addr: 10.42.42.114 |
| 34 | band: GSM-1800 |
| 35 | ipa_unit_id: '1' |
| 36 | label: sysmoBTS 1002 |
| 37 | type: sysmo |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 38 | tst test_suite: Reserving 1 x ip_address (candidates: 3) |
Neels Hofmeyr | 76d8103 | 2017-05-18 18:35:32 +0200 | [diff] [blame] | 39 | tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4 |
| 40 | addr: 10.42.42.1 |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 41 | tst test_suite: Reserving 2 x modem (candidates: 16) |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 42 | tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 43 | imsi: '901700000007801' |
| 44 | ki: D620F48487B1B782DA55DF6717F08FF9 |
| 45 | label: m7801 |
| 46 | path: /wavecom_0 |
| 47 | - _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254 |
| 48 | imsi: '901700000007802' |
| 49 | ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3 |
| 50 | label: m7802 |
| 51 | path: /wavecom_1 |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 52 | tst hello_world.py:[LINENR] START [test_suite↪hello_world.py] |
| 53 | tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] |
| 54 | tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] |
| 55 | tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] |
| 56 | tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] |
| 57 | tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] |
| 58 | tst hello_world.py:[LINENR] PASS [test_suite↪hello_world.py] |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame] | 59 | tst test_suite: PASS |
| 60 | pass: all 6 tests passed (5 skipped). |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 61 | |
| 62 | - a test with an error |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 63 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 64 | tst test_error.py:[LINENR] START [test_suite↪test_error.py] [suite.py:[LINENR]] |
| 65 | tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]] |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame] | 66 | tst test_error.py:[LINENR]: ERR: AssertionError: [test_error.py:[LINENR]: assert False] |
| 67 | tst test_error.py:[LINENR] FAIL (AssertionError) [test_suite↪test_error.py] [suite.py:[LINENR]] |
| 68 | tst test_suite: FAIL [suite.py:[LINENR]] |
| 69 | |
| 70 | - a test with a failure |
| 71 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 72 | tst test_fail.py:[LINENR] START [test_suite↪test_fail.py] [suite.py:[LINENR]] |
| 73 | tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]] |
| 74 | tst test_fail.py:[LINENR] FAIL (EpicFail) [test_suite↪test_fail.py] [suite.py:[LINENR]] |
| 75 | tst test_suite: FAIL [suite.py:[LINENR]] |
| 76 | |
| 77 | - a test with a raised failure |
| 78 | tst test_suite: Suite run start [suite.py:[LINENR]] |
| 79 | tst test_fail_raise.py:[LINENR] START [test_suite↪test_fail_raise.py] [suite.py:[LINENR]] |
| 80 | tst test_fail_raise.py:[LINENR]: I am 'test_suite' / 'test_fail_raise.py:[LINENR]' [test_suite↪test_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]] |
| 81 | tst test_fail_raise.py:[LINENR]: ERR: Failure: ('EpicFail', 'This failure is expected') [test_fail_raise.py:[LINENR]: raise Failure('EpicFail', 'This failure is expected')] |
| 82 | tst test_fail_raise.py:[LINENR] FAIL (EpicFail) [test_suite↪test_fail_raise.py] [suite.py:[LINENR]] |
| 83 | tst test_suite: FAIL [suite.py:[LINENR]] |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 84 | |
| 85 | - graceful exit. |