Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 1 | - non-existing suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 2 | cnf -: DBG: Found config file paths.conf as [PATH]/selftest/suite_test/paths.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 3 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path ./test_work/state_dir is [PATH]/selftest/suite_test/test_work/state_dir |
| 4 | cnf -: DBG: [PATH]/selftest/suite_test/paths.conf: relative path . is [PATH]/selftest/suite_test |
| 5 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
| 6 | --- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 7 | - no suite.conf |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 8 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 9 | cnf empty_dir: DBG: reading suite.conf |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 10 | cnf [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf] |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 11 | - valid suite dir |
Neels Hofmeyr | ef9ed2d | 2017-05-04 16:39:29 +0200 | [diff] [blame] | 12 | cnf -: DBG: Found path suites_dir as [PATH]/selftest/suite_test |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 13 | cnf test_suite: DBG: reading suite.conf |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 14 | defaults: |
| 15 | timeout: 60s |
| 16 | resources: |
| 17 | bts: |
| 18 | - times: '1' |
Neels Hofmeyr | 76d8103 | 2017-05-18 18:35:32 +0200 | [diff] [blame] | 19 | ip_address: |
| 20 | - times: '1' |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 21 | modem: |
| 22 | - times: '2' |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 23 | |
| 24 | - run hello world test |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 25 | cnf ResourcesPool: DBG: Found config file resources.conf as [PATH]/selftest/suite_test/resources.conf in ./suite_test which is [PATH]/selftest/suite_test |
| 26 | cnf ResourcesPool: DBG: Found path state_dir as [PATH]/selftest/suite_test/test_work/state_dir |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 27 | |
| 28 | --------------------------------------------------------------------- |
| 29 | trial test_suite |
| 30 | --------------------------------------------------------------------- |
Neels Hofmeyr | 7e2e8f1 | 2017-05-14 03:37:13 +0200 | [diff] [blame] | 31 | tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 32 | tst test_suite: DBG: {combining='resources'} |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 33 | tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'times': '1'}], ip_address=[{'times': '1'}], modem=[{'times': '2'}]}} [test_suite↪{combining_scenarios='resources'}] |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 34 | tst test_suite: Reserving 1 x bts (candidates: 3) |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 35 | tst test_suite: DBG: Picked - _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9 |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 36 | addr: 10.42.42.114 |
| 37 | band: GSM-1800 |
| 38 | ipa_unit_id: '1' |
| 39 | label: sysmoBTS 1002 |
| 40 | type: sysmo |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 41 | tst test_suite: Reserving 1 x ip_address (candidates: 3) |
Neels Hofmeyr | 76d8103 | 2017-05-18 18:35:32 +0200 | [diff] [blame] | 42 | tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4 |
| 43 | addr: 10.42.42.1 |
Neels Hofmeyr | 31e8320 | 2017-06-06 19:44:32 +0200 | [diff] [blame] | 44 | tst test_suite: Reserving 2 x modem (candidates: 16) |
Neels Hofmeyr | cccbe59 | 2017-05-07 01:16:07 +0200 | [diff] [blame] | 45 | tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f |
Neels Hofmeyr | 17c139e | 2017-04-12 02:42:02 +0200 | [diff] [blame] | 46 | imsi: '901700000007801' |
| 47 | ki: D620F48487B1B782DA55DF6717F08FF9 |
| 48 | label: m7801 |
| 49 | path: /wavecom_0 |
| 50 | - _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254 |
| 51 | imsi: '901700000007802' |
| 52 | ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3 |
| 53 | label: m7802 |
| 54 | path: /wavecom_1 |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 55 | |
| 56 | ---------------------------------------------- |
| 57 | trial test_suite hello_world.py |
| 58 | ---------------------------------------------- |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 59 | tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] |
| 60 | tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] |
| 61 | tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] |
| 62 | tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] |
| 63 | tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 64 | tst hello_world.py:[LINENR] Test passed (N.N sec) [test_suite↪hello_world.py] |
| 65 | --------------------------------------------------------------------- |
| 66 | trial test_suite PASS |
| 67 | --------------------------------------------------------------------- |
| 68 | PASS: test_suite (pass: 1, skip: 5) |
| 69 | pass: hello_world.py (N.N sec) |
| 70 | skip: mo_mt_sms.py |
| 71 | skip: mo_sms.py |
| 72 | skip: test_error.py |
| 73 | skip: test_fail.py |
| 74 | skip: test_fail_raise.py |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 75 | |
| 76 | - a test with an error |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 77 | |
| 78 | --------------------------------------------------------------------- |
| 79 | trial test_suite |
| 80 | --------------------------------------------------------------------- |
| 81 | |
| 82 | ---------------------------------------------- |
| 83 | trial test_suite test_error.py |
| 84 | ---------------------------------------------- |
Neels Hofmeyr | d1bedb1 | 2017-05-07 03:02:23 +0200 | [diff] [blame] | 85 | tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]] |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 86 | tst test_error.py:[LINENR]: ERR: AssertionError: test_error.py:[LINENR]: assert False [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]: assert False] |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 87 | tst test_error.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_error.py:[LINENR]] [suite.py:[LINENR]] |
| 88 | --------------------------------------------------------------------- |
| 89 | trial test_suite FAIL |
| 90 | --------------------------------------------------------------------- |
| 91 | FAIL: test_suite (fail: 1, skip: 5) |
| 92 | skip: hello_world.py (N.N sec) |
| 93 | skip: mo_mt_sms.py |
| 94 | skip: mo_sms.py |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 95 | FAIL: test_error.py (N.N sec) AssertionError: test_error.py:[LINENR]: assert False |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 96 | skip: test_fail.py |
| 97 | skip: test_fail_raise.py |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame] | 98 | |
| 99 | - a test with a failure |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 100 | |
| 101 | --------------------------------------------------------------------- |
| 102 | trial test_suite |
| 103 | --------------------------------------------------------------------- |
| 104 | |
| 105 | ---------------------------------------------- |
| 106 | trial test_suite test_fail.py |
| 107 | ---------------------------------------------- |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame] | 108 | tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]] |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 109 | tst test_fail.py:[LINENR]: ERR: EpicFail: This failure is expected [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]] |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 110 | tst test_fail.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_fail.py:[LINENR]] [suite.py:[LINENR]] |
| 111 | --------------------------------------------------------------------- |
| 112 | trial test_suite FAIL |
| 113 | --------------------------------------------------------------------- |
| 114 | FAIL: test_suite (fail: 1, skip: 5) |
| 115 | skip: hello_world.py (N.N sec) |
| 116 | skip: mo_mt_sms.py |
| 117 | skip: mo_sms.py |
| 118 | skip: test_error.py (N.N sec) |
| 119 | FAIL: test_fail.py (N.N sec) EpicFail: This failure is expected |
| 120 | skip: test_fail_raise.py |
Pau Espin Pedrol | 0ffb414 | 2017-05-15 18:24:35 +0200 | [diff] [blame] | 121 | |
| 122 | - a test with a raised failure |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 123 | |
| 124 | --------------------------------------------------------------------- |
| 125 | trial test_suite |
| 126 | --------------------------------------------------------------------- |
| 127 | |
| 128 | ---------------------------------------------- |
| 129 | trial test_suite test_fail_raise.py |
| 130 | ---------------------------------------------- |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 131 | tst test_fail_raise.py:[LINENR]: ERR: ExpectedFail: This failure is expected [test_suite↪test_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]: raise ExpectedFail('This failure is expected')] |
Neels Hofmeyr | 6ccda11 | 2017-06-06 19:41:17 +0200 | [diff] [blame] | 132 | tst test_fail_raise.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_fail_raise.py:[LINENR]] [suite.py:[LINENR]] |
| 133 | --------------------------------------------------------------------- |
| 134 | trial test_suite FAIL |
| 135 | --------------------------------------------------------------------- |
| 136 | FAIL: test_suite (fail: 1, skip: 5) |
| 137 | skip: hello_world.py (N.N sec) |
| 138 | skip: mo_mt_sms.py |
| 139 | skip: mo_sms.py |
| 140 | skip: test_error.py (N.N sec) |
| 141 | skip: test_fail.py (N.N sec) |
Neels Hofmeyr | 1a7a3f0 | 2017-06-10 01:18:27 +0200 | [diff] [blame] | 142 | FAIL: test_fail_raise.py (N.N sec) ExpectedFail: This failure is expected |
Neels Hofmeyr | 3531a19 | 2017-03-28 14:30:28 +0200 | [diff] [blame] | 143 | |
| 144 | - graceful exit. |