Gitiles
Code Review Sign In
gerrit.osmocom.org / osmo-gsm-tester / 3a0dea682e73c605c2a4d45f0e7a8a39fba3bb6b / . / selftest / suite_test / suite_test.ok
blob: d55317b24d4dda3f91e295fbf2962e94249cff91 [file] [log] [blame]
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]1- non-existing suite dir
Pau Espin Pedrol6c6c0e82020-05-11 18:30:58 +0200[diff] [blame]2cnf -: DBG: Found main configuration file in [PATH]/selftest/suite_test/paths.conf which is [PATH]/selftest/suite_test/paths.conf
3cnf -: DBG: MAIN CONFIG:
4{'default_suites_conf_path': '[PATH]/selftest/suite_test/default-suites.conf',
5 'defaults_conf_path': '[PATH]/selftest/suite_test/defaults.conf',
6 'resource_conf_path': '[PATH]/selftest/suite_test/resources.conf',
7 'scenarios_dir': '[PATH]/selftest/suite_test/scenarios',
8 'state_dir': '[PATH]/selftest/suite_test/test_work/state_dir',
Pau Espin Pedrole972c9c2020-05-12 15:06:55 +0200[diff] [blame]9 'suites_dir': '[PATH]/selftest/suite_test',
10 'trial_dir': '[PATH]/selftest/suite_test/trial'}
Neels Hofmeyref9ed2d2017-05-04 16:39:29 +0200[diff] [blame]11--- -: ERR: RuntimeError: Suite not found: 'does_not_exist' in [PATH]/selftest/suite_test
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]12- no suite.conf
Neels Hofmeyr31e83202017-06-06 19:44:32 +0200[diff] [blame]13cnf empty_dir: DBG: reading suite.conf
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]14cnf [PATH]/selftest/suite_test/empty_dir/suite.conf: ERR: FileNotFoundError: [Errno 2] No such file or directory: '[PATH]/selftest/suite_test/empty_dir/suite.conf' [empty_dir↪[PATH]/selftest/suite_test/empty_dir/suite.conf]
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]15- valid suite dir
Neels Hofmeyr31e83202017-06-06 19:44:32 +0200[diff] [blame]16cnf test_suite: DBG: reading suite.conf
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]17defaults:
18 timeout: 60s
19resources:
20 bts:
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]21 - label: sysmoCell 5000
22 times: '2'
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]23 - times: '1'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]24 type: sysmo
Neels Hofmeyr76d81032017-05-18 18:35:32 +0200[diff] [blame]25 ip_address:
26 - times: '1'
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]27 modem:
28 - times: '2'
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]29
30- run hello world test
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]31
32---------------------------------------------------------------------
33trial test_suite
34---------------------------------------------------------------------
Neels Hofmeyr7e2e8f12017-05-14 03:37:13 +0200[diff] [blame]35tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ...
Neels Hofmeyr31e83202017-06-06 19:44:32 +0200[diff] [blame]36tst test_suite: DBG: {combining='resources'}
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]37tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'label': 'sysmoCell 5000'}, {'label': 'sysmoCell 5000'}, {'type': 'sysmo'}], ip_address=[{}], modem=[{}, {}]}} [test_suite↪{combining_scenarios='resources'}]
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]38tst test_suite: DBG: {combining='modifiers'}
39tst {combining_scenarios='modifiers'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='modifiers'}]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]40tst test_suite: Reserving 3 x bts (candidates: 6)
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]41tst test_suite: DBG: Picked - _hash: a59640b8ba6a373552b24a6f9f65cadd2347bace
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]42 addr: 10.42.42.53
43 band: GSM-1800
44 ipa_unit_id: '7'
45 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]46 osmo_trx:
47 clock_reference: external
48 launch_trx: 'False'
49 trx_ip: 10.42.42.112
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]50 trx_list:
51 - max_power_red: '3'
52 nominal_power: '10'
53 - max_power_red: '0'
54 nominal_power: '12'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]55 type: osmo-bts-trx
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]56- _hash: c2feabd082c36a1cdeccb9a5237dfff7dbadb009
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]57 addr: 10.42.42.53
58 band: GSM-1800
59 ipa_unit_id: '7'
60 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]61 osmo_trx:
62 clock_reference: external
63 launch_trx: 'False'
64 trx_ip: 10.42.42.112
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]65 trx_list:
66 - nominal_power: '10'
67 - max_power_red: '1'
68 nominal_power: '12'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]69 type: osmo-bts-trx
70- _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
Neels Hofmeyr17c139e2017-04-12 02:42:02 +0200[diff] [blame]71 addr: 10.42.42.114
72 band: GSM-1800
73 ipa_unit_id: '1'
74 label: sysmoBTS 1002
75 type: sysmo
Neels Hofmeyr31e83202017-06-06 19:44:32 +0200[diff] [blame]76tst test_suite: Reserving 1 x ip_address (candidates: 3)
Neels Hofmeyr76d81032017-05-18 18:35:32 +0200[diff] [blame]77tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
78 addr: 10.42.42.1
Neels Hofmeyr31e83202017-06-06 19:44:32 +0200[diff] [blame]79tst test_suite: Reserving 2 x modem (candidates: 16)
Neels Hofmeyrcccbe592017-05-07 01:16:07 +0200[diff] [blame]80tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
Neels Hofmeyr17c139e2017-04-12 02:42:02 +0200[diff] [blame]81 imsi: '901700000007801'
82 ki: D620F48487B1B782DA55DF6717F08FF9
83 label: m7801
84 path: /wavecom_0
85- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
86 imsi: '901700000007802'
87 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
88 label: m7802
89 path: /wavecom_1
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]90
91----------------------------------------------
92trial test_suite hello_world.py
93----------------------------------------------
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +0200[diff] [blame]94tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]]
95tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]]
96tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]]
97tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]]
98tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]]
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]99tst hello_world.py:[LINENR] Test passed (N.N sec) [test_suite↪hello_world.py]
100---------------------------------------------------------------------
101trial test_suite PASS
102---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]103PASS: test_suite (pass: 1, skip: 6)
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]104 pass: hello_world.py (N.N sec)
105 skip: mo_mt_sms.py
106 skip: mo_sms.py
107 skip: test_error.py
108 skip: test_fail.py
109 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]110 skip: test_suite_params.py
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]111
112- a test with an error
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]113
114---------------------------------------------------------------------
115trial test_suite
116---------------------------------------------------------------------
117
118----------------------------------------------
119trial test_suite test_error.py
120----------------------------------------------
Neels Hofmeyrd1bedb12017-05-07 03:02:23 +0200[diff] [blame]121tst test_error.py:[LINENR]: I am 'test_suite' / 'test_error.py:[LINENR]' [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]]
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]122tst test_error.py:[LINENR]: ERR: AssertionError: test_error.py:[LINENR]: assert False [test_suite↪test_error.py:[LINENR]] [test_error.py:[LINENR]: assert False]
Pau Espin Pedrolfd5de3d2017-11-09 14:26:35 +0100[diff] [blame]123tst test_error.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_error.py:[LINENR]] [test.py:[LINENR]]
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]124---------------------------------------------------------------------
125trial test_suite FAIL
126---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]127FAIL: test_suite (fail: 1, skip: 6)
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]128 skip: hello_world.py (N.N sec)
129 skip: mo_mt_sms.py
130 skip: mo_sms.py
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]131 FAIL: test_error.py (N.N sec) AssertionError: test_error.py:[LINENR]: assert False
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]132 skip: test_fail.py
133 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]134 skip: test_suite_params.py
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +0200[diff] [blame]135
136- a test with a failure
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]137
138---------------------------------------------------------------------
139trial test_suite
140---------------------------------------------------------------------
141
142----------------------------------------------
143trial test_suite test_fail.py
144----------------------------------------------
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +0200[diff] [blame]145tst test_fail.py:[LINENR]: I am 'test_suite' / 'test_fail.py:[LINENR]' [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]]
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]146tst test_fail.py:[LINENR]: ERR: EpicFail: This failure is expected [test_suite↪test_fail.py:[LINENR]] [test_fail.py:[LINENR]]
Pau Espin Pedrolfd5de3d2017-11-09 14:26:35 +0100[diff] [blame]147tst test_fail.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_fail.py:[LINENR]] [test.py:[LINENR]]
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]148---------------------------------------------------------------------
149trial test_suite FAIL
150---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]151FAIL: test_suite (fail: 1, skip: 6)
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]152 skip: hello_world.py (N.N sec)
153 skip: mo_mt_sms.py
154 skip: mo_sms.py
155 skip: test_error.py (N.N sec)
156 FAIL: test_fail.py (N.N sec) EpicFail: This failure is expected
157 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]158 skip: test_suite_params.py
Pau Espin Pedrol0ffb4142017-05-15 18:24:35 +0200[diff] [blame]159
160- a test with a raised failure
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]161
162---------------------------------------------------------------------
163trial test_suite
164---------------------------------------------------------------------
165
166----------------------------------------------
167trial test_suite test_fail_raise.py
168----------------------------------------------
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]169tst test_fail_raise.py:[LINENR]: ERR: ExpectedFail: This failure is expected [test_suite↪test_fail_raise.py:[LINENR]] [test_fail_raise.py:[LINENR]: raise ExpectedFail('This failure is expected')]
Pau Espin Pedrolfd5de3d2017-11-09 14:26:35 +0100[diff] [blame]170tst test_fail_raise.py:[LINENR]: Test FAILED (N.N sec) [test_suite↪test_fail_raise.py:[LINENR]] [test.py:[LINENR]]
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]171---------------------------------------------------------------------
172trial test_suite FAIL
173---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]174FAIL: test_suite (fail: 1, skip: 6)
Neels Hofmeyr6ccda112017-06-06 19:41:17 +0200[diff] [blame]175 skip: hello_world.py (N.N sec)
176 skip: mo_mt_sms.py
177 skip: mo_sms.py
178 skip: test_error.py (N.N sec)
179 skip: test_fail.py (N.N sec)
Neels Hofmeyr1a7a3f02017-06-10 01:18:27 +0200[diff] [blame]180 FAIL: test_fail_raise.py (N.N sec) ExpectedFail: This failure is expected
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]181 skip: test_suite_params.py
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]182- test with half empty scenario
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]183
184---------------------------------------------------------------------
185trial test_suite
186---------------------------------------------------------------------
187tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... [suite.py:[LINENR]]
188tst test_suite: DBG: {combining='resources'} [suite.py:[LINENR]]
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]189tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'label': 'sysmoCell 5000'}, {'label': 'sysmoCell 5000'}, {'type': 'sysmo'}], ip_address=[{}], modem=[{}, {}]}} [test_suite↪{combining_scenarios='resources'}] [suite.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]190tst {combining_scenarios='resources', scenario='foo'}: [RESOURCE_DICT]
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]191tst test_suite: DBG: {combining='modifiers'} [suite.py:[LINENR]]
192tst {combining_scenarios='modifiers'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='modifiers'}] [suite.py:[LINENR]]
193tst {combining_scenarios='modifiers', scenario='foo'}: DBG: {conf={}, scenario='foo'} [test_suite↪{combining_scenarios='modifiers', scenario='foo'}] [suite.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]194tst test_suite: Reserving 3 x bts (candidates: 6) [resource.py:[LINENR]]
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]195tst test_suite: DBG: Picked - _hash: a59640b8ba6a373552b24a6f9f65cadd2347bace
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]196 addr: 10.42.42.53
197 band: GSM-1800
198 ipa_unit_id: '7'
199 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]200 osmo_trx:
201 clock_reference: external
202 launch_trx: 'False'
203 trx_ip: 10.42.42.112
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]204 trx_list:
205 - max_power_red: '3'
206 nominal_power: '10'
207 - max_power_red: '0'
208 nominal_power: '12'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]209 type: osmo-bts-trx
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]210- _hash: c2feabd082c36a1cdeccb9a5237dfff7dbadb009
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]211 addr: 10.42.42.53
212 band: GSM-1800
213 ipa_unit_id: '7'
214 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]215 osmo_trx:
216 clock_reference: external
217 launch_trx: 'False'
218 trx_ip: 10.42.42.112
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]219 trx_list:
220 - nominal_power: '10'
221 - max_power_red: '1'
222 nominal_power: '12'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]223 type: osmo-bts-trx
224- _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]225 addr: 10.42.42.114
226 band: GSM-1800
227 ipa_unit_id: '1'
228 label: sysmoBTS 1002
229 type: sysmo
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]230 [resource.py:[LINENR]]
231tst test_suite: Reserving 1 x ip_address (candidates: 3) [resource.py:[LINENR]]
232tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
233 addr: 10.42.42.1
234 [resource.py:[LINENR]]
235tst test_suite: Reserving 2 x modem (candidates: 16) [resource.py:[LINENR]]
236tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
237 imsi: '901700000007801'
238 ki: D620F48487B1B782DA55DF6717F08FF9
239 label: m7801
240 path: /wavecom_0
241- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
242 imsi: '901700000007802'
243 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
244 label: m7802
245 path: /wavecom_1
246 [resource.py:[LINENR]]
247
248----------------------------------------------
249trial test_suite hello_world.py
250----------------------------------------------
251tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
252tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
253tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
254tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
255tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
Pau Espin Pedrolfd5de3d2017-11-09 14:26:35 +0100[diff] [blame]256tst hello_world.py:[LINENR] Test passed (N.N sec) [test_suite↪hello_world.py] [test.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]257---------------------------------------------------------------------
258trial test_suite PASS
259---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]260PASS: test_suite (pass: 1, skip: 6)
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]261 pass: hello_world.py (N.N sec)
262 skip: mo_mt_sms.py
263 skip: mo_sms.py
264 skip: test_error.py
265 skip: test_fail.py
266 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]267 skip: test_suite_params.py
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]268- test with scenario
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]269
270---------------------------------------------------------------------
271trial test_suite
272---------------------------------------------------------------------
273tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... [suite.py:[LINENR]]
274tst test_suite: DBG: {combining='resources'} [suite.py:[LINENR]]
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]275tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'label': 'sysmoCell 5000'}, {'label': 'sysmoCell 5000'}, {'type': 'sysmo'}], ip_address=[{}], modem=[{}, {}]}} [test_suite↪{combining_scenarios='resources'}] [suite.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]276tst {combining_scenarios='resources', scenario='foo'}: [RESOURCE_DICT]
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]277tst test_suite: DBG: {combining='modifiers'} [suite.py:[LINENR]]
278tst {combining_scenarios='modifiers'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='modifiers'}] [suite.py:[LINENR]]
279tst {combining_scenarios='modifiers', scenario='foo'}: DBG: {conf={}, scenario='foo'} [test_suite↪{combining_scenarios='modifiers', scenario='foo'}] [suite.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]280tst test_suite: Reserving 3 x bts (candidates: 6) [resource.py:[LINENR]]
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]281tst test_suite: DBG: Picked - _hash: a59640b8ba6a373552b24a6f9f65cadd2347bace
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]282 addr: 10.42.42.53
283 band: GSM-1800
284 ipa_unit_id: '7'
285 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]286 osmo_trx:
287 clock_reference: external
288 launch_trx: 'False'
289 trx_ip: 10.42.42.112
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]290 trx_list:
Pau Espin Pedrol58475512017-09-14 15:33:15 +0200[diff] [blame]291 - max_power_red: '3'
292 nominal_power: '10'
293 - max_power_red: '0'
294 nominal_power: '12'
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]295 type: osmo-bts-trx
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]296- _hash: c2feabd082c36a1cdeccb9a5237dfff7dbadb009
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]297 addr: 10.42.42.53
298 band: GSM-1800
299 ipa_unit_id: '7'
300 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]301 osmo_trx:
302 clock_reference: external
303 launch_trx: 'False'
304 trx_ip: 10.42.42.112
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]305 trx_list:
306 - nominal_power: '10'
307 - max_power_red: '1'
308 nominal_power: '12'
Pau Espin Pedrolcbc72422017-09-14 15:55:49 +0200[diff] [blame]309 type: osmo-bts-trx
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]310- _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
311 addr: 10.42.42.114
312 band: GSM-1800
313 ipa_unit_id: '1'
314 label: sysmoBTS 1002
315 type: sysmo
316 [resource.py:[LINENR]]
317tst test_suite: Reserving 1 x ip_address (candidates: 3) [resource.py:[LINENR]]
318tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
319 addr: 10.42.42.1
320 [resource.py:[LINENR]]
321tst test_suite: Reserving 2 x modem (candidates: 16) [resource.py:[LINENR]]
322tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
323 imsi: '901700000007801'
324 ki: D620F48487B1B782DA55DF6717F08FF9
325 label: m7801
326 path: /wavecom_0
327- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
328 imsi: '901700000007802'
329 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
330 label: m7802
331 path: /wavecom_1
332 [resource.py:[LINENR]]
333
334----------------------------------------------
335trial test_suite hello_world.py
336----------------------------------------------
337tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
338tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
339tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
340tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
341tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
Pau Espin Pedrolfd5de3d2017-11-09 14:26:35 +0100[diff] [blame]342tst hello_world.py:[LINENR] Test passed (N.N sec) [test_suite↪hello_world.py] [test.py:[LINENR]]
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]343---------------------------------------------------------------------
344trial test_suite PASS
345---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]346PASS: test_suite (pass: 1, skip: 6)
Pau Espin Pedrol0b302792017-09-10 16:33:10 +0200[diff] [blame]347 pass: hello_world.py (N.N sec)
348 skip: mo_mt_sms.py
349 skip: mo_sms.py
350 skip: test_error.py
351 skip: test_fail.py
352 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]353 skip: test_suite_params.py
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]354- test with scenario and modifiers
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]355tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... [suite.py:[LINENR]]
356tst test_suite: DBG: {combining='resources'} [suite.py:[LINENR]]
357tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'label': 'sysmoCell 5000'}, {'label': 'sysmoCell 5000'}, {'type': 'sysmo'}], ip_address=[{}], modem=[{}, {}]}} [test_suite↪{combining_scenarios='resources'}] [suite.py:[LINENR]]
358tst {combining_scenarios='resources', scenario='foo'}: [RESOURCE_DICT]
359tst test_suite: DBG: {combining='modifiers'} [suite.py:[LINENR]]
360tst {combining_scenarios='modifiers'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='modifiers'}] [suite.py:[LINENR]]
361tst {combining_scenarios='modifiers', scenario='foo'}: DBG: {conf={bts=[{'trx_list': [{'nominal_power': '20'}, {'nominal_power': '20'}]}, {'trx_list': [{'nominal_power': '20'}, {'nominal_power': '20'}]}, {'type': 'sysmo'}]}, scenario='foo'} [test_suite↪{combining_scenarios='modifiers', scenario='foo'}] [suite.py:[LINENR]]
362tst test_suite: Reserving 3 x bts (candidates: 6) [resource.py:[LINENR]]
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]363tst test_suite: DBG: Picked - _hash: a59640b8ba6a373552b24a6f9f65cadd2347bace
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]364 addr: 10.42.42.53
365 band: GSM-1800
366 ipa_unit_id: '7'
367 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]368 osmo_trx:
369 clock_reference: external
370 launch_trx: 'False'
371 trx_ip: 10.42.42.112
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]372 trx_list:
373 - max_power_red: '3'
374 nominal_power: '10'
375 - max_power_red: '0'
376 nominal_power: '12'
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]377 type: osmo-bts-trx
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]378- _hash: c2feabd082c36a1cdeccb9a5237dfff7dbadb009
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]379 addr: 10.42.42.53
380 band: GSM-1800
381 ipa_unit_id: '7'
382 label: sysmoCell 5000
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]383 osmo_trx:
384 clock_reference: external
385 launch_trx: 'False'
386 trx_ip: 10.42.42.112
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]387 trx_list:
388 - nominal_power: '10'
389 - max_power_red: '1'
390 nominal_power: '12'
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]391 type: osmo-bts-trx
392- _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
393 addr: 10.42.42.114
394 band: GSM-1800
395 ipa_unit_id: '1'
396 label: sysmoBTS 1002
397 type: sysmo
398 [resource.py:[LINENR]]
399tst test_suite: Reserving 1 x ip_address (candidates: 3) [resource.py:[LINENR]]
400tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
401 addr: 10.42.42.1
402 [resource.py:[LINENR]]
403tst test_suite: Reserving 2 x modem (candidates: 16) [resource.py:[LINENR]]
404tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
405 imsi: '901700000007801'
406 ki: D620F48487B1B782DA55DF6717F08FF9
407 label: m7801
408 path: /wavecom_0
409- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
410 imsi: '901700000007802'
411 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
412 label: m7802
413 path: /wavecom_1
414 [resource.py:[LINENR]]
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]415resources(test_suite)={'bts': [{'_hash': 'a59640b8ba6a373552b24a6f9f65cadd2347bace',
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]416 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
417 'addr': '10.42.42.53',
418 'band': 'GSM-1800',
419 'ipa_unit_id': '7',
420 'label': 'sysmoCell 5000',
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]421 'osmo_trx': {'clock_reference': 'external',
422 'launch_trx': 'False',
423 'trx_ip': '10.42.42.112'},
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]424 'trx_list': [{'max_power_red': '3', 'nominal_power': '20'},
425 {'max_power_red': '0', 'nominal_power': '20'}],
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]426 'type': 'osmo-bts-trx'},
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]427 {'_hash': 'c2feabd082c36a1cdeccb9a5237dfff7dbadb009',
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]428 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
429 'addr': '10.42.42.53',
430 'band': 'GSM-1800',
431 'ipa_unit_id': '7',
432 'label': 'sysmoCell 5000',
Pau Espin Pedrol0d455042018-08-27 17:07:41 +0200[diff] [blame]433 'osmo_trx': {'clock_reference': 'external',
434 'launch_trx': 'False',
435 'trx_ip': '10.42.42.112'},
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]436 'trx_list': [{'nominal_power': '20'},
437 {'max_power_red': '1', 'nominal_power': '20'}],
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]438 'type': 'osmo-bts-trx'},
439 {'_hash': '07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9',
440 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
441 'addr': '10.42.42.114',
442 'band': 'GSM-1800',
443 'ipa_unit_id': '1',
444 'label': 'sysmoBTS 1002',
445 'type': 'sysmo'}],
446 'ip_address': [{'_hash': 'cde1debf28f07f94f92c761b4b7c6bf35785ced4',
447 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
448 'addr': '10.42.42.1'}],
449 'modem': [{'_hash': '19c69e45aa090fb511446bd00797690aa82ff52f',
450 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
451 'imsi': '901700000007801',
452 'ki': 'D620F48487B1B782DA55DF6717F08FF9',
453 'label': 'm7801',
454 'path': '/wavecom_0'},
455 {'_hash': 'e1a46516a1fb493b2617ab14fc1693a9a45ec254',
456 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
457 'imsi': '901700000007802',
458 'ki': '47FDB2D55CE6A10A85ABDAD034A5B7B3',
459 'label': 'm7802',
460 'path': '/wavecom_1'}]}
461
462---------------------------------------------------------------------
463trial test_suite
464---------------------------------------------------------------------
465
466----------------------------------------------
467trial test_suite hello_world.py
468----------------------------------------------
469tst hello_world.py:[LINENR]: hello world [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
470tst hello_world.py:[LINENR]: I am 'test_suite' / 'hello_world.py:[LINENR]' [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
471tst hello_world.py:[LINENR]: one [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
472tst hello_world.py:[LINENR]: two [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
473tst hello_world.py:[LINENR]: three [test_suite↪hello_world.py:[LINENR]] [hello_world.py:[LINENR]]
474tst hello_world.py:[LINENR] Test passed (N.N sec) [test_suite↪hello_world.py] [test.py:[LINENR]]
475---------------------------------------------------------------------
476trial test_suite PASS
477---------------------------------------------------------------------
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]478PASS: test_suite (pass: 1, skip: 6)
Pau Espin Pedrolaab56922018-08-21 14:58:29 +0200[diff] [blame]479 pass: hello_world.py (N.N sec)
480 skip: mo_mt_sms.py
481 skip: mo_sms.py
482 skip: test_error.py
483 skip: test_fail.py
484 skip: test_fail_raise.py
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]485 skip: test_suite_params.py
486- test with suite-specific config
Pau Espin Pedrol30637302020-05-06 21:11:02 +0200[diff] [blame]487tst test_suite: reserving resources in [PATH]/selftest/suite_test/test_work/state_dir ... [suite.py:[LINENR]]
488tst test_suite: DBG: {combining='resources'} [suite.py:[LINENR]]
489tst {combining_scenarios='resources'}: DBG: {definition_conf={bts=[{'label': 'sysmoCell 5000'}, {'label': 'sysmoCell 5000'}, {'type': 'sysmo'}], ip_address=[{}], modem=[{}, {}]}} [test_suite↪{combining_scenarios='resources'}] [suite.py:[LINENR]]
490tst {combining_scenarios='resources', scenario='foo'}: [RESOURCE_DICT]
491tst test_suite: DBG: {combining='modifiers'} [suite.py:[LINENR]]
492tst {combining_scenarios='modifiers'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='modifiers'}] [suite.py:[LINENR]]
493tst {combining_scenarios='modifiers', scenario='foo'}: DBG: {conf={}, scenario='foo'} [test_suite↪{combining_scenarios='modifiers', scenario='foo'}] [suite.py:[LINENR]]
494tst test_suite: Reserving 3 x bts (candidates: 6) [resource.py:[LINENR]]
495tst test_suite: DBG: Picked - _hash: a59640b8ba6a373552b24a6f9f65cadd2347bace
496 addr: 10.42.42.53
497 band: GSM-1800
498 ipa_unit_id: '7'
499 label: sysmoCell 5000
500 osmo_trx:
501 clock_reference: external
502 launch_trx: 'False'
503 trx_ip: 10.42.42.112
504 trx_list:
505 - max_power_red: '3'
506 nominal_power: '10'
507 - max_power_red: '0'
508 nominal_power: '12'
509 type: osmo-bts-trx
510- _hash: c2feabd082c36a1cdeccb9a5237dfff7dbadb009
511 addr: 10.42.42.53
512 band: GSM-1800
513 ipa_unit_id: '7'
514 label: sysmoCell 5000
515 osmo_trx:
516 clock_reference: external
517 launch_trx: 'False'
518 trx_ip: 10.42.42.112
519 trx_list:
520 - nominal_power: '10'
521 - max_power_red: '1'
522 nominal_power: '12'
523 type: osmo-bts-trx
524- _hash: 07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9
525 addr: 10.42.42.114
526 band: GSM-1800
527 ipa_unit_id: '1'
528 label: sysmoBTS 1002
529 type: sysmo
530 [resource.py:[LINENR]]
531tst test_suite: Reserving 1 x ip_address (candidates: 3) [resource.py:[LINENR]]
532tst test_suite: DBG: Picked - _hash: cde1debf28f07f94f92c761b4b7c6bf35785ced4
533 addr: 10.42.42.1
534 [resource.py:[LINENR]]
535tst test_suite: Reserving 2 x modem (candidates: 16) [resource.py:[LINENR]]
536tst test_suite: DBG: Picked - _hash: 19c69e45aa090fb511446bd00797690aa82ff52f
537 imsi: '901700000007801'
538 ki: D620F48487B1B782DA55DF6717F08FF9
539 label: m7801
540 path: /wavecom_0
541- _hash: e1a46516a1fb493b2617ab14fc1693a9a45ec254
542 imsi: '901700000007802'
543 ki: 47FDB2D55CE6A10A85ABDAD034A5B7B3
544 label: m7802
545 path: /wavecom_1
546 [resource.py:[LINENR]]
547resources(test_suite)={'bts': [{'_hash': 'a59640b8ba6a373552b24a6f9f65cadd2347bace',
548 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
549 'addr': '10.42.42.53',
550 'band': 'GSM-1800',
551 'ipa_unit_id': '7',
552 'label': 'sysmoCell 5000',
553 'osmo_trx': {'clock_reference': 'external',
554 'launch_trx': 'False',
555 'trx_ip': '10.42.42.112'},
556 'trx_list': [{'max_power_red': '3', 'nominal_power': '10'},
557 {'max_power_red': '0', 'nominal_power': '12'}],
558 'type': 'osmo-bts-trx'},
559 {'_hash': 'c2feabd082c36a1cdeccb9a5237dfff7dbadb009',
560 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
561 'addr': '10.42.42.53',
562 'band': 'GSM-1800',
563 'ipa_unit_id': '7',
564 'label': 'sysmoCell 5000',
565 'osmo_trx': {'clock_reference': 'external',
566 'launch_trx': 'False',
567 'trx_ip': '10.42.42.112'},
568 'trx_list': [{'nominal_power': '10'},
569 {'max_power_red': '1', 'nominal_power': '12'}],
570 'type': 'osmo-bts-trx'},
571 {'_hash': '07d9c8aaa940b674efcbbabdd69f58a6ce4e94f9',
572 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
573 'addr': '10.42.42.114',
574 'band': 'GSM-1800',
575 'ipa_unit_id': '1',
576 'label': 'sysmoBTS 1002',
577 'type': 'sysmo'}],
578 'ip_address': [{'_hash': 'cde1debf28f07f94f92c761b4b7c6bf35785ced4',
579 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
580 'addr': '10.42.42.1'}],
581 'modem': [{'_hash': '19c69e45aa090fb511446bd00797690aa82ff52f',
582 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
583 'imsi': '901700000007801',
584 'ki': 'D620F48487B1B782DA55DF6717F08FF9',
585 'label': 'm7801',
586 'path': '/wavecom_0'},
587 {'_hash': 'e1a46516a1fb493b2617ab14fc1693a9a45ec254',
588 '_reserved_by': 'test_suite-[ID_NUM]-[ID_NUM]',
589 'imsi': '901700000007802',
590 'ki': '47FDB2D55CE6A10A85ABDAD034A5B7B3',
591 'label': 'm7802',
592 'path': '/wavecom_1'}]}
593
594---------------------------------------------------------------------
595trial test_suite
596---------------------------------------------------------------------
597
598----------------------------------------------
599trial test_suite test_suite_params.py
600----------------------------------------------
601tst test_suite_params.py:[LINENR]: starting test [test_suite↪test_suite_params.py:[LINENR]] [test_suite_params.py:[LINENR]]
602tst test_suite: DBG: {combining='config'} [suite.py:[LINENR]]
603tst {combining_scenarios='config'}: DBG: {definition_conf={}} [test_suite↪{combining_scenarios='config'}] [suite.py:[LINENR]]
604tst {combining_scenarios='config', scenario='foo'}: DBG: {conf={suite={test_suite={some_suite_global_param='heyho', test_suite_params={one_bool_parameter='true', second_list_parameter=['23', '45']}}}}, scenario='foo'} [test_suite↪{combining_scenarios='config', scenario='foo'}] [suite.py:[LINENR]]
605tst test_suite_params.py:[LINENR]: SPECIFIC SUITE CONFIG: {'some_suite_global_param': 'heyho', [test_suite↪test_suite_params.py:[LINENR]] [test_suite_params.py:[LINENR]]
606tst test_suite_params.py:[LINENR]: 'test_suite_params': {'one_bool_parameter': 'true', [test_suite↪test_suite_params.py:[LINENR]] [test_suite_params.py:[LINENR]]
607tst test_suite_params.py:[LINENR]: 'second_list_parameter': ['23', '45']}} [test_suite↪test_suite_params.py:[LINENR]] [test_suite_params.py:[LINENR]]
608tst test_suite_params.py:[LINENR]: SPECIFIC TEST CONFIG: {'one_bool_parameter': 'true', 'second_list_parameter': ['23', '45']} [test_suite↪test_suite_params.py:[LINENR]] [test_suite_params.py:[LINENR]]
609tst test_suite_params.py:[LINENR] Test passed (N.N sec) [test_suite↪test_suite_params.py] [test.py:[LINENR]]
610---------------------------------------------------------------------
611trial test_suite PASS
612---------------------------------------------------------------------
613PASS: test_suite (pass: 1, skip: 6)
614 skip: hello_world.py
615 skip: mo_mt_sms.py
616 skip: mo_sms.py
617 skip: test_error.py
618 skip: test_fail.py
619 skip: test_fail_raise.py
620 pass: test_suite_params.py (N.N sec)
Neels Hofmeyr3531a192017-03-28 14:30:28 +0200[diff] [blame]621
622- graceful exit.