blob: aa785ada98dd34fafa7a8b053f5510a3fafdcd1b [file] [log] [blame]
Harald Welte21b46bd2017-12-17 19:46:32 +01001Integration Tests for OsmoBSC
2-----------------------------
3
4This test suite tests OsmoBSC while emulating both multiple BTS + MS as
5well as the MSC.
6
7In terms of external entities, you will need to run
8* osmo-mgw in order to properly terminate the MGCP commands by the BSC
9* osmo-stp as STP between the simulated MSC and osmo-bsc
10* 3x osmo-bts-omldummy as this test suite only implements RSL and no OML
11
12The included jenkins.sh script, together with the Dockerfiles from
13http://git.osmocom.org/docker-playground/ can be used to run both the
14osmo-bsc-under-test as well as the extenal entities and the tester.
15
16
17Further Test Ideas
18------------------
19
20This is a random list of things about things possible to test.
21Asterisks '*' are TODO, while 'x' means already implemented.
Harald Welte696ddb62017-12-08 14:01:43 +010022
23= exhaustion of resources
24
Harald Weltebab2f7a2017-12-15 15:16:42 +010025x send many CHAN RQD (any) and count if all channels get actually allocated
26xx verify BTS_CTR_CHREQ_TOTAL reflects number sent on RSL
Harald Welte696ddb62017-12-08 14:01:43 +010027** verify how quickly they get released again
28** verify that CHAN RQD with same RA + FN get only on allocation
Harald Weltebab2f7a2017-12-15 15:16:42 +010029x verify that we get IMM_ASS_REJ once channels are exhausted
30xx verify BTS_CTR_CHREQ_NO_CHANNEL increments accordigly
Harald Welte696ddb62017-12-08 14:01:43 +010031* verify for particular channel type / cause values
32* verify that IMM.ASS.REJ has increasing back-off
33* verify how BSC reacts to AGCH overload (DELETE IND)
34
Harald Welte696ddb62017-12-08 14:01:43 +010035= paging
36
Harald Weltebab2f7a2017-12-15 15:16:42 +010037x page by TMSI vs. page by IMSI
38x verify if CCCH_LOAD_IND(PCH) slot count is observed
39x verify paging expiration
40x paging with different identity (lac/cgi/...) on A interface -> expect on right BSC(s)
41
42= assignment
43
44x CSD call
45x CTM telephony
46x CIC on AoIP
47x missing CodecList IE
48* with no CIC and no AoIP
49* with IPv6 Address in AoIP
50* with LCLS information
Harald Welte21b46bd2017-12-17 19:46:32 +010051x supported/unsupported/invalid ciphers
Harald Weltebab2f7a2017-12-15 15:16:42 +010052* supported/unsupported/invalid codecs
53* inconsistent channel type + codec + codec-list
54* on full BTS -> fail
Harald Welte696ddb62017-12-08 14:01:43 +010055
56= hand-over
57
58* intra-BSC HO
59* handover detect when not expected
60
61= erroneous channel release
62
Harald Weltebab2f7a2017-12-15 15:16:42 +010063x no response to CHAN ACT
64x CONN FAIL IND from BTS
Harald Welte696ddb62017-12-08 14:01:43 +010065** verify counter increment of BTS_CTR_CHAN_RF_FAIL
66* no (or late?) response to RF CHAN REL
67* no (or late?) response to RLL RELEASE REQ
Harald Weltebab2f7a2017-12-15 15:16:42 +010068x RLL messages on not-activated channels
Harald Welte696ddb62017-12-08 14:01:43 +010069
70= misc
71
72* SMS-CB
Harald Weltebab2f7a2017-12-15 15:16:42 +010073x behavior in case of CHAN ACT NACK
Harald Welte696ddb62017-12-08 14:01:43 +010074* EST REQ for SAPI3 originating from core
75* behavior of BSC in various error cases (ERR IND)
76** BTS_CTR_CHAN_RLL_ERR increment on T200_EXPIRED
77* MODE MODIFY with ACK / NACK / no response
Harald Weltebab2f7a2017-12-15 15:16:42 +010078* invalid message type / IE type
79** verify BSSAP CONFUSION is sent in all applicable cases
Harald Welte696ddb62017-12-08 14:01:43 +010080
81= IPA voice related
82
83* expect IPA CRCX, send UDP flows, expect them on AoIP
84* expect RTCP
85* missing RTP flow?
86* missing RTCP?
87* missing / drop-outs in RTP flow[s]
88* no response to IPA CRCX / MDCX / DLCX
89
90= counters
91
92* test each and every counter in BSC, validate via CTRL interface
Harald Weltebab2f7a2017-12-15 15:16:42 +010093xx RSL/OML failure: drop link, expect BTS_CTR_BTS_xxx_FAIL +1
94xx paging
95xxx send PAGING from MSC side
96xxx expect BSC_CTR_PAGING_ATTEMPTED increase by one
97xxx expect BSC_CTR_PAGING_EXPIRED on T3113 expiration
Harald Welte696ddb62017-12-08 14:01:43 +010098** BTS_CTR_CODEC_* on CHAN_ACT_ACK
99* new counter ideas
100** number of SCCP CR timeouts
101** number of incoming RESET from MSC
102
103= VTY based/corresponding tests
104
105* changes in BCCH FILLING
106* changes in SACCH FILLING
107
Harald Welte21b46bd2017-12-17 19:46:32 +0100108= dynamic TS switching
109
110* TBD
111