G.4 Statistical testing of Performance Requirements with probability of misdetection

36.521-13GPPEvolved Universal Terrestrial Radio Access (E-UTRA)Part 1: Conformance testingRadio transmission and receptionRelease 17TSUser Equipment (UE) conformance specification

Tools: ARFCN - Frequency Conversion for 5G NR/LTE/UMTS/GSM

G.4.1 General

The test of receiver performance characteristics is two fold.

1. A signal or a combination of signals is offered to the RX port(s) of the receiver.

2. The ability of the receiver to demodulate /decode this signal is verified by analyzing the reaction of the UE to this signal.

In (2) is the statistical aspect of the test and is treated here.

The minimum requirement for those receiver performance tests are 1% or 0.1% misdetection probability

All receiver performance tests are performed in fading conditions. In addition to the statistical considerations, this requires the definition of a minimum test time.

NOTE: All demodulation performance tests (state from version 9.5.0) require a minimum test time, which exceeds the maximum test time in tables G.4.4. Under this circumstances only the test limit at the end of tables G.4.4.-1 resp. G.4.4.-2 is applicable.

G.4.2 Mapping the UE reaction to error ratio

The UE can not indicate the detection or misdetection of the physical channel under test directly. Indirect methods are described in the procedure of the applicable test.

G.4.3 Design of the test

G.2.3 applies, exception:

Limit ER = 0.01 and ER = 0.001

G.4.4 Numerical definition of the pass fail limits

Table G.4.4-1: pass fail limits for ER = 0.01

ne	ns_p	ns_f	ne	ns_p	ns_f	ne	ns_p	ns_f	ne	ns_p	ns_f
0	344	NA	40	3929	2553	80	7033	5874	120	10036	9354
1	485	NA	41	4009	2632	81	7109	5960	121	10110	9442
2	607	10	42	4089	2712	82	7185	6046	122	10184	9530
3	719	33	43	4168	2792	83	7261	6131	123	10259	9619
4	826	66	44	4247	2873	84	7336	6217	124	10333	9707
5	929	107	45	4327	2953	85	7412	6303	125	10407	9796
6	1029	152	46	4406	3034	86	7488	6389	126	10481	9884
7	1127	202	47	4484	3115	87	7564	6475	127	10555	9972
8	1223	255	48	4563	3196	88	7639	6561	128	10629	10061
9	1317	311	49	4642	3278	89	7715	6648	129	10703	10150
10	1409	370	50	4720	3359	90	7790	6734	130	10777	10238
11	1501	430	51	4799	3441	91	7866	6820	131	10851	10327
12	1592	492	52	4877	3523	92	7941	6907	132	10925	10416
13	1681	555	53	4955	3605	93	8017	6993	133	10999	10504
14	1770	620	54	5033	3688	94	8092	7080	134	11073	10593
15	1858	686	55	5111	3770	95	8167	7167	135	11147	10682
16	1946	754	56	5189	3853	96	8242	7253	136	11221	10771
17	2032	822	57	5267	3935	97	8317	7340	137	11295	10860
18	2119	891	58	5344	4018	98	8393	7427	138	11369	10949
19	2204	961	59	5422	4101	99	8468	7514	139	11442	11038
20	2290	1032	60	5499	4185	100	8543	7601	140	11516	11127
21	2374	1103	61	5577	4268	101	8618	7688	141	11590	11216
22	2459	1175	62	5654	4352	102	8693	7775	142	11664	11305
23	2543	1248	63	5731	4435	103	8768	7863	143	11737	11394
24	2627	1321	64	5809	4519	104	8843	7950	144	11811	11483
25	2710	1395	65	5886	4603	105	8917	8037	145	11885	11573
26	2793	1470	66	5963	4687	106	8992	8125	146	11958	11662
27	2876	1544	67	6039	4771	107	9067	8212	147	12032	11751
28	2958	1620	68	6116	4855	108	9142	8300	148	12105	11840
29	3040	1696	69	6193	4940	109	9216	8387	149	12179	11930
30	3122	1772	70	6270	5024	110	9291	8475	150	12252	12019
31	3204	1848	71	6346	5109	111	9366	8562	151	12326	12109
32	3285	1925	72	6423	5193	112	9440	8650	152	12399	12198
33	3366	2003	73	6499	5278	113	9515	8738	153	12473	12288
34	3447	2080	74	6576	5363	114	9589	8826	154	12546	12377
35	3528	2158	75	6652	5448	115	9664	8914	155	12620	12467
36	3609	2237	76	6728	5533	116	9738	9002	156	12693	12556
37	3689	2315	77	6805	5618	117	9813	9090	157	12767	12646
38	3769	2394	78	6881	5704	118	9887	9178	158	12840	12736
39	3850	2473	79	6957	5789	119	9962	9266	159	12913	12826
									160	NA	12915
									Test limit = 1.2352E-2

Table G.4.4-2: pass fail limits for ER = 0.001

ne	ns_p	ns_f	ne	ns_p	ns_f	ne	ns_p	ns_f	ne	ns_p	ns_f
0	3463	NA	41	40174	26265	82	71961	60368	123	102723	96075
1	4874	4	42	40971	27063	83	72720	61225	124	103465	96958
2	6096	99	43	41766	27863	84	73479	62083	125	104208	97842
3	7226	329	44	42559	28666	85	74237	62941	126	104949	98726
4	8298	658	45	43352	29471	86	74995	63801	127	105691	99610
5	9330	1059	46	44142	30279	87	75752	64661	128	106432	100495
6	10332	1513	47	44932	31088	88	76509	65522	129	107173	101380
7	11310	2009	48	45720	31899	89	77265	66383	130	107914	102266
8	12269	2539	49	46507	32713	90	78020	67246	131	108655	103152
9	13212	3096	50	47293	33528	91	78776	68109	132	109395	104039
10	14141	3677	51	48078	34345	92	79530	68973	133	110135	104926
11	15058	4278	52	48861	35164	93	80285	69838	134	110875	105813
12	15965	4896	53	49644	35984	94	81038	70704	135	111614	106701
13	16863	5530	54	50425	36807	95	81792	71570	136	112353	107589
14	17753	6177	55	51205	37631	96	82544	72437	137	113092	108478
15	18635	6836	56	51985	38456	97	83297	73305	138	113830	109367
16	19511	7507	57	52763	39283	98	84049	74173	139	114569	110257
17	20380	8188	58	53541	40112	99	84800	75042	140	115307	111146
18	21244	8878	59	54317	40942	100	85551	75911	141	116045	112037
19	22103	9576	60	55092	41773	101	86302	76782	142	116782	112927
20	22957	10282	61	55867	42606	102	87052	77653	143	117520	113818
21	23806	10995	62	56641	43440	103	87802	78524	144	118257	114710
22	24652	11715	63	57414	44276	104	88552	79396	145	118994	115602
23	25493	12441	64	58186	45113	105	89301	80269	146	119730	116494
24	26331	13173	65	58957	45951	106	90050	81143	147	120466	117386
25	27166	13911	66	59728	46790	107	90798	82017	148	121203	118279
26	27997	14654	67	60497	47631	108	91546	82891	149	121939	119173
27	28826	15401	68	61266	48472	109	92293	83766	150	122674	120066
28	29651	16154	69	62035	49315	110	93041	84642	151	123410	120960
29	30474	16910	70	62802	50159	111	93787	85518	152	124145	121855
30	31294	17671	71	63569	51004	112	94534	86395	153	124880	122749
31	32111	18436	72	64335	51851	113	95280	87273	154	125615	123644
32	32927	19204	73	65100	52698	114	96026	88151	155	126349	124540
33	33740	19976	74	65865	53546	115	96771	89029	156	127083	125435
34	34551	20752	75	66629	54396	116	97516	89908	157	127818	126332
35	35360	21531	76	67393	55246	117	98261	90788	158	128551	127228
36	36166	22312	77	68156	56097	118	99005	91668	159	129285	128125
37	36971	23097	78	68918	56950	119	99750	92548	160	130019	129022
38	37775	23885	79	69679	57803	120	100493	93429	161	130752	129919
39	38576	24676	80	70440	58657	121	101237	94311	162	NA	130817
40	39376	25469	81	71201	59512	122	101980	95193	Test limit = 1.2345E-3

NOTE 1: The first column is the number of errors (ne = number of misdetections)

NOTE 2: The second column is the number of samples for the pass limit (ns_p, ns=Number of Samples= number misdetections + number of detections)

NOTE 3: The third column is the number of samples for the fail limit (ns_f)

NOTE 4: The test limit at the end of the table is applicable, when the minimum test time in clause 3.5 governs the test. Pass the test for ER ≤ Test limit, otherwise fail.

G.4.5 Pass fail decision rules

G.2.5 applies

NOTE: For ER=0.01 an ideal DUT passes after 344 samples. The maximum test time is 12913 samples. For ER=0.001 an ideal DUT passes after 3463 samples. The maximum test time is 130752 samples.

For LAA the following also apply:

The pass fail decision is done individually for each CC. The pass fail decision for one component in the test vector is as follows: pass if all CCs or SCC only according to the test cases pass, otherwise fail.

It is allowed to apply more samples to the DUT, common for all CCs, (e.g. up to an integer number of frames). Use the ratio for the pass fail decision.

G.4.6 Minimum Test time

Table G.4.6-1: Minimum Test time for Demodulation of PCFICH/PDCCH

Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	FDD	TDD	FDD	TDD
1	[8.1]	R.15 (10 MHz, 8CCE, full, QPSK 1/3) (1×2 Low) ETU70	200 000	222 222	400 000	224 000	401 000
1	[8.2]	R.16 (1.4MHz, 2CCE, full, QPSK 1/3) (2×2 Low) EPA5	200 000	222 222	400 000	224 000	401 000
1 Rel-9 …	[ ]	R.16_1 (10MHz, 4CCE, full, QPSK 1/3) (2×2 Low) EVA70	200 000	222 222	400 000	224 000	401 000
1	[8.3]	R.17 (10MHz, 4CCE, full, QPSK 1/3) (4×2 Medium) EVA5	200 000	222 222	400 000	224 000	401 000
1 Rel-9 …	[ ]	R.17_1 (5MHz, 2CCE, full, QPSK 1/3) (4×2 Medium) EPA5	200 000	222 222	400 000	224 000	401 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-1a: Minimum Test time for Demodulation of PCFICH/PDCCH for eICIC

Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
				FDD	TDD	FDD	TDD
1	[ ]	R.15-1 (10 MHz, 8CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test1)	2 000 000	2 000 000	2 001 000	2 001 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-1b: Minimum Test time for Demodulation of PCFICH/PDCCH for feICIC

Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
				FDD	TDD	FDD	TDD
1	[ ]	R.15-2 (10 MHz, 8CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test1)	2 000 000	2 000 000	2 001 000	2 001 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-2: Minimum Test time for Demodulation of PHICH

Test No	Demod. scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demod. scenario	Demodulation scenario (info only)	MNAS (Simulation)	FDD	TDD	FDD	TDD
1	[9.1]	R.18 (10 MHz, full, QPSK 1/3) (1×2 Low) ETU70	200 000	200 000	500 000	200 000	500 000
2	[9.4]	R.24 (10MHz, full, 16QAM ½) (1×2 Low) ETU70	200 000	200 000	500 000	200 000	500 000
1	[9.2]	R.19 (1.4MHz, full, 64QAM 3/4) (2×2 Low) EPA5	200 000	200 000	500 000	200 000	500 000
1 Rel-9…	[ ]	R.19_1 (10MHz, full, 64QAM 3/4) (2×2 Low) EVA70	200 000	200 000	500 000	200 000	500 000
1A		R.19-1 (5MHz, full, 64QAM 3/4) (2×2 Low) EVA70	200 000	200 000	500 000	200 000	500 000
1	[9.3]	R.20 (10MHz, 1PRB, 16QAM ½) (4×2 Medium) EVA5	200 000	200 000	500 000	200 000	500 000
1 Rel-9…	[ ]	R.20_1 (5MHz, 1PRB, 16QAM ½) (4×2 Medium) EPA5	200 000	200 000	500 000	200 000	500 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-2a: Minimum Test time for Demodulation of PHICH for eICIC

Test No	Demod. scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
				FDD	TDD	FDD	TDD
1	[ ]	R.19_1 (10MHz, full, 64QAM 3/4) (2×2 Low) EPA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-2 Test1)	1 600 000	2 000 000	1 600 000	2 000 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-2b: Minimum Test time for Demodulation of PHICH for feICIC

Test No	Demod. scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
				FDD	TDD	FDD	TDD
1	[ ]	R.19_1 (10MHz, full, 64QAM 3/4) (2×2 Low) EPA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-2 Test1)	1 600 000	2 000 000	1 600 000	2 000 000
Note: Simulation method to derive MNAS is based on finite test time and its effect on test system uncertainty specified in clause F.1.4.

Table G.4.6-3: Minimum Test time for PHICH for UE Category 0 and UE Category 1bis

Clause 8.9.2.1.1/8.9.2.1.1_1/8.9.2.2.1/8.9.2.2.1_1

Test

Demodulation scenario

(info only)

MNAS

(Simulation)

MNS

(Calculation)

MNSF (Min No Sub Frames, mandatory)

HD-FDD

TDD

HD-FDD

TDD

R.19

(10MHz, 1PRB, PBSK, 1/2)

(2×1 Low)

EPA5

46 524

(MNAS is not simulated, but estimated based on similar scenarios in Table G.3.5-1 Test11) with HD-FDD pattern

124 064

93 048

126 000

95 000

Table G.4.6-4: Minimum Test time for Demodulation of PCFICH/PDCCH for 4 Rx antenna ports

Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	FDD	TDD	FDD	TDD
8.10.2.1.1, 8.10.2.2.1: Test 1	[ ]	R.15 (10 MHz, 8CCE, full, QPSK 1/3) (1×4 Low) ETU70	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test 1)	222 222	400 000	224 000	401 000
8.10.2.1.2, 8.10.2.2.2: Test 1	[ ]	R.16_1 (10MHz, 4CCE, full, QPSK 1/3) (2×4 Low) EVA70	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test 1)	222 222	400 000	224 000	401 000
8.10.2.1.3, 8.10.2.2.3: Test 1	[ ]	R.17_1 (5MHz, 2CCE, full, QPSK 1/3) (4×4 Medium A Xpol) EPA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test 1)	222 222	400 000	224 000	401 000

Table G.4.6-4.0: Minimum Test time for Demodulation of LAA PCFICH/PDCCH

Test No	Demodulation scenario (info only)	MNAS (Note 1)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Note 1)	FDD	TDD	FDD	TDD
8.4.3.1.1 Test 1 for PCC	PCC: R.16_1 FDD (10 MHz, 4CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000	222 222	N/A	224 000	N/A
8.4.3.1.1 Test 1-4 for SCC	SCC: R.3 FS3 (20 MHz, 4CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000	N/A	476 190 (Note 2)	N/A	478 000
Note 1: MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test1. Note 2: MNS for SCC is not deterministic due to the statistical burst transmission model in clause B.3.8. The average MNS is presented in this table. This is calculated based on an average burst length of 5.25 ms which in average takes 6.25 ms assuming UE not capable of partial subframes, and a simulated probability of LBT success (p) equal to 0.5 (ratio 6.25/5.25/0.5).

Table G.4.6-4a: Minimum Test time for Demodulation of PHICH for 4 Rx antenna ports

Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demod. Scenario	Demodulation scenario (info only)	MNAS (Simulation)	FDD	TDD	FDD	TDD
8.10.3.1.1, 8.10.3.2.1: Test 1	[ ]	R.18 (10 MHz, full, QPSK 1/3) (1×4 Low) ETU70	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-2 Test 1)	200 000	500 000	200 000	500 000
8.10.3.1.2, 8.10.3.2.2: Test 1	[ ]	R.19_1 (10MHz, full, 64QAM 3/4) (2×4 Low) EVA70	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-2 Test 1)	200 000	500 000	200 000	500 000
8.10.3.1.3, 8.10.3.2.3: Test 1	[ ]	R.20_1 (5MHz, 1PRB, 16QAM ½) (4×4 Medium correlation A, Cross polarized) EPA5	200 000 (MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-2 Test 1)	200 000	500 000	200 000	500 000

Table G.4.6-5: Minimum Test time for MPDCCH for UE Category M1 for FDD & HD-FDD

Test No	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)	MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Simulation)	FDD & HD-FDD	FDD & HD-FDD
8.11.2.1.1: Test 1	R.82 FDD (10MHz, 4 PRB, QPSK, 1/2) (2×1 Low) EPA5	97 280	291 840	293 000
8.11.2.1.2: Test 1	R.83 FDD (10MHz, 2+4 PRB, QPSK, 1/2) (2×1 Low) ETU1	194 560	583 680	585 000

Table G.4.6-5a: Minimum Test time for MPDCCH for UE Category M1 for TDD

Test No	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)	MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Simulation)	TDD	TDD
8.11.2.2.1: Test 1	R.82 TDD (10MHz, 4 PRB, QPSK, 1/2) (2×1 Low) EPA5	48 640	486 400	488 000
8.11.2.2.2: Test 1	R.83 TDD (10MHz, 2+4 PRB, QPSK, 1/2) (2×1 Low) ETU1	97 280	972 800	974 000

Table G.4.6-6: Minimum Test time for Demodulation of LAA PCFICH/PDCCH

Test No	Demodulation scenario (info only)	MNAS (Note 1)	MNS (Calculation)		MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Note 1)	FDD	TDD	FDD	TDD
8.4.3.1.2 Test 1 for PCC	PCC: R.16_1 TDD (10 MHz, 4CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000	N/A	400 000	N/A	401 000
8.4.3.1.2 Test 1-4 for SCC	SCC: R.4 FS3 (20 MHz, 4CCE, full, QPSK 1/3) (2×2 Low) EVA5	200 000	N/A	476 190 (Note 2)	N/A	478 000
Note 1: MNAS is not simulated, but estimated based on similar scenario in Table G.4.6-1 Test1. Note 2: MNS for SCC is not deterministic due to the statistical burst transmission model in clause B.3.8. The average MNS is presented in this table. This is calculated based on an average burst length of 5.25 ms which in average takes 6.25 ms assuming UE not capable of partial subframes, and a simulated probability of LBT success (p) equal to 0.5 (ratio 6.25/5.25/0.5).

Table G.4.6-7: Minimum Test time for NPDCCH for UE Category NB1

Test No	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)	MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Simulation)	HD-FDD	HD-FDD
8.12.2.1.1: Test 1	R.NB.3 FDD (200kHz, QPSK,1/2) (1×1) EPA5	36166	15430827	15431000
8.12.2.1.1: Test 2	R.NB.3 FDD (200kHz, QPSK,1/2) (1×1) ETU1	36166	55550976	55551000

Table G.4.6-8: Minimum Test time for NPDCCH Transmit diversity performance for UE Category NB1

Test No	Demodulation scenario (info only)	MNAS (Simulation)	MNS (Calculation)	MNSF (Min No Sub Frames, mandatory)
Test No	Demodulation scenario (info only)	MNAS (Simulation)	HD-FDD	HD-FDD
8.12.2.1.2: Test 1	R.NB.4 FDD (200kHz, QPSK,1/2) (2×1) EPA5	36166	4629248	4631000
8.12.2.1.2: Test 2	R.NB.4 FDD (200kHz, QPSK,1/2) (2×1) ETU1	36166	27775488	27777000

G.4.7 Test conditions for receiver performance tests

Table G.4.7: Test conditions for receiver performance tests

Test	Statistical independence	Number of components in the test vector, as specified in the test requirements and initial conditions of the applicable test	Over all Pass/Fail condition Restrictions and extensions see Table G.3.6-1
8.4.1.1 FDD PCFICH/PDCCH Single-antenna Port Performance	A misdetection is an independent event	1	NA
8.4.1.2 FDD PCFICH/PDCCH Transmit Diversity Performance	A misdetection is an independent event	2	To pass 8.4.1.2 each component in the test vector must pass
8.4.2.1 TDD PCFICH/PDCCH Single-antenna Port Performance	A misdetection is an independent event	1	NA
8.4.2.2 TDD PCFICH/PDCCH Transmit Diversity Performance	A misdetection is an independent event	2	To pass 8.4.2.2 each component in the test vector must pass
8.5.1.1 FDD PHICH Single-antenna Port Performance	A misdetection is an independent event	2	To pass 8.5.1.1 each component in the test vector must pass
8.5.1.2 FDD PHICH Transmit Diversity Performance	A misdetection is an independent event	2	To pass 8.5.1.2 each component in the test vector must pass
8.5.2.1 TDD PHICH Single-antenna Port Performance	A misdetection is an independent event	2	To pass 8.5.2.1 each component in the test vector must pass
8.5.2.2 TDD PHICH Transmit Diversity Performance	A misdetection is an independent event	2	To pass 8.5.2.2 each component in the test vector must pass