Executive Summary
| Metric | Value |
|---|
| Total Requirements | 514 |
| SDS Document Coverage | 80.0% |
| STD Document Coverage | 98.6% |
| Code DocRef Coverage | 74.1% |
| Total Test Scenarios | 1340 |
Execution Coverage Breakdown
| Status | Count | Percentage |
|---|
| Covered | 127 | 24.7% |
| Covered by Browser | 65 | 12.6% |
| Partial | 203 | 39.5% |
| Gap | 119 | 23.2% |
Domain Coverage
| Domain | REQs | STD Covered | Code Covered | Tests | Execution |
|---|
| ANALYTICS | 2 | 2/2 | 2/2 | 0 | 0/2 |
| ANALYZER | 2 | 1/2 | 2/2 | 0 | 0/2 |
| AUDIT | 4 | 4/4 | 4/4 | 64 | 0/4 |
| CALIB | 19 | 19/19 | 12/19 | 0 | 0/19 |
| CFGMODE | 34 | 34/34 | 12/34 | 0 | 0/34 |
| CLIENTCFG | 3 | 3/3 | 3/3 | 18 | 0/3 |
| COMMENTS | 10 | 10/10 | 9/10 | 210 | 0/10 |
| CONFIGIO | 22 | 22/22 | 14/22 | 66 | 0/22 |
| ERRORCODES | 13 | 13/13 | 11/13 | 0 | 0/13 |
| FILEIMPORT | 13 | 13/13 | 13/13 | 0 | 0/13 |
| FILTERS | 1 | 1/1 | 1/1 | 10 | 0/1 |
| GLOBALUI | 9 | 9/9 | 9/9 | 144 | 0/9 |
| HELP | 5 | 5/5 | 5/5 | 70 | 0/5 |
| KEYBOARD | 2 | 2/2 | 2/2 | 28 | 0/2 |
| KITCFG | 38 | 37/38 | 25/38 | 1102 | 1/38 |
| NFR | 5 | 5/5 | 3/5 | 0 | 0/5 |
| NOTIF | 5 | 5/5 | 0/5 | 50 | 0/5 |
| PRINT | 5 | 5/5 | 5/5 | 0 | 0/5 |
| PROGRESS | 4 | 4/4 | 4/4 | 44 | 0/4 |
| REANALYZE | 13 | 8/13 | 13/13 | 122 | 5/13 |
| REPORTS | 25 | 25/25 | 19/25 | 775 | 0/25 |
| RULETAGS | 10 | 10/10 | 4/10 | 0 | 0/10 |
| RUNFILE | 11 | 11/11 | 11/11 | 231 | 0/11 |
| RUNRPT | 37 | 37/37 | 1/37 | 814 | 0/37 |
| SITE | 5 | 5/5 | 5/5 | 45 | 0/5 |
| SPECIMEN | 12 | 12/12 | 11/12 | 0 | 0/12 |
| TABLES | 6 | 6/6 | 2/6 | 90 | 0/6 |
| UI | 1 | 1/1 | 1/1 | 7 | 0/1 |
| UPLOAD | 7 | 7/7 | 5/7 | 112 | 0/7 |
| USERMGMT | 16 | 16/16 | 13/16 | 576 | 0/16 |
| USERSET | 2 | 2/2 | 1/2 | 16 | 0/2 |
| USERSET-NFR | 1 | 1/1 | 0/1 | 0 | 0/1 |
Rule Coverage
| Rule | REQs | STD TVs | Code Covered | V3 Tests | Legacy | Exec Status |
|---|
| ADJ | 6 | 33 | 6/6 | 23 | 8 | 5/6 |
| ADJZIKA | 3 | 30 | 3/3 | 17 | 7 | 3/3 |
| AMB | 4 | 17 | 4/4 | 10 | 0 | 4/4 |
| BASELINE | 2 | 14 | 2/2 | 14 | 2 | 2/2 |
| BPEC | 1 | 22 | 1/1 | 22 | 0 | 1/1 |
| CC | 2 | 16 | 2/2 | 14 | 1 | 2/2 |
| COMBOUT | 4 | 61 | 4/4 | 19 | 32 | 2/4 |
| COMBOUTCTRL | 1 | 48 | 1/1 | 31 | 1 | 0/1 |
| CONTROLFAIL | 2 | 27 | 2/2 | 34 | 2 | 2/2 |
| CTCUTOFF | 5 | 26 | 5/5 | 19 | 2 | 2/5 |
| DELTACT | 1 | 24 | 1/1 | 6 | 1 | 0/1 |
| DSIGMOID | 5 | 29 | 5/5 | 35 | 27 | 5/5 |
| DSIGMOIDCTRL | 2 | 22 | 2/2 | 15 | 3 | 2/2 |
| ENGINE | 3 | 21 | 3/3 | 5 | 0 | 0/3 |
| EXTCTRL | 6 | 36 | 6/6 | 48 | 7 | 6/6 |
| ICCT | 1 | 8 | 1/1 | 5 | 0 | 0/1 |
| ICQUALSERUM | 1 | 12 | 1/1 | 8 | 1 | 0/1 |
| INCONCLUSIVE | 1 | 14 | 1/1 | 2 | 1 | 0/1 |
| INDETCTS | 1 | 12 | 1/1 | 9 | 1 | 1/1 |
| INHCT | 5 | 31 | 5/5 | 16 | 11 | 5/5 |
| INHQUAL | 2 | 16 | 2/2 | 18 | 3 | 2/2 |
| INHQUANT | 1 | 18 | 1/1 | 6 | 4 | 1/1 |
| INHSERUMQUANT | 1 | 21 | 1/1 | 4 | 2 | 0/1 |
| LINREG | 6 | 41 | 6/6 | 47 | 6 | 6/6 |
| MINCTRL | 4 | 20 | 4/4 | 38 | 4 | 0/4 |
| MINFL | 3 | 19 | 3/3 | 10 | 5 | 3/3 |
| MIXMISS | 4 | 32 | 4/4 | 38 | 0 | 4/4 |
| MWCOMBOUT | 1 | 8 | 1/1 | 5 | 7 | 1/1 |
| NEC | 1 | 10 | 1/1 | 7 | 2 | 0/1 |
| NECINH | 3 | 24 | 0/3 | 7 | 1 | 0/3 |
| NEGSIGMOID | 3 | 10 | 0/3 | 32 | 3 | 3/3 |
| NEGSIGMOIDCTRL | 5 | 17 | 0/5 | 47 | 3 | 5/5 |
| NOTTSQM | 1 | 8 | 1/1 | 0 | 1 | 0/1 |
| POSSIGMOID | 3 | 8 | 3/3 | 15 | 3 | 3/3 |
| POSSIGMOIDCTRL | 2 | 19 | 2/2 | 10 | 4 | 2/2 |
| QSSC | 3 | 18 | 3/3 | 47 | 3 | 3/3 |
| QTYWEIGHT | 2 | 11 | 0/2 | 5 | 2 | 1/2 |
| QUANTITIES | 1 | 24 | 1/1 | 18 | 3 | 0/1 |
| QUANTVAL | 6 | 50 | 6/6 | 29 | 8 | 6/6 |
| REPEATSAMP | 1 | 15 | 1/1 | 10 | 4 | 1/1 |
| RQUAL | 2 | 18 | 2/2 | 21 | 5 | 2/2 |
| RQUANT | 3 | 38 | 3/3 | 15 | 3 | 3/3 |
| RQUANTQUAL | 2 | 16 | 2/2 | 9 | 1 | 2/2 |
| RRES | 1 | 5 | 1/1 | 6 | 1 | 1/1 |
| RWAC | 4 | 24 | 4/4 | 5 | 23 | 4/4 |
| STDCURVE | 1 | 22 | 1/1 | 11 | 4 | 0/1 |
| STDQT | 5 | 41 | 5/5 | 41 | 9 | 0/5 |
| SWCOMBOUT | 1 | 12 | 1/1 | 8 | 12 | 1/1 |
| SYSINH | 3 | 40 | 3/3 | 11 | 14 | 2/3 |
| THRESH | 3 | 25 | 3/3 | 15 | 2 | 2/3 |
| UNEXPFL | 1 | 12 | 1/1 | 10 | 1 | 1/1 |
| WCAF | 3 | 30 | 3/3 | 23 | 6 | 3/3 |
| WDCLS | 3 | 19 | 3/3 | 2 | 23 | 3/3 |
| WDCLSC | 3 | 16 | 3/3 | 2 | 13 | 3/3 |
| WDCLSCINVSIG | 3 | 21 | 3/3 | 4 | 10 | 3/3 |
| WDCLSINVSIG | 3 | 17 | 3/3 | 1 | 11 | 2/3 |
| WDCT | 3 | 26 | 3/3 | 5 | 15 | 3/3 |
| WDCTC | 3 | 31 | 3/3 | 6 | 9 | 0/3 |
| WG | 13 | 113 | 13/13 | 156 | 208 | 0/13 |
| WT | 3 | 23 | 3/3 | 24 | 3 | 3/3 |
Test Method Distribution
| Method | REQ Count |
|---|
| TM-API | 289 |
| TM-API, TM-UI | 19 |
| TM-HYB | 46 |
| TM-HYB, TM-UI | 3 |
| TM-MAN | 6 |
| TM-MAN, TM-UI | 1 |
| TM-UI | 140 |
| TM-UI, TM-API | 2 |
| TM-UI, TM-MAN | 1 |
Test Method Alignment
Shows whether the actual test suite matches the STD-declared test method.
"Covered by Browser" means STD says TM-API but browser tests provide the coverage.
| STD Method | REQs | Matching Suite | Covered by Browser | Method Mismatch | No Tests | Manual Only |
|---|
| TM-API | 289 | 173 | 65 | 0 | 51 | 0 |
| TM-API, TM-UI | 19 | 12 | 0 | 0 | 7 | 0 |
| TM-HYB | 46 | 36 | 0 | 0 | 10 | 0 |
| TM-HYB, TM-UI | 3 | 3 | 0 | 0 | 0 | 0 |
| TM-MAN | 6 | 0 | 0 | 0 | 0 | 6 |
| TM-MAN, TM-UI | 1 | 1 | 0 | 0 | 0 | 0 |
| TM-UI | 140 | 95 | 0 | 0 | 45 | 0 |
| TM-UI, TM-API | 2 | 2 | 0 | 0 | 0 | 0 |
| TM-UI, TM-MAN | 1 | 1 | 0 | 0 | 0 | 0 |