• Home
Name Date Size #Lines LOC

..--

hdf/12-May-2024-30,56622,173

kernel/12-May-2024-5,1834,643

testtools/12-May-2024-8768

BUILD.gnD12-May-2024920 3126

LICENSED12-May-202410.1 KiB177150

OAT.xmlD12-May-20243.9 KiB6512

README.en.mdD12-May-202428.9 KiB508402

README.mdD12-May-202428.5 KiB541419

build.shD12-May-20244.4 KiB12095

bundle.jsonD12-May-2024675 3030

runtest.shD12-May-20245.9 KiB188155

test_packages.gniD12-May-20242.9 KiB8369

README.en.md

1# XTS<a name="EN-US_TOPIC_0000001126156429"></a>
2
3-   [Introduction](#section465982318513)
4-   [System Types](#section125090457443)
5-   [Directory Structure](#section161941989596)
6-   [Constraints](#section119744591305)
7-   [Usage Guidelines](#section137768191623)
8-   [Test Case Development Guidelines](#section3695134065513)
9    -   [C-based Test Case Development and Compilation \(for the Mini System\)](#section198193336544)
10    -   [C-based Test Case Execution \(for the Mini System\)](#section13820233175418)
11    -   [C++-based Test Case Development and Compilation \(for Standard and Small Systems\)](#section3822123311540)
12    -   [C++-based Test Case Execution \(for Standard and Small Systems\)](#section128222336544)
13
14
15## Introduction<a name="section465982318513"></a>
16
17The X test suite \(XTS\) subsystem contains a set of OpenHarmony certification test suites, including the currently supported hardware abstract test suite \(HATS\).
18
19This subsystem contains the HATS and  **tools**  software package.
20
21-   The  **hats**  directory stores the source code and configuration files of HATS test cases. The HATS helps device vendors detect the HAL software incompatibility as early as possible and ensures that the software is compatible to OpenHarmony during the entire development process.
22-   The  **tools**  software package stores the test case development framework related to  **hats**.
23
24## System Types<a name="section125090457443"></a>
25
26OpenHarmony supports the following system types:
27
28-   Mini system
29
30    A mini system runs on the devices whose memory is greater than or equal to 128 KiB and that are equipped with MCU processors such as ARM Cortex-M and 32-bit RISC-V. This system provides multiple lightweight network protocols and graphics frameworks, and a wide range of read/write components for the IoT bus. Typical products include connection modules, sensors, and wearables for smart home.
31
32-   Small system
33
34    A small system runs on the devices whose memory is greater than or equal to 1 MiB and that are equipped with application processors such as ARM Cortex-A. This system provides higher security capabilities, standard graphics frameworks, and video encoding and decoding capabilities. Typical products include smart home IP cameras, electronic cat eyes, and routers, and event data recorders \(EDRs\) for smart travel.
35
36-   Standard system
37
38    A standard system runs on the devices whose memory is greater than or equal to 128 MiB and that are equipped with application processors such as ARM Cortex-A. This system provides a complete application framework supporting the enhanced interaction, 3D GPU, hardware composer, diverse components, and rich animations. This system applies to high-end refrigerator displays.
39
40
41## Directory Structure<a name="section161941989596"></a>
42
43```
44/test/xts
45├── hats                # Test code
46│   └── subsystem       # Source code of subsystem test cases for the standard system
47│   └── subsystem_lite  # Source code of subsystems test cases for mini and small systems
48│   └── BUILD.gn        # Build configuration of test cases for the standard system
49│   └── build_lite
50│       └── BUILD.gn    # Build configuration of test cases for mini and small systems
51└── tools               # Test tool code
52```
53
54## Constraints<a name="section119744591305"></a>
55
56Test cases for the mini system must be developed based on C, and those for the small system must be developed based on C++.
57
58## Usage Guidelines<a name="section137768191623"></a>
59
60**Table  1**  Test case levels
61
62<a name="table12856113719456"></a>
63<table><thead align="left"><tr id="row88561737114517"><th class="cellrowborder" valign="top" width="33.333333333333336%" id="mcps1.2.4.1.1"><p id="p54711456452"><a name="p54711456452"></a><a name="p54711456452"></a>Level</p>
64</th>
65<th class="cellrowborder" valign="top" width="33.283328332833285%" id="mcps1.2.4.1.2"><p id="p114834544518"><a name="p114834544518"></a><a name="p114834544518"></a>Definition</p>
66</th>
67<th class="cellrowborder" valign="top" width="33.383338333833386%" id="mcps1.2.4.1.3"><p id="p348154574518"><a name="p348154574518"></a><a name="p348154574518"></a>Scope</p>
68</th>
69</tr>
70</thead>
71<tbody><tr id="row78561137134514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p17481345124512"><a name="p17481345124512"></a><a name="p17481345124512"></a>Level0</p>
72</td>
73<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p1548945204514"><a name="p1548945204514"></a><a name="p1548945204514"></a>Smoke</p>
74</td>
75<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p174824517456"><a name="p174824517456"></a><a name="p174824517456"></a>Verifies basic functionalities of key features and basic DFX attributes with the most common input. The pass result indicates that the features are runnable.</p>
76</td>
77</tr>
78<tr id="row28563372451"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p448445144512"><a name="p448445144512"></a><a name="p448445144512"></a>Level1</p>
79</td>
80<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p44813452452"><a name="p44813452452"></a><a name="p44813452452"></a>Basic</p>
81</td>
82<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p648184584514"><a name="p648184584514"></a><a name="p648184584514"></a>Verifies basic functionalities of key features and basic DFX attributes with common input. The pass result indicates that the features are testable.</p>
83</td>
84</tr>
85<tr id="row12856137204514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p164834520453"><a name="p164834520453"></a><a name="p164834520453"></a>Level2</p>
86</td>
87<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p148245184511"><a name="p148245184511"></a><a name="p148245184511"></a>Major</p>
88</td>
89<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p348945124510"><a name="p348945124510"></a><a name="p348945124510"></a>Verifies basic functionalities of key features and basic DFX attributes with common input and errors. The pass result indicates that the features are functional and ready for beta testing.</p>
90</td>
91</tr>
92<tr id="row48571137204514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p7481545184513"><a name="p7481545184513"></a><a name="p7481545184513"></a>Level3</p>
93</td>
94<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p1748184514455"><a name="p1748184514455"></a><a name="p1748184514455"></a>Regular</p>
95</td>
96<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p8481245104519"><a name="p8481245104519"></a><a name="p8481245104519"></a>Verifies functionalities of all key features, and all DFX attributes with common and uncommon input combinations or normal and abnormal preset conditions.</p>
97</td>
98</tr>
99<tr id="row14857133712451"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p1248144515456"><a name="p1248144515456"></a><a name="p1248144515456"></a>Level4</p>
100</td>
101<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p94804514519"><a name="p94804514519"></a><a name="p94804514519"></a>Rare</p>
102</td>
103<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p1248445164516"><a name="p1248445164516"></a><a name="p1248445164516"></a>Verifies functionalities of key features under extremely abnormal presets and uncommon input combinations.</p>
104</td>
105</tr>
106</tbody>
107</table>
108
109**Table  2**  Test case granularities
110
111<a name="table1690733521014"></a>
112<table><thead align="left"><tr id="row9907143516105"><th class="cellrowborder" valign="top" width="19.591959195919593%" id="mcps1.2.4.1.1"><p id="p1141312416102"><a name="p1141312416102"></a><a name="p1141312416102"></a>Test Scale</p>
113</th>
114<th class="cellrowborder" valign="top" width="35.17351735173517%" id="mcps1.2.4.1.2"><p id="p34131416109"><a name="p34131416109"></a><a name="p34131416109"></a>Test Objects</p>
115</th>
116<th class="cellrowborder" valign="top" width="45.23452345234523%" id="mcps1.2.4.1.3"><p id="p12413141171010"><a name="p12413141171010"></a><a name="p12413141171010"></a>Test Environment</p>
117</th>
118</tr>
119</thead>
120<tbody><tr id="row2907335181017"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p6414134117109"><a name="p6414134117109"></a><a name="p6414134117109"></a>LargeTest</p>
121</td>
122<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p20414104113101"><a name="p20414104113101"></a><a name="p20414104113101"></a>Service functionalities, all-scenario features, and mechanical power environment (MPE) and scenario-level DFX</p>
123</td>
124<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p5414841121013"><a name="p5414841121013"></a><a name="p5414841121013"></a>Devices close to real devices</p>
125</td>
126</tr>
127<tr id="row10907635131015"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p19414134117104"><a name="p19414134117104"></a><a name="p19414134117104"></a>MediumTest</p>
128</td>
129<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p114141241141018"><a name="p114141241141018"></a><a name="p114141241141018"></a>Modules, subsystem functionalities after module integration, and DFX</p>
130</td>
131<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p14414941111015"><a name="p14414941111015"></a><a name="p14414941111015"></a>Single device that is actually used. You can perform message simulation, but do not mock functions.</p>
132</td>
133</tr>
134<tr id="row1990713353100"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p641414110109"><a name="p641414110109"></a><a name="p641414110109"></a>SmallTest</p>
135</td>
136<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p54141541181018"><a name="p54141541181018"></a><a name="p54141541181018"></a>Modules, classes, and functions</p>
137</td>
138<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p1841494131013"><a name="p1841494131013"></a><a name="p1841494131013"></a>Local PC. Use a large number of mocks to replace dependencies with other modules.</p>
139</td>
140</tr>
141</tbody>
142</table>
143
144**Table  3**  Test types
145
146<a name="table18811230124619"></a>
147<table><thead align="left"><tr id="row48163019466"><th class="cellrowborder" valign="top" width="19.040000000000003%" id="mcps1.2.3.1.1"><p id="p1791784418465"><a name="p1791784418465"></a><a name="p1791784418465"></a>Type</p>
148</th>
149<th class="cellrowborder" valign="top" width="80.96%" id="mcps1.2.3.1.2"><p id="p2917164444614"><a name="p2917164444614"></a><a name="p2917164444614"></a>Definition</p>
150</th>
151</tr>
152</thead>
153<tbody><tr id="row682630104615"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1091784414469"><a name="p1091784414469"></a><a name="p1091784414469"></a>Function</p>
154</td>
155<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p16917344104618"><a name="p16917344104618"></a><a name="p16917344104618"></a>Tests the correctness of both service and platform functionalities provided by the tested object for end users or developers.</p>
156</td>
157</tr>
158<tr id="row1821930154611"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p591714474612"><a name="p591714474612"></a><a name="p591714474612"></a>Performance</p>
159</td>
160<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p15917154410463"><a name="p15917154410463"></a><a name="p15917154410463"></a>Tests the processing capability of the tested object under specific preset conditions and load models. The processing capability is measured by the service volume that can be processed in a unit time, for example, call per second, frame per second, or event processing volume per second.</p>
161</td>
162</tr>
163<tr id="row13821030104616"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p691711440467"><a name="p691711440467"></a><a name="p691711440467"></a>Power</p>
164</td>
165<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p159171544104616"><a name="p159171544104616"></a><a name="p159171544104616"></a>Tests the power consumption of the tested object in a certain period of time under specific preset conditions and load models.</p>
166</td>
167</tr>
168<tr id="row6821330114618"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p13917164454612"><a name="p13917164454612"></a><a name="p13917164454612"></a>Reliability</p>
169</td>
170<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p11917194416465"><a name="p11917194416465"></a><a name="p11917194416465"></a>Tests the service performance of the tested object under common and uncommon input conditions, or specified service volume pressure and long-term continuous running pressure. The test covers stability, pressure handling, fault injection, and Monkey test times.</p>
171</td>
172</tr>
173<tr id="row11821930184612"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1691774474618"><a name="p1691774474618"></a><a name="p1691774474618"></a>Security</p>
174</td>
175<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><a name="ul112421652121513"></a><a name="ul112421652121513"></a><ul id="ul112421652121513"><li>Tests the capability of defending against security threats, including but not limited to unauthorized access, use, disclosure, damage, modification, and destruction, to ensure information confidentiality, integrity, and availability.</li><li>Tests the privacy protection capability to ensure that the collection, use, retention, disclosure, and disposal of users' private data comply with laws and regulations.</li><li>Tests the compliance with various security specifications, such as security design, security requirements, and security certification of the Ministry of Industry and Information Technology (MIIT).</li></ul>
176</td>
177</tr>
178<tr id="row16825307467"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p129188444462"><a name="p129188444462"></a><a name="p129188444462"></a>Global</p>
179</td>
180<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p179186444465"><a name="p179186444465"></a><a name="p179186444465"></a>Tests the internationalized data and localization capabilities of the tested object, including multi-language display, various input/output habits, time formats, and regional features, such as currency, time, and culture taboos.</p>
181</td>
182</tr>
183<tr id="row08211308464"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p191814447465"><a name="p191814447465"></a><a name="p191814447465"></a>Compatibility</p>
184</td>
185<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><a name="ul186961827111612"></a><a name="ul186961827111612"></a><ul id="ul186961827111612"><li>Tests backward compatibility of an application with its own data, the forward and backward compatibility with the system, and the compatibility with different user data, such as audio file content of the player and smart SMS messages.</li><li>Tests system backward compatibility with its own data and the compatibility of common applications in the ecosystem.</li><li>Tests software compatibility with related hardware.</li></ul>
186</td>
187</tr>
188<tr id="row1782730124618"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p13918144134614"><a name="p13918144134614"></a><a name="p13918144134614"></a>User</p>
189</td>
190<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p1291844494611"><a name="p1291844494611"></a><a name="p1291844494611"></a>Tests user experience of the object in real user scenarios. All conclusions and comments should come from the users, which are all subjective evaluation in this case.</p>
191</td>
192</tr>
193<tr id="row58243024617"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1291884474614"><a name="p1291884474614"></a><a name="p1291884474614"></a>Standard</p>
194</td>
195<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p0918124424614"><a name="p0918124424614"></a><a name="p0918124424614"></a>Tests the compliance with industry and company-specific standards, protocols, and specifications. The standards here do not include any security standards that should be classified into the security test.</p>
196</td>
197</tr>
198<tr id="row382830124619"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p119181044164619"><a name="p119181044164619"></a><a name="p119181044164619"></a>Safety</p>
199</td>
200<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p1291818443468"><a name="p1291818443468"></a><a name="p1291818443468"></a>Tests the safety property of the tested object to avoid possible hazards to personal safety, health, and the object itself.</p>
201</td>
202</tr>
203<tr id="row1083153014465"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p39187441469"><a name="p39187441469"></a><a name="p39187441469"></a>Resilience</p>
204</td>
205<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p891815444462"><a name="p891815444462"></a><a name="p891815444462"></a>Tests the resilience property of the tested object to ensure that it can withstand and maintain the defined running status (including downgrading) when being attacked, and recover from and adapt defense to the attacks to approach mission assurance.</p>
206</td>
207</tr>
208</tbody>
209</table>
210
211## Test Case Development Guidelines<a name="section3695134065513"></a>
212
213You should select the appropriate programming language and your target test framework to develop test cases.
214
215**Table  4**  Test frameworks and test case languages for different systems
216
217<a name="table4418343171415"></a>
218<table><thead align="left"><tr id="row34183435145"><th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.1"><p id="p941874311148"><a name="p941874311148"></a><a name="p941874311148"></a>System</p>
219</th>
220<th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.2"><p id="p1841804341413"><a name="p1841804341413"></a><a name="p1841804341413"></a>Test Framework</p>
221</th>
222<th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.3"><p id="p2418104311148"><a name="p2418104311148"></a><a name="p2418104311148"></a>Language</p>
223</th>
224</tr>
225</thead>
226<tbody><tr id="row8419164319148"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p7419194312143"><a name="p7419194312143"></a><a name="p7419194312143"></a>Mini</p>
227</td>
228<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p10419124312145"><a name="p10419124312145"></a><a name="p10419124312145"></a>HCTest</p>
229</td>
230<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p11419643191410"><a name="p11419643191410"></a><a name="p11419643191410"></a>C</p>
231</td>
232</tr>
233<tr id="row141915438147"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p441911436141"><a name="p441911436141"></a><a name="p441911436141"></a>Small</p>
234</td>
235<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p541916432142"><a name="p541916432142"></a><a name="p541916432142"></a>HCPPTest</p>
236</td>
237<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p54191643131416"><a name="p54191643131416"></a><a name="p54191643131416"></a>C++</p>
238</td>
239</tr>
240<tr id="row4419134341417"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p341964313143"><a name="p341964313143"></a><a name="p341964313143"></a>Standard</p>
241</td>
242<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p10419443171416"><a name="p10419443171416"></a><a name="p10419443171416"></a>HJSUnit and HCPPTest</p>
243</td>
244<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p9419143181414"><a name="p9419143181414"></a><a name="p9419143181414"></a>JavaScript and C++</p>
245</td>
246</tr>
247</tbody>
248</table>
249
250### C-based Test Case Development and Compilation \(for the Mini System\)<a name="section198193336544"></a>
251
252**Developing test cases for the mini system**
253
254The HCTest framework is used to support test cases developed with the C language. HCTest is enhanced and adapted based on the open-source test framework Unity.
255
2561.  Access the  **test/xts/hats**  repository where the test cases will be stored.
257
258    ```
259    ├── hats
260    │ └──subsystem_lite
261    │ │ └── module_hal
262    │ │ │ └── BUILD.gn
263    │ │ │ └── src
264    │ └──build_lite
265    │ │ └── BUILD.gn
266    ```
267
2682.  Write the test case in the  **src**  directory.
269
270    1 Import the test framework header file.
271
272    ```
273    #include "hctest.h"
274    ```
275
276    2. Use the  **LITE\_TEST\_SUIT**  macro to define names of the subsystem, module, and test suite.
277
278    ```
279    /**
280    * @brief  Registers a test suite named IntTestSuite.
281    * @param  test Subsystem name
282    * @param  example Module name
283    * @param  IntTestSuite Test suite name
284    */
285    LITE_TEST_SUIT(test, example, IntTestSuite);
286    ```
287
288    3. Define Setup and TearDown.
289
290    Format: Test suite name+Setup, Test suite name+TearDown.
291
292    The Setup and TearDown functions must exist, but function bodies can be empty.
293
294    4. Use the  **LITE\_TEST\_CASE**  macro to write the test case.
295
296    Three parameters are involved: test suite name, test case name, and test case properties \(including type, granularity, and level\).
297
298    ```
299    LITE_TEST_CASE(IntTestSuite, TestCase001, Function | MediumTest | Level1)
300    {
301      // Do something
302    };
303    ```
304
305    5. Use the  **RUN\_TEST\_SUITE**  macro to register the test suite.
306
307    ```
308    RUN_TEST_SUITE(IntTestSuite);
309    ```
310
3113.  Create the configuration file \(**BUILD.gn**\) of the test module.
312
313    Create a  **BUILD.gn**  \(example\) build file in each test module directory. Specify the name of the built static library and its dependent header file and library in the build file. The format is as follows:
314
315    ```
316    import("//test/xts/tools/lite/build/suite_lite.gni")
317    hctest_suite("HatsDemoTest") {
318        suite_name = "hats"
319        sources = [
320            "src/test_demo.c",
321        ]
322        include_dirs = [ ]
323        cflags = [ "-Wno-error" ]
324    }
325    ```
326
3274.  Add build options to the  **BUILD.gn**  file in the  **hats**  directory.
328
329    You need to add the test module to the  **test/xts/hats/build\_lite/BUILD.gn**  script in the  **hats**  directory.
330
331    ```
332    lite_component("hats") {
333        ...
334        if(board_name == "liteos_m") {
335            features += [
336                ...
337                "//xts/hats/subsystem_lite/module_hal:HatsDemoTest"
338            ]
339        }
340    }
341    ```
342
3435.  Run build commands.
344
345    Test suites are built along with version build. The HATS is built together with the debug version.
346
347    >![](figures/icon-note.gif) **NOTE:**
348    >The HATS build middleware is a static library, which will be linked to the image.
349
350
351### C-based Test Case Execution \(for the Mini System\)<a name="section13820233175418"></a>
352
353**Executing test cases for the mini system**
354
355Burn the image into the development board.
356
357**Executing the test**
358
3591.  Use a serial port tool to log in to the development board and save information about the serial port.
3602.  Restart the device and view serial port logs.
361
362**Analyzing the test result**
363
364View the serial port logs, whose format is as follows:
365
366The log for each test suite starts with  **Start to run test suite:**  and ends with  **xx Tests xx Failures xx Ignored**.
367
368### C++-based Test Case Development and Compilation \(for Standard and Small Systems\)<a name="section3822123311540"></a>
369
370**Developing test cases for small-system devices**  \(For examples of the standard system, go to the  **global/i18n\_standard directory**.\)
371
372The HCPPTest framework is enhanced and adapted based on the open-source framework Googletest.
373
3741.  Access the  **test/xts/hats**  repository where the test cases will be stored.
375
376    ```
377    ├── hats
378    │ └──subsystem_lite
379    │ │ └── module_posix
380    │ │ │ └── BUILD.gn
381    │ │ │ └── src
382    │ └──build_lite
383    │ │ └── BUILD.gn
384    ```
385
3862.  Write the test case in the  **src**  directory.
387
388    1. Import the test framework header file.
389
390    The following statement includes  **gtest.h**.
391
392    ```
393    #include "gtest/gtest.h"
394    ```
395
396    2. Define Setup and TearDown.
397
398    ```
399    using namespace std;
400    using namespace testing::ext;
401    class TestSuite: public testing::Test {
402    protected:
403    // Preset action of the test suite, which is executed before the first test case
404    static void SetUpTestCase(void){
405    }
406    // Test suite cleanup action, which is executed after the last test case
407    static void TearDownTestCase(void){
408    }
409    // Preset action of the test case
410    virtual void SetUp()
411    {
412    }
413    // Cleanup action of the test case
414    virtual void TearDown()
415    {
416    }
417    };
418    ```
419
420    3. Use the  **HWTEST**  or  **HWTEST\_F**  macro to write the test case.
421
422    **HWTEST**: definition of common test cases, including the test suite name, test case name, and case annotation.
423
424    **HWTEST\_F**: definition of SetUp and TearDown test cases, including the test suite name, test case name, and case annotation.
425
426    Three parameters are involved: test suite name, test case name, and test case properties \(including type, granularity, and level\).
427
428    ```
429    HWTEST_F(TestSuite, TestCase_0001, Function | MediumTest | Level1) {
430    // Do something
431    }
432    ```
433
4343.  Create a configuration file \(**BUILD.gn**\) of the test module.
435
436    Create a  **BUILD.gn**  build file in each test module directory. Specify the name of the built static library and its dependent header file and library in the build file. Each test module is independently built into a  **.bin**  executable file, which can be directly pushed to the development board for testing.
437
438    Example:
439
440    ```
441    import("//test/xts/tools/lite/build/suite_lite.gni")
442    hcpptest_suite("HatsDemoTest") {
443        suite_name = "hats"
444        sources = [
445            "src/TestDemo.cpp"
446        ]
447
448        include_dirs = [
449            "src",
450            ...
451        ]
452        deps = [
453            ...
454        ]
455        cflags = [ "-Wno-error" ]
456    }
457    ```
458
4594.  Add build options to the  **BUILD.gn**  file in the  **hats**  directory.
460
461    Add the test module to the  **test/xts/hats/build\_lite/BUILD.gn**  script in the  **hats**  directory.
462
463    ```
464     lite_component("hats") {
465    ...
466    else if(board_name == "liteos_a") {
467            features += [
468                ...
469                "//xts/hats/subsystem_lite/module_posix:HatsDemoTest"
470            ]
471        }
472    }
473    ```
474
4755.  Run build commands.
476
477    Test suites are built along with the version build. The HATS is built together with the debug version.
478
479    >![](figures/icon-note.gif) **NOTE:**
480    >The HATS for the small system is independently built to an executable file \(.bin\) and archived in the  **suites\\hats**  directory of the build result.
481
482
483### C++-based Test Case Execution \(for Standard and Small Systems\)<a name="section128222336544"></a>
484
485**Executing test cases for the small system**
486
487Currently, test cases are shared by the NFS and mounted to the development board for execution.
488
489**Setting up the environment**
490
4911.  Use a network cable or wireless network to connect the development board to your PC.
4922.  Configure the IP address, subnet mask, and gateway for the development board. Ensure that the development board and the PC are in the same network segment.
4933.  Install and register the NFS server on the PC and start the NFS service.
4944.  Run the  **mount**  command for the development board to ensure that the development board can access NFS shared files on the PC.
495
496    Format:  **mount** _NFS server IP address_**:/**_NFS shared directory_ **/**_development board directory_ **nfs**
497
498    Example:
499
500    ```
501    mount 192.168.1.10:/nfs /nfs nfs
502    ```
503
504
505**Executing test cases**
506
507Execute  **HatsDemoTest.bin**  to trigger test case execution, and analyze serial port logs generated after the execution is complete.
508

README.md

1# XTS子系统<a name="ZH-CN_TOPIC_0000001117409671"></a>
2
3-   [简介](#section465982318513)
4-   [系统类型](#section125090457443)
5-   [目录](#section161941989596)
6-   [约束](#section119744591305)
7-   [使用说明](#section137768191623)
8-   [用例开发指导](#section3695134065513)
9    -   [C语言用例开发编译指导(适用于轻量系统产品用例开发)](#section198193336544)
10    -   [C语言用例执行指导(适用于轻量系统产品用例开发)](#section13820233175418)
11    -   [C++语言用例开发编译指导(适用于小型系统、标准系统用例开发)](#section3822123311540)
12    -   [C++语言用例执行指导(适用于小型系统、标准系统用例开发)](#section128222336544)
13
14-   [相关仓](#section1371113476307)
15
16## 简介<a name="section465982318513"></a>
17
18XTS子系统是OpenHarmony生态认证测试套件的集合,当前包括hats(hardware abstract test suite)HAL兼容性测试套件。
19
20XTS子系统当前包括hats与tools软件包:
21
22-   hats,存放hats相关测试用例源码与配置文件,其目的是帮助终端设备厂商尽早发现HAL层软件与OpenHarmony的不兼容性,确保软件在整个开发过程中满足OpenHarmony的兼容性要求。
23-   tools,存放hats相关测试用例开发框架。
24
25## 系统类型<a name="section125090457443"></a>
26
27OpenHarmony支持如下几种系统类型:
28
29-   轻量系统(mini system)
30
31    面向MCU类处理器例如Arm Cortex-M、RISC-V 32位的设备,硬件资源极其有限,支持的设备最小内存为128KiB,可以提供多种轻量级网络协议,轻量级的图形框架,以及丰富的IOT总线读写部件等。可支撑的产品如智能家居领域的连接类模组、传感器设备、穿戴类设备等。
32
33-   小型系统(small system)
34
35    面向应用处理器例如Arm Cortex-A的设备,支持的设备最小内存为1MiB,可以提供更高的安全能力、标准的图形框架、视频编解码的多媒体能力。可支撑的产品如智能家居领域的IP Camera、电子猫眼、路由器以及智慧出行领域的行车记录仪等。
36
37-   标准系统(standard system)
38
39    面向应用处理器例如Arm Cortex-A的设备,支持的设备最小内存为128MiB,可以提供增强的交互能力、3D GPU以及硬件合成能力、更多控件以及动画效果更丰富的图形能力、完整的应用框架。可支撑的产品如高端的冰箱显示屏。
40
41
42## 目录<a name="section161941989596"></a>
43
44```
45/test/xts
46├── hats                # 测试代码存放目录
47│   └── subsystem       # 标准系统子系统测试用例源码存放目录
48│   └── subsystem_lite  # 轻量系统、小型系统子系统测试用例源码存放目录
49│   └── BUILD.gn        # 标准系统测试用例编译配置
50│   └── build_lite      # 轻量系统、小型系统测试用例编译配置存放目录
51│       └── BUILD.gn    # 轻量系统、小型系统测试用例编译配置
52└── tools               # 测试工具代码存放目录
53```
54
55## 约束<a name="section119744591305"></a>
56
57轻量系统用例开发语言是C,小型系统用例开发语言是C++。
58
59## 使用说明<a name="section137768191623"></a>
60
61**表 1**  用例级别说明
62
63<a name="table12856113719456"></a>
64<table><thead align="left"><tr id="row88561737114517"><th class="cellrowborder" valign="top" width="33.333333333333336%" id="mcps1.2.4.1.1"><p id="p54711456452"><a name="p54711456452"></a><a name="p54711456452"></a>级别名称</p>
65</th>
66<th class="cellrowborder" valign="top" width="33.283328332833285%" id="mcps1.2.4.1.2"><p id="p114834544518"><a name="p114834544518"></a><a name="p114834544518"></a>基本定义</p>
67</th>
68<th class="cellrowborder" valign="top" width="33.383338333833386%" id="mcps1.2.4.1.3"><p id="p348154574518"><a name="p348154574518"></a><a name="p348154574518"></a>测试范围</p>
69</th>
70</tr>
71</thead>
72<tbody><tr id="row78561137134514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p17481345124512"><a name="p17481345124512"></a><a name="p17481345124512"></a>Level0</p>
73</td>
74<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p1548945204514"><a name="p1548945204514"></a><a name="p1548945204514"></a>冒烟</p>
75</td>
76<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p174824517456"><a name="p174824517456"></a><a name="p174824517456"></a>验证关键功能点基本功能/最基本DFX属性在最常见输入下的表现,通过表示功能基本可运行。</p>
77</td>
78</tr>
79<tr id="row28563372451"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p448445144512"><a name="p448445144512"></a><a name="p448445144512"></a>Level1</p>
80</td>
81<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p44813452452"><a name="p44813452452"></a><a name="p44813452452"></a>基本</p>
82</td>
83<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p648184584514"><a name="p648184584514"></a><a name="p648184584514"></a>验证各功能点基本功能/基本DFX属性在常见输入下的表现,通过表示功能基本可测试。</p>
84</td>
85</tr>
86<tr id="row12856137204514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p164834520453"><a name="p164834520453"></a><a name="p164834520453"></a>Level2</p>
87</td>
88<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p148245184511"><a name="p148245184511"></a><a name="p148245184511"></a>重要</p>
89</td>
90<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p348945124510"><a name="p348945124510"></a><a name="p348945124510"></a>验证各功能点的基本功能/基本DFX属性在常规输入/常见异常情况下的表现,通过表示功能基本正常可用,可开展Beta。</p>
91</td>
92</tr>
93<tr id="row48571137204514"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p7481545184513"><a name="p7481545184513"></a><a name="p7481545184513"></a>Level3</p>
94</td>
95<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p1748184514455"><a name="p1748184514455"></a><a name="p1748184514455"></a>一般</p>
96</td>
97<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p8481245104519"><a name="p8481245104519"></a><a name="p8481245104519"></a>验证各功能点的全部功能/全部DFX属性在各种常规/非常规输入组合下,或各种正常/异常预置条件组合下的表现。</p>
98</td>
99</tr>
100<tr id="row14857133712451"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.2.4.1.1 "><p id="p1248144515456"><a name="p1248144515456"></a><a name="p1248144515456"></a>Level4</p>
101</td>
102<td class="cellrowborder" valign="top" width="33.283328332833285%" headers="mcps1.2.4.1.2 "><p id="p94804514519"><a name="p94804514519"></a><a name="p94804514519"></a>生僻</p>
103</td>
104<td class="cellrowborder" valign="top" width="33.383338333833386%" headers="mcps1.2.4.1.3 "><p id="p1248445164516"><a name="p1248445164516"></a><a name="p1248445164516"></a>验证关键功能点在极端异常预置条件下、用户难以触及的异常输入组合下的表现。</p>
105</td>
106</tr>
107</tbody>
108</table>
109
110**表 2**  用例粒度说明
111
112<a name="table1690733521014"></a>
113<table><thead align="left"><tr id="row9907143516105"><th class="cellrowborder" valign="top" width="19.591959195919593%" id="mcps1.2.4.1.1"><p id="p1141312416102"><a name="p1141312416102"></a><a name="p1141312416102"></a>用例规模</p>
114</th>
115<th class="cellrowborder" valign="top" width="35.17351735173517%" id="mcps1.2.4.1.2"><p id="p34131416109"><a name="p34131416109"></a><a name="p34131416109"></a>被测试对象</p>
116</th>
117<th class="cellrowborder" valign="top" width="45.23452345234523%" id="mcps1.2.4.1.3"><p id="p12413141171010"><a name="p12413141171010"></a><a name="p12413141171010"></a>测试环境</p>
118</th>
119</tr>
120</thead>
121<tbody><tr id="row2907335181017"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p6414134117109"><a name="p6414134117109"></a><a name="p6414134117109"></a>LargeTest</p>
122</td>
123<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p20414104113101"><a name="p20414104113101"></a><a name="p20414104113101"></a>业务功能/全场景特性/整机及场景级DFX</p>
124</td>
125<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p5414841121013"><a name="p5414841121013"></a><a name="p5414841121013"></a>尽量使用贴近真实的环境设备</p>
126</td>
127</tr>
128<tr id="row10907635131015"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p19414134117104"><a name="p19414134117104"></a><a name="p19414134117104"></a>MediumTest</p>
129</td>
130<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p114141241141018"><a name="p114141241141018"></a><a name="p114141241141018"></a>模块/子系统集成至设备后的功能/DFX</p>
131</td>
132<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p14414941111015"><a name="p14414941111015"></a><a name="p14414941111015"></a>使用真实的单设备进行验证,可进行消息模拟,尽量不对函数进行MOCK</p>
133</td>
134</tr>
135<tr id="row1990713353100"><td class="cellrowborder" valign="top" width="19.591959195919593%" headers="mcps1.2.4.1.1 "><p id="p641414110109"><a name="p641414110109"></a><a name="p641414110109"></a>SmallTest</p>
136</td>
137<td class="cellrowborder" valign="top" width="35.17351735173517%" headers="mcps1.2.4.1.2 "><p id="p54141541181018"><a name="p54141541181018"></a><a name="p54141541181018"></a>模块/类/函数</p>
138</td>
139<td class="cellrowborder" valign="top" width="45.23452345234523%" headers="mcps1.2.4.1.3 "><p id="p1841494131013"><a name="p1841494131013"></a><a name="p1841494131013"></a>在开发者个人环境进行测试,尽量不依赖其他模块,存在大量的MOCK</p>
140</td>
141</tr>
142</tbody>
143</table>
144
145**表 3**  测试类型说明
146
147<a name="table18811230124619"></a>
148<table><thead align="left"><tr id="row48163019466"><th class="cellrowborder" valign="top" width="19.040000000000003%" id="mcps1.2.3.1.1"><p id="p1791784418465"><a name="p1791784418465"></a><a name="p1791784418465"></a>测试类型名称</p>
149</th>
150<th class="cellrowborder" valign="top" width="80.96%" id="mcps1.2.3.1.2"><p id="p2917164444614"><a name="p2917164444614"></a><a name="p2917164444614"></a>测试类型定义</p>
151</th>
152</tr>
153</thead>
154<tbody><tr id="row682630104615"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1091784414469"><a name="p1091784414469"></a><a name="p1091784414469"></a>Function</p>
155</td>
156<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p16917344104618"><a name="p16917344104618"></a><a name="p16917344104618"></a>验证被测对象提供给用户的业务功能实现正确性的测试项,这里的“用户”可以是终端用户或开发者,功能包括业务功能及平台功能</p>
157</td>
158</tr>
159<tr id="row1821930154611"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p591714474612"><a name="p591714474612"></a><a name="p591714474612"></a>Performance</p>
160</td>
161<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p15917154410463"><a name="p15917154410463"></a><a name="p15917154410463"></a>验证被测对象在特定预置条件/负载模型下的处理能力的测试项,“处理能力”一般以单位时间内可处理的业务量来衡量,如呼叫/秒,帧率/秒,事件处理量/秒等</p>
162</td>
163</tr>
164<tr id="row13821030104616"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p691711440467"><a name="p691711440467"></a><a name="p691711440467"></a>Power</p>
165</td>
166<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p159171544104616"><a name="p159171544104616"></a><a name="p159171544104616"></a>验证被测对象在特定预置条件/负载模型下在一定时间内能源消耗量的测试项</p>
167</td>
168</tr>
169<tr id="row6821330114618"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p13917164454612"><a name="p13917164454612"></a><a name="p13917164454612"></a>Reliability</p>
170</td>
171<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p11917194416465"><a name="p11917194416465"></a><a name="p11917194416465"></a>验证被测对象在正常/异常输入情况下,或业务量压力和长时间连续运行压力情况下业务表现的测试项,含稳定性、压力、故障注入、Monkey测试项</p>
172</td>
173</tr>
174<tr id="row11821930184612"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1691774474618"><a name="p1691774474618"></a><a name="p1691774474618"></a>Security</p>
175</td>
176<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p1791784410463"><a name="p1791784410463"></a><a name="p1791784410463"></a>验证系统对恶意威胁的防护能力,威胁包括但不限于未授权访问、使用、泄露、破坏、修改、毁灭,以保障信息的机密性、完整性和可用性; 验证系统对用户隐私的保护能力,保障用户的隐私数据被收集、使用、保有、披露和处置符合法律规范,保障用户的隐私权; 验证对各类安全规范的遵从情况,如安全设计规范、安全红线、工信部安全认证规范等,保障安全相关法律法规的合规。</p>
177</td>
178</tr>
179<tr id="row16825307467"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p129188444462"><a name="p129188444462"></a><a name="p129188444462"></a>Global</p>
180</td>
181<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p179186444465"><a name="p179186444465"></a><a name="p179186444465"></a>验证被测对象在是否具有国际化数据支持和本地化能力的测试项,包括语言显示、输入/输出习惯、时间显示、区域特性如货币时间禁忌等等</p>
182</td>
183</tr>
184<tr id="row08211308464"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p191814447465"><a name="p191814447465"></a><a name="p191814447465"></a>Compatibility</p>
185</td>
186<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p99181344144613"><a name="p99181344144613"></a><a name="p99181344144613"></a>当被测对象为应用时,包括被测对象对于自身数据的后向兼容性、对于系统的前后向兼容性、对于不同用户数据(如播放器之音频文件格式/智能短信之用户短信内容)的兼容性测试项; 当被测对象为系统时,包括被测系统对于系统自身数据的后向兼容性、以及对于生态中常用应用的兼容性测试项;当被测对象为软件时,包括被测系统对于相关的硬件的兼容性;</p>
187</td>
188</tr>
189<tr id="row1782730124618"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p13918144134614"><a name="p13918144134614"></a><a name="p13918144134614"></a>User</p>
190</td>
191<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p1291844494611"><a name="p1291844494611"></a><a name="p1291844494611"></a>验证被测对象在真实用户场景下的用户体验感受的测试项,注意此种情况下没有客观的“正确”与“失败”,所有的结论及评价都应该来自于用户</p>
192</td>
193</tr>
194<tr id="row58243024617"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p1291884474614"><a name="p1291884474614"></a><a name="p1291884474614"></a>Standard</p>
195</td>
196<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p0918124424614"><a name="p0918124424614"></a><a name="p0918124424614"></a>验证被测对象对于行业及公司内标准/协议/规范的遵从情况的测试项,注意此处的“标准”不包含任何安全标准,针对安全标准的测试项划归为“安全测试”类型</p>
197</td>
198</tr>
199<tr id="row382830124619"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p119181044164619"><a name="p119181044164619"></a><a name="p119181044164619"></a>Safety</p>
200</td>
201<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p1291818443468"><a name="p1291818443468"></a><a name="p1291818443468"></a>验证被测对象的Safety属性,避免产品可能对人身安全、健康以及产品本身带来的危害。</p>
202</td>
203</tr>
204<tr id="row1083153014465"><td class="cellrowborder" valign="top" width="19.040000000000003%" headers="mcps1.2.3.1.1 "><p id="p39187441469"><a name="p39187441469"></a><a name="p39187441469"></a>Resilience</p>
205</td>
206<td class="cellrowborder" valign="top" width="80.96%" headers="mcps1.2.3.1.2 "><p id="p891815444462"><a name="p891815444462"></a><a name="p891815444462"></a>验证被测对象的韧性属性,确保系统受攻击时承受并保持在有定义的运行状态(包括降级)、恢复并适应攻击以保障Mission达成。</p>
207</td>
208</tr>
209</tbody>
210</table>
211
212## 用例开发指导<a name="section3695134065513"></a>
213
214根据测试系统选择测试框架和对应测试用例语言。
215
216**表 4**  系统和测试框架、开发语言对应关系
217
218<a name="table4418343171415"></a>
219<table><thead align="left"><tr id="row34183435145"><th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.1"><p id="p941874311148"><a name="p941874311148"></a><a name="p941874311148"></a>系统</p>
220</th>
221<th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.2"><p id="p1841804341413"><a name="p1841804341413"></a><a name="p1841804341413"></a>测试框架</p>
222</th>
223<th class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.2.4.1.3"><p id="p2418104311148"><a name="p2418104311148"></a><a name="p2418104311148"></a>语言</p>
224</th>
225</tr>
226</thead>
227<tbody><tr id="row8419164319148"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p7419194312143"><a name="p7419194312143"></a><a name="p7419194312143"></a>轻量系统</p>
228</td>
229<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p10419124312145"><a name="p10419124312145"></a><a name="p10419124312145"></a>hctest</p>
230</td>
231<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p11419643191410"><a name="p11419643191410"></a><a name="p11419643191410"></a>c</p>
232</td>
233</tr>
234<tr id="row141915438147"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p441911436141"><a name="p441911436141"></a><a name="p441911436141"></a>小型系统</p>
235</td>
236<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p541916432142"><a name="p541916432142"></a><a name="p541916432142"></a>hcpptest</p>
237</td>
238<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p54191643131416"><a name="p54191643131416"></a><a name="p54191643131416"></a>c++</p>
239</td>
240</tr>
241<tr id="row4419134341417"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.1 "><p id="p341964313143"><a name="p341964313143"></a><a name="p341964313143"></a>标准系统</p>
242</td>
243<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.2 "><p id="p10419443171416"><a name="p10419443171416"></a><a name="p10419443171416"></a>HJSUnit、hcpptest</p>
244</td>
245<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.2.4.1.3 "><p id="p9419143181414"><a name="p9419143181414"></a><a name="p9419143181414"></a>js、c++</p>
246</td>
247</tr>
248</tbody>
249</table>
250
251### C语言用例开发编译指导(适用于轻量系统产品用例开发)<a name="section198193336544"></a>
252
253**示例:轻量系统测试用例开发**
254
255当前使用的测试框架是hctest,hctest测试框架支持使用C语言编写测试用例,是在开源测试框架unity的基础上进行增强和适配。
256
2571.  用例目录规范:测试用例存储到test/xts/hats仓中
258
259    ```
260    ├── hats
261    │ └──subsystem_lite
262    │ │ └── module_hal
263    │ │ │ └── BUILD.gn
264    │ │ │ └── src
265    │ └──build_lite
266    │ │ └── BUILD.gn
267    ```
268
2692.  src目录下用例编写样例。
270
271    1.引用测试框架
272
273    ```
274    #include "hctest.h"
275    ```
276
277    2. 使用宏定义LITE\_TEST\_SUIT定义子系统、模块、测试套件名称
278
279    ```
280    /**
281    * @brief  register a test suit named "IntTestSuite"
282    * @param  test subsystem name
283    * @param  example module name
284    * @param  IntTestSuite test suit name
285    */
286    LITE_TEST_SUIT(test, example, IntTestSuite);
287    ```
288
289    3. 定义Setup与TearDown
290
291    命名方式:测试套件名称+Setup,测试套件名称+TearDown。
292
293    Setup与TearDown必须存在,可以为空函数。
294
295    4. 使用宏定义LITE\_TEST\_CASE写测试用例
296
297    包括三个参数:测试套件名称,测试用例名称,用例属性(测试类型、用例粒度、用例级别)。
298
299    ```
300    LITE_TEST_CASE(IntTestSuite, TestCase001, Function | MediumTest | Level1)
301    {
302      //do something
303    };
304    ```
305
306    5. 使用宏定义 RUN\_TEST\_SUITE注册测试套件
307
308    ```
309    RUN_TEST_SUITE(IntTestSuite);
310    ```
311
3123.  测试模块的配置文件(BUILD.gn)样例:
313
314    在每个测试模块目录下新建BUILD.gn编译文件,用于指定编译后静态库的名称、依赖的头文件、依赖的库等;具体写法如下:
315
316    ```
317    import("//test/xts/tools/lite/build/suite_lite.gni")
318    hctest_suite("HatsDemoTest") {
319        suite_name = "hats"
320        sources = [
321            "src/test_demo.c",
322        ]
323        include_dirs = [ ]
324        cflags = [ "-Wno-error" ]
325    }
326    ```
327
3284.  hats下BUILD.gn增加编译选项。
329
330    需要将测试模块加入到hats目录下的编译脚本中,编译脚本路径:test/xts/hats/build\_lite/BUILD.gn331
332    ```
333    lite_component("hats") {
334        ...
335        if(board_name == "liteos_m") {
336            features += [
337                ...
338                "//xts/hats/subsystem_lite/module_hal:HatsDemoTest"
339            ]
340        }
341    }
342    ```
343
344
345
346### C语言用例执行指导(适用于轻量系统产品用例开发)<a name="section13820233175418"></a>
347
348**示例:轻量系统测试用例执行**
349
350将版本镜像烧录进开发板。
351
352**测试步骤**
353
3541.  使用串口工具登录开发板,并保存串口打印信息。
3552.  重启设备,查看串口日志。
356
357**测试结果分析指导**
358
359基于串口打印日志进行分析;
360
361每个测试套件执行以Start to run test suite开始,以xx Tests xx Failures xx Ignored结束。
362
363### C++语言用例开发编译指导(适用于小型系统、标准系统用例开发)<a name="section3822123311540"></a>
364
365**示例:小型系统测试用例开发**(标准系统参考具体样例目录:global/i18n\_standard)
366
367当前使用的测试框架是hcpptest,hcpptest测试框架是在开源的googletest测试框架的基础上进行的增强和适配。
368
3691.  规范用例目录:测试用例存储到test/xts/hats仓中。
370
371    ```
372    ├── hats
373    │ └──subsystem_lite
374    │ │ └── module_posix
375    │ │ │ └── BUILD.gn
376    │ │ │ └── src
377    │ └──build_lite
378    │ │ └── BUILD.gn
379    ```
380
3812.  测试模块src下用例编写样例:
382
383    1. 引用测试框架:
384
385    需要引用gtest.h  如:\#include "gtest/gtest.h"
386
387    ```
388    #include "gtest/gtest.h"
389    ```
390
391    2. 定义Setup与TearDown
392
393    ```
394    using namespace std;
395    using namespace testing::ext;
396    class TestSuite: public testing::Test {
397    protected:
398    // Preset action of the test suite, which is executed before the first test case
399    static void SetUpTestCase(void){
400    }
401    // Test suite cleanup action, which is executed after the last test case
402    static void TearDownTestCase(void){
403    }
404    // Preset action of the test case
405    virtual void SetUp()
406    {
407    }
408    // Cleanup action of the test case
409    virtual void TearDown()
410    {
411    }
412    };
413    ```
414
415    3. 使用宏定义HWTEST或HWTEST\_F写测试用例
416
417    普通测试用例的定义:HWTEST(测试套名称, 测试用例名称, 用例标注)。
418
419    包含SetUp和TearDown的测试用例的定义 :HWTEST\_F(测试套名称, 测试用例名称,用例标注)。
420
421    宏定义包括三个参数:测试套件名称,测试用例名称,用例属性(测试类型、用例粒度、用例级别)。
422
423    ```
424    HWTEST_F(TestSuite, TestCase_0001, Function | MediumTest | Level1) {
425    // do something
426    }
427    ```
428
4293.  测试模块下用例配置文件(BUILD.gn)样例:
430
431    每个测试模块目录下新建BUILD.gn编译文件,用于指定编译后可执行文件的名称、依赖的头文件、依赖的库等;具体写法如下。每个测试模块将独立编译成.bin可执行文件, 该文件可直接push到单板上进行测试。
432
433    举例:
434
435    ```
436    import("//test/xts/tools/lite/build/suite_lite.gni")
437    hcpptest_suite("HatsDemoTest") {
438        suite_name = "hats"
439        sources = [
440            "src/TestDemo.cpp"
441        ]
442
443        include_dirs = [
444            "src",
445            ...
446        ]
447        deps = [
448            ...
449        ]
450        cflags = [ "-Wno-error" ]
451    }
452
453    ```
454
4554.  hats目录下增加编译选项(BUILD.gn)样例:
456
457    将测试模块加入到hats目录下的编译脚本中,编译脚本为:test/xts/hats/build\_lite/BUILD.gn458
459    ```
460     lite_component("hats") {
461    ...
462    else if(board_name == "liteos_a") {
463            features += [
464                ...
465                "//xts/hats/subsystem_lite/module_posix:HatsDemoTest"
466            ]
467        }
468    }
469    ```
470
471
472
473### C++语言用例执行指导(适用于小型系统、标准系统用例开发)<a name="section128222336544"></a>
474
475**示例:小型系统测试用例执行**
476
477目前的用例执行采用nfs共享的方式,mount到单板去执行。
478
479**环境搭建**
480
4811.  使用网线或无线网络将开发板与PC进行连接。
4822.  开发板配置IP、子网掩码、网关,确保开发板与PC处于同一个网段。
4833.  PC安装nfs服务器并完成注册,启动nfs服务。
4844.  开发板配置mount命令,确保开发板可以访问PC端的nfs共享文件。
485
486    格式:mount \[nfs服务器IP\]:\[/nfs共享目录\] \[/开发板目录\] nfs
487
488    举例:
489
490    ```
491    mount 192.168.1.10:/nfs /nfs nfs
492    ```
493
494
495**用例执行**
496
497测试套件执行 HatsDemoTest.bin 触发用例执行,基于串口打印日志进行分析。
498
499### 全量编译指导(适用于标准系统)<a name="section128222336544"></a>
500
501全量编译test/xts/hats目录下执行编译命令: ./build.sh suite=hats system_size=standard
502
503测试用例输出目录:out/release/suites/hats/testcases
504
505测试框架&用例整体输出目录:out/release/suites/hats(编译用例时会同步编译测试套执行框架)
506
507### 全量用例执行指导(适用于小型系统、标准系统)<a name="section128222336544"></a>
508
509搭建测试环境 Windows工作台下安装python3.7及以上版本,确保工作台和测试设备正常连接。
510
511测试执行目录(对应编译生成的out/release/suites/hats目录)
512
513  ```
514├── testcase                       # 测试套文件存放目录
515│ └──xxx.hap                       # 测试套可执行hap文件
516│ └──xxx.json                      # 测试套对应执行配置文件
517├── tools                          # 测试框架工具目录
518├── run.bat                        # window平台测试套启动执行文件
519├── report                         # 测试报告生成目录
520
521  ```
522用例执行
523
524在Windows工作台上,找到从Linux服务器上拷贝下来的测试套件用例目录,在Windows命令窗口进入对应目录,直接执行hats\run.bat525
526界面启动后,输入用例执行指令。
527
528全量执行:run hats
529
530模块执行(具体模块可以查看\hats\testcases):run –l ActsSamgrTest
531
532查看测试报告。 进入hats\reports\,获取当前的执行记录,打开“summary_report.html”可以获取到测试报告。
533
534
535## 相关仓<a name="section1371113476307"></a>
536
537xts\_hats
538
539xts\_tools
540
541