GB/T 41813.2-2022 English PDF

US$339.00 · In stock
Delivery: <= 4 days. True-PDF full-copy in English will be manually translated and delivered via email.
GB/T 41813.2-2022: Information technology - Intelligent speech interaction testing method - Part 2: Semantic understanding
Status: Valid

Standard ID	USD	BUY PDF	Lead-Days	Standard Title (Description)	Status
GB/T 41813.2-2022	339	Add to Cart	4 days	Information technology - Intelligent speech interaction testing method - Part 2: Semantic understanding	Valid

Similar standards

GB/T 42450   GB/T 39788   GB/T 40685   GB/T 45281   GB/T 41800   GB/T 41813.1   

Basic data

Standard ID: GB/T 41813.2-2022 (GB/T41813.2-2022)
Description (Translated English): Information technology - Intelligent speech interaction testing method - Part 2: Semantic understanding
Sector / Industry: National Standard (Recommended)
Classification of Chinese Standard: L77
Classification of International Standard: 35.240.01
Word Count Estimation: 18,116
Date of Issue: 2022-10-14
Date of Implementation: 2023-05-01
Issuing agency(ies): State Administration for Market Regulation, China National Standardization Administration

GB/T 41813.2-2022: Information technology - Intelligent speech interaction testing method - Part 2: Semantic understanding

---This is a DRAFT version for illustration, not a final translation. Full copy of true-PDF in English version (including equations, symbols, images, flow-chart, tables, and figures etc.) will be manually/carefully translated upon your order.
Information technology -- Intelligent speech interaction testing method -- Part 2.Semantic understanding ICS 35.240.01 CCSL77 National Standards of People's Republic of China Information technology intelligent voice interaction test method Part 2.Semantic Understanding Published on 2022-10-12 2023-05-01 Implementation State Administration for Market Regulation Released by the National Standardization Administration directory Preface III Introduction IV 1 Scope 1 2 Normative references 1 3 Terms and Definitions 1 4 Overview 1 5 Test Preparation and Execution 2 5.1 Test dataset 2 5.2 Test Tools 3 5.3 Test Environment 3 5.4 Test execution 3 5.5 Result determination 3 6 Functional Test Method 3 6.1 Intent Understanding 3 6.2 Named Entity Recognition 3 6.3 Identification of sensitive information 4 6.4 Semantic Rejection 4 6.5 Information Retrieval 4 6.6 Text similarity calculation 4 6.7 Text Modification 4 6.8 Semantic Correction 4 6.9 Natural Language Generation 5 6.10 Logical Reasoning 5 6.11 Dialogue Guide 5 6.12 Context-sensitive multi-round conversations 5 7 Performance Test Method 5 7.1 The effect of semantic understanding 5 7.2 Efficiency of Semantic Understanding 8 7.3 System Stability 9 Appendix A (normative) Subjective Experience Test 10 A.1 Overview 10 A.2 Test item 10 A.3 Test method 10 Reference 12

foreword

This document is in accordance with the provisions of GB/T 1.1-2020 "Guidelines for Standardization Work Part 1.Structure and Drafting Rules of Standardization Documents" drafted. This document is the second part of GB/T 41813 "Information Technology Intelligent Voice Interaction Test Method". GB/T 41813 has been released the following parts. --- Part 1.Speech recognition; --- Part 2.Semantic understanding. Please note that some content of this document may be patented. The issuing agency of this document assumes no responsibility for identifying patents. This document is proposed and managed by the National Information Technology Standardization Technical Committee (SAC/TC28). This document is drafted by. China Electronics Standardization Institute, iFLYTEK Co., Ltd., Xiaomi Communication Technology Co., Ltd., China For Terminal Co., Ltd., Shenzhen Ubisoft Technology Co., Ltd., China Telecom Group Co., Ltd., Speed Technology Co., Ltd., Institute of Automation, Chinese Academy of Sciences, Institute of Biomedical Engineering, Chinese Academy of Medical Sciences, Harbin Institute of Technology, Hisense Video Technology Co., Ltd. Co., Ltd., Immediate Consumer Finance Co., Ltd., Tencent Technology (Beijing) Co., Ltd., Shenyang SIASUN Robot Automation Co., Ltd. Company, Shenzhen Human Horse Interactive Technology Co., Ltd., Ping An Technology (Shenzhen) Co., Ltd., Anhui Mickey Technology Co., Ltd., Jingfeng Technology (Shenzhen) Co., Ltd., Beijing Jietong Huasheng Technology Co., Ltd., Beijing Baidu Netcom Technology Co., Ltd., Shenzhen Beikeraisheng Technology Co., Ltd. Co., Ltd., Alibaba Cloud Computing Co., Ltd., Yuncong Technology Group Co., Ltd., Shanghai Computer Software Technology Development Center, NetEase (Hangzhou) Network Co., Ltd., Nanjing Yunwen Network Technology Co., Ltd., Lenovo (Beijing) Co., Ltd., Fuzhou Data Technology Research Institute Co., Ltd., National Network Software Product Quality Supervision and Inspection Center (Jinan), South China University of Technology, Shandong Computing Center (National Supercomputing Jinan Center), Shenyang Si Electronic Technology Co., Ltd., Zhengzhou Zhongye Technology Co., Ltd., China Automotive Data (Tianjin) Co., Ltd., China Electrical Appliance Research Institute Institute Co., Ltd., China Automotive Research Institute (Tianjin) Automotive Engineering Research Institute Co., Ltd., Zhongke Jiyuan (Hangzhou) Intelligent Technology Co., Ltd., Beijing Aishu Smart Technology Co., Ltd. The main drafters of this document. Xu Yang, Ma Wanzhong, Wu Guogang, Zhu Yajun, Jia Yijun, Zhou Lijun, Song Wenlin, Yuan Jie, Yang Zhen, Tian Dingshu, Qian Yanmin, Tao Jianhua, Hua Yunfei, Pu Jiangbo, Li Haifeng, Wang Feng, Yang Chunyong, Sudan, Zhang Feng, Feng Haihong, Liu Guotao, Ren Junmin, Chen Nan, Xing Qizhou, Li Xiaoru, Huang Shilei, Wang Miaomiao, Cai Lizhi, Li Jun, Hu Guanglong, Yang Meng, Lu Fei, Fang Bin, Wang Yue, Jing Kun, Wen Zhengqi, Li Jie, Zhang Ying, Xu Xiangmin, Meng Xianming, Gao Yongchao, Zhang Qingqing.

Introduction

Intelligent voice interaction is used in smart home, smart customer service, mobile terminals, vehicle terminals, as well as smart education, smart medical care, smart office, and services. It is widely used in many fields such as robotics, and has become one of the important ways of human-computer interaction. With the deepening of intelligent voice interaction, it is necessary to The system reference framework, basic technical requirements, and Internet interface requirements for intelligent voice interaction are unified and standardized. In this regard, the state has formulated It has established the basic national standard supporting intelligent voice interaction system. On this basis, it is also necessary to use a unified test method and evaluation standard to The ability of intelligent voice interaction system is evaluated, and the basic method and basis for evaluation of products and services related to intelligent voice interaction are provided. GB/T 41813 "Information Technology Intelligent Voice Interaction Test Method" is GB/T 36464 (all parts) "Information Technology Intelligent Language Audio Interaction System" provides basic and general testing methods. Intelligent voice interaction includes three basic loops. speech recognition, semantic understanding and speech synthesis. The test objects, test items, test environments and test methods involved in each link are different. GB/T 41813 "Information Technology Intelligent Voice Interaction Test Methods" aims to establish and describe general test items and general test methods applicable to all aspects of intelligent voice interaction. It consists of three parts. --- Part 1.Speech recognition. The purpose is to provide general test items and common test items for speech recognition in intelligent voice interaction applications. using the test method. --- Part 2.Semantic understanding. The purpose is to provide general test items and common test items for semantic understanding in intelligent voice interaction applications. using the test method. --- Part 3.Speech synthesis. The purpose is to provide general test items and common test items for speech synthesis in intelligent voice interaction applications. using the test method. Information technology intelligent voice interaction test method Part 2.Semantic Understanding

1 Scope

This document describes common test items and common test methods for semantic understanding systems in intelligent speech interaction testing. This document applies to the semantic understanding system of intelligent voice interaction applications by intelligent voice service providers, users and third-party testing agencies Design and implementation of tests.

2 Normative references

The contents of the following documents constitute essential provisions of this document through normative references in the text. Among them, dated citations documents, only the version corresponding to that date applies to this document; for undated references, the latest edition (including all amendments) applies to this document. GB/T 36464 (all parts) Information technology intelligent voice interactive system

3 Terms and Definitions

The terms and definitions defined in GB/T 36464 (all parts) and the following terms and definitions apply to this document. 3.1 Enables functional units to understand the intent of a person's speech. [Source. GB/T 36464.1-2020, 3.11] 3.2 named entity An entity that refers to a name with a specific or unique meaning. 3.3 intent The tasks or goals that the system needs to perform in the process of voice interaction.

4 Overview

The semantic comprehension test in the intelligent voice interaction test mainly includes functional test and performance test, as follows. ---Functional testing is used to check whether the system under test provides various functions related to semantic understanding, including. intent understanding, named entities Identification, sensitive information identification, semantic rejection, information retrieval, text similarity calculation, text modification, semantic modification, natural language generation Multi-turn dialogues that are successful, logical reasoning, dialogue guidance, and contextual relevance; ---Performance test is used to check various performances related to semantic understanding in the system under test, including. semantic understanding effect, semantic understanding efficiency and system stability. During the testing process, online/offline functional and performance tests should be performed according to the technical specifications of the system under test. Methods that can use subjective experience To carry out the test, the subjective experience test shall be performed according to the test items and test methods described in Appendix A. The test items listed in this document can be used for ......

Image     

Tips & Frequently Asked Questions:

Question 1: How long will the true-PDF of GB/T 41813.2-2022_English be delivered?

Answer: Upon your order, we will start to translate GB/T 41813.2-2022_English as soon as possible, and keep you informed of the progress. The lead time is typically 2 ~ 4 working days. The lengthier the document the longer the lead time.

Question 2: Can I share the purchased PDF of GB/T 41813.2-2022_English with my colleagues?

Answer: Yes. The purchased PDF of GB/T 41813.2-2022_English will be deemed to be sold to your employer/organization who actually pays for it, including your colleagues and your employer's intranet.

Question 3: Does the price include tax/VAT?

Answer: Yes. Our tax invoice, downloaded/delivered in 9 seconds, includes all tax/VAT and complies with 100+ countries' tax regulations (tax exempted in 100+ countries) -- See Avoidance of Double Taxation Agreements (DTAs): List of DTAs signed between Singapore and 100+ countries

Question 4: Do you accept my currency other than USD?

Answer: Yes. If you need your currency to be printed on the invoice, please write an email to Sales@ChineseStandard.net. In 2 working-hours, we will create a special link for you to pay in any currencies. Otherwise, follow the normal steps: Add to Cart -- Checkout -- Select your currency to pay.