Smart Speaker Comparison Test: Which One Has the Best AI Voice Interaction?

The concept of smart home has emerged, and smart home products have entered daily life one after another, bringing a lot of fun and convenience.
Don’t buy a smart speaker that can’t be awakened! Which speaker has the most powerful AI voice interaction? Among them, smart speakers are one of the most popular smart home products. With humanized control and functions, it has all functions such as connecting to WIFI, online on-demand, APP control, and multi-room control. It’s really great! Don’t buy a smart speaker that can’t be awakened! Which speaker has the most powerful AI voice interaction? However, the development time of smart speakers is still short, the quality is uneven, and the prices are vastly different.


There is even the statement that’smart speaker = mentally retarded speaker’. Do you also have the following questions: Are more expensive smart speakers better? Should you buy one with a screen? Which brands have higher cost performance and better performance? If you want to buy a smart speaker with more powerful AI voice interaction, how should you choose? To solve the above mysteries, under the guidance of the Shenzhen Consumer Council, the Futian District Consumer Council, the Bao’an District Consumer Council and the Longgang District Consumer Council jointly entrusted the Shenzhen Institute for Quality Consumption Research to carry out a comparative test of smart speaker products.


The Shenzhen Academy of Metrology and Quality Inspection conducts testing to provide consumers with scientific consumption guidelines and help quality consumption. Don’t buy a smart speaker that can’t be awakened! Which speaker has the most powerful AI voice interaction? This comparative test conducts graded evaluations on smart speaker samples from four aspects: performance, electromagnetic compatibility, reliability and eye protection safety.


There are a total of 10 samples, of which 5 have screens and 5 do not. The involved brands are (in no particular order): Tmall Genie, Xiaodu, Tencent Dingdang, Suning JIWU, Huawei, Himalaya, Xiaomi, Jingdong Jingyuzuo, Yeelight, Philips. Sample selection: This comparative test sample selection refers to the survey results of consumption situations and smart speakers with high consumer attention and good sales on major e-commerce platforms.


The samples are all purchased by staff on various e-commerce platforms to simulate consumers. Test standards and methods: Smart speakers belong to audio and video electronic products. At present, the domestic standard for such products is GB 8898-2011 ‘Safety Requirements for Audio, Video and Similar Electronic Equipment’. Secondly, the electromagnetic compatibility standards are GB T 13837-2012 ‘Limits and Methods of Measurement of Radio Disturbance Characteristics for Sound and Television Broadcast Receivers and Associated Equipment’ and GB 17625.


1-2012 ‘Electromagnetic Compatibility – Limits – Limits for Harmonic Current Emissions (Equipment with Input Current per Phase ≤16A)’.
There is no national mandatory standard for evaluating the performance, response speed, and capabilities of smart speakers. Avoid purchasing ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers without screens! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers without screens! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction? Don’t buy ‘unresponsive’ smart speakers! Which smart speaker has the most powerful AI voice interaction?
Note: 1.


All samples in this comparative test were purchased by staff as ordinary consumers through regular sales channels; 2. The comparative test evaluates smart speaker samples based on performance (far-field voice wake-up, false wake-ups, far-field voice recognition, voice interaction response speed), electrostatic discharge, drop, and blue light hazard, totaling 7 test items; among them, blue light hazard is only tested for 5 models with screens, and models without screens do not require testing.


3. The evaluation results are represented by “★”, the more “★” the better the result, and products with the same star rating are not ranked; 4. The Philips Smart Wireless Speaker (AW6005A/93) was found to lack intelligent voice interaction functions and is not included in this evaluation; 5. The results of this comparative test are only responsible for the purchased samples, and the results are for consumer reference only, not representing the quality status of different batches or specifications of the same brand, and do not constitute a recommendation or promotion of related products; 6.


Without written permission from the Futian District, Bao’an District, and Longgang District Consumer Associations of Shenzhen City, no unit or individual may use the results of this comparative test for commercial promotion.
Do you want to know the specific comparison test results? The researcher will present them to you immediately. Don’t buy a smart speaker that can’t be awakened anymore! Which speaker has the most powerful AI voice interaction? Performance test: Smart speakers, also known as AI speakers, differ from ordinary speakers in their AI voice interaction function.


The promotional page of Philips smart wireless speaker (AW6005A/93) shows it as a smart speaker, but after detection, it has no intelligent voice interaction function and does not participate in the performance test. Far-field voice wake-up: This comparison test set two distances of 3 meters and 5 meters, and issued wake-up instructions 10 times each in three environments of quiet, noise, and self-noise (i.


e., when the speaker is playing audio), for a total of 60 times to evaluate the wake-up performance of smart speakers. Judging from the test results, in general, the wake-up success rate is: 3 meters > 5 meters, quiet > self-noise > noise. The far-field voice wake-up rates of 10 samples vary greatly, with a difference of up to 75%! Among the 5 samples with screens, Tencent Dingdang and Tmall Genie have a wake-up rate of 100% and perform excellently; among the 5 samples without screens, Huawei and Xiaomi have a wake-up rate of 98.


3% and perform excellently. However, the far-field voice wake-up performance of Suning JIWU sample is poor, with a wake-up rate of only 25%. Don’t buy a smart speaker that can’t be awakened anymore! Which speaker has the most powerful AI voice interaction? Far-field voice wake-up test (3-meter distance) (the more wake-up times, the better). Don’t buy a smart speaker that can’t be awakened anymore! Which speaker has the most powerful AI voice interaction? Far-field voice wake-up test (5-meter distance) (the more wake-up times, the better).


False wake-up: Regarding smart speakers, there is a’supernatural’ rumor: it may suddenly make a sound when no one wakes it up. In this comparison test, 10 samples were placed in the same shielding room, and various audio files were continuously played for the smart speakers for 8 hours to ‘harass’ them. Surprisingly, all 10 samples withstood the ‘temptation’ and there was no false wake-up situation, performing excellently! Far-field voice recognition: For the understanding ability of smart speakers to voice instructions, we conducted far-field voice recognition tests.


At a distance of 3 meters, in quiet, noise, and self-noise environments respectively, the smart speakers were awakened and the weather query function was performed. Each scene was repeated 10 times for a total of 30 times. The test results found that the far-field voice recognition ability of 10 samples varies greatly, and the difference between the highest and lowest rankings is as high as 22 times.


Tmall Genie and Xiaomi have the highest voice recognition success rate, reaching 29 times; followed by Huawei and Xiaodu at Home, reaching 27 times, performing excellently. While Yeelight and Suning JIWU have only 7 successful recognition times.



Don’t buy’sleepy’ smart speakers anymore! Which speaker has the most powerful AI voice interaction? Far-field voice recognition (the more times the better). According to the results of early consumer surveys, 83% of consumers pay attention to the reaction sensitivity of smart speakers. This comparative test is set in a quiet environment to evaluate the response speed of smart speakers in two aspects: querying weather and playing songs.


The test results found that the difference between the fastest and slowest samples in voice interaction response speed is more than 2 seconds. The Tmall Genie sample has the best comprehensive performance. The response times for querying weather and playing music are 1.79 seconds and 2.02 seconds respectively. The Himalaya sample has the slowest response, with response times of 3.93 seconds and 4.


62 seconds respectively. Don’t buy’sleepy’ smart speakers anymore! Which speaker has the most powerful AI voice interaction? Voice interaction response speed – querying weather (the smaller the value, the better), unit: second. Don’t buy’sleepy’ smart speakers anymore! Which speaker has the most powerful AI voice interaction? Voice interaction response speed – playing music (the smaller the value, the better), unit: second.


Electromagnetic compatibility electrostatic discharge test. Electrostatic discharges can occur in many scenarios in life. After static electricity accumulates to a certain extent, discharges will occur. Electrostatic discharges can affect the normal operation of electronic products and even cause electrical failures. The test results found that all 10 samples meet the national standard requirements for electrostatic discharge immunity test.


Nice! Reliability drop test. Most smart speakers are lightweight and easy to move. Therefore, there is a risk of dropping or even breaking when moving products. The test results show that all 10 samples meet the national mandatory standard drop test requirements. Eye protection safety blue light hazard. Many brands have launched smart speakers with touch screens and added many video contents such as parent-child and early education.


But many parents are worried that under long-term use, it will have an impact on the eye health of children. The test results found that the blue light tests of 5 smart speaker samples with screens all reached RG0 level (the highest level), with excellent performance. After getting the above comparative test results, do you have a favorite smart speaker? After purchasing a speaker, for the health and safety of you and your children, please also pay attention to the following matters.


Don’t buy’sleepy’ smart speakers anymore! Which speaker has the most powerful AI voice interaction? Consumption TIPS. 1. The placement distance of smart speakers should not be too far. Smart speakers should be placed where you are located when you often use them. The recommended distance is 3-5 meters. Too far a distance will affect the recognition ability of smart speakers for your instructions. 2.


Do not turn up the volume too high. When using smart speakers to play music or videos, the volume should not be turned up too high. Long-term use will affect the hearing health of users.



Pay attention to ventilation and keep away from heat sources. Some smart speakers come with built-in rechargeable batteries, so it is recommended to place them in a well-ventilated area indoors, away from moisture, and heat sources.


Do not watch videos on the screen for extended periods. Although some smart speakers also have video playback capabilities, the screens are generally small and have low resolution. Prolonged use of smart speakers for watching videos can adversely affect vision.


Appendix: 2020 Smart Speaker Comparison Test Results Summary Table (Click to enlarge)


Avoid purchasing smart speakers that are unresponsive to voice commands! Which speaker has the most effective AI voice interaction?


Notes: 1. All samples in this comparison test were purchased by staff as ordinary consumers through regular sales channels. The results are for consumer reference only and do not constitute a recommendation or promotion of related products; 2. The comparison test evaluates smart speaker samples across 7 test items: performance (far-field voice wake-up, false wake-ups, far-field voice recognition, voice interaction response speed), electrostatic discharge, drop test, and blue light hazard; among these, blue light hazard testing was only conducted on 5 models with screens, and models without screens were not tested.


3. Evaluation results are indicated by “★”, the more “★” the better, and products with the same rating are not ranked; 4. Philips Smart Wireless Speaker (AW6005A/93) was found to lack intelligent voice interaction features and was not included in this evaluation; 5. In the summary table, “√” indicates compliance with the reference standards of this comparison test, “×” indicates non-compliance, and “N/A” indicates the product is not applicable for that test; 6.


In the blue light hazard test, RGO level means that the light does not cause any harm under the defined limits of the standard, and the blue light hazard part is defined as not causing retinal harm within 10000s; 7. Brands and models refer to product information on the sample packaging and sales page product information; 8. The results of this comparison test are only responsible for the purchased samples and do not represent the quality status of different batches or specifications of the same brand; 9.


Without written permission from the Futian District Consumer Association, Bao’an District Consumer Association, and Longgang District Consumer Association, no unit or individual may use the results of this comparison test for commercial promotion.



Leave a Comment

Your email address will not be published. Required fields are marked *