Performance Testing IoT: A New Challenge in Testing

Printer-friendly versionPrinter-friendly versionSend by emailSend by email
Performance Testing Tools are an Essential Component of Testing in the IoT Age
Wednesday, June 7th, 2017
svenH

Internet of Things(IoT) devices are exploding in use, creating new business opportunities and putting a smarter spin on old solutions. These new devices don’t always fit into the conventional use-case mold software developers are accustomed to working with: they present a range of new challenges in performance testing.

Since these devices are most often designed to simplify and streamline everyday tasks, many consumers may not even realize how many IoT items they already own, such as watches, fitness bands, exercise machines, laundry machines, refrigerators, thermostats, and TVs.

Performance Testing APIs: Playing Well with Others

A smart device should work on a wide range of devices and web browsers to reach the largest possible audience. For example, a smart thermostat that only works with iPhones won’t sell to people who use Android. Application Program Interfaces, or APIs, are designed to help a specific device communicate with other systems.

From a business standpoint, IBM defines APIs as “the commercial exchange of business functions, capabilities, or competencies as services.” This means that developers should use API testing and performance testing tools to make sure the IoT device’s web interface works correctly with all major web browsers, iOS apps, Android apps, and other platforms as well as a variety of screen sizes.

High Volume Usage and Growth Explosion

According to the technology research experts at Gartner, there are around 6.4 billion IoT devices in use as of 2016, and that number is expected to grow to a staggering 20.8 billion by 2020. Servers hosting remote applications for IoT devices need to be equipped to handle the expected workload increases.

Developers can use virtualization to run performance testing on the servers to see how well they hold up under pressure. IoT developers need to be aware of thresholds where the infrastructure will start demonstrating a degraded user experience. Customers are likely to stop using devices that cease working correctly and responding quickly.

The increased device volume also means that more devices will be competing for the same amount of radio frequency spectrum. Too many devices, as well as interference from other sources, can be problematic for smart device testing because the devices can experience slow communication with servers and end-user devices.

Functional Testing vs. Real World Testing

Testing IoT through straight functional testing and virtualization does not capture all real-world situations. IoT devices present countless new use cases: they often move around, so network connection is not consistently reliable. The devices may reside in places with weaker connections that the consumer does not think about because they do not have an active relationship with the device.

Smart devices are also prone to problems with infrastructure, including overburdened WiFi channels, unreliable network hardware, and slow, inconsistent Internet connections. IoT devices still need to function reliably when operating with less than ideal infrastructure conditions, meaning both the server and the device need to be programmed accordingly.

IoT devices often have passive roles, so examining how the devices are used and how to test them requires an adjusted look at performance testing tools and performance monitoring.

For example, a connected car/vehicle needs to accurately measure input from things like the engine, speed, road conditions and other sources in very high volumes. It will be difficult to operate one million connected cars without actually performing real world load tests.

The seismic shift in the automotive industry, with cars essentially becoming data centers, places a huge reliance on having battle tested APIs so that IoT enabled devices and services do not crash. This means monitoring, advanced testing and ongoing maintenance will be everything to the new ‘tech’ automotive companies of the future, on a scale never seen before.

Exciting new business opportunities

While IoT in combination with business critical applications brings a new level of complexity to the performance monitoring and testing process, the business opportunities the devices present nevertheless offer an exciting new frontier. Improvements to network infrastructure and performance testing processes will be driven by the market demand on uptime and quality of service.

by Sven Hammar, CSO of Apica

Sven Hammar is co-founder and Chief Strategy Officer of Apica, a provider of powerful, best-in-class technology for testing, monitoring, and optimizing the performance of cloud and mobile applications. Mr. Hammar he has decade-long experience and expertise in web performance and web optimization, e-commerce, cloud services, IT entrepreneurship and the Internet. He is also a serial entrepreneur who has founded several successful IT companies over the years.

Comments

samsung fire

new energy