• Follow us


Data – lots of data! What the IoT creates, and how best to manage it

It has been well publicised by global analyst giants, IDC and Gartner, that the IoT space is predicted to explode in the years up to 2020 and beyond. While estimates on the numbers of smart, connected devices may vary, the one thing everyone can agree on is that we’re looking at tens of billions of new connected devices accessing the Internet by 2020. Naturally, with billions of new connected devices accessing networks and the Internet, questions around data storage and security are front of mind.

With the disparate nature of the IoT and the variety of sectors it serves, the devices themselves have the potential to be located (literally) anywhere around the globe: from a smart meter in a home, or a sensor on a remote weather station, to devices in the stomachs of cows alerting farmers when to milk the heard, connected devices know no bounds in terms of locations or applications.

The variety of these locations, however, does present a serious question for IT teams and businesses regarding the processing, management and security of the data created by these devices. Traditional IT approaches are not applicable to the IoT in most cases, so this calls for a rethink about traditional, centralised IT networks and controls. Increasingly‚ edge computing will come to the fore when we talk about the IoT, enabling large quantities of data to be managed beyond the confines of the corporate IT boundaries.

However, security will continue to remain a significant challenge. While cloud can provide the flexibility and compute power to enable software patch updates on devices, the pure number of connected devices in play will mean that compromised hardware will remain an issue. Simply put, the bigger your network, the more possible entry points there are for hackers looking to exploit it.

How to deal with an unpredictable IoT data stream and avoid exploitation

IoT data is mostly unstructured, and therefore can easily be stored in public cloud infrastructure. All the major cloud providers offer low-cost scalable storage systems based on object storage technology. With high-speed networks and no charge for data input, public cloud is a great location to store the volumes of IoT data being generated by businesses.

But, the public cloud has more to give. Cloud service providers (CSPs), have extended their product offerings to include big data analysis tools that ingest and process large volumes of unstructured content. This allows businesses to create highly scalable ML/AI applications to process data more efficiently than in a private data centre.

Sensor data from Industry 4.0: understanding the how and where

Typically, IoT devices are seen as individual, remotely managed and embedded appliances such as cameras, but this isn’t always the case. Many businesses have distributed environments that run one or more servers at branch locations to monitor building access, environmental controls or other tasks that relate directly to the business itself. As a result, IoT is a mesh of devices that could create, store and process content across numerous physical locations.

Distributed data is the information created outside the corporate data centre or network. We are increasingly seeing the term ‘edge’ used to describe computing and data management tasks performed outside core data centres. Although edge computing has existed for many years, the current evolution in IoT and edge computing is notable for the sheer volume of data created in non-core data centre locations.

This brings unique challenges to IT departments that must ensure this data is adequately secured, collated and processed. Most IT organisations are used to knowing exactly where their data resides. With IoT, the challenge of putting arms around all of the content owned by a business is much greater, with obvious implications on user privacy and regulations, such as GDPR.

With the possibility of so much information being created at the edge, it’s impossible to move the data into the data centre for processing in a timely fashion. First, with a wide variety of devices deployed it may be simply impossible for a business to move the data into the data centre without investing heavily in external networking.

Second, in many instances the value of the data may not be best served by storing everything. For example, a camera that counts cars passing a traffic intersection doesn’t need to store the entire video, just report back the number of cars counted over specific time periods. The video data could be moved back at some time in the future or simply discarded.

A third point to consider is the timely processing of data. IoT devices may need to make local processing decisions quickly and not tolerate the latency of reading and writing the data into a core data centre for processing to occur. This distributed data and processing requirement means that businesses need to add the capability to push compute and applications to the edge and, in many cases, pre-process data before it is uploaded to the core data centre for long-term processing.

IoT in a nutshell: why is it critical and what makes it difficult?

The data that connected devices produce is the key to the value that they can deliver. In the truest sense of the Internet of Things, data streams can and should be accessible in real-time, thus providing companies with the latest information from which they can pivot and adapt. Consider this in an Industrial IoT (IIoT) scenario: real-time data could influence the production cycles of heavy industry, thus minimising downtime in a blast furnace for example, in the process saving material costs and maximising cost efficiencies.

If you consider the potential importance of data created in by IoT devices then you begin to understand the central importance of being able to access it, and even more so, the need for it to be 100 per cent reliable and secure from external ‘tampering’.

Predicting business requirements is key to any company’s forecasting plans and, ultimately, bottom-line ROI, whether it’s a publicly-listed, established multi-national, or a fast-paced, edgy, new disruptor. With the digitalisation of markets, an increasingly crowded competitive space, and a seemingly endless stream of new data sets and tech hitting the decks, it can often feel for businesses (big and small) that they are swimming against an unrelenting tide of technology.

However, we should not view these challenges as insurmountable. While technology will continue to inevitably advance, for those who meet this challenge to stay relevant and ‘embrace the chaos’, they will actually find that out of the chaos comes clarity, and out of clarity of mission comes a competitive advantage.

IoT represents a sea-change in the way companies think about IT and business approaches, but there is rich reward for those who stay the course and navigate the challenges around the physical management and security of the data – data that represents the unique value-add of IoT to both businesses and consumers alike.

Marc Lucas, Systems Engineer, CommvaultImage Credit: IT Pro Portal

Read More

Leave A Comment

More News

Latest ITProPortal news

StrongVPN review New! 2019-05-20 11:30:48Simple yet effective VPN vendor.

Fujitsu says trust can be the new keyword New! 2019-05-20 09:00:34Fujitsu doubles down on trust as new CEO promises changes.

Salesforce suffers major outage New! 2019-05-20 08:00:16Glitch gave employees the ability to read and write across company data.

GDPR - weathering the storm, one year on New! 2019-05-20 07:53:07Experts discuss GDPR one year on.

HPE snaps up supercomputing firm Cray New! 2019-05-20 07:30:01Deal will see HPE pay out $1.3bn in cash.

UK consumers don't think GDPR has worked New! 2019-05-20 07:00:06They don't feel any safer than they did a year ago.

South Korea to ditch Windows for Linux New! 2019-05-20 06:30:52Cost and security seem to be main concerns.

A new manufacturing approach to optical transceivers New! 2019-05-20 06:30:28In order to enjoy the same benefits as the silicon electronic supply chain, the optical transceiver industry needs a new approach to manufacturing.

Google pulls Android support for Huawei New! 2019-05-20 06:17:23Broadcom, Qualcomm, Infineon join Google in limiting their partnerships with Huawei.

It’s all about the logs – Looking into New! 2019-05-20 05:30:34Complete and accurate logs are the keystone of any effective information security program.

The business of millennials: Consumers, workers and brand New! 2019-05-20 05:30:12The millennial generation has been the subject of speculation, jokes and awe since the term was coined, and is often criticised about its consumer hab

Making 2019 the year of the end-user New! 2019-05-20 05:00:07Here’s what is changing in 2019: A laser focus on the impact of all of this tech to those who matter – end-users.

TechRadar: Internet news

Microsoft has a patent to help you keep New! 2019-05-20 13:24:59Microsoft has patented an automated travel diary tool.

South Korea moves from Windows to Linux New! 2019-05-20 13:15:03South Korea's government has revealed that it will transition from Windows 7 to Linux before the OS' End of Life early next year.

Now TV's Game of Thrones offer is ending New! 2019-05-20 12:43:03Don't miss your chance to watch every episode of Game of Thrones with this Now TV deal.

Honor 20 will still get security updates despite New! 2019-05-20 12:25:34Google's restrictions on the Huawei brand won't affect the unannounced Honor 20 more than it will existing devices.

How to watch Game of Thrones season 8, New! 2019-05-20 12:07:29We've made it to the grand finale of GoT - watch Game of Thrones season 8, episode 6 online from wherever you are.

AMD Navi GPUs appear in leaked benchmarks New! 2019-05-20 11:31:23A renowned leaker has revealed what looks like an AMD Navi GPU via leaked performance benchmarks.

The best free PDF editor 2019: change text New! 2019-05-20 11:15:37Our pick of the best free PDF editors will let you edit text, add images and even make documents from scratch.

The best online YouTube downloader 2019: save videos New! 2019-05-20 11:01:57Online YouTube downloaders that let you save your favorite videos in seconds, without any extra software

Warriors vs Trail Blazers live stream: how to New! 2019-05-20 11:00:49Is Golden State's place in the NBA Finals settled? Live stream Trail Blazers vs Warriors from absolutely anywhere you are.

Doctor Who: The Edge of Time is a New! 2019-05-20 11:00:06We got a first-look at the Doctor Who VR experience from Maze Theory.

Best smartwatch 2019: the top wearables you can New! 2019-05-20 10:41:24Not all wearables are worth buying, so we've put together a list of the best smartwatches you should consider today.

Memorial Day sales 2019: a guide to the New! 2019-05-20 10:37:47Your guide to the best Memorial Day sales and deals going on from top retailers like Amazon and Walmart.

TechCrunch » Enterprise

VMware acquires Bitnami to deliver packaged applications anywhere 2019-05-15 12:52:01VMware announced today that it’s acquiring Bitnami, the package application company that was a member of the Y Combinator Winter 2013 class. The

Tealium, a big data platform for structuring disparate 2019-05-15 11:11:57The average enterprise today uses about 90 different software packages, with between 30-40 of them touching customers directly or indirectly. The data

Solo.io wants to bring order to service meshes 2019-05-15 11:05:07As containers and microservices have proliferated, a new kind of tool called the service mesh has developed to help manage and understand interactions

Egnyte brings native G Suite file support to 2019-05-15 09:10:55Egnyte announced today that customers can now store G Suite files inside its storage, security and governance platform. This builds on the support the

In travel tech, 4 rivals merge in Europe 2019-05-15 07:30:14The growth of Airbnb and other big travel startups has given a fillip to the wider travel industry, and today several smaller startups in the short-te

New Relic takes a measured approach to platform 2019-05-14 16:02:12New Relic, the SaaS applications performance management platform, announced a major update to that platform today. Instead of ripping off the Band-Aid

Beyond costs, what else can we do to 2019-05-14 14:59:00In this section of my exploration into innovation in inclusive housing, I am digging into the 200+ companies impacting the key phases of developi

CEO Howard Lerman on building a public company 2019-05-14 13:05:01It’s just over two years since Yext debuted on the New York Stock Exchange, and to mark the occasion, I sat down with co-founder and CEO Howard

Sisense acquires Periscope Data to build integrated data 2019-05-14 12:00:23Sisense announced today that it has acquired Periscope Data to create what it is calling a complete data science and analytics platform for customers.

Algorithmia raises $25M Series B for its AI 2019-05-14 11:00:35Algorithmia, a Seattle-based startup that offers a cloud-agnostic AI automation platform for enterprises, today announced a $25 million Series B fundi

LinkedIn integrates and updates jobs and hiring platforms, 2019-05-14 08:58:43LinkedIn, the social networking platform for the working world that’s now owned by Microsoft, has leveraged its role as a repository for people&

Announcing TechCrunch Sessions: Enterprise this September in San 2019-05-13 19:30:35Of the many categories in the tech world, none is more ferociously competitive than enterprise. For decades, SAP, Oracle, Adobe, Microsoft, IBM and Sa

Digital Trends

The Iron Throne deserved better: Who should have New! 2019-05-20 12:47:22Who should have sat on the Iron Throne? A look at some of the people who could have been the best ruler to sit on the Iron Throne in Game of Thrones,

Ubisoft goes to great lengths to make its New! 2019-05-20 12:33:18Ubisoft's accessibility project manager David Tisserand shared details on a new accessibility initiative during Global Accessibility Awareness Day. H

GM thinks up new electronic brain for its New! 2019-05-20 12:00:48General Motors is launching a new electrical architecture to support more tech features in its cars. The system debuts on the 2020 Cadillac CT5, and w

Vampire: The Masquerade – Bloodlines 2 publisher opts New! 2019-05-20 11:28:23Epic Games launched its first major sale and made the decision to cover the cost of discounts, but a couple of publishers opted out anyway. One withdr

Now that Game of Thrones is over, here’s New! 2019-05-20 11:23:19Now that HBO brought its hit series Game of Thrones to a conclusion, audiences are going to have a Westeros-sized space open up in their regular viewi

Walmart slashes prices on electric hybrid bicycles for New! 2019-05-20 10:53:28Electric bikes can be economical, convenient, and fun. Heading into summer, Walmart slashed the prices for two pedal-assist Hyper E-ride Mountain and

Here are some common Kindle Fire problems, and New! 2019-05-20 10:44:06Is your Amazon tablet giving you grief? Is it refusing to behave the way you expect? Take a deep breath -- everything will be fine. Here are some wide

The Samsung Galaxy Tab S4, the best Android New! 2019-05-20 09:34:12Apple dominates the tablet market, but others are catching up: The Samsung Galaxy Tab S4, our favorite Android tablet, proves that these devices have

Huawei fires back against U.S. ban after Google New! 2019-05-20 09:29:53Google has severed most of its partnerships with Huawei, after its addition to the "Entity List" of the U.S. Department of Commerce. Future Huawei d

The best OnePlus 7 Pro cases to keep New! 2019-05-20 08:00:12The OnePlus 7 Pro is OnePlus's latest flagship killer, and it's an incredible phone. But it's expensive, and it's not going to protect itself. Get

Realme starts selling phones in the U.K., and New! 2019-05-20 07:48:29Realme, a Chinese smartphone manufacturer from the same group as OnePlus, Vivo, and Oppo, has launched its first device in the U.K. and Europe. The Re

Help wanted: British royal family seeks social media New! 2019-05-20 03:50:01The British royal family is looking for a social media expert to help it communicate its role and activities to the masses. So if you like the idea of

Disclaimer and Notice:WorldProNews.com is not responsible of these news or any information published on this website.