“Mini-AI” required for telcos to push AI to the edge

759

The critical architecture decision that every mobile network operator (MNO) needs to make in the next few months or years is how to balance resources between the center and the edge of the network (see Wireless Watch August 4 2017 for our analysis of this). The adoption of artificial intelligence (AI) to help optimize the network more intelligently and dynamically should help with this, but it may also become part of the dilemma.

In an interview with EETimes last week, Alex Tepper, founder and head of corporate and business development at Avitas Systems (a GE venture to apply AI in the industrial sector), said that the key limitation of AI today is its inability to compute on the edge device itself – in a drone, for instance, enabling it to change its behavior in-flight without the delay inherent in receiving instructions from the cloud. Qualcomm, Intel and others are working to bring AI to devices as small as handsets, but this is still a work in progress – so is the issue of miniaturizing AI going  to be yet another delaying factor as MNOs work towards the new-look software-driven network architectures which will help get the best results from 4G and 5G.

Once networks are virtualized, the potential to transform their efficiencies and responsiveness should be limitless. But only if the planning of the physical, as well as the virtual, resources is fit for purpose. Depending on the use case and business model, there should be an optimal allocation of network and compute resources to different places along the chain, from cloud to switch to local gateway to the device itself. Ideally this should be capable of adjusting to changing circumstances in terms of traffic levels and type.

Of course, the ability of AI to help make these decisions is key  – building on deep machine-based analysis of traffic patterns, user behaviour and history, and many other factors. It is one of three main areas which are driving telcos’ rising interest in AI:

More intelligent optimization of their network resources to improve efficiency and customer experience is one;

The others are less telco-specific, namely to build a new customer relationship through chatbots and other new interactions, which in turn build on a new holistic view of the user, and through hyper-personalized services;

And to harness the significant stores of valuable data which telcos hold on their subscribers and networks, for business-to-business revenue streams based on big data analytics and deep context awareness.

This interest is translating into real projects. A study of 48 mobile operators worldwide by Rethink Technology Research,  to be published in October, found that 58% were engaged in AI tests, trials or real world deployments, with machine learning being the most commonly used technology.

A newly published survey of the broader telco space by CapGemini concluded that, while telcos used to be AI laggards, they are now leading large-scale deployments, with 49% deploying the technology, ahead of an average of 36% across all industries. These are being led initially, in the majority of cases, by customer service applications, but a full 93% of telco adopters said they expected AI to increase efficiency and effectiveness, while 79% claimed to have seen a 10% boost in sales thanks to AI.

Capgemini said in its report that the “low hanging fruit” use cases for telco AI are  forecasting, managing risk and tracking customer and transaction histories. “Organizations need to have a clear view of where AI can create the most enduring advantage for them and their customers,” said the report, adding that, across many sectors, companies are failing to align AI investments with business opportunities. Interestingly, despite the massive AI R&D projects in the US and China, it is India, with its well-established base of software engineers, where the largest percentage of companies (across all sectors) are using AI commercially, at 58%.

Ron Tolido, CTO for CapGemini’s Insights & Data practice, said that many organizations are focusing more effort on complex AI projects and missing out on simpler deployments which could drive quicker returns.

This may be why many operators are looking first to chatbots and digital assistants, which are becoming well understood by the commercial side of the telco business and are very visible to customers.

For instance, in March, Amdocs announced aia, a digital intelligence platform which combines AI and machine learning capabilities – including cognitive computing services from IBM’s Watson – to make predictions, automate decisions and directly manage conversations with customers.  This week, it jointly launched an AI-driven chatbot with Microsoft, specifically for MNOs, powered by aia and  Microsoft Cognitive Services, the basis of what the Windows giant calls the new ‘conversational’ interface with the digital world.

However, more transformative effects could come from optimizing the network on a fully dynamic basis, linked to customer experience (proactively shifting a high value customer, who has wandered into a spot where a small cell is about to fail, to another connection, for instance). It will be easier for MNOs to improve their overall customer engagement once they are delivering an excellent network experience (not to mention users having to spend less time interacting with customer care in the first place). If that is not in place, Apple, Facebook and the others will continue to be the primary digital interface for most users.

Vendors are starting to support the optimization aim. Nokia has made several announcements in recent months, including its Autonomous Care offerings, unveiled in May. Earlier this month, ZTE said MNOs needed to accelerate their network AI efforts and announced a platform (as-yet somewhat ill-defined) to help. This will incorporate self-optimizing network (SON) capabilities as well as algorithms to support new interfaces based on natural language processing and facial recognition. The Chinese vendor aims to offer an end-to-end platform which covers a wide range of telco-specific use cases from intelligent automated networks to new consumer services, and which incorporates the algorithms along with the chips and terminal hardware. The elements promised include ‘self-researching AI chips’, robot modules and intelligent terminals such as smartphones and smart home controllers.

“Complemented with high computing power, precision algorithm and data analytics capability, AI technology will lead to the evolution of highly intelligent autonomous, automatic, self-optimizing and self-healing networks,” ZTE said in its release. “At this stage, operators and vendors are still proactively exploring and seeking more efficient, stable and accurate AI algorithms and solutions to reduce the operation labor cost and effectively improve operating income. The platform can help operators introduce new technologies and build next generation intelligent network more conveniently amidst the ongoing advancement of AI technologies.”

ZTE’s inclusion of smartphone and controller devices in its AI portfolio indicates that the algorithms – which, before the days of cheap mass storage and compute power – required a supercomputer to run, can now be applied to a mobile gadget. Intel and Qualcomm have both recently demonstrated neural processing engines running on chips targeted at gateways or mobile devices. They effectively take snapshots of broader machine learning models which are created and modified in the cloud, and run them locally to reduce latency and improve context awareness (see Wireless Watch September 4 2017).

This helps, but does not solve, the issue of how much intelligence and processing should be placed at the edge as opposed to the central engine. Edge-based AI improves responsiveness but an efficient way of updating the central platform is essential to avoid fragmentation. There are daunting issues of supporting smooth roaming for users who move from one AI-optimized, context aware cell to another with no such user experience. For challenges such as load balancing across different locations and times of day, a common view of the whole network is essential.

So the ability to do more AI at the edge does not answer all the questions of how to harness resources most efficiently as Tepper from Avitas makes clear. Avitas, being backed by GE – one of the flagwavers for using AI to make the Industrial Internet of Things a reality – is at the coalface of this movement. It recently announced an alliance with Nvidia to work on enabling AI in inspection services for the oil, gas and transportation industries. Such deals will be important for Nvidia, whose GPUs (graphics processing units) have been key enablers of affordable AI engines in recent years, but are now being challenged by more specialized processors like Google’s Tensor, or by FPGA-based approaches like Intel’s.

Nvidia wrote in a recent blog post: “How do you send a human being to inspect a petroleum refinery flare stack — one that operates at hundreds of degrees and requires negotiating a high risk vertical climb? The answer is you don’t.” While climbing a cell tower does not carry this level of risk, MNOs such as AT&T and T-Mobile USA have already experimented with drones to inspect and even install equipment, to save cost and liability. However virtualized, there will always be physical elements to a mobile network, and civil works can be the most expensive aspect of a roll-out, especially when it comes to large numbers of small cells to support urban densification.

Tepper points out that AI can create 3D models of an asset such as a cell tower, then layer “points of interest” on top of that to enable drones to spot problems and automate defect detection. Avitas and Nvidia are currently using truck-based AI engines to get closer to towers and industrial sites, but Tepper wants to get that intelligence into the drone itself. This is a far more complex, resource-hungry and mission critical task than supporting consumer applications based on vision processing, for instance, on a handset.

AT&T is also working on an edge computing model with AI elements to boost automation, revealed Marachel Knight, SVP of wireless network architecture, at the Mobile Future Forward conference this month. It aims to design its 5G RANs so that network computing components are geographically close to a tower or small cell to lower latency. It has already said that it plans to fit its edge computing platforms with high end GPUs and CPUs, and coordinate and manage all these elements with its software-defined network (SDN) controllers.

The goal is the same for AT&T and for GE (and many others) – to make AI highly personal and context aware, in order to go beyond automation and improved decision support, and enable new ways of working. On that journey, the right decisions, about how much to distribute or centralize, will help decide where the MNO fits into the complex AI value chain.

The ‘self-driving telco’ will take years to achieve, says ETSI’s AI initiative

The fully automated, ‘self-driving telco network’ is a one of the cornerstones of the next generation mobile vision for many operators, since it would dramatically improve operating costs and quality of service. Applying artificial intelligence (AI) to network management and orchestration (MANO) software could help achieve automation with a high level of intelligence, and a new ETSI ISG (Industry Specification Group) is focusing on this challenge – but warns it will take years to become commercial reality.

Densification and the rise of virtualized networks both introduce a huge number of new components into the picture, and this means modern networks are becoming hard for humans to understand quickly. This is the view of Ray Forbes of Huawei, who is the Convener of ETSI’s recently formed ISG, whose title is Experiential Network Intelligence (ENI). This kicked off in April with founder members including Verizon, China Telecom and, along with Huawei itself, the China Academy of Telecommunications Research, Hong Kong University of Science and Technology, Samsung, Xilinx and Samsung R&D Institute UK. Forbes says ETSI is talking to other operators like NTT Docomo, Orange and Deutsche Telekom about joining.

Forbes said, in an interview with LightReading, that many operators are incurring unnecessary cost by over-engineering their networks (adding surplus capacity to cope with peak loads) and running services at the least efficient times. He estimates that networks are typically 50% over-engineered, but that AI could reduce that to 10% by allocating resources more dynamically and efficiently according to workload, time of day and geographic patterns.

This would further enhance the resource efficiency impact which operators are already envisaging from virtualization and software-defined networking, which make it possible to dial network resources up and down on-demand (by calling up new instances of virtual network functions), while an SDN controller orchestrates those VNFs across the whole network.

AI would provide a new level of intelligence and automation for those SDN decisions, while also using machine learning to understand usage patterns in more detail, relating these to network resources, and predicting any faults and failures before they affect user experience. As China Telecom’s Haining Wang, vice chair of the ENI ISG, put it, while SDN and virtualization are helping to make networks more flexible, management complexity remains as high as ever – it is just transferred from hardware to software.

“It’s making resource management less human dependent in terms of knowledge,” Forbes said. “You want to have a business analyst who just performs data models; you don’t want to have a lot of pre-thinking and management analysts that analyze what to do.”

These are the practical objectives which underpin ETSI ENI’s remit, which is to define an AI-based context-aware system based on the ‘observe-orient-decide-act’ control model. This year, it will develop use cases and requirements for telco network AI, which it will model in 2018. It will then move on to testing and automation in 2019-2020.

In other words, this is not an overnight process. The technologies and processes are immature, with many unknowns, and few telcos are at the stage of planning AI-driven projects for the near future. For many, it will be part of a wider progress towards SDN and 5G, which will take place over as many as 10 years. And AI and machine learning are of their nature slow to perfect because the models need to learn until they reach the stage where they can make quicker, better decisions than a team of trained experts. “You need to design a model and spend a bit of time teaching the model how to do things,” Forbes said.

He added: “We don’t want to jump in the deep end”, cautioning that the dream of “fully AI-based autonomics” is far away, though ENI is taking steps in that direction.  “The ultimate aim is to improve the user experience and simplicity to have intent-based network indications in line with customer demand for new revenue,” he concluded.

To avoid reinventing the wheel, ENI will work with other ETSI initiatives like NFV, Multi-Access Edge Computing (MEC) and Next Generation Protocol (NGP), as well as other standards groups including IETF, Metro Ethernet Forum, 3GPP and Broadband Forum.

At the heart of ENI’s approach will be context awareness – the goal of many 5G-related projects, which envisage a whole new wave of mobile experiences, and revenue-generating services, which derive from the networks’ precise knowledge of a user’s context, preferences and habits.

The group says it will define an AI-enabled context aware system based on the ‘observe-orient-decide-act’ control model, which allows a system to adjust the services it is offering according to changes in user requirements, environmental conditions and business goals. This system will result in standardized models for using AI to manage a network and intelligently control service delivery and user experience.

The automated system will learn from previous experience and so add intelligence to automated network planning and monitoring, reducing opex, improving capacity usage, and boosting user experience, to a greater extent than just using automated technologies like self-optimizing network (SON).

The group will also study network telemetry, big data mechanisms, machine learning, and how to simplify and scale complex device configuration and monitoring.

“The unique added value of the ETSI ISG ENI approach is to define new metrics to quantify the operator’s experience; this enables the optimization and adjustment of the operator’s experience over time, taking advantage of machine learning and reasoning,” said Forbes when the ISG was announced in April.

While standards will be welcome, especially to encourage multivendor, interoperable networks, some operators are already embarking on this AI-driven path. Telefonica has deployed its first service operation centers for intelligent management of its networks, based on real time, AI-aided analysis of customer experience. These initial centers are in Argentina, Chile and Germany and the Spanish-based operator says they are a first step towards applying AI broadly to operations, proactively spotting incidents and taking action to improve customer experience. The system will be implemented in all Telefonica’s markets over time.

The technology underpinning this is Huawei’s Smartcare SOC (Service Operation Center) solution. This technology forms a bridge between network resource assets management and customer assets management, said Telefonica, providing per-service per-user (PSPU) visibility of customer experience.

Enrique Blanco, Telefonica’s global CTO, said in April: “These SOCs are the first step in bringing customer experience to the next level. In the near future the application of artificial intelligence to networks will maximize capacity and solve any problems before end users even notice anything. The final objective is to manage the network automatically to avert any potential problems.”

He added: “Machine learning is also becoming critical as operators virtualize their infrastructure: networks are becoming dynamic and exponentially more complicated to manage as the control is delegated to the network’s edge. As Telefonica moves towards the next generation of networks, intelligence and analytics are key, to turn data into a knowledge that enables real life innovation.”

Full context awareness combined with automated, AI-enabled network management is at the heart of many 5G visions. The UK-based 5G Innovation Center, for instance, last year showed off its Flat Distributed Cloud (FDC) framework for 5G.  This has context awareness at its core and uses information about the user and network status to provide better quality of experience over its dynamic and distributed cloud architecture, directing resources where they are most needed.

FDC is able to understand a user’s (or ‘thing’s) context and deliver just the right amount of capacity, latency and so on required for that particular situation. That would achieve one of the key aims of 5G – to support a user experience which is perceived to be always sufficient (as opposed to over-delivering, for a given usage, on some occasions and then disappointing on others).

The architecture will enable the network to access and act upon context information automatically and, based on that, make decisions about the right levels of QoS. The user would share information with the network via a user profile, which would then provide the ‘5 Ws’ – what, when, where, who, why – to support more intelligent, personalized decisions by systems such as SON.

For more information, visit Rethink Technology Research.