Skip to main content

Fujitsu

Global

Archived content

NOTE: this is an archived page and the content is likely to be out of date.

Fujitsu Develops New Deep Learning Technology to Analyze Time-Series Data with High Precision

Applied to IoT data, significantly improves accuracy by about 25% compared to previous technology

Fujitsu Laboratories Ltd.

Kawasaki, Japan, February 16, 2016

Fujitsu Laboratories Ltd. today announced that it has developed deep learning technology(1) that can analyze time-series data with a high degree of accuracy. Demonstrating promise for Internet-of-Things applications, time-series data can also be subject to severe volatility, making it difficult for people to discern patterns in the data.

Deep learning technology, which is attracting attention as a breakthrough in the advance of artificial intelligence, has achieved extremely high recognition accuracy with images and speech, but the types of data to which it can be applied is still limited. In particular, it has been difficult to accurately and automatically classify volatile time-series data–such as that taken from IoT devices–of which people have difficulty discerning patterns.

Now Fujitsu Laboratories has developed an approach to deep learning that uses advanced mathematical techniques to extract geometric features from time-series data, enabling highly accurate classification of volatile time-series.

In benchmark tests held at UC Irvine Machine Learning Repository(2) that classified time-series data captured from gyroscopes in wearable devices, the new technology was found to achieve roughly 85% accuracy, about a 25% improvement over existing technology.

This technology will be used in Fujitsu's Human Centric AI Zinrai artificial intelligence technology.

Details of this technology will be presented at the Fujitsu North America Technology Forum (NAFT 2016), which will be held on Tuesday, February 16, in Santa Clara, California.

Background

In recent years, in the field of machine learning, which is a central technology in artificial intelligence, deep learning technology has been attracting attention as a way to automatically extract feature values needed to interpret and assess phenomena without rules being taught manually.

Especially in the IoT era, massive volumes of time-series data are being accumulated from devices. By applying deep learning to this data and classifying it with a high degree of accuracy, further analyses can be performed, holding the prospect that it will lead to the creation of new value and the opening of new business areas.

Issues

Deep learning is a potent machine learning technique, and it is attracting attention as a breakthrough in the progress of artificial intelligence, but so far it has only been able to be effectively applied to limited types of data, such as images and speech.

In particular, for complex time-series data that is subject to severe oscillations and captured by sensors embedded in IoT devices, it has so far been difficult to achieve highly accurate classifications using deep learning or any other machine learning techniques.

About the Technology

Now Fujitsu Laboratories has developed deep learning technology that uses advanced chaos theory and topology to automatically and accurately classify volatile time-series data. This can accurately handle even complex time-series data with severe oscillations.

The technology uses the following procedures to learn and classify:

1. Graphically represents time-series data using chaos theory

Numerical data captured by sensors are represented superficially as the product of a complex combination of dynamic movements. While it is difficult to directly investigate the mechanisms of these dynamic movements, plotting changes over time on a graph is known to reveal characteristic tracks for each mechanism of movement. Applying this graphic approach makes it possible to distinguish between the time-series data via diagrams.

2. Quantify the diagrams using topology

Because it is difficult to directly apply machine learning to the diagrams created in step 1, Fujitsu Laboratories applied topological data analysis(3) to express features of the diagrams as numbers. With this method, rather than the features one might normally associate with a graphical image, the number of holes contained in the diagram and the major shape features are analyzed and then converted into a propriety vector representation.

3. Learning and classification using a convolutional neural network

Fujitsu Laboratories newly designed a convolutional neural network that trains on the propriety vector representations from step 2, enabling the classification of volatile time-series data.

Figure 1: How this technology classifies time-series dataFigure 1: How this technology classifies time-series data
Larger View (108 KB)

Results

Using the time-series data from gyroscopic sensors built into wearable devices, this technology was found to achieve an accuracy of approximately 85%, an improvement of about 25% over existing techniques, on the UC Irvine Machine Learning Repository benchmark test for classifying human activities. In tests to infer mental states using brainwave time-series data, this technique achieved an accuracy of about 77%, a roughly 20% improvement over existing techniques.

This technology extends the types of data to which deep learning can be applied to time-series data. Moreover, because it can very accurately classify time-series data with severe oscillations, which people have difficulty discerning, it enables new types of analyses. For example, using IoT devices, it could be used to accurately detect equipment anomalies or forecast breakdowns in factories, or could be used to analyze vital-signs data to assist with medical diagnoses and treatment. In ways such as these, it is expected that this technology will bring advancements to a variety of fields through artificial intelligence.

Future Plans

Fujitsu Laboratories will work on further improving the accuracy of its time-series data classification technology with the aim of a practical implementation of it in fiscal 2016 as a core part of Human Centric AI Zinrai. The company is also working to broaden the application of deep learning to types of data other than images, sounds, and time series, and to perform more sophisticated data analysis.

For More Information


  • [1] Deep learning technology

    A type of machine learning using a multi-layered neural-network model.

  • [2] UC Irvine Machine Learning Repository

    A world-renowned repository providing numerous datasets for comparative evaluations of machine learning.

  • [3] Topological data analysis

    A data-analysis technique that treats data as a set of points arrayed within a certain space, from which geometric information can be extracted.

About Fujitsu

Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 159,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.8 trillion yen (US$40 billion) for the fiscal year ended March 31, 2015. For more information, please see http://www.fujitsu.com.

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.

Press Contacts

Public and Investor Relations Division
Inquiries

Company:Fujitsu Limited

Technical Contacts

Knowledge Information Processing Laboratory

E-mail: E-mail: contact-big-i@ml.labs.fujitsu.com
Company:Fujitsu Laboratories Ltd.


All company or product names mentioned herein are trademarks or registered trademarks of their respective owners. Information provided in this press release is accurate at time of publication and is subject to change without advance notice.

Date: 16 February, 2016
City: Kawasaki, Japan
Company: Fujitsu Laboratories Ltd.