GTM-W5W3BK9
Skip to main content
  1. Home >
  2. About Fujitsu >
  3. Resources >
  4. News >
  5. Press Releases >
  6. 2017 >
  7. Fujitsu Develops Automatic DNN Construction System

Fujitsu Develops Automatic DNN Construction System

Automatically recommend DNN model for non-professional users’ requests.

Fujitsu Research & Development Center Co. Ltd.,Fujitsu Laboratories Ltd.

Beijing,China, July 19, 2017

Fujitsu R&D Center Co., Ltd. and Fujitsu Laboratories Ltd. (collectively "Fujitsu"). today announced an advanced deep learning technology for helping non-professional users to employ DNN models to solve their problems. By using this system, well-balanced DNN models between the accuracy and time consumption will be automatically generated based on the given task of the user. Furthermore, the system is able to provide the DNN model to the user within couple of hours while the conventional process may take several days. We hope this technology can make further contribution to enlarge the DNN application field and realize the general AI platform.

Details are being announced at the 18th ICME meeting, an International conference on multimedia & expro in Hong Kong, China, from July 10 to 14.

Background

Deep learning technology has been widely used for AI related tasks with promising performance. However, construction and parameter adjustment of DNN models need specific knowledge and experience, which are difficult for non-professional users. Even for experts of deep learning, it takes much time and effort to design proper model for certain task. All of these reasons have hindered the expansion of DNN application fields.

Topics

In order to make easy and quick usage of DNN models, especially for non-professional users, we have considered the automatic DNN construction and proposed the corresponding system. This system consists of three steps, data analysis, model recommendation and accuracy curve fitting.

Technology

  1. Complexity score analysis for user’s task

    We evaluate the given task of the user and give a specific “complexity score” for it. The complexity score represents the difficulty level of the task. For example, for the classification task, the image data of different classes are analyzed. The average inter-class and inner-class difference are calculated. Finally, the difficulty of this task is given based on the average difference. With the complexity score, the system is able to search the optimal DNN model and parameters to match user’s task perfectly.

  2. DNN models ability score evaluation

    We use the “ability score” to describe the classification ability of the CNN model. The ability score is evaluated by considering the total calculation times, the shape (depth and width) of the model and the gradient vanishing problem. We can give a specific ability score for any DNN model.

  3. Model recommendation and accuracy curve fitting

    Based on the complexity score, the system will recommend three DNN models according to their ability scores. The three models are small, middle and large model. Users can choose one from them according to their specific requirement. For example, small model for higher speed and large model for higher accuracy. We will train all of the three models and fit a curve to show the trend between model complexity and classification accuracy.

    The framework about automatic DNN construction system

    Figure 1: The framework about automatic DNN construction system


Effect

Our automatic DNN construction system can deal with most of classification tasks and has an excellent performance. Fig 2 shows a recommendation example on dataset of handwritten Chinese released in 2010 by the Institute of Automation, Chinese Academy of Sciences (CASIA), which is used as a standard by academic societies. The best performance by far is 97.30%[1]. Three models are recommended by our system. The accuracy-ability score curve is fitted from the recognition accuracies of the three recommended models. The classification accuracies of the middle and large model are near the-state-of-the-art level. The total recommendation time, including complexity score calculation and the training of the three models, is 30 hours with GeForce GTX TITAN X and Intel® Xeon® CPU E5-2640 v3 @2.60GHz. Our system can recommend good performance models to the non-professional users full automatically. Thus, huge time for study deep learning is saved.

Recommendation results on CASIA handwriting Chinese dataset

Figure 2: Recommendation results on CASIA handwriting Chinese dataset

Future Plan

Fujitsu will aim to bring this technology to Zinrai in 2017, Fujitsu's AI technology platform, and apply it to various image recognition tasks.

[1] Xuefeng Xiao, et al, “Building fast and compact convolutional neural networks for offline handwritten Chinese character recognition”, Pattern Recognition, Volume 72, December 2017, Page 72-81.

About Fujitsu

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 155,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.5 trillion yen (US$40 billion) for the fiscal year ended March 31, 2017. For more information, please seehttp://www.fujitsu.com.

About Fujitsu R&D Center Co., Ltd.

Established in 1998, Fujitsu R&D Center Co., Ltd. is a wholly owned R&D center of Fujitsu Limited, located in Beijing. The center's research areas cover the major business fields of the Fujitsu Group, including information processing, telecommunications, semiconductors, and software and services. For more information, please see: http://www.fujitsu.com/cn/frdc/en/

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://jp.fujitsu.com/labs/en.

Contacts

E-mail: E-mail: itl-ocr@cn.fujitsu.com
Company:Fujitsu R&D Center Co., Ltd.


All company or product names mentioned herein are trademarks or registered trademarks of their respective owners. Information provided in this press release is accurate at time of publication and is subject to change without advance notice.

Press Release ID: 2017-07-19
Date: 19 July, 2017
City: Beijing,China
Company: Fujitsu R&D Center Co., Ltd., Fujitsu Laboratories Ltd.