GTM-MQNC2Z4
Skip to main content
  1. Home >
  2. About Fujitsu >
  3. Resource Center >
  4. News >
  5. Press releases >
  6. 2015 >
  7. Fujitsu Develops Industry's First Technology to Recognize Flow of People from Low-Resolution Imaging

Fujitsu Develops Industry's First Technology to Recognize Flow of People from Low-Resolution Imaging

With concern for privacy, images where faces are indistinguishable are used for highly accurate detection of people's movements

Fujitsu Laboratories Ltd.

Kawasaki, Japan, March 06, 2015

Fujitsu today announced that it has developed the industry's first technology that provides highly accurate detection of people's movements and that can recognize the flow of people from low-resolution imagery incapable of distinguishing faces.

In existing systems that analyze video taken from surveillance cameras and recognize flows of people, the problem has been that the resolution may be high enough to identify individuals, rendering the footage unusable. Now Fujitsu Laboratories has developed technology that, even when the overall image resolution has been degraded from high to low resolution so that people's faces cannot be recognized, extracts multiple defining features of an individual, thereby making it possible to detect the person's movement with a high degree of accuracy.

This makes it possible to detect people in video with resolution low enough to mitigate anxieties about privacy, and thereby enable recognition of people's movement.

Details of this technology are being presented at the Information Processing Society of Japan's technical committee conference, "Computer Vision and Image Media", opening March 6 at Tohoku University.

Background

In recent years, data on the movement paths of people inside a facility or on the streets of a city have started to be used by stores, for example, to optimize the selection of a store location or the arrangement of merchandize or deployment of staff inside a store, in order to improve customer service. There are rising expectations about the use of data on pedestrian flows in cities to relieve congestion when there are events, to devise operating plans for public transportation systems, and to guide evacuations during disaster emergencies.

Figure 1: Recognition and utilization of patterns in the flow of peopleFigure 1: Recognition and utilization of patterns in the flow of people
Larger View (77 KB)

Issues

When video images from surveillance cameras installed on city streets or in commercial facilities are used to recognize flows of pedestrian traffic, the privacy of individuals whose movements are being recorded need to be taken into consideration. As the resolution of these cameras has improved, it has become possible to clearly recognize a person's face, which, although unproblematic from the perspective of crime prevention, raises privacy issues when third parties have information on a person's movements, such as what the person was doing at a particular time and place.

Typically, the following technologies are used to extract information on flows of people.

  1. Person detection: extract a person-like shape from an image.
  2. Person matching: using multiple cameras, determine whether a person detected by one camera is the same person detected by other cameras.

Because these technologies have used information detected from a person's face, build, gender, and other personal characteristics to determine if it is the same person, the problem has been that the person may be identified, causing the video to be unusable.

About the Technology

Using features that people have in common, Fujitsu Laboratories has devised person-recognition technology that extracts body-like shapes such as heads and torsos in low resolution images, and determines if the person is the same based on clothing colors. Key features of the technology are as follows:

1. Person detection using low-resolution images (Figure 2)

Fujitsu Laboratories focused on the fact that, even in low-resolution images, the head persists as a distinctive human characteristic that is unaffected by a person's posture or the angle from which the person is seen. Regardless of whether viewed from the front, back, left, or right side, the established characteristics of the head being a roughly elliptical shape and at the top of a person's body have the advantage of persisting even in low-resolution images.

The actual extraction process is as follows:

  1. Focusing on head-shaped characteristics in the input image (Figure 2-left), extract head-shaped candidates (Figure 2-middle).
  2. Because many similar shapes were detected, treating the lower ones as torso shapes makes it possible to accurately detect people even from low-resolution images (Figure 2-right).
  3. Based on the people detected in Step 2, detect their relative proximity to the camera, beginning with the closest person, and update the image of more distant persons to compensate for partially obscured areas of a body. This makes it possible to accurately detect even multiple, overlapping people.

This technology can independently recognize the heads and torsos of multiple people.

Figure 2: Human features extraction from low-resolution imagery (Left: input image; Middle: First-round detection; Right: Detection results)Figure 2: Human features extraction from low-resolution imagery
(Left: input image; Middle: First-round detection; Right: Detection results)

2. Person matching from low-resolution images using clothing colors (Figure 3)

Matching a single detected person between multiple cameras makes it possible to recognize a person's movements between cameras.

The same color can be extracted regardless of resolution, but typically in low-resolution images, the colors of smaller areas are absorbed and mixed into adjacent areas, making good detection impossible. By selectively extracting only the distinctive colors of a person's clothing, Fujitsu Laboratories has been able to perform reliable person matching using low-resolution images.

Figure 3: Person matching using low-resolution imagesFigure 3: Person matching using low-resolution images

Results

Until now, it has been difficult to perform person detection and person matching using low-resolution images in which a person's face cannot be identified, but using the technology it developed, Fujitsu Laboratories performed an indoor trial, in which it was able to detect, in the flow of people, the paths of approximately 80% of the people(1).

As a result, when arranging merchandize or deploying staff inside a store, for example, it makes it possible to use surveillance camera images that respect the privacy of the people whose images are being recorded, and enables the use of images that do not identify individuals to improve customer service.

Future Plans

Fujitsu Laboratories plans to conduct more practical testing to improve detection accuracy, and aims for commercial implementation during fiscal 2015.


  • [1] Paths of approximately 80% of the people

    Tracking accuracy depends on the recording environment and camera positioning.

About Fujitsu

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 162,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.8 trillion yen (US$46 billion) for the fiscal year ended March 31, 2014. For more information, please see http://www.fujitsu.com.

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.

Press Contacts

Public and Investor Relations Division
Inquiries

Company:Fujitsu Limited

Technical Contacts

Media Processing Systems Laboratories
Image Computing Lab.


E-mail: E-mail: humanflow@ml.labs.fujitsu.com
Company:Fujitsu Laboratories Ltd.


All company or product names mentioned herein are trademarks or registered trademarks of their respective owners. Information provided in this press release is accurate at time of publication and is subject to change without advance notice.

Date: 06 March, 2015
City: Kawasaki, Japan
Company: Fujitsu Laboratories Ltd.

Services & Products

Corporate Information

Country Selector

Global

Change

World Map