Establishment of the Consortium for Advanced Assistive Mobility Platform, Aiming to Improve Accessibility and Quality of Life for the Visually Impaired, Through AI Suitcase Development

  • Social Contribution

February 6, 2020

Alps Alpine Co., Ltd.
Omron Corporation
Shimizu Corporation
IBM Japan, Ltd.
Mitsubishi Motors Corporation

Alps Alpine Co. Ltd. (headquartered in Ota District, Tokyo; Representative Director, President & CEO Toshihiro Kuriyama), Omron Corporation (headquartered in Shimogyo District, Kyoto; President and CEO Yoshihito Yamada), Shimizu Corporation (headquartered in Chuo District, Tokyo; President and Representative Director Kazuyuki Inoue), IBM Japan, Ltd. (headquartered in Chuo District, Tokyo; General Manager Akio Yamaguchi), and Mitsubishi Motors Corporation (headquartered in Minato District, Tokyo; Representative Executive Officer and CEO Takao Kato) have established the Consortium for Advanced Assistive Mobility Platform, a general incorporated association. Aiming to improve accessibility in society (*1) and quality of life for the visually impaired, the consortium will develop an integrated technological solution (hereafter called an "AI suitcase") that will support people's transport and communication with AI, and will conduct pilot experiments and demonstrations toward ultimate implementation in society. Through its activities, the consortium aims to achieve a co-living society in which people, regardless of any disabilities they may have, can live together with mutual respect for one another's individuality.

Background to the Consortium's Establishment

In recent years, the number of people with visual impairments is on the rise due to age-related declining vision and the onset of eye diseases such as glaucoma. A survey by the Japanese Ophthalmological Society (*2) estimated that there are 1.64 million people in Japan with visual impairments, of whom 188,000 are completely blind. Some research results (*3) suggest that across the globe, the number of visually impaired people will triple by 2050, leading to increasing concern about this exponential increase in number.

People with visual impairments face a number of challenges; among these, one of the largest hurdles that prevents social participation is the inability to move around town freely. For instance, it is extremely difficult for the visually impaired to do everyday tasks, such as to check their route on a map and head to a destination, to walk on the street while avoiding people or objects, to enter shops after checking signs and signboards, to line up at train stations and stores, or to spot someone whom they know and to greet the person. Since the enactments of the New Barrier Free Transport Act in June 2006 and the Disability Discrimination Act in April 2016, more measures have been implemented in Japan for people with disabilities, including eradicating steps and adding elevators to improve accessibility for wheelchair users. However, people with visual impairments who cannot visually look around and check their safety still face challenges in their social lives, including during commuting to work and school.

To resolve these issues, the consortium will work to develop an AI suitcase, an integrated solution that will help the visually impaired to get around town independently, by supplementing visual information by combining the latest AI with robotics. This AI suitcase is a wearable device and suitcase-shaped navigation robot designed for the visually impaired; it can be carried around easily without stress in one's daily life. Under this consortium, multiple companies in various fields of business will bring together their technologies and expertise to develop such an AI suitcase. Through pilot experiments, the companies will identify the requirements for social implementation and aim to achieve a solution that resolves transport and communication issues for the visually impaired.

The consortium was inspired by the research that IBM fellow Chieko Asakawa conducted at Carnegie Mellon University (U.S.) on navigation for the visually impaired. The consortium will join hands with universities including Carnegie Mellon as well as relevant organizations that support the visually impaired in order to develop new accessibility technologies. (*4)

  • *1Accessibility: Ease of access to information and services.

  • *2Source: "Social cost of visual impairment in Japan," 2006–2008, Japanese Ophthalmologist Society study group

  • *3 Source: "Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis," August 2017, Lancet Global Health

  • *4Guerreiro, João, Daisuke Sato, Saki Asakawa, Huixu Dong, Kris M. Kitani, and Chieko Asakawa. “CaBot: Designing and Evaluating an Autonomous Navigation Robot for Blind People.” In The 21st International ACM SIGACCESS Conference on Computers and Accessibility, pp. 68-82. 2019.

Overview of the Consortium

Name Consortium for Advanced Assistive Mobility Platform (CAAMP, a general incorporated association)
Address Chuo District, Tokyo
Established December 20, 2019
Purpose Development of the AI Suitcase, an integrated solution device that contributes to improving accessibility and quality of life (*5) of the visually impaired in society, by utilizing AI to help them move around independently, and conducting pilot experiments toward social implementation
Main activities
  1. Develop a small navigation robot that the visually impaired can carry with them without stress in their daily lives
  2. Integrate various component technologies, including the necessary hardware (such as an engine mechanism, battery, camera, image-recognition sensor, touch sensor, and packaging) and software (such as AI, location data processing, system control): system integration
  3. 3. Conduct pilot experiments on an AI suitcase prototype
Activity period December 1, 2019 – November 30, 2022 (as scheduled)
Participants and their roles 5 companies (as of February 2020, in Japanese alphabetical order)
  • Alps Alpine: Offering advice and technologies based on their know-how regarding touch interfaces
  • Omron (board member):Offering advice and technologies based on their know-how regarding image recognition and various sensors
  • Shimizu (board member): Offering advice and technologies based on their know-how regarding public spaces, indoor and outdoor navigation, and robotics as well as the administrative and accounting features required for running the association
  • IBM Japan (chair): Offering advice and technologies based on their know-how regarding AI, accessibility, indoor and outdoor navigation, computer vision, and cloud computing as well as the administrative operations required for running the association
  • Mitsubishi Motors: Offering advice and technologies based on their know-how regarding car development and general mobility issues

    *5Quality of life: One indicator of people's satisfaction with life

Features of the AI Suitcase

Basic features: Support the user's transport.
1. A small navigation robot searches for the optimal route to the user's destination based on the person's location data and map data.
2. The suitcase navigates the visually impaired user by offering information via speech and touch from the small navigation robot and wearable device.
3. The small navigation robot identifies and avoids obstacles via video and sensor information.
Unique features: Support the visually impaired user's actions and communication.
4. An interactive conversational feature tells the user about nearby stores and supports the user's shopping, using location data and knowledge data from the cloud.
5. The suitcase identifies the behavior of people nearby based on video and sensor information and assists the user in behaving as required for the occasion, such as joining a line.
6. The suitcase identifies people whom the user knows from video, interprets the people's situations from their facial expressions and behavior, and supports the user's smooth communication.

Image of the AI Suitcase

Image of the AI Suitcase

(FYI) Components of the AI Suitcase

(FYI) Components of the AI Suitcase

Pilot Experiment on the AI Suitcase

An AI suitcase pilot experiment will be opened to the public in June 2020 at a commercial complex in Tokyo.

Media contact

  • Contact Takeda, Communications and IR, Sustainability Promotion Office, Alps Alpine
    TEL: 03-5499-8001 / E-mail: alps-pr@jp.alps.com
  • Contact Yasui, Brand Communications, Omron
    TEL: 075-344-7175 / E-mail: kazunori.yasui@omron.com
  • Contact Imamura, Corporate Communications, Shimizu
    TEL: 03-3561-1186 / E-mail: hideo@shimz.co.jp
  • Contact Hazuki Ichinose, IBM Japan Communications
    TEL: 03-3808-5120 / E-mail: Hazuki.Ichinose@ibm.com
  • Contact Tetsuji Inoue, Public Relations Dept., Mitsubishi Motors Corporation
    TEL: 03-6852-2498 / E-mail: press.mmc@mitsubishi-motors.com

The information contained in this news release is the current information on the date of publication. Please be aware that this information may have changed by the time you view it. Please contact the company to inquire for further details.