Fujitsu chosen for GENIAC project, starts development of large language models for logical reasoning

Enhancing reliability of generative AI, accelerating application of generative AI in business operations

Fujitsu Limited

Kawasaki, May 17, 2024

Fujitsu today announced that it has been chosen for the “Research and Development Project of the Enhanced Infrastructures for Post-5G Information and Communication Systems/Development of post-5G information and communication systems,” a subsidy project launched by Japan’s New Energy and Industrial Technology Development Organization (NEDO) under Japan’s Ministry of Economy, Trade and Industry’s (METI) Generative AI Accelerator Challenge (GENIAC) initiative to enhance Japan’s capability to develop generative AI (1). Under the subsidy project, Fujitsu will start research and development on technology combining knowledge graphs with large language models to realize LLMs that enable logical reasoning.

Fujitsu has been conducting R&D of generative AI technologies for application in business operations. On May 10, Fujitsu in cooperation with a team of researchers announced the release of Fugaku-LLM (2), a large language model with enhanced Japanese language capability, and plans to continue to strengthen the development of specialized LLMs for various industries and businesses.

As part of its R&D activities, Fujitsu has been focusing on the problem posed by hallucinations in large language models (LLMs), a phenomenon in which generative AI creates plausible but incorrect or unrelated output. Fujitsu aims to realize a new technology that strengthens the reliability of LLMs by combining LLMs with knowledge graphs, ultimately enabling the application of LLMs in operations that require high levels of compliance and explainability, including tort determination and basis search in the legal field, internal control and accounting audits in finance, and symptom search and diagnostic support in the medical field. Fujitsu anticipates that the newly developed technology will enable the realization of an LLM for logical reasoning that creates clear and comprehensible outputs.

Fujitsu plans to offer the new technology to the Japanese market at the end of fiscal 2024, as a step to further enhance its technologies to protect conversational AI from hallucinations and adversarial attacks announced in September 2023 (3).

LLMs that enable logical reasoning

To address the task of reliability in the output of LLMs, Fujitsu started development of LLMs specialized in knowledge graph generation and inference, one of the knowledge processing technologies, to make LLMs logically infer answers according to the knowledge graph generated from natural language regulations and rules. Fujitsu plans to position this technology as the core technology of a generative AI trust technology that eliminates output instability and ensure accurate output in compliance with large and complex regulatory and internal regulations, a technique Fujitsu aims to realize in fiscal 2024 as part of its company-wide AI strategy (4).

As part of the GENIAC program, Fujitsu will develop two specialized LLMs: an LLM for knowledge graph generation, which converts natural language documents into knowledge graphs to form knowledge, and an LLM for knowledge graph inference that searches for relevant information on knowledge graphs for a given question, aggregates it logically, and answers it.

To efficiently develop two specialized LLMs in a limited development period, Fujitsu will first develop a pre-trained LLM that is common to both specialized LLMs. The advantage of this LLM development is that it enables LLMs to handle both documents in natural language and knowledge graphs by adding a bilingual corpus (5) to the pre-learning data. Specialized LLMs are then developed simultaneously by carrying out instruction learning (6) for knowledge graph generation for the first model, and instruction learning for knowledge graph inference for the second model.

Future Plans

Moving forward, Fujitsu will offer the specialized LLMs for knowledge graph generation and inference, evaluation scripts for knowledge graph generation and inference tasks, and other knowledge and know-how acquired during this project via Hugging Face (7), GitHub (8), the Fujitsu blog, and the GENIAC community in compliance with terms of use, OSS licenses, and copyright of the data and software used. Fujitsu further plans to release the new technologies via Fujitsu Kozuchi, Fujitsu’s dedicated AI service that allows users to accelerate the testing and deployment of advanced AI technologies.

Related Links

Fujitsu’s Commitment to the Sustainable Development Goals (SDGs)

The Sustainable Development Goals (SDGs) adopted by the United Nations in 2015 represent a set of common goals to be achieved worldwide by 2030.
Fujitsu’s purpose — “to make the world more sustainable by building trust in society through innovation” — is a promise to contribute to the vision of a better future empowered by the SDGs.

The goals most relevant to this project

About Fujitsu

Fujitsu’s purpose is to make the world more sustainable by building trust in society through innovation. As the digital transformation partner of choice for customers in over 100 countries, our 124,000 employees work to resolve some of the greatest challenges facing humanity. Our range of services and solutions draw on five key technologies: Computing, Networks, AI, Data & Security, and Converging Technologies, which we bring together to deliver sustainability transformation. Fujitsu Limited (TSE:6702) reported consolidated revenues of 3.7 trillion yen (US$26 billion) for the fiscal year ended March 31, 2024 and remains the top digital services company in Japan by market share. Find out more:

Press Contacts

Fujitsu Limited
Public and Investor Relations Division

All company or product names mentioned herein are trademarks or registered trademarks of their respective owners. Information provided in this press release is accurate at time of publication and is subject to change without advance notice.

Date: 17 May, 2024
City: Kawasaki, Japan
Company: Fujitsu Limited
Top of Page