首页 > AI前沿 > Knowledge Graphs Quality Assessment in the Era of LLMs: A Conceptual Framework

Knowledge Graphs Quality Assessment in the Era of LLMs: A Conceptual Framework

arXiv自然语言 2026-10-04 03:41 3 阅读 查看原文

Knowledge Graphs (KGs) have been popularized during the last few decades and are increasingly constructed and consumed by Large Language Models (LLMs). Various applications therefore rely on KGs to provide concise, complete, accurate, faithful, fresh, and traceable answers.

However, what is the quality of those KGs? In which cases should a KG be used, and can it be trusted to ground an LLM? How might it be evaluated?

We reviewed the literature on quality assessment (QA) of data, information, linked data, KGs, and the intersection of KGs and LLMs. We extended the current state-of-the-art frameworks to a catalog of 24 quality dimensions (QDs) and various quality metrics (QMs). Furthermore, we propose a general-purpose, customizable to a domain or task, and practical QA framework for assessing the quality of KGs.