首页|Image2Triplets: A computer vision-based explicit relationship extraction framework for updating construction activity knowledge graphs

Image2Triplets: A computer vision-based explicit relationship extraction framework for updating construction activity knowledge graphs

扫码查看
? 2022 Elsevier B.V.Knowledge graph (KG) is an effective tool for knowledge management, particularly in the architecture, engineering and construction (AEC) industry, where knowledge is fragmented and complicated. However, research on KG updates in the industry is scarce, with most current research focusing on text-based KG updates. Considering the superiority of visual data over textual data in terms of accuracy and timeliness, the potential of computer vision technology for explicit relationship extraction in KG updates is yet to be explored. This paper combines zero-shot human-object interaction detection techniques with general KGs to propose a novel framework called Image2Triplets that can extract explicit visual relationships from images to update the construction activity KG. Comprehensive experiments on the images of architectural decoration processes have been performed to validate the proposed framework. The results and insights will contribute new knowledge and evidence to human-object interaction detection, KG update and construction informatics from the theoretical perspective.

Computer visionExplicit relationship extractionHuman-object interaction detectionKnowledge graphZero-shot learning

Pan Z.、Su C.、Deng Y.、Cheng J.

展开 >

School of Civil Engineering and Transportation South China University of Technology

Department of Civil and Environmental Engineering The Hong Kong University of Science and Technology

2022

Computers in Industry

Computers in Industry

EISCI
ISSN:0166-3615
年,卷(期):2022.137
  • 5
  • 71