Semantic Web and Creative AI -- A Technical Report from ISWS 2023

2025-01-30

AI Summary

This study addresses critical challenges in large language models (LLMs)—namely, knowledge verifiability, interpretability, and collaborative creativity—by bridging the semantic web and generative AI. Methodologically, it pioneers a systematic integration of semantic web technologies (RDF/OWL, nanopublications, scientific knowledge graphs) with LLMs and multimodal generative models, introducing three novel paradigms: commonsense prototyping, conceptual fusion, and implicit knowledge elicitation, underpinned by a personal knowledge graph–driven prompt engineering and commonsense reasoning framework. Contributions include: (1) ten original research proposals applied to domains including legal compliance, human-AI co-narration, algorithmic composition, and art criticism; (2) empirical validation of LLMs as interpretable knowledge engineering assistants; and (3) advancement of deep integration between factual knowledge and creative expression—paving the way for decentralized, commonsense-driven, multimodal next-generation AI systems.

Technology Category

• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: (Large) Language Models
• Cognitive Modeling & Cognitive Systems: Computational Creativity

Application Category

• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation

Abstract

The International Semantic Web Research School (ISWS) is a week-long intensive program designed to immerse participants in the field. This document reports a collaborative effort performed by ten teams of students, each guided by a senior researcher as their mentor, attending ISWS 2023. Each team provided a different perspective to the topic of creative AI, substantiated by a set of research questions as the main subject of their investigation. The 2023 edition of ISWS focuses on the intersection of Semantic Web technologies and Creative AI. ISWS 2023 explored various intersections between Semantic Web technologies and creative AI. A key area of focus was the potential of LLMs as support tools for knowledge engineering. Participants also delved into the multifaceted applications of LLMs, including legal aspects of creative content production, humans in the loop, decentralised approaches to multimodal generative AI models, nanopublications and AI for personal scientific knowledge graphs, commonsense knowledge in automatic story and narrative completion, generative AI for art critique, prompt engineering, automatic music composition, commonsense prototyping and conceptual blending, and elicitation of tacit knowledge. As Large Language Models and semantic technologies continue to evolve, new exciting prospects are emerging: a future where the boundaries between creative expression and factual knowledge become increasingly permeable and porous, leading to a world of knowledge that is both informative and inspiring.

Problem

• Semantic Web
• Creative Artificial Intelligence
• Large Language Models

Innovation

• Semantic Web
• Creative Artificial Intelligence
• Large Language Models