Virtual–physical Integration and Consistency through mulTimodal, Open, Real-time XR

VICTOR-XR addresses Area A of HORIZON-CL4-2025-03-HUMAN-14 by establishing a European reference framework for Virtual–Physical Consistency (VPC) in Virtual Worlds (VW), advancing immersion through tightly integrated multimodal interaction across haptics, vision, speech, gaze and bio signals. The architecture comprises a closed Ground–Update–Loop that reconciles Digital Twins (DT) with real-world signals, scene-aware cognitive co-pilots that turn sensing into explainable and safe assistance, a standards-aligned middleware backbone for interoperability, and XR-native learning and assessment that convert operational data into validated competencies. Privacy, security, inclusivity and safety are embedded through ethics-by-design and SSH expertise. Pilots in automotive manufacturing, collaborative robotics and rehabilitation will demonstrate improved multimodal synchronisation with measurable gains in immersion quality, user safety, productivity and ergonomics, and clinical outcomes. The stack leverages standards and contributes to standardisation to ensure reliability, robustness and interoperability for broad adoption. The 16-partners/7-countries consortium combines leading research and technology organisations (DFKI, ETH, AALTO, POLIMI, UPV, SSSA, UJI), industrial end-users in automotive and advanced manufacturing (BREMBO, MASMEC), a major healthcare provider (VHIR), deep-tech SMEs (NEUROFAI, NEURANICS) and ecosystem actors (EITM, MADE, GVISION), balancing scientific excellence, agile innovation, industrial validation, VW alignment, and EU-wide replication capacity. Moreover, a wide, carefully selected External Advisory Board (EAB) provides independent validation and clear pathways to early adoption and scale at international level.