Enhanced-XR Human-Robot Interactive Collaboration for Welding Operations
About Us
WELD-E aspires to revolutionize robotic welding processes by integrating Artificial Intelligence (AI) and Extended Reality (XR) technologies. As the manufacturing industry advances toward Industry 5.0, companies face the challenge of maintaining efficiency, versatility, and productivity in a rapidly digitalizing environment. WELD-E addresses these needs by introducing an immersive, voice and vision-based AI system within an XR environment to provide real-time, remote support and monitoring for robotic welding.
How it Works
With WELD-E, experts can support welders remotely using speech recognition, multilingual translation, and natural language processing. This collaborative mixed-reality platform uses :
- Speech recognition and automated translation models (multilingual user support, seamless communications and translation)
- Natural language models and conversation agents (more natural human-machine interfacing, facilitated communications)
- A collaborative, Mixed-Reality (XR) environment (3D visualization, advanced interaction, welding operations, information modelling etc.)
- Conversation Agent (CA) : Powered by a language model specialized in welding, the CA ensures technical instructions are precisely captured and interpreted by the robot. This enhances communication and minimizes interaction errors between the expert and the robot.
- Visual Language (VL) Model with Model Deployment Optimization Tool (MDOT) : The VL model, using computer vision, interprets what the robot “sees”, detects any misalignment or risk and provides constant real-time feedback maintaining safety and quality during welding.
- Extended Reality (XR) : XR combines 3D visuals and virtual environments, allowing experts to interact with holographic welding tasks in real time. This immersive setup lets experts guide the robot with precision, enhancing accuracy and user experience.
Technologies
The WELD-E pipeline
Partners
