Virtual reality and AI prepare healthcare professionals for the future

Cases Health

How The Simulation Crew innovates healthcare communication with avatars

Training communication skills is crucial in the healthcare sector, where effective interaction with patients has a major impact on the quality of care. The Simulation Crew, a company based in Nijmegen, the Netherlands, has developed a pioneering way to train these skills using virtual reality (VR) and artificial intelligence (AI). Their innovative approach not only helps healthcare professionals communicate better, but also prepares them for the challenges of a rapidly changing field.

From serious games to soft skill training

Started in 2017 developing serious games, The Simulation Crew decided four years ago to focus on communication and soft skill training via VR. According to co-founder Edward Bosma, there was an increasing need for effective, scalable methods to train these skills, especially in healthcare. ‘Hard skills are often already well trained with existing tools, but communication and soft skills require a more personalised and interactive approach,’ Bosma explains.

Their technology allows users to engage in realistic role-playing games via VR and avatars. This allows professionals to learn how to deal with various situations and improve their skills in a safe, controlled environment.

‘Simulating a natural conversation with both verbal and non-verbal communication is essential to really transfer skills into practice.’
- Edward Bosma, The Simulation Crew

A virtual doctor: efficiency and empathy combined

One of The Simulation Crew's most innovative projects is the development of an AI-powered virtual doctor. This digital assistant performs anamnesis before the conversation with the real doctor. The goal? Gathering valuable background information about the patient's complaints, lifestyle and concerns. This not only makes for more efficient consultations, but also gives doctors more time and space to focus on the personal aspect of care.

The project, which is currently being tested at Radboudumc, shows promising results. ‘The response from patients, including those with low literacy levels, has been very positive,’ says Dr. K. K., who is also a doctor. ‘They enjoy talking freely with the virtual doctor, which is much less stressful than filling in questionnaires,’ Bosma said.

The power of AI: natural interaction and advanced analytics

A key element of the technology is the use of AI to simulate natural conversations. The avatars respond in real time, with both verbal and non-verbal communication, such as facial expressions and body language. This AI component not only makes the interaction realistic, but also provides feedback based on the user's performance.
‘The analysis of the user's behaviour - both verbal and non-verbal - helps them better understand their own communication,’ he says. ‘This enables targeted improvements,’ Bosma says.

Challenges and future plans

While the technology has a lot of potential, there are also challenges, such as the regulations surrounding AI and MDR (Medical Device Regulation). ‘For our training tools, this is not required, but for applications like the virtual doctor it is,’ says Bosma. In addition, technical aspects, such as low latency and natural expressions of avatars, are crucial to make the experience as realistic as possible.

The Simulation Crew looks forward to further collaboration with partners such as Health Valley and AI hub Oost-Nederland to accelerate access to markets and share knowledge. Bosma stresses, ‘A network where we can share experiences and solutions around AI, such as privacy and security issues, would be hugely valuable.’

Innovating together in healthcare

With projects like the virtual doctor and their advanced communication training, The Simulation Crew shows how AI and VR can contribute to an efficient healthcare sector. Their technology not only makes communication training more accessible, but also creates a bridge between humans and technology that contributes to empathetic care.

Want to know more about innovations in AI and healthcare? On the website of AI hub Oost-Nederland, discover how companies like The Simulation Crew are shaping the future of healthcare.

Written bij Heath Valley
 

Icon