project results

Project Results

PR1: DR FLEMP Guidelines: Methodology & Recommendations

The DR FLEMP Guidelines comprise an inventory of all available previous experience with MR-based training. Through comprehensive desk research and a profound literature review, best practices were identified. A survey was conducted among target groups, including learners, educators, and medical professionals, to gather insights and feedback.

The key results of PR1 include:

• Best Practice Identification: Documentation of the most effective methodologies and practices in MR-based language training.
• Survey and Analysis: Detailed findings from surveys conducted among target groups.
• Catalogue of Training Scenarios: Compilation of various training scenarios based on the research and survey data.

This guidelines document provides a thorough methodological framework and recommendations for developing mixed reality applications in foreign language education. It synthesises previous experiences and best practices in MR-based training. The guidelines were formulated through a combination of desk research, literature review, and a comprehensive survey of learners, educators, and medical professionals.

PR2: DR FLEMP Mixed Reality Testing & Demonstration Toolkit

Based on the analysis carried out in PR1, the methodical and didactical features of the future DR FLEMP App were identified and listed. The Mixed Reality Testing & Demonstration Toolkit (MRDT) was developed to showcase the potential of the technology.

Key features include:

• Technology Showcase: Demonstrates the capabilities and applications of MR and AI in language education.
• Standalone and Integrated Use: Can be used independently or alongside the main DR FLEMP App to train users in basic operational skills.

The MRDT serves as both a showcase and a practical training tool, illustrating the potential of mixed reality technology in language education. The toolkit
includes methodical and didactical features identified in PR1, allowing users to gain hands-on experience with the technology. It supports both standalone
use and integration with the main DR FLEMP App, enabling users to develop basic operational skills essential for utilising MR applications in their training
programmes.

PR3: DR FLEMP Learning Application Prototype

AI-Supported VR-Simulation Scenarios and AR-Based Exercise

Two AI-supported simulation scenarios and an AR-based exercise were developed as part of PR3. These scenarios and exercises provide immersive,
practical training experiences for users, enhancing their language skills in realistic settings.

Key components include:

• VR Simulation Scenarios: Two detailed and interactive VR scenarios designed to simulate real-life medical situations. These scenarios enable learners to practice their language skills in context, providing a realistic and engaging learning environment.

• AR-Based Exercise: An augmented reality exercise that complements the VR scenarios by offering additional interactive learning opportunities.

• AI-Based Communication Training Tool: Integration of advanced AI tools to support communication training, including:

• Voice Recognition: The AI tool can accurately transcribe spoken language, helping learners to refine their pronunciation and fluency.

• Voice-to-Text: This feature transcribes learners’ spoken input into text, allowing for a detailed analysis of language use and providing a basis for
corrective feedback.

• Text-to-Voice: Converts written text into spoken language, enabling learners to hear correct pronunciations and improve their listening skills.

• Interactive AI Communication: Powered by ChatGPT, this tool provides real-time interactive communication practice, enabling learners to engage in
simulated conversations with virtual patients and receive immediate feedback and corrections.

These application provides realistic and interactive training experiences, simulating real-world medical environments and helping learners to develop and
apply language skills in context. The AR-based exercise complements the VR scenarios by offering additional layers of interactivity and engagement, further enhancing the learning experience. The integration of AI-powered tools ensures that learners receive comprehensive language training,
addressing both their spoken and written communication needs.

PR4: DR FLRMP Training Course

The Training Course was compiled based on the materials obtained during the project implementation. Its purpose is to equip educators and learners with the necessary knowledge to integrate MR-based training solutions into their teaching or learning practices.

Key elements of the training course include:

• Comprehensive Curriculum: A  covering all aspects of MR-based language training.

• Practical Implementation Guidance: Detailed instructions and guidelines for effectively integrating MR technology into educational practices.

The training course offers a helpful educational resource for integrating MR-based training solutions into teaching and learning practices. Drawing on the materials and insights gained during the project, the course provides detailed guidance on adopting and implementing MR technology in language
education. It is designed to support educators and learners in mastering the use of MR applications, ensuring that they can effectively utilise these
advanced tools to improve