1. Context, definition of the problem
Earlier on, in the framework of a project to improve their training programs, and focused on search and rescue helicopter’s crews, Centro Jovellanos developed together with an Asturian start-up their first prototype based on vision technology.
The objective of the prototype was to validate a hybrid solution, physical and virtual environment, as a training tool. A non-complex emergency situation was selected to be tested, in this case, a single emergency exit manoeuvre.
Virtual reality and the hybrid prototype proved to be valuable tools to train with.
To achieve a comprehensive training of a helicopter crew, there are key elements missing in this first approach:
- The prototype was developed for a single player and does not enable a joint and coordinated training of the emergency procedures for the whole crew. The crew of the Spanish Maritime Safety Agency SAR helicopter is usually consisting of 4 or 5 members.
- The prototype does not offer trainees the possibility to see their bodies, preventing trainees from an immersive experience as well as making it almost impossible to interact with other participants and with the elements of the cabin during their practice (e.g., during the evacuation manoeuvre when using an emergency exit window, having a precise view of the body is necessary to complete the procedure correctly and safely).
Centro Jovellanos considers virtual reality as a valuable tool to be used in our training programmes but, for this specific type of training, a hybrid solution seems to be the ideal tool to reach our goals. Merging a modular realistic helicopter cabin mock-up together with a multiplayer augmented reality/mixed reality system.
Challenge definition. Description of need
The development of an augmented reality/mixed reality system that will be overlaid on top of a realistic scale model cabin of an AW139 helicopter. The objective of the system will be to offer the possibility to train the whole crew of a SAR Helicopter (4 – 5 members) on emergency and working procedures.
Jovellanos Centre will place at the start-up’s disposal, this realistic scale model of the helicopter’s cabin.
The solution must fulfil the following technical requirements:
Create a hybrid reality: Combining and integrating:
The physical reality of the user's physical surroundings, such as the cabin of the helicopter - without decorative features or textures-emergency exits, extinguisher as well as other common equipment of the cabin, with a virtual environment that will overlay a realistic environment, will put decorative features or textures to the scale model cabin as well as include other visual and sound elements, such as alarms and smoke, allowing the user to interact with and among real-world and virtual objects.
- The final solution will develop a virtual environment of the internal and external elements of the model AgustaWestland AW139 used by the Spanish Maritime Safety and Rescue Agency.
- The solution will be developed to be used by 4-5 trainees at the same. Each trainee will be distributed in different locations of the helicopter.
- The model will let each trainee interacts with the other crew members.
- The model will let each trainee interacts with physical elements of the scale model as operative emergency exits and extinguishers.
- The prototype may include an intercom and external communications system. It could be integrated or not.
- The final solution will develop an emergency landing/ ditching scenario.
- The proponent may use any technology he deems appropriate to find the solution. The use of Unity or a licensed flight simulation software will be deemed as positive.
- The solution will be based on wireless technologies.
- The solution be accessible for future improvements.
Centro Jovellanos will make available the physical elements to the developer and will be in charge of any modification needed to connect the physical elements to the virtual ones.
3. Expected outcomes:
The proponent will design the technological solution including software, specifying all the required elements and functionalities.
The solution will have a 15,000€ budget for the development of the system.
Jovellanos Centre will make available the hardware for the implementation of the prototype with their own resources or assuming the purchase of new assets up to 4.500 euros. The proponent will provide full details (brand, model, supplier and cost) of hardware that should be procured for the development of the prototype for the project.
More information about the challenge: https://www.at-virtual.eu/events/infoday-3rd-call-vision-technologies-20220228114501
Applications to this challenge are not allowed because the call is already closed.