Enhanced miner-information interaction to improve maintenance and safety with augmented reality technologies and new sensors (Emimsar) : final report

Emimsar was a research project whose main objective was to facilitate the work and to improve the safety of underground miners by providing them with enhanced means to access essential computer-stored information when and where they need it most. The technology selected to ease this interaction is called 'Augmented Reality', and consists of the visual superimposition of computer-generated data or images of virtual objects over images of the real scene viewed by the user. Additionally, the project has developed a condition-oriented preventive maintenance based on novel sensors on heavy duty gears of conveyors and ploughs and on drive systems with high performance chains and sprockets in AFC and plough systems, implementing an online monitoring system that provides valuable indicators of machine condition at the operational and control centre. Suitable radio-based positioning technologies were identified and evaluated to act as navigational aids in underground mines, and prototype systems were constructed. Equipment for local tracking and identification was also developed, making use of display systems and augmented-reality goggles developed within the project. A data acquisition system for plough and AFC drives was developed and put into operation. A pick force sensor for road header cutter heads has been built, tested in a coal mine and patented. Resources of KBMS dealing with the support of processes of mining machine's maintenance were developed. A diversity of software has been developed for positioning and navigation aids, for AR tools providing assistance in maintenance, repair and operator training activities, and for many other tasks.