Basic description of the topic:
In modern operating room environments, intelligent monitoring and analysis systems are playing an increasingly important role in the automatic tracking and documentation of surgical activities. Multi-camera data acquisition enables the observation of the entire operating room space, the identification of persons, instruments and major activities, as well as the objective analysis of operating room workflows. In the long term, such systems may support the optimization of surgical processes, training, patient safety and the development of intelligent operating room assistant systems.
The candidate’s task is to develop a multi-camera machine vision-based system for the recognition of operating room activities performed in the simulated operating room environment of the Óbuda University MedTech Innovation and Education Center. The work includes the design of an appropriate camera setup, the synchronized recording of camera streams, the creation of a custom video database based on predefined operating room scenes and activities, and the application of machine learning methods for recognizing persons, instruments, activities and events. The aim of the developed system is the higher-level spatial and temporal analysis of operating room processes based on video data acquired from multiple viewpoints.
Detailed tasks:
- Literature overview in the field of operating room activity recognition, multi-camera machine vision, object tracking and workflow analysis;
- Getting acquainted with the operating room unit, instrument set and relevant surgical layouts of the MedTech Innovation and Education Center;
- Design of a multi-camera data acquisition system and camera setup in a simulated operating room environment;
- Development of a video acquisition protocol for predefined operating room scenes, roles and activities;
- Creation and annotation of a custom multi-camera video database;
- Application, and if necessary training or fine-tuning, of person, instrument and activity recognition algorithms;
- Fusion and comparison of information from multiple viewpoints and temporal tracking of operating room events;
- Development of a method suitable for the automatic recognition of operating room activities or events;
- Testing the developed system in a simulated operating room environment and evaluating the results.
Over the course of the project, the student will have the opportunity to become familiar with the research infrastructure of the Óbuda University MedTech Innovation and Education Center and the Antal Bejczy Center for Intelligent Robotics, and to get involved in the research and development activities carried out there.