R&D colleagues involved in the coordinated project SUNRISE have been very active these last weeks. Besides organising and moderating a thematic track within the FedCSIS 2024 (early September) its coordinator Aljosa Pasic (Cybersecurity team) has participated as a panelist in the round table Innovative Policies, Resilient Infrastructures at the EU-CIP Conference “Resilience Reimagined: Innovating Critical Infrastructure for Tomorrow" in Madrid.
On the other hand, Mario Triviño (Computer Vision team) has contributed a new video to the YouTube channel of the project, although not for the first time. He also attended the European Commission's Security Research Event at the beginning of 2024 on behalf of Eviden. As a presenter at the event, he introduced a SUNRISE demo video he crafted for this occasion, representing the project.
Mario explains: “Since presenting our progress at the event, we've continued to refine and enhance the functionalities we introduced, focusing on improving each module with cutting-edge models and algorithms. Notably, we've integrated other advanced open-vocabulary detection options with YOLO-world, and for Visual Question Answering (VQA), we've upgraded to LLaVA1.6 and incorporated V*Seal ideas as part of our Multimodal Language-and-Vision Models (M-LLM) approach”.
The new video was presented in Viena in November during the 2nd year review of SUNRISE.
In his LinkedIn account, Mario explains how the video showcases the versatility of the tool he's created, illustrating the way "a simple graphical interface can rearrange integrated modules and models to build more complex AI pipelines. As I’ve shared before, this solution combines Vision-Language Models VLMs (like MolmoAI, Phi3.5-Vision, etc.) for Visual Question Answering VQA tasks with open-vocabulary detectors and segmenters (GroundingDINO, SAM-HQ) or fine-tuned models (YOLOv8) for specific tasks such as detecting cracks, corrosion, or fire”.
“Here are a couple of examples of the results obtained in various inspection scenarios, such as the recent floods in Valencia or the hydroelectric facilities of one of our critical infrastructure stakeholders in Italy”.
