Search and rescue is a critical role and it has largely been done in the same way for hundreds of years – using unaided visual search to find objects in the water.
A team from RAAF Base Amberley’s Air Mobility Group, 35 Squadron have taken part in a collaboration between the Air Force’s Plan Jerico and Warfare Innovation Navy Branch.
AI-Search, Defence’s Artificial Intelligence (AI) prototype to transform airborne search and rescue, is now in its second phase of development.
A C-27J Spartan sortie from RAAF Amberley off the coast of Stradbroke Island, with the assistance of the Australian Volunteer Coast Guard, helped evaluate the AI-Search algorithm to recognise a life raft and other waterborne vessels.
This sortie was the second of several phases to develop and evaluate this proof of concept.
The AI-Search algorithms are being developed by budding machine learning expert, Lieutenant Harry Hubbert from the Warfare Innovation Navy Branch.
“During the sortie, we had a few GoPro sensors rigged up to detect a life raft and two algorithmic approaches working together to increase accuracy and the likelihood of a detection,” Lieutenant Hubbert said.
“This sortie was pretty challenging as the life raft was upside down, making it harder to see for both the human eye and the AI-Search sensors.
“The sensors are trained to detect an orange top, rather than a black top, but the AI-Search still had a 70 per cent detection rate, compared to the human detection rate of around 50 per cent.
“The 30 per cent AI-Search non-detections happened when there was low contrast between dark water and the black underside of the life raft, and the good news is that we had no false positives.”
Flying Officer Katherine Mitchell, piloting the aircraft as part of a search and rescue training exercise said that it was hard to see the upside-down life raft.
“We barely saw it 50 per cent of the time,” Flying Officer Mitchell said.
“AI-Search is already picking up more than what we are seeing, it’s incredible and it doesn’t get fatigued.”
Wing Commander Michael Gan, Plan Jericho’s AI lead said that they are now taking their learnings, finding the strengths and weaknesses, and iterating the next version.”
“The next phase will involve testing different sensor and processor combinations in a range of environmental conditions, with the potential of testing on a range of aircraft, including UAS,” Wing Commander Gan said.
To join Jericho’s Air Force accelerator program, EDGY Air Force, and turn a game-changing idea into a joint force edge. Submit ideas to [email protected] or visit airforce.gov.au/EDGY.
Read also:
