Can Xamarin and Azure Cognitive Services Improve Daily Work of a Surgeon?
Recently, Hacking Health Camp 2018 took place in Strasbourg over a period of 49 hours. The objective of this hackathon was to build a prototype to improve healthcare.
Earlier in March, our local Innovation team met with Pr Frederic Bodin, a plastic surgeon in Strasbourg. As a part of their daily routine, he and his team of surgeons take around 5 to 10 pictures of patients’ body parts, before and after surgery and see up to 10 patients a day each. Once a week, they review patients’ pictures for the upcoming week, which can represent 100 to 200 pictures to see in less than 2 hours.
That causes several problems:
- Pictures can be taken with different devices including personal smartphones which are not secured and doesn’t comply with medical security rules
- It takes hours to their assistants to sort pictures into patients’ files, and it also takes a lot of time to prepare a weekly review
- They don’t have a centralized system to store and search for pictures
- Pictures aren’t qualified and are difficult to use and find
He first imagined a solution using a digital camera with a Wifi SD Card, thinking smartphones wouldn’t be secured enough. He also was against using cloud because of medical rules.
Three members of our local Sogeti Innovation team, Vincent Marceddu, Mohamed Zeamari and Alexis Schutzger decided to compete in the Hacking Health Camp Hackathon with Pr Bodin to help him build a solution. With the help of Julien Muller, our Microsoft Architect, they have prepared a solution based on Xamarin forms mobile app and Azure.
During the weekend, they went further validating their technical choices. They were joined by a designer, Jerome Levasseur and a BizDev, Matis Ringdal who helped market the project. Thanks to a specialized medical lawyer, they convinced Pr Bodin that Cloud solution can be used and it complies to “HDS” (French Healthcare Data Hosting rules).
Then, they imagined a 4-step process:
- Step 1: Surgeon scan patient reference with a Xamarin form app, the picture is immediately sent to Azure
- Step 2: Azure extract text form patient label using Vison API and send back the text information to a mobile app
- Step 3: App detect in the Azure SQL DB if the patient’s already known, create a file if it doesn’t exist
- Step 4: Surgeon can take body parts pictures that will automatically be added to the patient file
The last step that couldn’t be accomplished during the weekend will be to use Vision API to suggest tags to a surgeon, for example detecting an arm or chest. The main goal was to display a surgery’s tag list related to the body parts and therefore, speed up the process of indexing.
After 49 hours of work, the team won 2 prizes, a 10.000 € fund to build the project from HUS (Hospital University of Strasbourg), and a five-month coaching to build a start-up form SEMIA, local incubator.
Congratulations to the entire team for their innovative work!
About Sogeti Labs
SogetiLabs gathers distinguished technology leaders from around the Sogeti world. It is an initiative explaining not how IT works, but what IT means for business.