April 2, 2018

Can Xamarin and Azure Cognitive Services Improve Daily Work of a Surgeon?

BY :     April 2, 2018

Recently, Hacking Health Camp 2018 took place in Strasbourg over a period of 49 hours.  The objective of this hackathon was to build a prototype to improve healthcare.

Earlier in March, our local Innovation team met with Pr Frederic Bodin, a plastic surgeon in Strasbourg. As a part of their daily routine, he and his team of surgeons take around 5 to 10 pictures of patients’ body parts, before and after surgery and see up to 10 patients a day each. Once a week, they review patients’ pictures for the upcoming week, which can represent 100 to 200 pictures to see in less than 2 hours.

That causes several problems:

  • Pictures can be taken with different devices including personal smartphones which are not secured and doesn’t comply with medical security rules
  • It takes hours to their assistants to sort pictures into patients’ files, and it also takes a lot of time to prepare a weekly review
  • They don’t have a centralized system to store and search for pictures
  • Pictures aren’t qualified and are difficult to use and find

He first imagined a solution using a digital camera with a Wifi SD Card, thinking smartphones wouldn’t be secured enough. He also was against using cloud because of medical rules.

Three members of our local Sogeti Innovation team, Vincent Marceddu, Mohamed Zeamari and Alexis Schutzger decided to compete in the Hacking Health Camp Hackathon with Pr Bodin to help him build a solution. With the help of Julien Muller, our Microsoft Architect, they have prepared a solution based on Xamarin forms mobile app and Azure.

During the weekend, they went further validating their technical choices. They were joined by a designer, Jerome Levasseur and a BizDev, Matis Ringdal who helped market the project. Thanks to a specialized medical lawyer, they convinced Pr Bodin that Cloud solution can be used and it complies to “HDS” (French Healthcare Data Hosting rules).

Then, they imagined a 4-step process:

  • Step 1: Surgeon scan patient reference with a Xamarin form app, the picture is immediately sent to Azure
  • Step 2: Azure extract text form patient label using Vison API and send back the text information to a mobile app
  • Step 3: App detect in the Azure SQL DB if the patient’s already known, create a file if it doesn’t exist
  • Step 4: Surgeon can take body parts pictures that will automatically be added to the patient file

The last step that couldn’t be accomplished during the weekend will be to use Vision API to suggest tags to a surgeon, for example detecting an arm or chest. The main goal was to display a surgery’s tag list related to the body parts and therefore, speed up the process of indexing.

After 49 hours of work, the team won 2 prizes, a 10.000 € fund to build the project from HUS (Hospital University of Strasbourg), and a five-month coaching to build a start-up form SEMIA, local incubator.

Congratulations to the entire team for their innovative work!

 

Nicolas Couchot

About

After 5 years as a project manager for French press websites, I joined Sogeti in 2016, first as local Innovation projet manager in Strasbourg and, since 2017, as Innovation Manager for the large East Area of France. My projects are mainly internals projects that we use as training field for our consultants when they are not on assignment and as a demonstrators for our clients.

More on Nicolas Couchot.

Related Posts

Your email address will not be published. Required fields are marked *

8 + 8 =


    *Opinions expressed on this blog reflect the writer’s views and not the position of the Sogeti Group