Microsoft: Accessibilità e Generative AI - Dati sulla disabilità con FightTheStroke e ISTAT

Francesca Fedeli, Founder FightTheStroke e Alessandra Battisti, Dipartimento per la produzione statistica – Istat. 17 Gennaio 2024

Microsoft: L’Intelligenza Artificiale per l’Accessibilità: Microsoft Italia annuncia un hackathon per lo sviluppo di progetti di inclusione attraverso l’innovazione digitale

Milano, 30 novembre 2023 – In un momento di forte innovazione tecnologica, Microsoft Italia conferma il proprio impegno nel promuovere l’inclusione e l’equità sociale attraverso il digitale e annuncia l’Hackathon “AI for Inclusion”, una call to action per lo sviluppo di progettualità basate su soluzioni di AI generativa per valorizzare la diversità e promuovere una maggiore accessibilità nel mondo delle aziende e nella società.     

 I nuovi trend digitali come l’AI generativa, infatti, possono aiutare le persone con disabilità nelle comuni operazioni quotidiane, e offrire loro la possibilità di esprimere al meglio il proprio potenziale anche nella vita professionale.  

 L’annuncio è avvenuto oggi durante un evento in Microsoft House a Milano in cui Microsoft insieme ad aziende, startup, NGO e associazioni si è confrontata sul ruolo del digitale quale abilitatore di inclusione sociale in grado di valorizzare il talento e la diversità in azienda. L’evento ha visto la partecipazione di AccessiWay, Alleanza Assicurazioni (gruppo Generali), Generali, Associazione Italiana Dislessia, Capgemini, CNR, Diversity LAB, EY, FightTheStroke, FISH, Fondazione ASPHI Onlus, ISTAT, Novis Games, Politecnico di Milano, Poste Italiane, Rai-CRITS, Telepass, UICI, Unicredit e URBI, che hanno condiviso le proprie esperienze su come stanno affrontando le diverse sfide e opportunità che queste tematiche comportano.  

 Secondo un’indagine ISTAT e FightTheStroke1, in Italia il 5,2% della popolazione è composto da persone con disabilità, che hanno un tasso di occupazione del 45,6% – al di sotto della media EU del 47,3%. In questo scenario, l’AI generativa può avere un ruolo determinante perché può aiutare a colmare il mismatch tra le capacità personali e l’ambiente circostante, amplificando le abilità umane.  

 In questo contesto si inserisce l’Hackathon “AI for Inclusion”, iniziativa volta a supportare l’ideazione, la creazione e lo sviluppo di idee e progetti che facciano leva sul digitale per promuovere l’inclusione sociale e ridurre così le barriere in ambiti specifici, aperto. L’hackathon, aperto ad aziende, startup, associazioni e mondo accademico, ha l’obiettivo di mettere a sistema competenze, skill e know-how per realizzare soluzioni innovative a supporto del percorso di inclusione delle persone con disabilità.  

 Questa iniziativa rientra in un piano più ampio sviluppato da Microsoft nel corso degli anni volto a valorizzare la diversità e promuovere l’inclusione ed equità sociale: dallo sviluppo di prodotti inclusivi “by design” ovvero pensati per essere utilizzati da tutti già nella fase della loro progettazione, in una logica di Inclusive Design, fino alla recente introduzione di Microsoft Copilot, ovvero l’iniezione di AI generativa all’interno degli strumenti più diffusi per la produttività. La tecnologia si rivela infatti un potente alleato delle persone, in grado di supportarle nelle loro attività quotidiane e assottigliando le differenze.  

 Microsoft Copilot, per esempio, grazie all’uso del linguaggio naturale può facilitare di molto l’interazione con gli strumenti tecnologici di uso quotidiano, accelerando l’efficacia delle tecnologie assistive. L’AI di Microsoft, grazie all’integrazione di funzionalità come la traduzione, gli input vocali, i sottotitoli, la descrizione delle immagini può contribuire a rispondere alle diverse necessità delle persone con disabilità, permanente o temporanea.  

 “In Italia il divario occupazionale tra le persone con e senza disabilità è del 35,9%.  Le tecnologie digitali offrono opportunità uniche per ridurre questo gap, permettendo a individui con disabilità di partecipare attivamente alla società anche attraverso una completa inclusione in ambito lavorativo. Come Microsoft ci impegniamo affinché nessuno sia lasciato indietro. Con l’incontro di oggi e Microsoft Hackathon for Inclusion vogliamo sensibilizzare aziende pubbliche e private su un tema così cruciale, estendendo il dibattito e implementando progetti e iniziative concrete per consentire a tutti di esprimere il loro pieno potenziale grazie al digitale. riducendo disparità e promuovendo una partecipazione più equa a livello sociale ed economico” ha commentato Federico Suria, Direttore Divisione Enterprise Commercial. 

Microsoft Garage Wall of Fame for MirrorHR – Epilepsy Research Kit

MirrorHR – Epilepsy Research Kit

A community-led early warning system for parents of kids with epilepsy

"I have become a MirrorHR-addict: I fall asleep more calmly knowing I have a technological ally. Every night, I see the heart rate trend in real time and periodically download the data to correlate it to events, and understand if there are stressful things that worsen the picture."

– MirrorHR app user

About MirrorHR – Epilepsy Research Kit

Parents of children with epilepsy struggle with accessing data and often feel helpless in predicting seizures or ensuring their child receives care as soon as possible should one occur. To attack this problem head-on, Roberto D’Angelo, a Business Program Manager at Microsoft, and his wife, Francesca Fideli, founded the non-profit FightTheStroke.org to connect and share information with other parents with a need to monitor and quickly address seizures like those experienced by their son, Mario. 

MirrorHR, originally conceived as a platform to support members of FightThe Stroke, was created during a Microsoft Global Hackathon and nurtured through a Garage Fellowship. To use the MirrorHR app, a child wears a device much like a smartwatch. The device monitors the child’s heart rate and alerts any caregivers through the app when certain heartbeat anomalies occur, while giving to parents full control of the system and the key data to intervene, like the length of the seizure, the possibility to record a video, track emergency medications or even call the doctor. Instead of monitoring a child’s breathing and other activities at night face-to-face – disrupting sleep and more – parents can monitor from another room, but still intervene more readily and effectively. 

Key Features 

MirrorHR is an app connected to a wearable device that uses artificial intelligence from Microsoft Azure to capture, process, and monitor data such as heart rate that can alert users to telltale signs of potential seizures. The app also monitors other biometric data, sending previously unavailable insights to parents and doctors. 

In addition to nighttime monitoring through the app, self-care options like prescription logs and a video diary allow parents to easily record any potential triggers that could have increased the probability of a seizure, so that when reviewing the data with their doctor, the conversation can be data-driven, leading to a more meaningful conversation.

Video

MirrorHR by FightTheStroke and MicrosoftRoberto and Microsoft employee hackers talk about the importance of monitoring and predicting seizures and how the idea for the MirrorHR app and the hackathon prototype can help with quality of life and peace of mind.

Journey

In 2014, frustrated by sleepless nights due to their son Mario’s unpredictable epilepsy, Roberto and Francesca established FightTheStroke.

When they realized the quality of life for their son could be improved with support from an app, Roberto and Francesca conceived MirrorHR using Microsoft Azure.

The name MirrorHR was inspired by the mirroring relationship between a caregiver and a vulnerable patient. Their son was picking up on their sadness and stress, mirroring their emotions. They wanted him to instead see the best from them, their smiles and their willingness to fight for him, instead of their stress and depression.

As an employee, Roberto saw an opportunity to utilize the Microsoft Global Hackathon to make progress on the app. The Hackathon is an annual Microsoft event inviting employees to devote time to developing a new idea. Hackathon 2019 was Roberto and Francesca’s first opportunity to work on MirrorHR with a team of dedicated Microsoft hackers, and it resulted in the project winning Grand Prize and first-place in two additional categories around AI, Health, and Accessibility.

As the app developed, Roberto saw value in a residency – now known as a Garage Fellowship – with The Garage. Ed Essey, Director of Business Value, oversees the coaching of new products from conception to market. Essey worked with Roberto and the core of the project team on how to take MirrorHR to users and caregivers.

Regarding The Garage Fellowship: “The liftoff method … helped this small group of people from diverse backgrounds to quickly unite as a high-performing team. It fostered a strong connection among them based on their values, and the team always communicated openly about what mattered or what required improvement. They established a deep trust and psychological safety in each other, and they were stronger because of it.” says Essey.

Due to their success at Hackathon and growing interest from many families and doctors, the app was handed-off to the FightTheStroke Foundation that improved it further, thanks to their community, and finally made it available, completely free, in 2022. So far it has been downloaded from 36 countries across the globe, proving how big the demand is for this kind of technology and community-led approach where parents and doctors, having the deepest possible knowledge of the condition, design solutions for other parents and doctors in the same condition.

The team is still hard at work, currently looking for additional funding/sponsorship to develop it further and open it to other platforms.

Team

The 2019 Hackathon team Epilepsy Research Kit for Kids (aka MirrorHR) photographed at The Garage on the Microsoft campus in Redmond, WA.

Standing from left to right, Hackathon team members based in Redmond: Joel Gillespie, Maki Roggers, Mervin Johnsingh, Scott Kivitz, Robert Brais, Jessica Glago, Jacopo Mangiavacchi, Pritika Mehra. Kneeling/sitting from left to right: Scott Thompson, Rui Xia, Angie Maddox, Jun Taek Lee. Not pictured: Aditya Singh, Akansha Gawade, Alessandro Bigi, Aroma Mahendru, Devagnanam Jayaseelan, Elena Terenzi, Giuseppe Martinelli, Guenda Sciancalepore, Hervi Icban, Juan Sepulveda, Melike Ceylan, Michael Schmidt, Mikayla Jones, Neil Gat, Ricardo Wagner, Roberto D’Angelo, Spencer Morris. Credit: Photo by Scott Eklund/Red Box Pictures

Press

Reflecting Parents’ Love | Microsoft Unlocked

The MirrorHR Project: How A Team Of Microsoft Employees Created An Early Warning System For Kids With Epilepsy (forbes.com)

Hackathon project mirrors courage, accelerates progress in the Microsoft Garage Residency – Microsoft Garage

MirrorHR — FightTheStroke

A way to bring peace of mind — and sleep — to parents whose children suffer seizures wins Microsoft Hackathon

Microsoft on Linkedin

Microsoft Unlocked: Reflecting Parents’ Love

https://unlocked.microsoft.com/hack-the-future/

Reflecting Parents’ Love

The Science Behind

A father’s path to peace of mind

On a cold December night in 2018, Roberto D’Angelo is speeding through the streets of Milan in an ambulance. After an infinite number of sleepless nights, Roberto feels destroyed. He’s exhausted and desperate.

His son Mario is having another seizure. What can he do to really help Mario, to reduce or even prevent these life-threatening emergencies that keep him up most nights? Roberto places his hand on Mario’s heart. It’s beating very fast, like it usually does when Mario has a seizure.

A spike in heart rate could indicate the onset of a seizure.

The biggest fear of parents of children with epilepsy is that a seizure could lead to SUDEP, or sudden unexpected death in epilepsy. Roberto thinks of how he could help calm this fear for himself and other parents.

Back at home, Roberto does some research and discovers that an accelerated heart rate is often linked to the onset of a seizure. He has an idea. His son could wear a device—like a smartwatch—to track his heart rate in an app, alerting him when it surpasses a normal rate.

FightTheStroke

Mario suffered a stroke at ten days old that increased his risk of seizures. He developed epilepsy at age three, which motivated Roberto and his wife Francesca Fedeli to establish FightTheStroke Foundation in 2014.

FightTheStroke is a network for parents of children with cerebral palsy and the conditions associated with it, including epilepsy, to share information and look for crowdsourced but validated solutions.

Roberto has been with Microsoft in sales and marketing since 1998, and isn’t sure how to build an app. How could he make this happen?

Apart from the risk, it’s the fear and fact that you lose your peace of mind. You can’t sleep anymore because you’re always checking if your son is breathing.

Francesca Fedeli

Co-founder, FightTheStroke

Roberto and Francesca believe the best way to help Mario is to help everyone like him and their parents. Through FightTheStroke, they created the MirrorHR epilepsy research kit, a platform to help support the burden of seizures in families like his.

The name MirrorHR was inspired by the mirroring relationship between a caregiver and a vulnerable patient. HR indicates the heart rate variable. As they explained in this memorable TED talk, Roberto and Francesca realized Mario looked to them for guidance. He was picking up on their sadness and stress, mirroring their emotions. They wanted him to instead see the best from them, their smiles instead of their fight.

MirrorHR: The app

In January 2019, Roberto decides to make his idea of a wearable device a reality. He dives into research, but soon discovers the data needed to oversee people with epilepsy is virtually inaccessible.

“Epilepsy research, despite the 50 million people in the world who have it,” says Roberto, “has made little progress in the last 30 years. Think about the number of people who are still drug resistant.”

Part of the problem is the data is fragmented, siloed within IT systems, hospital networks, and geographies.

Roberto knows parents of children with epilepsy struggle with accessing data. They feel as helpless as he does. There is really no way to reduce the frequency of their children’s seizures, much less know when they’re about to occur. Roberto realizes he has the power to change this with his smartwatch idea.

Connecting with fellow Microsoft employees who collaborated on the Hackathon.

Hack the future

As a Microsoft employee, Roberto has the opportunity to enter the 2019 Microsoft Global Hackathon. Here, employees are encouraged to tackle projects that fuel their professional and personal passions. He recruits a team of talented people with personal experiences related to autism, strokes, and surviving cancer. Their research reveals that an app to monitor a child’s heart rate through a smartwatch could work.

I fall asleep more calmly, knowing I have a technological ally.

MirrorHR user

Roberto and his team participate in the Hackathon with the intention of winning the Grand Prize for 2019, the Health AI Hack, and the AI for Accessibility Hack Challenge. And they do! The prize includes an incubation period in the Microsoft Garage for the team to partner with FightTheStroke and PBSF, a leading medical organization in Brazil, as part of Microsoft’s Hack for Good program. This allows employees to volunteer time supporting nonprofit organizations.

Making the dream a reality

A prototype of the app and smartwatch are brought to life. When Roberto finally sees it, he knows it’s going to work. The concept is simple and it’s easy to use. Basically, a child wears a smartwatch. The device monitors the child’s heart rate and alerts their parents through an app when certain heartbeat anomalies occur. The app also monitors biometric data, sending insights to parents and doctors.

Self-care options like prescription logs and a video diary allow parents to easily upload daily occurrences and detect patterns. Azure machine learning extracts information from the videos, detecting patterns and triggers that may impact the likelihood of seizures.

“At night, I discovered that my daughter had minimal seizures that I would never have noticed. When my daughter goes to bed, she is delighted to put the watch on because then she has a lot of fun asking questions. I put a little dog as a dial that I told her guards her,” says a parent who uses the app.

Three years after winning the Hackathon, Roberto is where he wants to be, but there’s still a lot of research that needs to be done. Families around the world are beta testing the device, sending valuable data anonymously to speed development and increase its marketability. The goal is to make it simple to use and as accurate as possible.

“I have become a MirrorHR-addict: I fall asleep more calmly, knowing I have a technological ally. Every night, I see the heart rate trend in real-time and periodically download the data to calculate the average heart rate, correlate it to events, and understand if there are stressful things that worsen the picture,” says a parent who uses the app.

Roberto wants to create a movement between parents and doctors who care. His goal is to help families like his sleep well at night. So far, parents are getting more sleep, and kids love wearing a smartwatch to bed.

Visit MirrorHR to learn more about and support the project.

Working at Microsoft: empowering our people

Our mission is deeply inclusive: empower every person and every organization on the planet to achieve more. We expect each of us—no matter what our level, role or function is—to play an active role in creating environments where people of diverse backgrounds are excited to bring all of who they are and do their best work.