DEV Community

Cover image for HealthifAI โ€” ๐˜š๐˜ฆ๐˜ข๐˜ฎ๐˜ญ๐˜ฆ๐˜ด๐˜ด ๐˜๐˜ฆ๐˜ข๐˜ญ๐˜ต๐˜ฉ๐˜ค๐˜ข๐˜ณ๐˜ฆ ๐˜ด๐˜ฐ๐˜ญ๐˜ถ๐˜ต๐˜ช๐˜ฐ๐˜ฏ๐˜ด ๐˜ง๐˜ฐ๐˜ณ ๐˜—๐˜ณ๐˜ฐ๐˜ท๐˜ช๐˜ฅ๐˜ฆ๐˜ณ๐˜ด ๐Ÿฅโš•๏ธ
Pratyay Banerjee
Pratyay Banerjee

Posted on • Updated on

HealthifAI โ€” ๐˜š๐˜ฆ๐˜ข๐˜ฎ๐˜ญ๐˜ฆ๐˜ด๐˜ด ๐˜๐˜ฆ๐˜ข๐˜ญ๐˜ต๐˜ฉ๐˜ค๐˜ข๐˜ณ๐˜ฆ ๐˜ด๐˜ฐ๐˜ญ๐˜ถ๐˜ต๐˜ช๐˜ฐ๐˜ฏ๐˜ด ๐˜ง๐˜ฐ๐˜ณ ๐˜—๐˜ณ๐˜ฐ๐˜ท๐˜ช๐˜ฅ๐˜ฆ๐˜ณ๐˜ด ๐Ÿฅโš•๏ธ

Category Submission:

  • Wacky Wildcard ๐Ÿƒ
  • Smooth Shifters ๐ŸŒฌ๏ธ

What we built ๐Ÿค—

HealthifAI is a smart Web application built to provide Seamless Healthcare solutions for Providers & is fueled by Linode. ๐Ÿฅโš•๏ธ

Creators :

Inspiration ๐Ÿ’ก

Healthcare is one of the most important and critical industries in the world. Providing quality medical care to patients is essential, but it is often hindered by various challenges such as overburdened healthcare workers, lack of medical devices in rural areas, and administrative stress.

image

With the advent of artificial intelligence and machine learning, the healthcare industry has a unique opportunity to tackle these challenges head-on and revolutionize the way medical care is delivered.

With this as context, we plan to tackle the Provider Shortage & Burnout and Access to Care strategic themes.

image

What it does ๐Ÿค”

HealthifAI aims to tackle several key pain points in the healthcare industry โ€” specifically for the following :

Provider Shortage & Burnout :

  • Intuitive, easy & safe digital patient record entry which eliminates the need for manual and legacy record entry methods.
  • We provide an ML-powered "soft diagnosis" to save time for doctors and nurses.
  • We have location-based COVID-19 alerts to better equip workers.
  • Multilingual speech-to-text notes, because it's easier!
  • Reminder system to help with medication/check-ups. Keeping track of everything is hard!

Group 30

Access to care :

  • Multilingual communication model that transcribes speech from any language into English. This is particularly helpful in rural areas where communication is a barrier.
  • Experimental Computer-Vision powered heart rate monitor. This transforms everyday hand-held devices into medical devices - an exciting vision for the future!

App Tryout Link ๐Ÿ”—

๐Ÿ‘‰ Home : https://healthifai-with.tech [Frontend deployed on Vercel โ–ฒ & Backend deployed on Linode]

Alternate URL : http://45.79.166.94 (Hosted on Linode)

๐Ÿ“Œ Endpoint List :

image

image

image

Video โ–ถ๏ธ

Privacy & Security ๐Ÿ”

HealthifAI handles a wide range of sensitive information as healthcare data. In the wrong hands, this data could dramatically harm individuals. We took special efforts and considerations to ensure that our platform protects the privacy and sensitive information of all of our users making it 100% GDPR compliant!

How we built it โš™๏ธ

HealthifAI was built using cutting-edge AI and Machine Learning technologies, including OpenAI's whisper as well as DETR (End-to-End Object Detection) model with ResNet-50 backbone.

image

For the disease detection part, we've used a Kaggle dataset which can be found here. Our machine learning model performs extremely well in terms of disease prediction as we benchmarked an accuracy of more than 92% over a prolonged period. Based on the inference, we also return symptom severity and basic precautions in no time!

image

We used the Flask framework to build a RESTful API that can handle incoming requests and return appropriate responses. For the front-end, we used React.JS & Tailwind as CSS framework. The Authentication (OAuth) has been done by Firebase & weโ€™re also using the Cloudstore database for storing user logs. We have deployed the front-end of our Webapp on Vercel & most importantly, the backend is running on Linode.

linodedesc

The API was integrated with the Open-AI speech-to-text model "whisper" to transcribe speech from any language into English. Further, Gaussian Naive Bayes for classification was implemented to "soft diagnose" patients based on their symptoms.

image

We're also running our custom algorithm to analyse and return the heartbeat in realtime using a concept called as photoplethysmography, where we leverage a camera & with the capability of face detection, we record images of facial skin, as skin can represent changes in arterial blood volume between the systolic and diastolic phases of the cardiac cycle & then we return the ROI. The computer-vision powered heart rate monitor was built using image processing techniques built with OpenCV. In essence, the camera detects sensitive changes in the neck and forehead which is then used to infer heart rate.

image


Screenshots ๐Ÿ–ผ๏ธ

Disease Prediction Heartbeat Monitor
DPx HBx

image

Link to Source Code ๐Ÿ‘จโ€๐Ÿ’ป

GitHub logo Neilblaze / HealthifAI

HealthyfAI โ€” Crafted with ๐Ÿ’™

DevThumb

Category Submission:

  • Wacky Wildcard ๐Ÿƒ
  • Smooth Shifters ๐ŸŒฌ๏ธ

What we built ๐Ÿค—

HealthifAI is a smart Web application built to provide Seamless Healthcare solutions for Providers & is fueled by Linode. ๐Ÿฅโš•๏ธ

Inspiration ๐Ÿ’ก

Healthcare is one of the most important and critical industries in the world. Providing quality medical care to patients is essential, but it is often hindered by various challenges such as overburdened healthcare workers, lack of medical devices in rural areas, and administrative stress.

image

With the advent of artificial intelligence and machine learning, the healthcare industry has a unique opportunity to tackle these challenges head-on and revolutionize the way medical care is delivered.

With this as context, we plan to tackle the Provider Shortage & Burnout and Access to Care strategic themes.

image

What it does ๐Ÿค”

HealthifAI aims to tackle several key pain points in the healthcare industry โ€” specifically for the followingโ€ฆ

Permissive License โš–๏ธ

MIT

Why Linode?

Building scalable systems are always a tricky thing. Although our app is not serving millions of customers as of now, but as software enthusiast, we strive to build an infinitely scalable application. And here Linode helped us a lot.

image

Thanks to Linode for providing us with $100 credits! ๐Ÿ˜Š

Linode is a cloud-based virtual machine service that we used to deploy the backend of our HealthifAI project. We chose Linode because it provides a reliable and scalable hosting solution for our web application, and it also offers competitive pricing.

image

Once our virtual machine was up and running, we installed and configured the necessary softwares and other tools required for our application. We also set up security measures, including firewalls and SSL certificates, to ensure that our backend was protected from potential cyber threats.

image

Linode provided us with an easy-to-use interface to manage our virtual machine, including monitoring tools to track server performance and resource usage. It also allowed us to scale our resources up or down depending on the demands of our application.

image

Overall, using Linode allowed us to deploy a reliable and scalable backend for our HealthifAI project, without worrying about the complexities of managing our own physical servers.


Design ๐ŸŽจ

We were heavily inspired by the revised version of Double Diamond design process, a model popularized by the British Design Council, which not only includes visual design, but a full-fledged research cycle in which you must discover and define your problem before tackling your solution & then finally deploy it.

image

  1. Discover: a deep dive into the problem we are trying to solve.
  2. Define: synthesizing the information from the discovery phase into a problem definition.
  3. Develop: think up solutions to the problem.
  4. Deliver: pick the best solution and build that.

Moreover, we utilized design tools like Figma, Photoshop & Illustrator to prototype our designs before doing any coding. Through this, we are able to get iterative feedback so that we spend less time re-writing code.

image

Research ๐Ÿ“š

Research is the key to empathizing with users: we found our specific user group early and that paves the way for our whole project. Here are a few of the resources that were helpful to us โ€”

CREDITS

  • Design Resources : Freepik, Behance
  • Icons : Icons8, fontawesome
  • Font : Righteous / Roboto / Raleway

Challenges we ran into ๐Ÿ˜ค

Building HealthifAI was not without its challenges. One of our challenges was integrating the various AI and machine learning technologies into a cohesive and functional system. This required a deep understanding of each technology, as well as expertise in data processing and software engineering. We participated in hourly review sessions to share findings of distributed research - our biggest challenge was sticking to tight schedules! Moreover, we also ran into troubles while deploying the backend on Linode, but thanks to it's amazing documentation, things got sorted quite quickly!

image

We are proud of finishing the project on time which seemed like a tough task as we started working on it quite late due to other commitments. We were also able to add most of the features that we envisioned for the app during ideation. And as always, working overnight was pretty fun! :)

What's next? ๐Ÿš€

The sky's the limit for HealthifAI. We are already exploring new ways to improve and expand the platform, including incorporating new technologies and partnering with healthcare providers to bring our vision to a wider audience. We're committed to making a real impact in the healthcare industry and changing lives for the better.

Conclusion ๐Ÿฃ

That's it for now! We can't wait to see the impact that HealthifAI will have on the world. Stay tuned for updates and more exciting developments! Also, I would love to thank my project partner @subhamx for helping me, & Special thanks goes to @devencourt for resolving everyone's doubts! ๐Ÿ™Œ.

And as always, thank you #DEV #DEVCommunity & #Linode for hosting this hackathon! ๐Ÿ’š

breaker.png

Top comments (0)