Together: The first app to use generative AI to complete and manage cumbersome healthcare tasks
Industry
Healthcare
Location
California, US
Timeline
12 months
Together is the first app to use generative AI to complete and manage cumbersome healthcare tasks with a mission to revolutionize how we manage our health.
The challenge
Connecting one of the most challenging industries with cutting-edge information technology can bring healthcare to a completely new level. We believe AI technology has the potential to revolutionize healthcare by improving diagnosis, developing personalized treatment plans, enhancing patient care, streamlining administrative tasks, and enabling remote care.
The idea behind Together is to help complete everyday healthcare tasks and to provide an effective way to achieve optimal health with a range of powerful tools and features. The app uses generative AI to complete and manage cumbersome healthcare tasks like scanning and tracking medications, measuring and sharing vitals, managing doctors and pharmacies, and getting actionable insights for better health outcomes. Using AI-powered features like facial recognition, optical character recognition, and algorithmic personalization the app provides tracking and monitoring of health metrics and enables more effective care with personalized recommendations and insights.
The solution
Together is an innovative healthcare app that is set to transform the way patients manage their healthcare journey. The app helps patients and caregivers manage their medications, appointments, refills, doctors, and more just by using their smartphone camera and voice, eliminating the need for typing. Serving as a centralized care platform, Together streamlines several tasks like making appointments with the doctor, automatically calling in refills, and determining the preventive checks that users are likely to need by taking pictures of patients’ bill pottles. Additionally, the Together app eliminates the need for paperwork that is still prevalent in healthcare today. By helping adults follow their care plans for better health, Together provides peace of mind to caregivers and empowers healthcare services with important, real-time information.
The Together app is a shared platform with the concept of inviting loved ones to manage their health together. The app offers a unique collaborative experience where users can connect, support, and motivate each other, all while seamlessly tracking their health journeys. With the idea of inviting and sharing health information, the app helps users stay accountable for their health goals and allows them to set and track health goals together. Moreover, the app ensures medication adherence by offering timely reminders and robust tracking features, making it particularly beneficial for couples managing multiple medications or those who might find it challenging to remember their medication schedules. One of Together’s core features is the Smart Pill Botle Scanner – the innovative way of gathering information about medications by scanning the bottle with the phone camera. It eliminates the need for manual data entry; instead, users simply scan medication bottles using their phone’s camera, and the app automatically logs all the essential details.
Smart Pill Bottle Scanner: Simplifying Medication Tracking
Using a single photo of a prescription bottle, the app can detect the doctor’s name and contact information, the pharmacy the patient uses, the correct dosage of the medication, the date that refills are due, and any precautionary advice. Based on the prescription information, Together may make preventive care suggestions or recommendations.
“We specifically made it so that there is no data entry. That was the entire idea — that you could just scan your pill bottle and we could learn all about you.”
Together by Renee co-founder and Chief Strategy Officer Dr. Renee Dua
Beyond filling prescriptions, the app also serves as a place to store the user’s healthcare provider information, so that individuals can easily access each doctor’s contact information and prescribed medications. One of the key benefits of the app is personalized recommendations and insights based on individual health data and goals helping users make informed decisions about their health and take proactive steps to improve their health outcomes. The Together app uses data from your medications, vitals, and physical attributes to empower its AI-driven recommendations. These insights go beyond just health tips, offering suggested routines and even guidance on preventive exams to ensure that every individual receives personalized health advice tailored to their unique needs.
Using advanced facial recognition technology to measure vitals
The app uses smartphone camera-based selfies that patients take to measure movements and changes in the color and size of blood vessels in the face and eyes. It applies artificial intelligence algorithms to determine blood pressure, heart rate, and oxygen levels. By simply looking at their smartphone cameras, end-users can measure and track vital signs and get personalized recommendations to improve their preventive healthcare.
Depression and anxiety symptoms detection using voice
Using voice analysis, the app provides essential information to help identify potential concerns related to anxiety or depression. Through a simple interaction where the user speaks into their microphone, the app measures parameters such as speech smoothness, liveliness, control, and energy range in the user’s voice, offering valuable insights into mental vitals.
“The AI behind Together positions all the information inside the bigger picture. That’s the beauty of AI, this data all has to be put in context — not just what’s going on with the patient, but also for caregivers who are dealing with the health issues of loved ones.”
Together by Renee co-founder and CEO Nick Desai