Computer Vision AI: A Message from Mike
Video
A Message from Caregility President and COO Mike Brandofino
Read the Press Release here:
Caregility Releases First Edge-Based Computer Vision AI Capability for Healthcare
Artificial Intelligence (AI) is steadily becoming a part of our everyday lives. From self-driving cars to targeted social media ads, AI is revolutionizing nearly every industry. Healthcare is no exception. At Caregility, we value AI as a tool that is capable of reducing errors, supporting clinicians, and keeping patients safe. We also recognize that AI is not without its limitations and cannot replace the experience, compassion, and empathy of professional healthcare workers.
The healthcare industry is no stranger to incorporating technology to deliver groundbreaking treatments while reducing costs and improving patient outcomes. Robotic surgeries, approved in 2000, are just one example of machine learning. In recent years, AI technology has become commonplace in our smartphones, watches, and other wearable devices to monitor our vital signs, ovulation cycles, cardiac rhythms, glucose levels, and sleep patterns.
The applications in development appear limitless. The following are additional examples of AI in healthcare that are already underway, or we can expect to encounter in the near future:
These cutting-edge concepts require deep learning, a type of advanced machine learning in which AI learns and adapts from its data without human intervention. There are many layers of deep learning, where algorithms use their neural networks, which function like the human brain, to recognize patterns and predict outcomes.
AI may have the advantage of processing information much faster than the human brain, but it has yet to master the qualities of human nature and emotion. The goal is not for AI to replace the expertise of a skilled clinician but to optimize the way care teams capture and use clinical information. Still, it would be naive to underestimate the potential power of AI, given its relatively quick integration, growth, and impact. This is why we must begin the conversation about how to responsibly utilize AI without overstepping boundaries.
As advancements in AI continue, we must consider the impacts on transparency, privacy, cost, efficiency, and person-centered care. Since there is hardly anything more personal or private than our health information, we must navigate a delicate balance that keeps ethics and patient care at the forefront. According to the editorial Responsible AI in Healthcare: Opportunities, Challenges, and Best Practices, responsible AI “seeks to ensure that AI systems are developed and deployed in a manner that is ethical, fair, transparent, accountable, and beneficial to all users.”
Nurses comprise the largest component of the healthcare workforce, with over 5.2 million active nurses nationwide. Not surprisingly, nurses spend the majority of their time in direct patient care. They perform ongoing assessments, administer medications, and complete tasks at the direction of physicians. While nurses may constantly interact with patients, they report a lack of “presence,” meaning their ability to share in the human experience with patients. Nurses frequently cite increasing documentation requirements, high-acuity workloads, and staffing shortages as factors that limit quality time with patients.
This is where Caregility’s AI capabilities make a difference. By automating certain tasks, we can afford nurses the time necessary to provide compassionate, individualized care. Here are the ways we accomplish this:
Augmented Observation. One nurse can’t be everywhere. Computer vision technology acts as an extra layer of patient safety protection to detect behaviors that could result in patient injury or adverse events, such as falls, elopement, or violence. Our iObserver application incorporates remote patient sitters to observe up to 12 patients simultaneously. With two-way audio and visual and Augmented Observation capabilities, the virtual observer can intervene rapidly by redirecting the patient or sending an alert for assistance to the bedside team.
Vitals Trending. Monitoring resting heart rate, respiratory rate, and movement is crucial in evaluating a patient’s health status. In most traditional healthcare settings, vital signs are obtained at prescribed intervals or as needed, which can delay care if the patient is deteriorating. Furthermore, frequent vital sign checks can be disruptive to the patient’s rest and recovery. With Caregility’s continuous and contactless vitals monitoring, nurses can capture patient vitals continuously, review trends over time, and receive alerts when a significant change in patient condition is identified.
Vitals Scanning. Make the most of telehealth visits with virtual vital sign scanning. Facial scanning software obtains the patient’s blood pressure, heart, and respiratory rate in less than a minute to support remote clinical evaluations. This information is useful for patient follow-up visits, as well as remote monitoring in the home setting.
AI will never replace or replicate the warm touch, listening ear, or clinical judgment of a nurse. However, Responsible Health AI can transform the healthcare landscape through enhanced patient access to care and provider collaboration. The key is to develop processes that enable clinicians to work more efficiently without creating disconnection or distrust. Caregility remains committed to this goal by integrating progressive technology and innovative workflows without sacrificing excellent human-based care.
In the wake of several challenging years for healthcare, health IT conference-goers showed up at the 2024 HIMSS exhibit with renewed enthusiasm and a discerning eye on ROI.
Attendees from healthcare institutions across the globe convened in Orlando, March 3-6, to explore solutions for “creating tomorrow’s health,” as the conference theme promised. The forum offered providers an opportunity to consider future-state possibilities and fresh approaches to persistent problems like process inefficiency and staffing challenges. AI and hybrid care solutions were on tap to answer both needs.
In healthcare’s post-pandemic era, augmented intelligence and hybrid care models are bringing additional dimensions to the patient care team. The embrace of virtual care and AI at the patient bedside is redefining what we consider to be table stakes in care delivery.
Like the ViVE conference that drew healthcare stakeholders to the West Coast in the weeks prior, HIMSS24 showcased an overwhelming array of health AI innovations. As Caregility COO Mike Brandofino observed, you couldn’t walk the conference floor without bumping into an AI company.
During the conference, Brandofino sat down with HIMSS TV host Kate Milliken to dig into some of the ways health systems are using AI and hybrid care models to elevate the inpatient experience.
“The hospital room of the future is really about how you can use sensors in the room to augment information for the caregivers, thereby stretching what they can do,” said Brandofino.
“Our approach is what we call responsible AI. What we’ve done is focused on how we can enhance the information that’s getting to the caregiver. Things like vitals scanning – can we, just through an image of the patient’s face, get the blood pressure of the patient and give that to the clinician who is looking at the patient right now?”
Those solutions are closing care gaps, improving care quality for patients, and saving time for care teams. “We notify caregivers of changes that they need to pay attention to,” said Brandofino. “We don’t want to replace the caregivers. What we want to do is augment the information they have so they can spend more time maximizing their certification.”
Caregility’s “Intelligent Hospital Room of the Future” conference exhibit demonstrated ways health systems are using virtual collaboration, AI, and digital health integrations to build next-gen hybrid care models like radar-supported Virtual Nursing and computer vision-assisted Virtual Patient Observation.
Still, some providers are wary of adopting nascent technologies without proof of value and some reassurance.
As momentum builds for AI regulation on a national level, healthcare leaders are rising to meet the call for accountability within the medical field. During HIMSS24, Microsoft announced the creation of the Trustworthy & Responsible AI Network (TRAIN), “which aims to operationalize responsible AI principles to improve the quality, safety, and trustworthiness of AI in health.”
Fellow members of the TRAIN consortium include over a dozen leading health systems, OCHIN, and TruBridge. The group will share AI best practices, provide tools to enable the measurement of AI-related outcomes, and facilitate the development of “a federated national AI outcomes registry that will capture real-world outcomes related to efficacy, safety, and optimization of AI algorithms.”
As AI transparency initiatives unfold, the 2025 conference circuit could see a new system of checks and balances in place to help providers vet vendor offerings. For its part, HIMSS24 presented promising paths forward for providers keen on balancing innovation and ethics.
Author: Paul Oliver, CRO, Caregility
Some years ago, while in a discussion about technology innovation, the CIO of a world-famous healthcare institution spoke about his focus on compassionate care. That conversation struck a chord with me. At its very core, healthcare delivery is a human undertaking that is skillfully tailored to meet the needs of the individual patient. We should never lose sight of that fact. Digital health solutions must be a means to that end: delivering high-quality, compassionate, efficient, and safe patient care across the continuum of prevention, diagnosis, treatment, recovery, and follow-up. Technology must blend into the background and silently help human caregivers do their best work.
With this mission in mind, our team at Caregility is now embedding AI technologies into our proven virtual care platform to bring individualized patient care to a new level. The compassionate care belief system is a driving force as we set about that work.
We recognize the immense potential for AI in healthcare, but the consequences of getting it wrong, even in a tightly defined domain such as virtual care, could be harmful to care teams and patients. We’ve seen AI applied in broad strokes – delivering a standard set of capabilities to every patient without consideration of their individual needs. We believe that approach is a mistake, and we are committed to applying AI in a responsible way that respects the needs of individual patients and adapts accordingly.
To ensure our introduction of AI creates value for care teams and contributes to individualized patient care, we’ve embraced a few key steering principles. We believe these principles will help us stay true to our compassionate care beliefs, focus our development work, and allow us to adapt quickly as the underlying technology matures and we receive real-world feedback from our customers. Those steering principles include:
At Caregility, we are providing an optional set of AI-driven services that enhance specific virtual clinical programs, such as Virtual Nursing and Continuous Observation. As we build out these and other AI solutions, in order to adhere to our guiding principles, Caregility is employing an agile software development approach to release AI enhancements for virtual care in phases.
The initial phase is a minimum viable product (MVP) that embeds selected AI capability into our platform, delivering a targeted subset of our overall AI vision to Caregility customers and their patients. We will deploy the MVP to early field trial customers willing and able to partner closely with our clinical solutions team. Together they will provide our development team with a feedback loop that answers essential questions: Are we heading in the right direction? Is our vision for AI enhancement something that solves problems that exist in this institution, or should we adjust? Do our customers trust that this technology shows promise?
We’ll then make modifications and improvements to deliver subsequent phases, using customer feedback to drive value at every stage: Does it increase efficiency? Does it improve care quality? Does it positively impact patient and staff safety?
Our goal is to create additional value for our customers through the Caregility point-of-care telehealth systems that they have already deployed and are planning to deploy. With powerful edge computing and high-resolution cameras and microphone arrays that simultaneously support live two-way audio/video sessions and multimedia streaming, the Caregility Cloud™ platform was built with medical-grade AI integration in mind.
Each Caregility point-of-care system we deploy today is equipped with sophisticated, purpose-built microphone arrays and HD cameras that can introduce both remote clinician support and AI-enhanced monitoring to care teams. Here are a few examples that illustrate what purpose-built means:
The question we seek to answer through AI enhancement is: What tasks can AI help us automate to augment the work of care teams?
As we set out to introduce clinical AI to our virtual care platform, we’re focused on three key areas.
Computer vision enhancements will analyze patient room video streams to look for safety risks, best practice adherence, and workflow optimization opportunities. If the engine detects something that requires human intervention, our intent is to flag it for the right member of the care team. We will leverage our existing iConsult and iObserver applications as the main way to surface useful AI-driven insights to care team members, with incremental updates expected. We want insights to be actionable, not disruptive. Customer feedback from early field trials will inform our roadmap.
In the outpatient context of telehealth, we plan to extend video stream processing to virtual visits to gather patient vital signs (i.e., respiratory rate, heart rate, blood pressure, and body temperature) from facial video analysis. We’ll present this live data to the remote clinician so they can see it as part of their remote consultation.
Acoustic-based AI will listen to audio streams for patterns that can alert staff to patient stress or behavioral issues. In the inpatient context, we are researching embedded AI to identify medically relevant parts of conversations between clinical staff and patients to relieve some of the clinical note-taking burden for care teams. Ambient listening will inform structured clinical data capture for nurses to review before being documented in the EHR.
We are also working to integrate an optional radar sensor with our point-of-care devices to support contactless vitals streaming in inpatient care. Trending heart and respiratory rates over time could signal deterioration or changes in the patient’s condition. Our goal is to support personalized compassionate care and alert the appropriate clinician if vital signs diverge away from that patient’s baseline. Sepsis is a major patient safety factor in our hospitals, and we believe widespread adoption of this type of technology will help attack that problem and others.
The AI journey ramps up for Caregility in 2024, when we release our first commercial offerings addressing two of our key focus areas: Augmented Observation and Vitals Trending. We will partner closely with our early field test customers to measure the impact those solutions have on key performance indicators. Customer feedback will fuel our next wave of intelligent telehealth enhancements aimed at advancing compassionate, personalized care.
Traditionally, healthcare has been regarded as a laggard in embracing IT innovations, primarily due to the inherent complexity of care delivery and the stringent regulatory environment. However, this perception is undergoing a significant transformation. The widespread adoption of acute telehealth has played a pivotal role in this shift, providing care teams with valuable hands-on experience that has helped build trust in health technology. As a result, healthcare professionals have become more comfortable with and open to leveraging digital health tools in their daily practices.
This newfound receptivity to digital enablement has set the stage for a remarkable leap forward in the industry. This is evidenced by the recent surge of interest in artificial intelligence (AI) in healthcare. The proliferation of generative AI and the urgent need to find new solutions to the ongoing staffing crisis are further fueling interest in exploring AI’s place in clinical care.
Although headway has been made regarding operational use cases for machine learning-based AI in backend process improvements, healthcare teams are eager to identify and implement AI solutions that can enhance clinical workflows, produce more precise diagnoses, and improve patient outcomes. For the many hospitals equipped with synchronous, audio/video-based telehealth services at the bedside, infrastructure exists to introduce AI services at the point of care as well.
In the realm of virtual care, the evolution of intelligent telehealth endpoints has been remarkable. As telehealth has evolved from audio-only interactions to feature-rich video encounters, camera and microphone quality have improved to keep pace. One noteworthy development is the integration of edge computing capabilities into telehealth endpoints, enabling the support of AI applications. New multiplexing technology supports multiple cameras, allowing care teams to simultaneously support virtual patient engagement and video-based AI solutions.
In addition to high-fidelity camera and microphone arrays, new sensors such as radar technology are making their way into telehealth platforms. These sensors are capable of continuously capturing valuable clinical data while minimizing disruption to the care process. These advancements in telehealth are allowing care teams to infuse AI services such as Augmented Observation and Vitals Trending into bedside care processes, arming clinical teams with patient safety reinforcement tools that reduce pressure on staff and lead to better outcomes.
While the adoption of AI in healthcare holds immense promise, it also comes with its set of challenges and precautions.
In a recent interview with Healthcare IT Today editor John Lynn at the 2023 HLTH conference, Caregility Chief Product and Engineering Officer Kedar Ganta lauded AI’s ability to bring in ambient intelligence from audio, video, and sensor feeds, “whether it’s collecting vitals or documenting notes for the clinician.” This technology operates in the background, collecting vital patient information and supporting care processes without causing disruption.
Ganta does note, however, that amidst the excitement surrounding AI, the topics of trust and accountability often receive insufficient attention. Establishing patient and provider trust in AI systems is crucial. “This is where regulation comes into the picture,” says Ganta. “It’s a balance between over-regulating something versus promoting innovation.” Reliable data and transparency in AI solutions are essential for building trust, and the inner workings of AI algorithms should be shared with providers to enhance visibility into these factors.
Additionally, “providers should have the ability to override the AI decision” Ganta advises. Creating a regulatory framework and an independent body to oversee AI in healthcare is vital to address these concerns. As AI continues to reshape the healthcare landscape, these discussions about trust, regulation, and accountability are essential for harnessing the full potential of AI while safeguarding patient wellbeing.
As the healthcare industry continues to embrace these advancements, the future holds exciting possibilities for improved patient outcomes and experiences.
ChatGPT and a plethora of other AI-powered applications are rapidly gaining popularity in today’s tech-driven world. In healthcare, AI and machine learning algorithms are being adopted to drive efficiency in patient-facing and back-office settings alike.
One of the clinical frontiers gaining attention is the augmentation of virtual care programs with AI tools such as computer vision, ambient clinical intelligence, and contactless monitoring. By bringing these AI enhancements into virtual workflows in the inpatient setting, healthcare organizations hope to positively impact patient safety, clinical outcomes, care team experience, and operational performance.
During a recent fireside chat, Caregility President and COO Mike Brandofino sat down with Healthcare Innovation editor Mark Hagland to explore the practicality, best practices, and perils associated with selecting and adopting AI technology to advance telehealth.
AI is showing promise in clinical use cases in acute care settings where staffing shortages and burnout are prominent. As Brandofino sees it, one of AI’s biggest benefits is in “augmenting the information that a clinician or caregiver has access to with more clinical insight than they’d be able to gather on their own.” When evaluating tools, he encourages stakeholders to consider the impact: “Is it taking tasks away that can potentially save staff time? Is it a tool that adds to productivity?”
One of the AI functions Brandofino sees potential in is radar-based contactless monitoring. These tools continuously capture patient vitals such as heart rate and breathing rate, as well as track motion in the room. This allows caregivers to see trends over time.
“The AI part of that is the algorithms can detect changes in that pattern that mean something,” Brandofino explains. He offers a practical use case example. “That radar device can tell you, based on telemetry, that a patient is starting to wake up. Now think of a post-op situation where the nurses have to be there when the patient wakes up disoriented. Can you just have a contactless device notify them when the patient is starting to wake up so they can get in there then instead of sitting there for 30 minutes waiting?”
Automated, contactless vitals monitoring also accelerates the frequency and timeliness of clinical documentation.
“If you think about what happens with nurses as they do their rounds and take vital signs, many times they don’t get that information into the EHR until the end of their shift or hours later,” Brandofino notes. AI tools can gather vital signs many times throughout the day and put it through an algorithm to evaluate if the patient is getting better or worse. This allows care teams to intervene earlier and potentially improve outcomes.
Ambient clinical intelligence uses AI tools like natural language processing to draft clinical notes and reports, posing similar efficiency benefits. In care environments where resources are thin and burnout is high, those incremental time savings can add up.
As you evaluate AI solutions to bring into patient care delivery, it’s important not to become enamored with the technology before understanding where it fits into the patient care workflow. Brandofino recommends including all stakeholders—clinical, IT, and operations—in evaluations. “How are you going to support your device fleet? Consider the clinical workflow as well as the experience on the patient side.”
“Think about the operational logistics of supporting what you’re doing,” Brandofino advises. “What we suggest to our customers is to understand the impact that you’re going to have on the staff on the floor and think about what that is going to be like at scale.” Nurses are some of the most interrupted people in healthcare. The last thing you want to do is introduce new tools that add to their stress level, whether that be an overabundance of false alarms or device overload.
Given the newness of many AI tools entering the market, it’s also important to consider who you’re partnering with. Has the tool been implemented in one or two patient rooms or thousands of rooms? Are there examples of in-market success that can offer a roadmap?
By integrating AI with virtual care, healthcare organizations can modernize care delivery with innovative new tools and keep the human element of care intact. AI can drive intelligent clinical alerting, while virtual engagement channels serve as a bridge for immediate staff intervention. When combined, these resources amplify what virtual teams are capable of supporting remotely, doubling down on reducing the burdens on bedside staff.
“We believe that combining that remote nurse with smart technology to help gather telemetry in the room will be really impactful in improving care for patients in the long term,” says Brandofino. “Don’t feel like you have to put in a siloed solution just to get access to AI technology. Look for players that are capable of integrating with what you already have. If you already have high-end cameras and mics in the room with edge processing, what else can you gather in the patient room to give to caregivers?”
Ultimately, healthcare organizations that focus on applying technologies that solve real problems that exist today around the shortage of nurses, productivity, and quality of life for staff will have the most impact.
Interested in learning more about AI-enhanced hybrid care solutions?
Contact us today!
Artificial intelligence has been bandied about in the healthcare industry for years but, if the 2023 health IT tradeshow circuit is any indication, health AI may finally be entering its heyday.
The HIMSS23 conference recently wrapped up, with roughly 35,000 healthcare professionals gathering in Chicago to showcase and explore solutions aimed at improving care delivery, patient outcomes, and operational efficiency. And much like the recent ViVE conference, there was no shortage of health AI news and innovation on display:
The focus on AI is unsurprising given the explosive popularity of platforms like ChatGPT. Mainstream access to AI tools is fueling innovation across industries as stakeholders look to leverage the technology in their respective fields. For healthcare, AI is rapidly moving from hype to practical application in both clinical and operational use cases.
“AI is currently in the spotlight, with a mix of anticipation and apprehension about its potential to alleviate staffing shortages and expand care in a challenged healthcare system,” observed Caregility Chief Product and Engineering Officer Kedar Ganta, who was among those in attendance at HIMSS 2023. “While some are still struggling to grasp AI’s role beyond the buzz, others are already exploring its integration with various technologies.”
Many of the health AI solutions in and entering the market aim to help providers improve patient outcomes by supporting the early detection of patient deterioration and adverse events using things like computer vision and contactless monitoring. Health AI tools can also improve the clinician experience by adding a digital line of support to simplify tasks, for example, using ambient intelligence tools to support clinical documentation.
As Caregility President and COO Mike Brandofino put it, “AI advancements will enhance clinical insight and enable care for more patients, in spite of challenges related to limited staff resources.Nothing can replace a knowledgeable, experienced caregiver, but how much more effective can they be if we augment the information available to them? Continuous virtual observation of patients, data capture through wearables, and access to predictive algorithms that can help providers anticipate conditions affecting patient outcomes will combine to improve care.”
The potential benefits are undeniable, but health AI implementation won’t come without its challenges. An overwhelming array of innovative health AI solutions are entering the market. As healthcare organizations pilot emerging technologies, adopting health AI solutions without introducing new tech silos and solution sprawl that may congest networks will be pivotal.
In a recent interview with HIMSS TV, Brandofino touched on ways virtual care platform integration can help hospitals and health systems more easily integrate health AI solutions into clinical workflows.
“There are going to be a lot of things that come on the market – shiny new objects – and not all of it is going to work,” said Brandofino. “Our approach through our ecosystem is to show that we can integrate one system in a room with [a variety of] different AI platforms.”
In adopting a platform approach, health systems are equipped to experiment with health AI solutions in a way that leverages existing virtual care infrastructure, rather than introducing an additional framework to manage new resources that might become obsolete.
“Combining virtual care solutions and AI technology yields tremendous potential to enhance and improve a variety of clinical workflows in acute care settings,” said Pete McLain, Chief Strategy Officer at Caregility. “Artificial intelligence has the potential to enhance and augment – not replace – care teams, helping them save time, capture more meaningful patient data, and support clinical decisions and interventions that lead to better care and improved patient outcomes.”
To learn more about Caregility’s AI-enhanced hybrid care solutions, contact us today.
Efforts to bring regulatory oversight and transparency to healthcare AI received a push from notable advocacy groups recently.
In October 2022, members of the Coalition for Health AI (CHAI) convened to finalize regulatory framework recommendations on the responsible use of artificial intelligence. ONC recently joined the FDA, NIH, and the White House Office of Science and Technology Policy (OSTP) as federal observers of the coalition, which counts Johns Hopkins University, Mayo Clinic, Google, and Microsoft among its members.
CHAI announced plans to share its recommendations, culled from healthcare stakeholder workshops and public feedback, by the end of the year. The organization aims to identify priority areas that require guidance to ensure equity in healthcare AI research, technology, and policy. Healthcare IT News reports that CHAI researchers are also developing an online curriculum to support standards-based training on AI development, support, and maintenance.
CHIA’s news came on the heels of the White House OSTP introducing its broader Blueprint for an AI Bill of Rights. The Blueprint identifies five guidelines for the design, use, and deployment of automated systems that seek to protect Americans, including:
The framework applies to automated systems that “have the potential to meaningfully impact the American public’s rights, opportunities, or access to critical resources or services,” including healthcare.
Clinical Decision Support (CDS) software guidance issued by the FDA in late September 2022 includes more explicit recommendations related to the use of AI in healthcare. The FDA recommends that CDS Software-as-a-Medical-Device (SaMD) solutions provide plain language descriptions of underlying algorithms, data sets, and research validation methods, including:
You can find a list of software functions this would impact here.
Each of these initiatives seeks to contribute to a more comprehensive regulatory framework for healthcare AI and offers a glimpse into what is likely ahead for the flourishing – and currently largely unregulated – field.
These tools hold tremendous potential clinically (i.e., disease prediction) and operationally (i.e., process automation). From enterprise imaging workflow support to advanced video analysis for patient fall detection, providers are eager to leverage AI to drive efficiency in care delivery. There is, however, growing awareness of the potential for bias in underlying algorithms, which can lead to health inequity.
Stakeholders are calling for transparency in healthcare AI algorithms, and rightly so. The kind of “explained AI” that CHAI, the White House, and the FDA are championing would pave the way for new regulatory frameworks that foster trust for clinicians and patients and accountability for vendors.
“Existing models of regulation are designed for ‘locked’ healthcare solutions, whereas AI is flexible and evolves over time,” notes EY GSA Life Sciences Law Leader Heinz-Uwe Dettling. “Devices may need reauthorization if the AI continues to develop in a way that deviates from the manner predicted by the manufacturer.”
The coming years will undoubtedly see friction between AI innovation and regulation. As a broader regulatory framework materializes, those who embrace algorithm transparency could benefit from proactively leading the charge to build trust between solution providers, clinical teams, and patients.
Just a few years ago, virtual sitting was being touted as one of the most important technology implementations a hospital could make to reduce costs and improve patient safety. Hospitals could install cameras into patient rooms, or make use of existing video-enabled carts, and then set up a remote monitoring center where patient sitters keep an eye on patients in multiple rooms (or even multiple facilities) all at once.
Yet such is the pace of change in information technology that even the traditional patient sitter model is now ready for a transformation. How? Enter “augmented intelligence,” commonly known as artificial intelligence, based on machine learning.
The current virtual patient observation model is a proven, cost-effective strategy to replace in-person sitters, or hospital staff who sit in rooms with patients who are at risk of harming themselves, such as when attempting to get out of bed unattended.
As Caregility’s Donna Gudmestad wrote last year:
Virtual patient observation can be used in a variety of settings but is key to helping hospitals avoid costs from fall injuries. Every year hundreds of thousands of patients fall in hospitals, with one-third resulting in serious injury. The Joint Commission estimates that, on average, a fall with injury costs $14,000, but depending on the severity of the injury, unreimbursed costs for treating a single hospital-related fall injury can be up to $30,000.
Yet the existing model also has shortcomings.
To start, these systems tend to send a high number of false alerts to the remote patient sitters. According to a study published by the Journal of Healthcare Informatics Research in 2016, medical professionals in hospitals can encounter more than 700 alarms in a single day – making it difficult to differentiate a true emergency. ECRI listed false alarms among its top 10 health technology hazards in 2020. With so many false alerts, patient sitter fatigue becomes very real and dangerous as human monitors begin to tune out alarms.
Next, the current approach to virtual sitting usually only focuses on a rectangular area around the patient bed, unable to monitor or analyze what else is in the room.
With a new generation of machine learning-enabled video analysis software paired with video monitoring technology, we have the potential to solve these core problems.
It’s important to note that nothing can replace a knowledgeable, experienced caregiver, but how much more effective can they be if we augment the information they have at their fingertips?
This is precisely where AI comes in.
AI can be applied to the video recordings taken in most hospital patient rooms to better categorize alarms related to movement in those rooms. Augmented Video Analysis (AVA) systems can provide additional information and data to hospital decision makers, resulting in more accurate warnings and alerts, among other benefits.
AVA leverages real-time video and experiential knowledge to learn what is going on in the room, and alert clinical staff if help is needed. Over time, AVA learns how to better observe not just that one patient, but all patients, everywhere. It learns continually—and it doesn’t get tired.
As mentioned, the current systems have their shortcomings. But the AVA system uses unique algorithms (or sets of rules) for the computer to follow. The algorithms can determine the severity and/or scope of the action in the room.
The more video the system receives, the more detail it can detect, and the more accurate assessment it can provide. Has the patient fallen out of bed – or just leaned over to pick something up off the floor? Did a visitor reach to hold a patient’s hand– or did they pull out an IV?
Some distinguishing features of AVA systems include:
With all this capability to observe and analyze what is going on in a room, AVA can still be configured to protect the patients’ privacy.
First, AVA de-identifies patients by blurring their faces. Second, the cameras only capture video—the software does not listen in on conversations. And third, all data is captured and stored in a secure, HIPAA compliant system.
The new generation of advanced video analysis can make use of video technology that the hospital or health system is already invested in, whether that is carts, wall-mounted video cameras, or another system.
Plus, AI can be trained on and applied to new problems identified over time, or new risks. Whatever challenge your current virtual sitting solution is facing, there is a good chance that AVA can help.
Interested in learning more about AVA? Download our whitepaper, “How Augmented Video Analysis Is Improving Patient Care— and More” now to learn how:
If 2020 was the year that health systems embraced telehealth out of necessity and then discovered its many benefits, what might 2021 and beyond hold?
For health systems looking to further improve the cost savings and other advantages of telehealth, the new horizon is augmented intelligence: or, the use of artificial intelligence (AI) tools, such as machine learning, to assist and augment the capabilities of medical teams.
These tools can help with both routine administrative tasks and higher-level work, such as diagnosis, treatment, and patient monitoring.
Below we look at just a few of the helpful augmented intelligence tools that already exist in telehealth, preview potential future applications of augmented intelligence, and advise health systems on how best to take advantage of this new era in medical innovation.
The last few years have brought to market many remote patient monitoring devices that utilize augmented intelligence, enabling both hospital care staff and physicians to focus on other tasks while knowing that their patients are being continuously evaluated.
For example, EarlySense offers a sensor that is placed under a patient’s mattress and tracks multiple data points, including heart and respiratory rates. The sensor uses AI to analyze this continuous data stream and to detect early signs of deterioration, which the care team can then correct.
Similarly, Myia collects data from at-home patients with chronic conditions and uses machine learning to surface patients needing a clinical intervention.
Somatix offers the SafeBeing system, which is a remote patient monitoring device that relies on a wearable that uses AI to monitor gestures and passively collect biofeedback data. Somatix’s cloud-based system analyzes this data in real time to provide insights and alerts, such as an increased fall risk, for the care team. Somatix’s system works well for nursing homes and long-term care facilities.
Other companies are using AI to develop a more holistic portrait of patients’ health. Recognizing that clinical care accounts for only a small percentage of a patient’s health, with social determinants of health and behavior being major factors contributing to wellness, Innovaccer developed an AI-driven social vulnerability index that helps health systems see a fuller picture of both individual and population health.
We have also seen this type of technology being used to help with administrative tasks throughout various AI healthcare workflows.
For example, natural language processing, augmented by AI, can be used not only to transcribe patient-provider conversations during phone or video visits, but to assess which were the most salient points of the interaction and worthy of further attention. The resulting notes inform the provider’s care plan and also remind the patient of what was discussed.
In addition, as the Advisory Board wrote last year, at Providence St. Joseph Health in Washington and other health systems, system administrators have deployed chatbots to screen patients and direct them to the right resources, thereby discouraging the so-called worried well from unnecessarily coming into hospitals.
The possible future applications of augmented intelligence or AI in healthcare workflows are limited only by our collective imagination.
A Government Accountability Office Report envisioned that dermatology video visits may one day involve augmented intelligent patient care that assesses the patient’s skin for lesions and assists dermatologists in detecting precancerous and cancerous growths.
In this Becker’s Health IT article, a technology and data specialist with the University of California, Irvine, predicts that in the future individuals will have a digital health “twin” made up of all the data about an individual’s health. This twin’s data will continually be updated, and augmented intelligence tools will reveal health trends and trajectories for the individual as well as suggest personalized steps to better health.
Here, at Caregility, we predict that combining augmented intelligence with wearables and two-way video will be a game changer for virtual care, specifically when it comes to remote patient monitoring. Each of these components has had varied success to date in individual use cases, but when they are combined into a comprehensive virtual platform, providers will see the greatest benefit in improving care and reducing costs.
So, how can your health system benefit from all the latest applications in augmented intelligence in telehealth and be ready when new innovations reach the market?
To build a foundation for telehealth-enabled augmented intelligence technologies, the most critical step is adopting a flexible telehealth platform, capable of integrating with third-party apps and systems. Those who don’t start planning for the coming augmented intelligence healthcare transformation now may find themselves suddenly out-smarted and out-maneuvered: not by a human competitor, but by a learning machine.
For more on trends coming in the new year and beyond, check out our latest telehealth news roundup.