Conectar
With ambient listening systems increasingly adopted in healthcare, analyzing clinician-patient conversations has become essential. The Omaha System is a standardized terminology for documenting patient care, classifying health problems into four domains across 42 problems and 377 signs/symptoms. Manually identifying and mapping these problems is time-consuming and labor-intensive. This study aims to automate health problem identification from clinician-patient conversations using large language models (LLMs) with retrieval-augmented generation (RAG).
Using the Omaha System framework, we analyzed 5118 utterances from 22 clinician-patient encounters in home healthcare. RAG-enhanced LLMs detected health problems and mapped them to Omaha System terminology. We evaluated different model configurations, including embedding models, context window sizes, parameter settings (top k, top p), and prompting strategies (zero-shot, few-shot, and chain-of-thought). Three LLMs—Llama 3.1-8B-Instruct, GPT-4o-mini, and GPT-o3-mini—were compared using precision, recall, and F1-score against expert annotations.
The optimal configuration used a 1-utterance context window, top k = 15, top p = 0.6, and few-shot learning with chain-of-thought prompting. GPT-4o-mini achieved the highest F1-score (0.90) for both problem and sign/symptom identification, followed by GPT-o3-mini (0.83/0.82), while Llama 3.1-8B-Instruct performed worst (0.73/0.72).
Using the Omaha System, LLMs with RAG effectively automate health problem identification in clinical conversations. This approach can enhance documentation completeness, reduce documentation burden, and potentially improve patient outcomes through more comprehensive problem identification, translating into tangible improvements in clinical efficiency and care delivery.
Automating health problem identification from clinical conversations can improve documentation accuracy, reduce burden, and ensure alignment with standardized frameworks like the Omaha System, enhancing care quality and continuity in home healthcare.
Little is known about the range and frequency of symptoms among older adult home healthcare patients with urinary incontinence, as this information is predominantly contained in clinical notes. Natural language processing can uncover symptom information among older adults with urinary incontinence to promote holistic, equitable care.
We conducted a secondary analysis of cross-sectional data collected between January 1, 2015, and December 31, 2017, from the largest HHC agency in the Northeastern United States. We aimed to develop and test a natural language processing algorithm to extract symptom information from clinical notes for older adults with urinary incontinence and analyze differences in symptom documentation by race or ethnicity.
Symptoms were identified through expert clinician-driven Delphi survey rounds. We developed a natural language processing algorithm for symptom identification in clinical notes, examined symptom documentation frequencies, and analyzed differences in symptom documentation by race or ethnicity using chi-squared tests and logistic regression models.
In total, 39,179 home healthcare episodes containing 1,098,419 clinical notes for 29,981 distinct patients were included. Nearly 40% of the sample represented racially or ethnically minoritized groups (i.e., 18% Black, 14% Hispanic, 7% Asian/Pacific Islander, 0.3% multi-racial, and 0.2% Native American). Based on expert clinician-driven Delphi survey rounds, the following symptoms were identified: anxiety, dizziness, constipation, syncope, tachycardia, urinary frequency/urgency, urinary hesitancy/retention, and vision impairment/blurred vision. The natural language processing algorithm achieved excellent performance (average precision of 0.92). Approximately 29% of home healthcare episodes had symptom information documented. Compared to home healthcare episodes for White patients, home healthcare episodes for Asian/Pacific Islander (odds ratio = 0.74, 95% confidence interval [0.67–0.80], p < 0.001), Black (odds ratio = 0.69, 95% confidence interval [0.64–0.73], p < 0.001), and Hispanic (odds ratio = 0.91, 95% confidence interval [0.85–0.97], p < 0.01) patients were less likely to have any symptoms documented in clinical notes.
We found multidimensional symptoms and differences in symptom documentation among a diverse cohort of older adults with urinary incontinence, underscoring the need for comprehensive assessments by clinicians. Future research should apply natural language processing to other data sources and investigate symptom clusters to inform holistic care strategies for diverse populations.
Knowledge of symptoms of older adult home healthcare patients with urinary incontinence can facilitate comprehensive assessments, health equity, and improved outcomes.
The healthcare industry increasingly values high-quality and personalized care. Patients with heart failure (HF) receiving home health care (HHC) often experience hospitalizations due to worsening symptoms and comorbidities. Therefore, close symptom monitoring and timely intervention based on risk prediction could help HHC clinicians prevent emergency department (ED) visits and hospitalizations. This study aims to (1) describe important variables associated with a higher risk of ED visits and hospitalizations in HF patients receiving HHC; (2) map data requirements of a clinical decision support (CDS) tool to the exchangeable data standard for integrating a CDS tool into the care of patients with HF; (3) outline a pipeline for developing a real-time artificial intelligence (AI)-based CDS tool.
We used patient data from a large HHC organization in the Northeastern US to determine the factors that can predict ED visits and hospitalizations among patients with HF in HHC (9362 patients in 12,223 care episodes). We examined vital signs, HHC visit details (e.g., the purpose of the visit), and clinical note–derived variables. The study identified critical factors that can predict ED visits and hospitalizations and used these findings to suggest a practical CDS tool for nurses. The tool's proposed design includes a system that can analyze data quickly to offer timely advice to healthcare clinicians.
Our research showed that the length of time since a patient was admitted to HHC and how recently they have shown symptoms of HF were significant factors predicting an adverse event. Additionally, we found this information from the last few HHC visits before the occurrence of an ED visit or hospitalization were particularly important in the prediction. One hundred percent of clinical demographic profiles from the Outcome and Assessment Information Set variables were mapped to the exchangeable data standard, while natural language processing–driven variables couldn't be mapped due to their nature, as they are generated from unstructured data. The suggested CDS tool alerts nurses about newly emerging or rising risks, helping them make informed decisions.
This study discusses the creation of a time-series risk prediction model and its potential CDS applications within HHC, aiming to enhance patient outcomes, streamline resource utilization, and improve the quality of care for individuals with HF.
This study provides a detailed plan for a CDS tool that uses the latest AI technology designed to aid nurses in their day-to-day HHC service. Our proposed CDS tool includes an alert system that serves as a guard rail to prevent ED visits and hospitalizations. This tool can potentially improve how nurses make decisions and improve patient outcomes by providing early warnings about ED visits and hospitalizations.
Identifying health problems in audio-recorded patient–nurse communication is important to improve outcomes in home healthcare patients who have complex conditions with increased risks of hospital utilization. Training machine learning classifiers for identifying problems requires resource-intensive human annotation.
To generate synthetic patient–nurse communication and to automatically annotate for common health problems encountered in home healthcare settings using GPT-4. We also examined whether augmenting real-world patient–nurse communication with synthetic data can improve the performance of machine learning to identify health problems.
Secondary data analysis of patient–nurse verbal communication data in home healthcare settings.
The data were collected from one of the largest home healthcare organizations in the United States. We used 23 audio recordings of patient–nurse communications from 15 patients. The audio recordings were transcribed verbatim and manually annotated for health problems (e.g., circulation, skin, pain) indicated in the Omaha System Classification scheme. Synthetic data of patient–nurse communication were generated using the in-context learning prompting method, enhanced by chain-of-thought prompting to improve the automatic annotation performance. Machine learning classifiers were applied to three training datasets: real-world communication, synthetic communication, and real-world communication augmented by synthetic communication.
Average F1 scores improved from 0.62 to 0.63 after training data were augmented with synthetic communication. The largest increase was observed using the XGBoost classifier where F1 scores improved from 0.61 to 0.64 (about 5% improvement). When trained solely on either real-world communication or synthetic communication, the classifiers showed comparable F1 scores of 0.62–0.61, respectively.
Integrating synthetic data improves machine learning classifiers' ability to identify health problems in home healthcare, with performance comparable to training on real-world data alone, highlighting the potential of synthetic data in healthcare analytics.
This study demonstrates the clinical relevance of leveraging synthetic patient–nurse communication data to enhance machine learning classifier performances to identify health problems in home healthcare settings, which will contribute to more accurate and efficient problem identification and detection of home healthcare patients with complex health conditions.
Home healthcare (HHC) enables patients to receive healthcare services within their homes to manage chronic conditions and recover from illnesses. Recent research has identified disparities in HHC based on race or ethnicity. Social determinants of health (SDOH) describe the external factors influencing a patient's health, such as access to care and social support. Individuals from racially or ethnically minoritized communities are known to be disproportionately affected by SDOH. Existing evidence suggests that SDOH are documented in clinical notes. However, no prior study has investigated the documentation of SDOH across individuals from different racial or ethnic backgrounds in the HHC setting. This study aimed to (1) describe frequencies of SDOH documented in clinical notes by race or ethnicity and (2) determine associations between race or ethnicity and SDOH documentation.
Retrospective data analysis.
We conducted a cross-sectional secondary data analysis of 86,866 HHC episodes representing 65,693 unique patients from one large HHC agency in New York collected between January 1, 2015, and December 31, 2017. We reported the frequency of six SDOH (physical environment, social environment, housing and economic circumstances, food insecurity, access to care, and education and literacy) documented in clinical notes across individuals reported as Asian/Pacific Islander, Black, Hispanic, multi-racial, Native American, or White. We analyzed differences in SDOH documentation by race or ethnicity using logistic regression models.
Compared to patients reported as White, patients across other racial or ethnic groups had higher frequencies of SDOH documented in their clinical notes. Our results suggest that race or ethnicity is associated with SDOH documentation in HHC.
As the study of SDOH in HHC continues to evolve, our results provide a foundation to evaluate social information in the HHC setting and understand how it influences the quality of care provided.
The results of this exploratory study can help clinicians understand the differences in SDOH across individuals from different racial and ethnic groups and serve as a foundation for future research aimed at fostering more inclusive HHC documentation practices.
FreshRSS 