How Avahi and iFrameAI are using​ Amazon Nova Sonic to improve​ patient communications​

Client

iFrameAI

Location

San Francisco, California

Industry

Healthcare Technology

Services & Tech

Amazon Nova Sonic, Amazon Bedrock, AWS P5 Instances, NVIDIA H100 GPUs, Custom LLM Integration, EHR System Integration

Project Overview

Avahi, in collaboration with iFrameAI, helped a leading healthcare technology provider modernize patient communication through an AI-powered virtual assistant built on Amazon Nova Sonic and a custom medical LLM. The solution enables natural, real-time interactions between patients, staff, and insurers while automating key administrative tasks. By leveraging AWS infrastructure and advanced generative AI, the system delivers human-like voice responses, reduces call wait times, and improves overall patient engagement. 

About the
Customer

The customer is a healthcare technology company focused on creating intelligent communication solutions for hospitals and clinics. Their mission is to simplify patient engagement, streamline operations, and enhance the quality of care by integrating AI into healthcare workflows.

The
Problem

Traditional healthcare call centers struggle with scalability and personalization. Human operators can only handle a limited number of calls at once, and long hold times delay access to critical medical information. Automated phone systems, while faster, often lack empathy and contextual understanding, leaving patients frustrated. 

This communication gap
impacts patient satisfaction, staff efficiency, and hospital throughput. Without modernization, the customer risked losing patients to competitors offering faster, digital-first experiences and missing early indicators of health concerns due to fragmented communication workflows.

Why AWS

AWS provided the scalability, performance, and reliability necessary to power an advanced AI-driven voice system in a regulated healthcare environment. Services such as Amazon Bedrock and Amazon Nova Sonic allowed seamless integration of large language models and speech-to-speech capabilities with low latency and enterprise-grade security. The customer also valued AWS’s compliance certifications and ability to support massive compute workloads through GPU-optimized instances.

Avahi’s proven expertise in deploying AI and LLM solutions on AWS made it the ideal partner. As an AWS Premier Tier Services Partner with deep healthcare and AI specialization, Avahi was able to design a compliant, high-speed, and secure architecture tailored to the customer’s needs. 
 
The customer selected Avahi for its track record of successfully integrating custom models with AWS services and its hands-on approach to accelerating generative AI adoption with measurable business outcomes. 

Solution

Avahi and iFrameAI designed and implemented a custom AI-powered virtual assistant using Amazon Nova Sonic for real-time, natural conversations. The assistant connects seamlessly with EHR and hospital systems to automate insurance authorizations and deliver personalized patient instructions. 

A custom medical LLM was developed to access and interpret complete patient histories, ensuring
accurate and empathetic responses. To handle the extensive context required for medical data, Avahi engineered a model capable of processing up to 40 million tokens per minute, ten times faster than conventional models.
 

The solution
runs on 64 AWS P5 instances with 512 NVIDIA H100 GPUs, providing the computational scale to analyze years of medical data while maintaining near-instant voice response times. Amazon Nova Sonic’s expressive, low-latency speech generation allows the assistant to communicate naturally and securely with patients, while its reasoning capabilities help detect trends in patient health over time.
 

Key Deliverables

  • AI-powered virtual assistant integrated with EHR and hospital systems 
  • Custom medical LLM supporting full patient history analysis 
  • Deployment on 64 AWS P5 instances with 512 NVIDIA H100 GPUs 
  • Large context window enabling 40 million tokens per minute processing 
  • Real-time speech-to-speech interaction powered by Amazon Nova Sonic 
  • End-to-end integration with AWS Bedrock for generative AI model management 

Project
Impact

The AI assistant has transformed how hospitals communicate with patients by delivering fast, empathetic, and informed responses. It reduced administrative bottlenecks and improved patient satisfaction by ensuring that every interaction feels human, informed, and immediate. 

By unifying patient data with conversational AI, the customer achieved faster access to health information, reduced call times, and laid the foundation for proactive care through predictive trend analysis.
 

Metrics

  • Processes 40 million tokens per minute 
  • Utilizes 64 P5 instances and 512 NVIDIA H100 GPUs 
  • Achieved 10x faster data processing compared to standard models 

We highly recommend Avahi as a reliable and innovative technology partner. Their expertise in cutting-edge technologies was instrumental in building our Proof of Concept (PoC) and developing our Minimum Viable Product (MVP). Avahi consistently delivered high-quality solutions on time while maintaining a collaborative, responsive approach. They went beyond expectations by identifying opportunities for enhancement, ensuring scalability and compliance for our law enforcement-focused products. Avahi is the clear choice if you need a tech partner with industry knowledge, professionalism, and a commitment to innovation.

Brandon Puhlman

Founder, Bravo Foxtrot

Ready to Transform Your Business with AI?

Book Your Free Ignition AI Workshop

Let’s explore your high-impact AI opportunities together in a complimentary half-day session

View Our Case Studies

See how we’ve delivered measurable results for businesses like yours