Blue Machines AI Launches Aurora, a BFSI-Native Speech-to-Text Model That Outperforms Leading ASR Models

Blue Machines AI, an advanced agentic CX operating system for enterprises, today announced the launch of Aurora, a multilingual speech-to-text model purpose-built for the Banking, Financial Services, and Insurance (BFSI) sector.

Aurora is designed for real-time financial conversations in India, where customers frequently switch languages, combine English financial terminology with regional languages, and communicate over noisy or low-bandwidth telephone connections.

Internal benchmarking on representative BFSI sample datasets showed that Aurora achieved a Semantic Word Error Rate (WER) of 1.51% for English, 2.43% for Hindi BFSI conversations, and 5.52% across multilingual speech. It also recorded a BFSI Entity Error Rate of 4.23% for information such as monetary amounts, interest rates, policy numbers, account references and transaction IDs.

• Aurora was evaluated against leading speech-to-text models using consistent audio inputs and scoring methodology. Blue Machines AI’s internal evaluation showed that Aurora delivers higher accuracy at lower latency and is purpose-built for streaming, real-time BFSI conversations.
•  The datasets covered banking, lending, insurance, collections and customer-servicing conversations. They included Indian English, Hindi, Hinglish, multilingual and code-mixed speech, regional pronunciation patterns, background noise and telephony audio.

Unlike general-purpose speech-to-text models, Aurora is trained to understand BFSI vocabulary such as EMIs, outstanding amounts, foreclosure charges, disbursals, KYC, premiums, SIPs, NAVs, policy numbers, transaction IDs and payment dates. It is also designed to recognise the numbers, currencies, percentages and financial identifiers that drive downstream workflows.

“Aurora reflects our commitment to building sovereign AI infrastructure for Indian enterprises,” said Nirmit Parikh, Founder and CEO, Blue Machines AI. “India’s financial conversations do not happen in a single language or follow a standard script. When AI misunderstands an EMI amount, policy number or repayment commitment, it can change the customer outcome. By building Aurora in India, we are giving financial institutions speech intelligence designed for how their customers naturally communicate, while ensuring greater control over their data, models and customer interactions.”

“Building speech intelligence for BFSI requires more than generic transcription,” said Abhishek Ranjan, Chief Technology Officer at Blue Machines AI. “Aurora’s cache-aware FastConformer encoder and streaming transducer decoder enable it to retain context while processing speech incrementally. The model has been optimized for multilingual and code-mixed speech, low-latency inference and high-concurrency environments. Crucially, it is evaluated on its ability to accurately recognize the entities that drive financial workflows, not merely the surrounding sentences. In internal throughput tests, Aurora supported 960 concurrent real-time streams per H100 at a 320 ms operating point and 2,400 concurrent streams per H100 at a 1.12-second operating point.”

Blue Machines AI has also built custom training pipelines that allow Aurora to be adapted using customer-authorised enterprise data. This enables the model to learn an institution’s proprietary product names, terminology, geographies, accents and interaction patterns. Internal evaluations showed that customer-specific retraining can deliver a 40–45% relative reduction in recognition errors compared with the base model on institution-specific datasets.

Aurora integrates with Blue Machines AI’s enterprise CX AI platform to support customer journeys across acquisition, onboarding, lending, collections, servicing, insurance, claims and customer support. It can be deployed on a managed cloud, within an enterprise VPC or on-premises, enabling financial institutions to align implementations with their security, data residency and governance requirements.