What Is Conformer-2 and How Does It Improve Speech Recognition?

TL;DR

Conformer-2 significantly enhances speech recognition, particularly for alphanumerics and proper nouns, by utilizing 1.1 million hours of training data and a noisy student-teacher training method. This model delivers better performance in various domains while also allowing users to control transcription costs through new speech thresholds. Conformer-2 is currently the default model available on Assembly AI's API.

Transcript

today we are introducing conformer 2 which is an improvement over conformer 1 in terms of speed alphanumerics and proper noun recognition and noise robustness is it gonna be a first world championship for verstappen is it going to be an eight ball championship for Lewis Hamilton where Cooper Staffing and the best news is conformer 2 is already the ... Read More

Key Insights

• 🐎 Conformer 2 outperforms Conformer 1 in speed, alphanumerics, and proper noun recognition.
• 🚂 Trained on 1.1 million hours of data with significant performance improvements across domains.
• 🧑‍🎓 Utilizes noisy student-teacher training for enhanced data quality and quantity.
• 🌍 Focuses on real-world application nuances like alphanumerics and proper noun recognition.
• 🐕‍🦺 Introduces Speech thresholds for cost control in transcription services.
• 😘 Offers seamless customer experience with system optimizations and lower latency.
• 😒 Already available on Assembly AI's API for immediate use.

Questions & Answers

Q: What are the key improvements in Conformer 2 over Conformer 1?

Conformer 2 excels in speed, alphanumerics, proper noun recognition, and noise robustness, thanks to training on 1.1 million hours of data and various system optimizations.

Q: How does Conformer 2 utilize noisy student-teacher training to enhance its models?

Noisy student-teacher training allows Conformer 2 to improve data quality and quantity through semi-supervised learning, resulting in high-quality pseudo labels and avoiding overfitting.

Q: Why is proper noun recognition essential in speech recognition models like Conformer 2?

Proper noun recognition is crucial as it determines the accuracy and meaningfulness of the transcribed speech, especially in real-world applications where the correct recognition of names and entities is vital.

Q: How does the new parameter, Speech thresholds, benefit users of Assembly AI with Conformer 2?

Speech thresholds empower users to control the cost of transcriptions by setting minimum minutes before processing, offering cost savings for various types of audio files.

Summary & Key Takeaways

• Conformer 2 surpasses its predecessor in speed, alphanumerics, proper noun recognition, and noise robustness.

• Trained on 1.1 million hours of data, it shows significant performance enhancements across various domains.

• Engineered with optimizations to lower latency and offer a seamless customer experience.