Summary: Broadcom, in partnership with CAMB.AI, has announced an innovative AI chipset capable of translating audio in real time directly on the device. This technology eliminates the need for cloud connectivity, enhancing privacy and reducing latency. Additionally, it offers audio descriptions of on-screen content, promising improved accessibility for users worldwide. While still in testing, this chipset aims to support over 150 languages and could soon be integrated into TVs and other gadgets.
Introducing Broadcom’s New AI Chipset
Broadcom has teamed up with CAMB.AI to develop a cutting-edge AI chipset that brings on-device audio translation to the next level. This system-on-chip (SoC) allows devices to perform translation, dubbing, and audio description tasks locally, without relying on cloud services.
How On-Device Audio Translation Works
By processing all audio translation tasks directly on the user’s device, the chipset offers ultra-low latency and enhanced privacy. This local processing also significantly reduces wireless bandwidth usage, making it efficient and user-friendly.
Audio Description for Enhanced Accessibility
One exciting feature demonstrated involves audio descriptions of visual content. In a demo using a clip from the film Ratatouille, the AI provides scene descriptions in multiple languages, accompanied by written translations on-screen. This functionality is especially beneficial for individuals with vision impairments.
What This Means for Users
Broadcom and CAMB.AI promise on-device translation support for over 150 languages. The voice model powering this technology is already in use by organizations such as NASCAR, Comcast, and Eurovision, indicating its reliability and versatility.
Current Limitations and Future Prospects
It’s important to note that the showcased demo was a carefully edited clip, and real-world performance and accuracy remain to be seen. The technology is currently in the testing phase, with no announced timeline for when these chips will be available in consumer devices like TVs. Additionally, Broadcom recently partnered with OpenAI to assist in manufacturing AI chips, highlighting its growing role in AI hardware development.
Note: If you purchase something through a link in this article, we may earn a commission.