Xilinx unveils ML capabilities and HDMi 2.1 Versal ACAP for 8K deployment
Machine learning (ML) capabilities have been introduced by Xilinx for devices intended for the professional audio/video (Pro AV) and broadcast markets. The company has also introduced a programmable HDMI 2.1 implementation on its 7nm Versal devices.
ML capabilities including region-of-interest encoding, intelligent digital signage, automatic object tracking and window cropping, and speech recognition have been added to Xilinx’s Pro AV and broadcast devices. Customers can take implement these capabilities on Xilinx devices, including the Zynq UltraScale+ MPSoC platform, for AI edge processing. The combination of real-time audio and video processing, AV connectivity interfaces, codecs, IP networking, CPU, and GPU in an adaptable and scalable single-chip can save significant space as well as provide power and cost savings, says Xilinx.
ML is driving new usage models. Ramesh Iyer, director of Pro AV & Broadcast at Xilinx, commented: “Adding ML into Xilinx’s adaptable platforms provides a highly integrated AV processor that delivers proven support for 8K video, AV-over-IP, and compression, and now adds advanced capabilities for monetising analytics, improving workflow efficiency and enhancing usability”. It is by using these ML features, he added, that companies will increase innovation, differentiate themselves and accelerate time-to-market in region-of-interest encoding, to detect faces and features using ML and the Zynq UltraScale+ MPSoC integrated H.264/H.265 codec, for example. It can also be used in intelligent digital signage, using ML models for gender, age and gesture detection to deliver targeted, interactive advertising.
It can also be used in automated object tracking and window cropping, in switchable content at live events and in control rooms.
It can also be used in speech recognition when automatically output text from speech automates the transcription of meeting notes and language translation.
The programmable HDMI 2.1 implementation on 7nm Versal devices, allows customers to transmit, receive and process up to 8K (7680 x 4320 pixels) UHD video for HDMI 2.1’s 48Gbits per second data rates.
Xilinx explains that the 7nm Versal ACAP offers scalar, adaptable and intelligent engines in a software-programmable silicon infrastructure as well as embedded software, multi-channel AV processing pipelines, and AI inferencing. Additionally, combining real-time video processing, AV connectivity interfaces, codecs, IP networking, CPU and GPU into a single chip saves space, power, and cost, adds Xilinx.
