Is it possible to display the audio/video preview in the product catalog?

No, the YITH WooCommerce Featured Audio & Video Content plugin allows you to enter an audio or video file, but it will only be visible in the product page.