Multimodal Transformer

A transformer-based model that integrates representations from more than one kind of input, such as text, audio and video, so that relationships within and across modalities can inform a prediction.

English

Arabic

المحول متعدد الوسائط

First appeared in

AI Read Short Stress Stories to Separate Two Healthcare-Worker Profiles

Longitudinal Clustering Facial Expression Embedding Acoustic Embedding Area Under the Receiver Operating Characteristic Curve Cloud Account Takeover Origin-Bound Authentication

Multimodal Transformer

More terms