Visual language tasks are a hot topic these days in the fields of natural language processing (NLP) and computer vision. Most existing methods are based on pretrained models that use late fusion approaches to fuse multi-modal inputs for downstream tasks.…