A Novel Actor Dual-Critic Model for Remote Sensing Image Captioning

We deal with the problem of high inter-class similarity in reference sentences describing remote sensing data in optical remote sensing (RS) images using the notion of deep reinforcement learning. To this end, we introduce an Actor Dual-Critic training strategy where a second critic model is deployed in the form of an encoder-decoder RNN to encode the latent information corresponding to the original and generated captions. Our proposed encoder-decoder RNN guarantees high-level comprehension of images by sentence-to-image translation.

Please find the paper, poster, presentation, and code.

If you find this work useful, please cite our paper

@inproceedings{chavhan2020novel,
author    = {Ruchika Chavhan and Biplab Banerjee and Xiao Xiang Zhu and Subhasis Chaudhuri},
title     = {A Novel Actor Dual-Critic Model for Remote Sensing Image Captioning},
booktitle = {International Conference on Pattern Recognition (ICPR)},
year      = {2020}
}