Update README.md

README.md

@@ -6,9 +6,21 @@ datasets:
 - StanfordAIMI/interpret-cxr-test-hidden
 ---
 
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
+# CXRMate-RRG4
+
+This is an evolution of https://huggingface.co/aehrc/cxrmate developed for the Radiology Report Generation task of BioNLP @ ACL 2024.
+
+For this, proposed EAST: Entropy-Augmented Self-critical sequence Training (EAST). 
+EAST modifies Self-Critical Sequence Training (SCST) by adding entropy regularisation. 
+This helps maintain a higher entropy in the token distribution, 
+preventing overfitting to common phrases and ensuring a broader exploration of the vocabulary during training, 
+which is essential for handling the diversity of the radiology reports in the RRG24 datasets. 
+We apply this to a multimodal language model with RadGraph as the reward.
+ 
+Additionally, our model incorporates several other aspects. 
+We use token type embeddings to differentiate between findings and impression section tokens, as well as image embeddings. 
+To handle missing sections, we employ special tokens. 
+We also utilise an attention mask with non-causal masking for the image embeddings and a causal mask for the report token embeddings.