Instructions to use aehrc/cxrmate-rrg24 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aehrc/cxrmate-rrg24 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="aehrc/cxrmate-rrg24", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("aehrc/cxrmate-rrg24", trust_remote_code=True) model = AutoModel.from_pretrained("aehrc/cxrmate-rrg24", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,13 +6,6 @@ datasets:
|
|
| 6 |
- StanfordAIMI/interpret-cxr-test-hidden
|
| 7 |
---
|
| 8 |
|
| 9 |
-
<Gallery />
|
| 10 |
-
|
| 11 |
-
widget:
|
| 12 |
-
- text: "drawing of tintin in a shop"
|
| 13 |
-
output:
|
| 14 |
-
url: "tokens.drawio.png"
|
| 15 |
-
|
| 16 |
# CXRMate-RRG4: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generation
|
| 17 |
|
| 18 |
This is an evolution of https://huggingface.co/aehrc/cxrmate developed for the Radiology Report Generation task of BioNLP @ ACL 2024.
|
|
@@ -25,7 +18,7 @@ For this, we proposed EAST: Entropy-Augmented Self-critical sequence Training (E
|
|
| 25 |
|
| 26 |
EAST was applied to a multimodal language model with RadGraph as the reward. Other features include:
|
| 27 |
- Token type embeddings to differentiate between findings and impression section tokens, as well as image embeddings.
|
| 28 |
-
- Special tokens (`NF` and `NI`) to handle missing *findings* and *impression* sections.
|
| 29 |
- Non-causal attention masking for the image embeddings and a causal attention masking for the report token embeddings.
|
| 30 |
|
| 31 |
## Example:
|
|
|
|
| 6 |
- StanfordAIMI/interpret-cxr-test-hidden
|
| 7 |
---
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
# CXRMate-RRG4: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generation
|
| 10 |
|
| 11 |
This is an evolution of https://huggingface.co/aehrc/cxrmate developed for the Radiology Report Generation task of BioNLP @ ACL 2024.
|
|
|
|
| 18 |
|
| 19 |
EAST was applied to a multimodal language model with RadGraph as the reward. Other features include:
|
| 20 |
- Token type embeddings to differentiate between findings and impression section tokens, as well as image embeddings.
|
| 21 |
+
- Special tokens (`[NF]` and `[NI]`) to handle missing *findings* and *impression* sections.
|
| 22 |
- Non-causal attention masking for the image embeddings and a causal attention masking for the report token embeddings.
|
| 23 |
|
| 24 |
## Example:
|