Word Sense Disambiguation with Reasoning using "deshanksuman/Advance_Reasoning_for_Verb_WSD".

This approach is focused on syntactic and Semantic reasoning.

Hyperparameter for Training

per_device_train_batch_size=4, gradient_accumulation_steps=8, warmup_steps=50, num_train_epochs=2, learning_rate=2e-4, fp16=not torch.cuda.is_bf16_supported(), bf16=torch.cuda.is_bf16_supported(), logging_steps=10, optim="adamw_torch", weight_decay=0.01, lr_scheduler_type="linear", seed=3407

This is developed by Deshan Sumanathilaka https://sumanathilaka.github.io

Acknowledgement

We acknowledge the support of the Supercomputing Wales project, which is part-funded by the European Regional Development Fund (ERDF) via Welsh Government.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for deshanksuman/finetunedQwen3-4B-Instruct-WSD-Verb_reasoning

Base model

Qwen/Qwen3-4B-Base

Finetuned

Qwen/Qwen3-4B

Finetuned

(1088)

this model

deshanksuman
/

finetunedQwen3-4B-Instruct-WSD-Verb_reasoning

Hyperparameter for Training

Acknowledgement

Model tree for deshanksuman/finetunedQwen3-4B-Instruct-WSD-Verb_reasoning

Dataset used to train deshanksuman/finetunedQwen3-4B-Instruct-WSD-Verb_reasoning