Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

tiny-aya-translate
/
tr-hi-s2st-v0.3

Audio-to-Audio
PEFT
Safetensors
Moshi
Turkish
Hindi
speech-to-speech-translation
simultaneous-translation
mimi
lora
tpu
turkish
hindi
Eval Results (legacy)
Model card Files Files and versions
xet
Community

Instructions to use tiny-aya-translate/tr-hi-s2st-v0.3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • PEFT

    How to use tiny-aya-translate/tr-hi-s2st-v0.3 with PEFT:

    Task type is invalid.
  • Moshi

    How to use tiny-aya-translate/tr-hi-s2st-v0.3 with Moshi:

    # pip install moshi
    # Run the interactive web server
    python -m moshi.server --hf-repo "tiny-aya-translate/tr-hi-s2st-v0.3"
    # Then open https://localhost:8998 in your browser
    # pip install moshi
    import torch
    from moshi.models import loaders
    
    # Load checkpoint info from HuggingFace
    checkpoint = loaders.CheckpointInfo.from_hf_repo("tiny-aya-translate/tr-hi-s2st-v0.3")
    
    # Load the Mimi audio codec
    mimi = checkpoint.get_mimi(device="cuda")
    mimi.set_num_codebooks(8)
    
    # Encode audio (24kHz, mono)
    wav = torch.randn(1, 1, 24000 * 10)  # [batch, channels, samples]
    with torch.no_grad():
        codes = mimi.encode(wav.cuda())
        decoded = mimi.decode(codes)
  • Notebooks
  • Google Colab
  • Kaggle
tr-hi-s2st-v0.3
Ctrl+K
Ctrl+K
  • 1 contributor
History: 243 commits
cataluna84's picture
cataluna84
Card: licence correction (CC-BY-NC-4.0) + lineage and code cross-links
c946e1b verified 4 days ago
  • assets
    v0.3 eval figure: training-dynamics.png 9 days ago
  • checkpoints
    checkpoints/step-1 11 days ago
  • eval
    eval results (eval/step_060000) 9 days ago
  • logs
    log snapshot step 76000 11 days ago
  • samples
    audio demo step 65000 12 days ago
  • .gitattributes
    4.34 kB
    v0.3 eval figure: see-it-learn.gif 9 days ago
  • README.md
    35.2 kB
    Card: licence correction (CC-BY-NC-4.0) + lineage and code cross-links 4 days ago