Machine learning - a dhruva-sarma Collection

dhruva-sarma 's Collections

Model architecture

Computer vision

Natural Language (LLM, NLP etc)

Machine learning

Machine learning

updated Dec 20, 2024

Adam-mini: Use Fewer Learning Rates To Gain More

Paper • 2406.16793 • Published Jun 24, 2024 • 69
No More Adam: Learning Rate Scaling at Initialization is All You Need

Paper • 2412.11768 • Published Dec 16, 2024 • 43