Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,87 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language: en
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
tags:
|
| 5 |
+
- image-classification
|
| 6 |
+
- green-ai
|
| 7 |
+
- energy-efficiency
|
| 8 |
+
- computer-vision
|
| 9 |
+
- mobilevitv3
|
| 10 |
+
- eden-framework
|
| 11 |
+
- e2am
|
| 12 |
+
- sustainable-ai
|
| 13 |
+
datasets:
|
| 14 |
+
- cifar100
|
| 15 |
+
metrics:
|
| 16 |
+
- accuracy
|
| 17 |
+
co2_eq_emissions:
|
| 18 |
+
emissions: 1.1836
|
| 19 |
+
unit: kg
|
| 20 |
+
source: Estimated via CodeCarbon (grid factor 0.475 kg CO2e/kWh)
|
| 21 |
+
hardware_used: NVIDIA GeForce GTX 1080 Ti
|
| 22 |
+
dataset_info:
|
| 23 |
+
dataset_size: "60,000 images – 100 classes (32×32 px)"
|
| 24 |
+
---
|
| 25 |
+
|
| 26 |
+
# EDEN-MobileViTv3-CIFAR-100 — *SOTA Optimized*
|
| 27 |
+
|
| 28 |
+
> **Primary KPI:** EAG (Energy-to-Accuracy Gradient) = `1.6061e-11` ΔAcc/ΔJoules
|
| 29 |
+
|
| 30 |
+
## Abstract
|
| 31 |
+
This model is part of **Project EDEN (Energy-Driven Evolution of Networks)**, implementing the **E2AM (Energy Efficient Advanced Model)** Framework. The goal is to shift AI benchmarking from pure accuracy to *Green SOTA* — maximizing predictive power per Joule consumed.
|
| 32 |
+
|
| 33 |
+
**Applied Technique:** Phase 2 – Progressive Unfreezing + AMP (E2AM SOTA)
|
| 34 |
+
|
| 35 |
+
## Profiling Environment
|
| 36 |
+
| Component | Specification |
|
| 37 |
+
|---|---|
|
| 38 |
+
| **GPU** | NVIDIA GeForce GTX 1080 Ti (11 GB VRAM, 250 W TDP) |
|
| 39 |
+
| **CPU** | Intel Xeon W-2125 (4 cores / 8 threads @ 4.00 GHz) |
|
| 40 |
+
| **RAM** | 63.66 GB System RAM |
|
| 41 |
+
| **OS** | Windows 10 |
|
| 42 |
+
| **Dataset** | CIFAR-100 — 60,000 images – 100 classes (32×32 px) |
|
| 43 |
+
|
| 44 |
+
## 🟢 Green Delta Table
|
| 45 |
+
*Comparing this model against the reference baseline (ResNet-50 equivalent)*
|
| 46 |
+
|
| 47 |
+
| Metric | ResNet50 Baseline | **MobileViTv3 (EDEN)** | Δ |
|
| 48 |
+
|---|---|---|---|
|
| 49 |
+
| Accuracy | 0.9492 | **0.9487** | `-0.05%` |
|
| 50 |
+
| Total Energy (J) | 40,102,666 | **8,970,737** | `77.63% saved` |
|
| 51 |
+
| CO₂ Emissions (kg) | 5.2913 | **1.1836** | — |
|
| 52 |
+
| **EAG Score** | — | **1.6061e-11** | ΔAcc/ΔJoules |
|
| 53 |
+
|
| 54 |
+
> A **positive EAG** means this model learns more per Joule than the baseline.
|
| 55 |
+
> A **negative EAG** indicates a trade-off where higher accuracy required more energy investment.
|
| 56 |
+
|
| 57 |
+
## E2AM Algorithm — Applied Phases
|
| 58 |
+
|
| 59 |
+
**Phase 1 – Zero-Overhead Initialization:** Dataset pre-loaded into pinned System RAM to eliminate disk I/O power spikes.
|
| 60 |
+
|
| 61 |
+
**Phase 2 – Progressive Unfreezing:** Backbone frozen for the first `E_unfreeze` epochs (only the classification head trains). At `E_unfreeze`, all layers are unfrozen and the learning rate is decayed. Gradient accumulation over N micro-batches simulates large batch sizes without proportional VRAM cost, slashing power-draw spikes.
|
| 62 |
+
|
| 63 |
+
**AMP (Automated Mixed Precision):** `torch.cuda.amp.autocast()` halves GPU memory bandwidth, reducing energy per backward pass.
|
| 64 |
+
|
| 65 |
+
**Sparse Regularisation:** L1 penalty `λ·Σ|W|` applied to trainable weights, driving dead neurons to zero and enabling future pruning.
|
| 66 |
+
|
| 67 |
+
## Training Statistics
|
| 68 |
+
| Metric | Value |
|
| 69 |
+
|---|---|
|
| 70 |
+
| Final Accuracy | 0.9487 (94.87%) |
|
| 71 |
+
| Total Energy Consumed | 8,970,737 J (2.4919 kWh) |
|
| 72 |
+
| Training Time | 13,495 s (3.75 hrs) |
|
| 73 |
+
| Estimated CO₂ | 1.1836 kg CO₂e |
|
| 74 |
+
| Training Log | `test1\eden_optimized_cifar100_custom_mobilevitv3.csv` |
|
| 75 |
+
|
| 76 |
+
## Cite This Research
|
| 77 |
+
If you use this model, please cite the **EDEN / E2AM Framework**:
|
| 78 |
+
|
| 79 |
+
```bibtex
|
| 80 |
+
@misc{eden2025,
|
| 81 |
+
title = {Project EDEN: Energy-Driven Evolution of Networks},
|
| 82 |
+
author = {EDEN Research Team},
|
| 83 |
+
year = {2025},
|
| 84 |
+
note = {Hugging Face Organization: ProjectEDEN},
|
| 85 |
+
url = {https://huggingface.co/Shanmuk4622}
|
| 86 |
+
}
|
| 87 |
+
```
|