How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="microsoft/GELab-Zero-4B-preview-Sico-Evolution")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("microsoft/GELab-Zero-4B-preview-Sico-Evolution")
model = AutoModelForMultimodalLM.from_pretrained("microsoft/GELab-Zero-4B-preview-Sico-Evolution")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links
  • ๐Ÿ”ง This model is part of Sico โ€” an open-source platform for building and evolving Digital Workers, where AI agents and their human operators co-evolve through real work.
  • โญ Star the Sico repository to follow new evolved models and our model evolution pipeline โ€” this GUI agent is the first public release, with more on the way.
  • ๐Ÿ“„ Backed by our survey on agentic evolution and co-evolving humanโ€“AI systems.

GELab-Zero-4B-preview-Sico-Evolution

A 4B GUI agent fine-tuned (LoRA) from the open-source GELab-Zero-4B-preview base model on Microsoft Edge and Copilot UI trajectories. It is built with our general-purpose GUI model evolution pipeline โ€” an iterative mechanism that keeps lifting an agent's real task success rate round after round, and transfers to any GUI app.

Highlights

From 39.8% to 82.9%: Sico-Evolution achieves a dominant 82.9% Task Success Rate, a massive +43.1% absolute surge over the 39.8% base-model baseline.

Outperforms Closed-Source SOTAs: It edges out top proprietary giants like gpt-5.4 (79.7%), Claude-Opus-4.6 (81.3%), and claude-opus-4.7 (82.1%).

Vastly Exceeds Open-Source Models: It crushes leading competitors including kimi-k2.6 (62.6%) and UI-Venus-1.5-30B (61.0%).

Results

Edge / Copilot Test Cases โ€” TSR

Downloads last month
852
Safetensors
Model size
4B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for microsoft/GELab-Zero-4B-preview-Sico-Evolution

Adapters
6 models
Quantizations
2 models

Space using microsoft/GELab-Zero-4B-preview-Sico-Evolution 1