Laika-1-3B

Laika-1-3B is a 3 billion parameter language model specialized for space science, astronomy, satellite operations, and aerospace engineering. Named after Laika, the first animal to orbit Earth, this model is designed to assist with space-related tasks and knowledge.

Model Details

Parameter Value
Architecture LlamaForCausalLM
Parameters 3B
Hidden Size 3072
Intermediate Size 8192
Attention Heads 24
Hidden Layers 28
Vocab Size 32,000
Context Length 4,096
Precision bfloat16

Intended Use

Laika-1-3B is designed for:

  • Space Science Q&A - Answering questions about astronomy, astrophysics, cosmology, and planetary science
  • Satellite Operations - Assisting with satellite communication, orbit mechanics, and mission planning
  • Aerospace Engineering - Supporting aerospace design concepts and technical discussions
  • Space Education - Explaining space-related concepts for educational purposes
  • Research Assistance - Helping with space science research and literature review

How to Use

Using Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "albertic-ai/Laika-1-3B"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto")

messages = [
    {"role": "system", "content": "You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering."},
    {"role": "user", "content": "Explain the concept of Lagrange points and their significance for space missions."}
]

input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)

outputs = model.generate(
    input_ids,
    max_new_tokens=512,
    temperature=0.7,
    top_p=0.9,
    do_sample=True,
)

response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
print(response)

Using Pipeline

from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="albertic-ai/Laika-1-3B",
    torch_dtype="auto",
    device_map="auto",
)

messages = [
    {"role": "user", "content": "What are the main challenges of interplanetary travel?"}
]

output = pipe(messages, max_new_tokens=512)
print(output[0]["generated_text"][-1]["content"])

Chat Template

Laika-1-3B uses the following chat format:

<s>### System:
You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering.

### User:
{user_message}

### Assistant:
{assistant_response}</s>

Training

Laika-1-3B was trained on a curated dataset of space science literature, including:

  • Astronomical research papers and publications
  • Satellite operations documentation
  • Aerospace engineering textbooks and materials
  • Space mission reports and technical documents
  • Educational astronomy content

Limitations

  • The model may generate plausible-sounding but incorrect information about specific space missions or technical details
  • It should not be used as a sole source for mission-critical decisions
  • Knowledge is limited to training data cutoff
  • May struggle with highly specialized or niche topics outside its training distribution
  • Not suitable for real-time satellite operations without human oversight

License

This model is released under the Apache 2.0 License.

Citation

@misc{laika-1-3b,
  title={Laika-1-3B: A Language Model for Space Science},
  author={Albertic AI},
  year={2024},
  url={https://huggingface.co/albertic-ai/Laika-1-3B}
}

Links

Downloads last month
56
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support