Instructions to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="RekaAI/reka-flash-3.1-rekaquant-q3_k_s", filename="reka-flash-3.1-rekaquant-q3_k_s.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S # Run inference directly in the terminal: llama cli -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S # Run inference directly in the terminal: llama cli -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S # Run inference directly in the terminal: ./llama-cli -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
Use Docker
docker model run hf.co/RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
- LM Studio
- Jan
- Ollama
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with Ollama:
ollama run hf.co/RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
- Unsloth Studio
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RekaAI/reka-flash-3.1-rekaquant-q3_k_s to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RekaAI/reka-flash-3.1-rekaquant-q3_k_s to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for RekaAI/reka-flash-3.1-rekaquant-q3_k_s to start chatting
- Atomic Chat new
- Docker Model Runner
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with Docker Model Runner:
docker model run hf.co/RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
- Lemonade
How to use RekaAI/reka-flash-3.1-rekaquant-q3_k_s with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull RekaAI/reka-flash-3.1-rekaquant-q3_k_s:Q3_K_S
Run and chat with the model
lemonade run user.reka-flash-3.1-rekaquant-q3_k_s-Q3_K_S
List all available models
lemonade list
CoT of this model is really bad.
After thinking for 167 minutes and 42 seconds, filling my 16384 context window by 103.5%, I think it's fairly safe to say that there's definitely something wrong about the thinking process of this model. Even the AI got frustrated (and utterly lost and confused by its own thoughts) as seen in the last bit of the CoT:
Wait, no. The user's code has a typo where they wrote rightPaddleY instead of rightPaddleY.
But I'm getting too frustrated.
Final Answer: </answer> </answer> </answer>
The response just continued with endless stream of "answer" tags until it hit the stop string.
Sorry for this bad experience. Could you please tell us your prompt?
Sorry for this bad experience. Could you please tell us your prompt?
This is the prompt:
fix the following pong game code: <!DOCTYPE html><html lang="en"><head><meta charset="UTF-8"><title>Pong Game</title><style>canvas {display: block;margin: auto;background: #000;}</style></head><body><canvas id="pongCanvas" width="480" height="320"></canvas><script>const canvas = document.getElementById('pongCanvas');const ctx = canvas.getContext('2d');// Game variables and constantslet x = canvas.width / 2;let y = canvas.height - 30;let dx = 2;let dy = -2;const ballRadius = 10;const paddleHeight = 10;const paddleWidth = 75;let leftPaddleY = (canvas.height - paddleHeight) / 2;let rightPaddleY = (canvas.height - paddleHeight) / 2;const paddleSpeed = 5;let score = 0;// Create the ballfunction drawBall() {ctx.beginPath();ctx.arc(x, y, ballRadius, 0, Math.PI*2);ctx.fillStyle = "#0095DD";ctx.fill();ctx.closePath();}// Create the paddlesfunction drawPaddle(x, y) {ctx.beginPath();ctx.rect(x, y, paddleWidth, paddleHeight);ctx.fillStyle = "#0095DD";ctx.fill();ctx.closePath();}// Draw the scorefunction drawScore() {ctx.font = "16px Arial";ctx.fillStyle = "#0095DD";ctx.fillText("Score: " + score, 8, 20);}// Draw everythingfunction draw() {ctx.clearRect(0, 0, canvas.width, canvas.height);drawBall();drawPaddle(10, leftPaddleY);drawPaddle(canvas.width - paddleWidth - 10, rightPaddleY);drawScore();// Move the ballx += dx;y += dy;// Bounce off top and bottom wallsif(y + dy < ballRadius || y + dy > canvas.height - ballRadius) {dy = -dy;}// Bounce off left paddleif(x - ballRadius < 10 + paddleWidth && y > leftPaddleY && y < leftPaddleY + paddleHeight) {dx = -dx;score++;}// Bounce off right paddle (computer's paddle)if(x + ballRadius > canvas.width - 10 - paddleWidth && y > rightPaddleY && y < rightPaddleY + paddleHeight) {dx = -dx;}// Reset the ball if it goes out of bounds on the left or rightif(x + ballRadius < 0 || x - ballRadius > canvas.width) {x = canvas.width / 2;y = canvas.height - 30;}// Move the computer's paddle to follow the ballrightPaddleY += (dy > 0 ? paddleSpeed : -paddleSpeed);requestAnimationFrame(draw);}// Control the left paddle with keyboard eventsdocument.addEventListener("keydown", keyDownHandler, false);document.addEventListener("keyup", keyUpHandler, false);let rightPressed = false;let leftPressed = false;function keyDownHandler(e) {if(e.key == "Right" || e.key == "ArrowRight") {rightPressed = true;}else if(e.key == "Left" || e.key == "ArrowLeft") {leftPressed = true;}}function keyUpHandler(e) {if(e.key == "Right" || e.key == "ArrowRight") {rightPressed = false;}else if(e.key == "Left" || e.key == "ArrowLeft") {leftPressed = false;}}// Implement computer AI for right paddle (computer)function computerAI() {if(y > rightPaddleY + paddleHeight / 2 && rightPaddleY < canvas.height - paddleHeight) {rightPaddleY += paddleSpeed;} else if(y < rightPaddleY + paddleHeight / 2 && rightPaddleY > 0) {rightPaddleY -= paddleSpeed;}}// Start the gamesetInterval(computerAI, 10); // Adjust the interval for AI responsivenessdraw();</script></body></html>
