> ## Documentation Index
> Fetch the complete documentation index at: https://docs.ramalama.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Laptop

> Using RamaLama Labs container artifacts on your local machine.

Our containerized AI artifacts are OCI compatible allowing you to directly use them with docker, podman and kubernetes wherever you need them: whether the cloud, a datacenter, or your basement.
Our artifacts are regularly rebuilt, updated, and scanned for vulnerabilities to provide, the smallest, fastest, and most secure runtime possible.

<Tip>
  You can find comparisons between different images on the comparisons page of each image
  (e.g. for llama.cpp's [cuda](https://registry.ramalama.com/projects/ramalama/repositories/ramalama%2Fllamacpp-cuda-distroless) and [cpu](https://registry.ramalama.com/projects/ramalama/repositories/ramalama%2Fllamacpp-cpu-distroless)) runtimes.
</Tip>

## Quick start

<Steps>
  <Step title="Install dependencies">
    Getting started requires either Docker or Podman. We also recommend the RamaLama CLI for a streamlined experience.

    1. Install [Podman](https://podman.io/docs/installation) or [Docker](https://docs.docker.com/get-docker/)
    2. (Optional) Install [RamaLama CLI](/pages/getting_started/oss)
  </Step>

  <Step title="Run the model">
    Model images bundle both the runtime and model, providing a single runnable container.

    <CodeGroup>
      ```bash title="RamaLama" theme={"system"}
      ramalama serve --image rlcr.io/ramalama/llamacpp-cpu-distroless rlcr://gemma3-270m:latest
      ```

      ```bash title="Docker" theme={"system"}
      docker pull rlcr.io/ramalama/gemma3-270m:latest
      docker run --rm -p 8080:8080 rlcr.io/ramalama/gemma3-270m:latest
      ```

      ```bash title="Podman" theme={"system"}
      podman pull rlcr.io/ramalama/gemma3-270m:latest
      podman run --rm -p 8080:8080 rlcr.io/ramalama/gemma3-270m:latest
      ```
    </CodeGroup>

    <Tip>
      You can find the full catalogue of RamaLama Labs images [here](https://registry.ramalama.com/projects/ramalama)
    </Tip>
  </Step>

  <Step title="Get chatting">
    The endpoint is OpenAI‑compatible. Try a quick chat request:

    <CodeGroup>
      ```bash title="RamaLama" theme={"system"}
      ramalama chat "Say hello in one sentence"
      ```

      ```bash title="curl" theme={"system"}
      curl -s http://localhost:8080/v1/chat/completions \
        -H 'Content-Type: application/json' \
        -d '{
              "model": "gemma3-270m",
              "messages": [
                {"role": "user", "content": "Say hello in one sentence"}
              ]
            }'
      ```
    </CodeGroup>

    <CodeGroup>
      ```text title="RamaLama" theme={"system"}
      Hello!
      ```

      ```json title="curl" theme={"system"}
      {
          "id":"chatcmpl-ZYtHxmjGSdIHs7tqMlA6eS9NhctuDZ6Y",
          "model":"gemma3-270m",
          "object":"chat.completion",
          "choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello! "}}]
      }
      ```
    </CodeGroup>
  </Step>
</Steps>

<Tip>
  Many of our images come bundled with a web server GUI. If you'd prefer to chat directly with the agent you can access it at the root url where
  the agent is being served (e.g. `http://localhost:8080`)
</Tip>

## Next steps

<CardGroup cols={3}>
  <Card title="Deploy to Production" icon="rocket" href="/pages/deploying/local">
    Deploy with Docker Compose or Kubernetes for production workloads
  </Card>

  <Card title="Security & Provenance" icon="shield" href="/pages/education/CVE">
    Review CVEs, SBOMs, and security best practices
  </Card>

  <Card title="Request Custom Images" icon="envelope" href="https://www.ramalama.com/contact">
    Need bespoke images for specific hardware or compliance needs?
  </Card>
</CardGroup>