Skip to main content
The Python SDK relies on the RamaLama CLI and a container manager to provision and run models locally.

Installation

1

Prerequisites

In order for you or your users to run use the SDK they will need to:
  • Install a container manager like docker or Podman.
  • Make sure the container manager is running
2

Install the SDK from PyPI

pip install ramalama-sdk
After installing the SDK the ramalama CLI will be installed by default. Additional platform specific installation instructions are available here.
3

Get chatting

Head to the quick start to run your first prompt.

Verify installation

import ramalama_sdk

print(f"SDK Version: {ramalama_sdk.__version__}")

Troubleshooting

  • If the SDK cannot start a model, verify Docker or Podman is running.