llama-cpp-python — Easy Playground

Python bindings for llama.cpp: run LLMs locally on CPU/GPU

Getting started with llama-cpp-pythonRun locally

Install

pip install llama-cpp-python

Python CodeRun locally

# Install: pip install llama-cpp-python
import llama_cpp_python

# Basic llama-cpp-python usage
print(f"Using llama-cpp-python")
# See documentation for detailed examples

# Install: pip install llama-cpp-python
import llama_cpp_python

# Basic llama-cpp-python usage
print(f"Using llama-cpp-python")
# See documentation for detailed examples

Expected Output

# Expected output shown below
# (Run locally with: llama_cpp_python)

llama-cpp-python is a third-party package. Python bindings for llama.cpp: run LLMs locally on CPU/GPU. Install with: pip install llama-cpp-python

Challenge

Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?

View all Easy examples for llama-cpp-python