Butter also works when stacked with other Chat Completions endpoints like Helicone.
Helicone supports custom Helicone-Target-URL headers to route requests to Butter.
See it in the example below.
Make sure to pass your provider key(s) in the Helicone platform first.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://gateway.helicone.ai/v1",
default_headers={
"Helicone-Auth": f"Bearer {os.getenv("HELICONE_API_KEY")}",
"Helicone-Target-URL": "https://proxy.butter.dev/v1",
"Butter-Auth": f"Bearer {os.getenv('BUTTER_API_KEY')}"
}
)
response = client.chat.completions.create(
model="gpt-4",
messages=[{"role": "user", "content": "What is the English word for mantequilla?"}]
)
print(response)