Quickstart

Get up to speed with our API in one minute.

Together AI makes it easy to run leading open-source models using only a few lines of code.

1. Register for an account

First, register for an account to get an API key. New accounts come with $1 to get started.

Once you’ve registered, set your account’s API key to an environment variable named TOGETHER_API_KEY:

Shell

export TOGETHER_API_KEY=xxxxx

2. Install your preferred library

Together provides an official library for Python and TypeScript, or you can call our HTTP API in any language you want:

Pyhton

pip install together

3. Run your first query against a model

Choose a model to query. In this example, we’ll do a chat completion on Llama 3.1 8B with streaming:

Python

from together import Together

client = Together()

stream = client.chat.completions.create(
  model="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
  messages=[{"role": "user", "content": "What are the top 3 things to do in New York?"}],
  stream=True,
)

for chunk in stream:
  print(chunk.choices[0].delta.content or "", end="", flush=True)

Congratulations –you’ve just made your first query to Together AI!

Next steps

• Explore our cookbook for Python recipes with Together AI
• Explore our demos for full-stack open source example apps.
• Check out the Together AI playground to try out different models.
• See our integrations with leading LLM frameworks.

Resources

• Discord
• Pricing
• Support

---