TweetSyncdocs

TogetherAI

Setting Up the API Key for TogetherAI:

1. Sign up on TogetherAI.
2. After creating your account, go to the API section.
3. Generate a new API key and copy it.

Example code to set up the API Key:

import together

# Configure the API Key
together.api_key = "your_api_key"

# Example request to generate text with a model
response = together.text.generate(prompt="Tell me a story", max_tokens=50)
print(response)

Available Models:

Language Models

1. 01.AI

   • 01-ai Yi Base (34B)

     • API: zero-one-ai/Yi-34B
     • Context Length: 4096

   • 01-ai Yi Base (6B)

     • API: zero-one-ai/Yi-6B
     • Context Length: 4096

2. Mistral AI

   • Mixtral 8X22B
     • API: mistralai/Mixtral-8x22B
     • Context Length: 65536

3. Google

   • Gemma (2B)

     • API: google/gemma-2b
     • Context Length: 8192

   • Gemma (7B)

     • API: google/gemma-7b
     • Context Length: 8192

4. Meta

   • LLaMA-2 (70B)

     • API: meta-llama/Llama-2-70b-hf
     • Context Length: 4096

   • LLaMA-2 (13B)

     • API: meta-llama/Llama-2-13b-hf
     • Context Length: 4096

   • LLaMA-2 (7B)

     • API: meta-llama/Llama-2-7b-hf
     • Context Length: 4096

   • LLaMA-3 (8B)

     • API: meta-llama/Llama-3-8b-hf
     • Context Length: 8192

   • LLaMA-3 (70B)

     • API: meta-llama/Meta-Llama-3-70B
     • Context Length: 8192

5. Microsoft

   • Microsoft Phi-2
     • API: microsoft/phi-2
     • Context Length: 2048

6. Nexusflow

   • NexusRaven (13B)
     • API: Nexusflow/NexusRaven-V2-13B
     • Context Length: 16384

7. Qwen

   • Qwen 1.5 (0.5B)

     • API: Qwen/Qwen1.5-0.5B
     • Context Length: 32768

   • Qwen 1.5 (1.8B)

     • API: Qwen/Qwen1.5-1.8B
     • Context Length: 32768

   • Qwen 1.5 (4B)

     • API: Qwen/Qwen1.5-4B
     • Context Length: 32768

   • Qwen 1.5 (7B)

     • API: Qwen/Qwen1.5-7B
     • Context Length: 32768

   • Qwen 1.5 (14B)

     • API: Qwen/Qwen1.5-14B
     • Context Length: 32768

   • Qwen 1.5 (32B)

     • API: Qwen/Qwen1.5-32B
     • Context Length: 32768

   • Qwen 1.5 (72B)

     • API: Qwen/Qwen1.5-72B
     • Context Length: 4096

8. Together

   • GPT-JT-Moderation (6B)

     • API: togethercomputer/GPT-JT-Moderation-6B
     • Context Length: 2048

   • LLaMA-2-32K (7B)

     • API: togethercomputer/LLaMA-2-7B-32K
     • Context Length: 32768

   • RedPajama-INCITE (3B)

     • API: togethercomputer/RedPajama-INCITE-Base-3B-v1
     • Context Length: 2048

   • RedPajama-INCITE (7B)

     • API: togethercomputer/RedPajama-INCITE-7B-Base
     • Context Length: 2048

   • RedPajama-INCITE Instruct (3B)

     • API: togethercomputer/RedPajama-INCITE-Instruct-3B-v1
     • Context Length: 2048

   • RedPajama-INCITE Instruct (7B)

     • API: togethercomputer/RedPajama-INCITE-7B-Instruct
     • Context Length: 2048

   • StripedHyena Hessian (7B)

     • API: togethercomputer/StripedHyena-Hessian-7B
     • Context Length: 32768

9. MistralAI

   • Mistral (7B)

     • API: mistralai/Mistral-7B-v0.1
     • Context Length: 8192

   • Mixtral-8x7B (46.7B)

     • API: mistralai/Mixtral-8x7B-v0.1
     • Context Length: 32768

Code Models

1. Meta

   • Code Llama Python (70B)

     • API: codellama/CodeLlama-70b-Python-hf
     • Context Length: 4096

   • Code Llama Python (34B)

     • API: codellama/CodeLlama-34b-Python-hf
     • Context Length: 16384

   • Code Llama Python (13B)

     • API: codellama/CodeLlama-13b-Python-hf
     • Context Length: 16384

   • Code Llama Python (7B)

     • API: codellama/CodeLlama-7b-Python-hf
     • Context Length: 16384

2. Phind

   • Phind Code LLaMA v2 (34B)
     • API: Phind/Phind-CodeLlama-34B-v2
     • Context Length: 16384

3. WizardLM

   • WizardCoder Python v1.0 (34B)
     • API: WizardLM/WizardCoder-Python-34B-V1.0
     • Context Length: 8192

Moderation Models

1. Meta
   • Llama Guard (7B)
     • API: Meta-Llama/Llama-Guard-7b
     • Context Length: 4096

Genomic Models

1. Together

   • Evo-1 Base (8K)

     • API: togethercomputer/evo-1-8k-base
     • Context Length: 8192

   • Evo-1 Base (131K)

     • API: togethercomputer/evo-1-131k-base
     • Context Length: 131072