together 1.2.11__py3-none-any.whl → 2.0.0a8__py3-none-any.whl

together-1.2.11.dist-info/METADATA

@@ -1,408 +0,0 @@
-Metadata-Version: 2.1
-Name: together
-Version: 1.2.11
-Summary: Python client for Together's Cloud Platform!
-Home-page: https://github.com/togethercomputer/together-python
-License: Apache-2.0
-Author: Together AI
-Author-email: support@together.ai
-Requires-Python: >=3.8,<4.0
-Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Operating System :: POSIX :: Linux
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.8
-Classifier: Programming Language :: Python :: 3.9
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Requires-Dist: aiohttp (>=3.9.3,<4.0.0)
-Requires-Dist: click (>=8.1.7,<9.0.0)
-Requires-Dist: eval-type-backport (>=0.1.3,<0.3.0)
-Requires-Dist: filelock (>=3.13.1,<4.0.0)
-Requires-Dist: numpy (>=1.23.5) ; python_version < "3.12"
-Requires-Dist: numpy (>=1.26.0) ; python_version >= "3.12"
-Requires-Dist: pillow (>=10.3.0,<11.0.0)
-Requires-Dist: pyarrow (>=10.0.1)
-Requires-Dist: pydantic (>=2.6.3,<3.0.0)
-Requires-Dist: requests (>=2.31.0,<3.0.0)
-Requires-Dist: tabulate (>=0.9.0,<0.10.0)
-Requires-Dist: tqdm (>=4.66.2,<5.0.0)
-Requires-Dist: typer (>=0.9,<0.13)
-Project-URL: Bug Tracker, https://github.com/togethercomputer/together-python/issues
-Project-URL: Repository, https://github.com/togethercomputer/together-python
-Description-Content-Type: text/markdown
-
-<div align="center">
-  <a href="https://www.together.ai/">
-    <img alt="together.ai" height="100px" src="https://assets-global.website-files.com/64f6f2c0e3f4c5a91c1e823a/654693d569494912cfc0c0d4_favicon.svg">
-  </a>
-</div>
-
-# Together Python API library
-
-[![PyPI version](https://img.shields.io/pypi/v/together.svg)](https://pypi.org/project/together/)
-[![Discord](https://dcbadge.vercel.app/api/server/9Rk6sSeWEG?style=flat&compact=true)](https://discord.com/invite/9Rk6sSeWEG)
-[![Twitter](https://img.shields.io/twitter/url/https/twitter.com/togethercompute.svg?style=social&label=Follow%20%40togethercompute)](https://twitter.com/togethercompute)
-
-The [Together Python API Library](https://pypi.org/project/together/) is the official Python client for Together's API platform, providing a convenient way for interacting with the REST APIs and enables easy integrations with Python 3.8+ applications with easy to use synchronous and asynchronous clients.
-
-
-
-## Installation
-
-> 🚧
-> The Library was rewritten in v1.0.0 released in April of 2024. There were significant changes made.
-
-To install Together Python Library from PyPI, simply run:
-
-```shell Shell
-pip install --upgrade together
-```
-
-### Setting up API Key
-
-> 🚧 You will need to create an account with [Together.ai](https://api.together.xyz/) to obtain a Together API Key.
-
-Once logged in to the Together Playground, you can find available API keys in [this settings page](https://api.together.xyz/settings/api-keys).
-
-#### Setting environment variable
-
-```shell
-export TOGETHER_API_KEY=xxxxx
-```
-
-#### Using the client
-
-```python
-from together import Together
-
-client = Together(api_key="xxxxx")
-```
-
-This repo contains both a Python Library and a CLI. We'll demonstrate how to use both below.
-
-## Usage – Python Client
-
-### Chat Completions
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-response = client.chat.completions.create(
-    model="mistralai/Mixtral-8x7B-Instruct-v0.1",
-    messages=[{"role": "user", "content": "tell me about new york"}],
-)
-print(response.choices[0].message.content)
-```
-
-#### Streaming
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-stream = client.chat.completions.create(
-    model="mistralai/Mixtral-8x7B-Instruct-v0.1",
-    messages=[{"role": "user", "content": "tell me about new york"}],
-    stream=True,
-)
-
-for chunk in stream:
-    print(chunk.choices[0].delta.content or "", end="", flush=True)
-```
-
-#### Async usage
-
-```python
-import os, asyncio
-from together import AsyncTogether
-
-async_client = AsyncTogether(api_key=os.environ.get("TOGETHER_API_KEY"))
-messages = [
-    "What are the top things to do in San Francisco?",
-    "What country is Paris in?",
-]
-
-async def async_chat_completion(messages):
-    async_client = AsyncTogether(api_key=os.environ.get("TOGETHER_API_KEY"))
-    tasks = [
-        async_client.chat.completions.create(
-            model="mistralai/Mixtral-8x7B-Instruct-v0.1",
-            messages=[{"role": "user", "content": message}],
-        )
-        for message in messages
-    ]
-    responses = await asyncio.gather(*tasks)
-
-    for response in responses:
-        print(response.choices[0].message.content)
-
-asyncio.run(async_chat_completion(messages))
-```
-
-### Completions
-
-Completions are for code and language models shown [here](https://docs.together.ai/docs/inference-models). Below, a code model example is shown.
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-response = client.completions.create(
-    model="codellama/CodeLlama-34b-Python-hf",
-    prompt="Write a Next.js component with TailwindCSS for a header component.",
-    max_tokens=200,
-)
-print(response.choices[0].text)
-```
-
-#### Streaming
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-stream = client.completions.create(
-    model="codellama/CodeLlama-34b-Python-hf",
-    prompt="Write a Next.js component with TailwindCSS for a header component.",
-    stream=True,
-)
-
-for chunk in stream:
-    print(chunk.choices[0].delta.content or "", end="", flush=True)
-```
-
-#### Async usage
-
-```python
-import os, asyncio
-from together import AsyncTogether
-
-async_client = AsyncTogether(api_key=os.environ.get("TOGETHER_API_KEY"))
-prompts = [
-    "Write a Next.js component with TailwindCSS for a header component.",
-    "Write a python function for the fibonacci sequence",
-]
-
-async def async_chat_completion(prompts):
-    async_client = AsyncTogether(api_key=os.environ.get("TOGETHER_API_KEY"))
-    tasks = [
-        async_client.completions.create(
-            model="codellama/CodeLlama-34b-Python-hf",
-            prompt=prompt,
-        )
-        for prompt in prompts
-    ]
-    responses = await asyncio.gather(*tasks)
-
-    for response in responses:
-        print(response.choices[0].text)
-
-asyncio.run(async_chat_completion(prompts))
-```
-
-### Image generation
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-response = client.images.generate(
-    prompt="space robots",
-    model="stabilityai/stable-diffusion-xl-base-1.0",
-    steps=10,
-    n=4,
-)
-print(response.data[0].b64_json)
-```
-
-### Embeddings
-
-```python
-from typing import List
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-def get_embeddings(texts: List[str], model: str) -> List[List[float]]:
-    texts = [text.replace("\n", " ") for text in texts]
-    outputs = client.embeddings.create(model=model, input = texts)
-    return [outputs.data[i].embedding for i in range(len(texts))]
-
-input_texts = ['Our solar system orbits the Milky Way galaxy at about 515,000 mph']
-embeddings = get_embeddings(input_texts, model='togethercomputer/m2-bert-80M-8k-retrieval')
-
-print(embeddings)
-```
-
-### Files
-
-The files API is used for fine-tuning and allows developers to upload data to fine-tune on. It also has several methods to list all files, retrive files, and delete files. Please refer to our fine-tuning docs [here](https://docs.together.ai/docs/fine-tuning-python).
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-client.files.upload(file="somedata.jsonl") # uploads a file
-client.files.list() # lists all uploaded files
-client.files.retrieve(id="file-d0d318cb-b7d9-493a-bd70-1cfe089d3815") # retrieves a specific file
-client.files.retrieve_content(id="file-d0d318cb-b7d9-493a-bd70-1cfe089d3815") # retrieves content of a specific file
-client.files.delete(id="file-d0d318cb-b7d9-493a-bd70-1cfe089d3815") # deletes a file
-```
-
-### Fine-tunes
-
-The finetune API is used for fine-tuning and allows developers to create finetuning jobs. It also has several methods to list all jobs, retrive statuses and get checkpoints. Please refer to our fine-tuning docs [here](https://docs.together.ai/docs/fine-tuning-python).
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-client.fine_tuning.create(
-  training_file = 'file-d0d318cb-b7d9-493a-bd70-1cfe089d3815',
-  model = 'mistralai/Mixtral-8x7B-Instruct-v0.1',
-  n_epochs = 3,
-  n_checkpoints = 1,
-  batch_size = 4,
-  learning_rate = 1e-5,
-  suffix = 'my-demo-finetune',
-  wandb_api_key = '1a2b3c4d5e.......',
-)
-client.fine_tuning.list() # lists all fine-tuned jobs
-client.fine_tuning.retrieve(id="ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b") # retrieves information on finetune event
-client.fine_tuning.cancel(id="ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b") # Cancels a fine-tuning job
-client.fine_tuning.list_events(id="ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b") #  Lists events of a fine-tune job
-client.fine_tuning.download(id="ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b") # downloads compressed fine-tuned model or checkpoint to local disk
-```
-
-### Models
-
-This lists all the models that Together supports.
-
-```python
-import os
-from together import Together
-
-client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
-
-models = client.models.list()
-
-for model in models:
-    print(model)
-```
-
-## Usage – CLI
-
-### Chat Completions
-
-```bash
-together chat.completions \
-  --message "system" "You are a helpful assistant named Together" \
-  --message "user" "What is your name?" \
-  --model mistralai/Mixtral-8x7B-Instruct-v0.1
-```
-
-The Chat Completions CLI enables streaming tokens to stdout by default. To disable streaming, use `--no-stream`.
-
-### Completions
-
-```bash
-together completions \
-  "Large language models are " \
-  --model mistralai/Mixtral-8x7B-v0.1 \
-  --max-tokens 512 \
-  --stop "."
-```
-
-The Completions CLI enables streaming tokens to stdout by default. To disable streaming, use `--no-stream`.
-
-### Image Generations
-
-```bash
-together images generate \
-  "space robots" \
-  --model stabilityai/stable-diffusion-xl-base-1.0 \
-  --n 4
-```
-
-The image is opened in the default image viewer by default. To disable this, use `--no-show`.
-
-### Files
-
-```bash
-# Help
-together files --help
-
-# Check file
-together files check example.jsonl
-
-# Upload file
-together files upload example.jsonl
-
-# List files
-together files list
-
-# Retrieve file metadata
-together files retrieve file-6f50f9d1-5b95-416c-9040-0799b2b4b894
-
-# Retrieve file content
-together files retrieve-content file-6f50f9d1-5b95-416c-9040-0799b2b4b894
-
-# Delete remote file
-together files delete file-6f50f9d1-5b95-416c-9040-0799b2b4b894
-```
-
-### Fine-tuning
-
-```bash
-# Help
-together fine-tuning --help
-
-# Create fine-tune job
-together fine-tuning create \
-  --model togethercomputer/llama-2-7b-chat \
-  --training-file file-711d8724-b3e3-4ae2-b516-94841958117d
-
-# List fine-tune jobs
-together fine-tuning list
-
-# Retrieve fine-tune job details
-together fine-tuning retrieve ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
-
-# List fine-tune job events
-together fine-tuning list-events ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
-
-# Cancel running job
-together fine-tuning cancel ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
-
-# Download fine-tuned model weights
-together fine-tuning download ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
-```
-
-### Models
-
-```bash
-# Help
-together models --help
-
-# List models
-together models list
-```
-
-## Contributing
-
-Refer to the [Contributing Guide](CONTRIBUTING.md)
-

together-1.2.11.dist-info/RECORD

@@ -1,58 +0,0 @@
-together/__init__.py,sha256=B8T7ybZ7D6jJNRTuFDVjOFlImCNag8tNZXpZdXz7xNM,1530
-together/abstract/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-together/abstract/api_requestor.py,sha256=HxVOcaGBLHzNEDBxYx7XZ2OGBBt1z_wMBSnsIcnS6vA,25570
-together/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-together/cli/api/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-together/cli/api/chat.py,sha256=2PHRb-9T-lUEKhUJFtc7SxJv3shCVx40gq_8pzfsewM,9234
-together/cli/api/completions.py,sha256=l-Zw5t7hojL3w8xd_mitS2NRB72i5Z0xwkzH0rT5XMc,4263
-together/cli/api/files.py,sha256=QLYEXRkY8J2Gg1SbTCtzGfoTMvosoeACNK83L_oLubs,3397
-together/cli/api/finetune.py,sha256=c6-T-5K7sODgQa7ehdqZqyluRaDUzPXCgMeFWm3iIwA,8855
-together/cli/api/images.py,sha256=01dFYa2sK1HqUwVCD9FlwcjqkYWLoNxFZkzok13EriE,2363
-together/cli/api/models.py,sha256=xWEzu8ZpxM_Pz9KEjRPRVuv_v22RayYZ4QcgiezT5tE,1126
-together/cli/cli.py,sha256=RC0tgapkSOFjsRPg8p-8dx9D2LDzm8YmVCHUjk_aVyQ,1977
-together/client.py,sha256=mOlIFjjE9eSTb0o_weaKJwm8qvWNKHDiMmp8kQ7y68I,4946
-together/constants.py,sha256=WHe6JA9TliwgErkCnovWPS9w9xXfA3X5PtKJv_y2JxQ,908
-together/error.py,sha256=emjhTSsLwiZvW0v1EmYemjacCMtcFIKAXWWK_2IdP18,5419
-together/filemanager.py,sha256=QHhBn73oVFdgUpSYXYLmJzHJ9c5wYEMJC0ur6ZgDeYo,11269
-together/legacy/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-together/legacy/base.py,sha256=ehrX1SCfRbK5OA83wL1q7-tfF-yuZOUxzjxYfFtdvvQ,727
-together/legacy/complete.py,sha256=NRJX-vjnkg4HrgDo9LS3jFfhwfXpeGxcl24dcrLPK3A,2439
-together/legacy/embeddings.py,sha256=nyTERjyPLTm7Sc987a9FJt1adnW7gIa7xs2CwXLE9EI,635
-together/legacy/files.py,sha256=qmAqMiNTPWb6WvLV5Tsv6kxGRfQ31q7OkHZNFwkw8v0,4082
-together/legacy/finetune.py,sha256=k-lERbZLEZlW1QQ9A9zhhwl5KIPjf_jT0R0LSiLbD2Y,5063
-together/legacy/images.py,sha256=bJJRs-6C7-NexPyaeyHiYlHOU51yls5-QAiqtO4xrZU,626
-together/legacy/models.py,sha256=85ZN9Ids_FjdYNDRv5k7sgrtVWPKPHqkDplORtVUGHg,1087
-together/resources/__init__.py,sha256=7BLdBCNUbgi5mz30EFfdkdIYiGfFCkiUbdNzMY1-igY,792
-together/resources/chat/__init__.py,sha256=RsTptdP8MeGjcdIjze896-J27cRvCbUoMft0X2BVlQ8,617
-together/resources/chat/completions.py,sha256=AOmm2CRwhz9VZpez35LoOUw432IPbtwCeUQXtCd3RK8,14208
-together/resources/completions.py,sha256=C_Djn41zjdWdPn4rnOrAVEHvOaqyBSyxZS4eYqsZdMI,11482
-together/resources/embeddings.py,sha256=PTvLb82yjG_-iQOyuhsilp77Fr7gZ0o6WD2KeRnKoxs,2675
-together/resources/files.py,sha256=bnPbaF25e4InBRPvHwXHXT-oSX1Z1sZRsnQW5wq82U4,4990
-together/resources/finetune.py,sha256=t8wOulAyNFKlHjHv_u4-PwdL-rR-klgEvDEfH-efdkQ,15970
-together/resources/images.py,sha256=LQUjKPaFxWTqOAPnyF1Pp7Rz4NLOYhmoKwshpYiprEM,4923
-together/resources/models.py,sha256=2dtHhXAqTDOOpwSbYLzWcKTC0-m2Szlb7LDYvp7Jr4w,1786
-together/resources/rerank.py,sha256=3Ju_aRSyZ1s_3zCSNZnSnEJErUVmt2xa3M8z1nvejMA,3931
-together/together_response.py,sha256=MhczUCPem93cjX-A1TOAUrRj3sO-o3SLcEcTsZgVzQI,1319
-together/types/__init__.py,sha256=ghMiyyR2UzY-Io9Ck3ocwmS6_XSO9VaYWwbLqPDSZfo,1681
-together/types/abstract.py,sha256=1lFQI_3WjsR_t1128AeKW0aTk6EiM6Gh1J3ZuyLLPao,642
-together/types/chat_completions.py,sha256=wy_2E2moA2Aw1RVRXG7bLcHqkSULv-MlJZygajbQN_8,4406
-together/types/common.py,sha256=4ZeIgqGioqhIC-nNxY90czNPp-kAqboMulw6-1z6ShM,1511
-together/types/completions.py,sha256=yydloTQePGaY97Lx-kbkvgCqBFhHFl7jU5s7uf9Ncg0,2901
-together/types/embeddings.py,sha256=J7grkYYn7xhqeKaBO2T-8XQRtHhkzYzymovtGdIUK5A,751
-together/types/error.py,sha256=OVlCs3cx_2WhZK4JzHT8SQyRIIqKOP1AZQ4y1PydjAE,370
-together/types/files.py,sha256=-rEUfsV6f2vZB9NrFxT4_933ubsDIUNkPB-3OlOFk4A,1954
-together/types/finetune.py,sha256=UqZH98L3vVxZ6vykE5rmZFdpYQrqrkTvotZIiyqAME0,7362
-together/types/images.py,sha256=zX4Vt38tFDKU6yGb_hBY_N5eSTn3KPdpP5Ce_qnRHXQ,915
-together/types/models.py,sha256=K9Om3cCFexy7qzRSEXUj7gpCy1CVb1hHx7MGG-hvTLw,1035
-together/types/rerank.py,sha256=qZfuXOn7MZ6ly8hpJ_MZ7OU_Bi1-cgYNSB20Wja8Qkk,1061
-together/utils/__init__.py,sha256=VpjeRTya1m5eEE-Qe1zYTFsNAvuEA-dy7M2eG9Xu4fc,662
-together/utils/_log.py,sha256=yzdOV6iBEsyqF8UVvKhZm-ATtRokm34V-dXjTv3WKdE,1665
-together/utils/api_helpers.py,sha256=RSF7SRhbjHzroMOSWAXscflByM1r1ta_1SpxkAT22iE,2407
-together/utils/files.py,sha256=gMLthqfP5hKxVAerHMdy7gLXzdfY6lyOXdpW24Y4X3I,7165
-together/utils/tools.py,sha256=3-lXWP3cBCzOVSZg9tr5zOT1jaVeKAKVWxO2fcXZTh8,1788
-together/version.py,sha256=p03ivHyE0SyWU4jAnRTBi_sOwywVWoZPU4g2gzRgG-Y,126
-together-1.2.11.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
-together-1.2.11.dist-info/METADATA,sha256=dGhkUfJY1_UbjfOmWiFoDIs-QzLFD1ZgBwRy9E7P59Y,11813
-together-1.2.11.dist-info/WHEEL,sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg,88
-together-1.2.11.dist-info/entry_points.txt,sha256=G-b5NKW6lUUf1V1fH8IPTBb7jXnK7lhbX9H1zTEJXPs,50
-together-1.2.11.dist-info/RECORD,,

together-1.2.11.dist-info/entry_points.txt

@@ -1,3 +0,0 @@
-[console_scripts]
-together=together.cli.cli:main
-