skypilot-nightly 1.0.0.dev2024053101__py3-none-any.whl → 1.0.0.dev2025022801__py3-none-any.whl

skypilot_nightly-1.0.0.dev2025022801.dist-info/METADATA

@@ -0,0 +1,363 @@
+Metadata-Version: 2.2
+Name: skypilot-nightly
+Version: 1.0.0.dev2025022801
+Summary: SkyPilot: An intercloud broker for the clouds
+Author: SkyPilot Team
+License: Apache 2.0
+Project-URL: Homepage, https://github.com/skypilot-org/skypilot
+Project-URL: Issues, https://github.com/skypilot-org/skypilot/issues
+Project-URL: Discussion, https://github.com/skypilot-org/skypilot/discussions
+Project-URL: Documentation, https://docs.skypilot.co/
+Classifier: Programming Language :: Python :: 3.7
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: System :: Distributed Computing
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: wheel
+Requires-Dist: cachetools
+Requires-Dist: click>=7.0
+Requires-Dist: colorama
+Requires-Dist: cryptography
+Requires-Dist: jinja2>=3.0
+Requires-Dist: jsonschema
+Requires-Dist: networkx
+Requires-Dist: pandas>=1.3.0
+Requires-Dist: pendulum
+Requires-Dist: PrettyTable>=2.0.0
+Requires-Dist: python-dotenv
+Requires-Dist: rich
+Requires-Dist: tabulate
+Requires-Dist: typing_extensions
+Requires-Dist: filelock>=3.6.0
+Requires-Dist: packaging
+Requires-Dist: psutil
+Requires-Dist: pulp
+Requires-Dist: pyyaml!=5.4.*,>3.13
+Requires-Dist: requests
+Requires-Dist: fastapi
+Requires-Dist: uvicorn[standard]
+Requires-Dist: pydantic!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,<3,>2
+Requires-Dist: python-multipart
+Requires-Dist: aiofiles
+Requires-Dist: httpx
+Requires-Dist: setproctitle
+Provides-Extra: aws
+Requires-Dist: urllib3<2; extra == "aws"
+Requires-Dist: awscli>=1.27.10; extra == "aws"
+Requires-Dist: botocore>=1.29.10; extra == "aws"
+Requires-Dist: boto3>=1.26.1; extra == "aws"
+Requires-Dist: colorama<0.4.5; extra == "aws"
+Provides-Extra: azure
+Requires-Dist: azure-cli>=2.65.0; extra == "azure"
+Requires-Dist: azure-core>=1.31.0; extra == "azure"
+Requires-Dist: azure-identity>=1.19.0; extra == "azure"
+Requires-Dist: azure-mgmt-network>=27.0.0; extra == "azure"
+Requires-Dist: azure-mgmt-compute>=33.0.0; extra == "azure"
+Requires-Dist: azure-storage-blob>=12.23.1; extra == "azure"
+Requires-Dist: msgraph-sdk; extra == "azure"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "azure"
+Provides-Extra: gcp
+Requires-Dist: google-api-python-client>=2.69.0; extra == "gcp"
+Requires-Dist: google-cloud-storage; extra == "gcp"
+Provides-Extra: ibm
+Requires-Dist: ibm-cloud-sdk-core; extra == "ibm"
+Requires-Dist: ibm-vpc; extra == "ibm"
+Requires-Dist: ibm-platform-services; extra == "ibm"
+Requires-Dist: ibm-cos-sdk; extra == "ibm"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "ibm"
+Provides-Extra: docker
+Requires-Dist: docker; extra == "docker"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "docker"
+Provides-Extra: lambda
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "lambda"
+Provides-Extra: cloudflare
+Requires-Dist: urllib3<2; extra == "cloudflare"
+Requires-Dist: awscli>=1.27.10; extra == "cloudflare"
+Requires-Dist: botocore>=1.29.10; extra == "cloudflare"
+Requires-Dist: boto3>=1.26.1; extra == "cloudflare"
+Requires-Dist: colorama<0.4.5; extra == "cloudflare"
+Provides-Extra: scp
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "scp"
+Provides-Extra: oci
+Requires-Dist: oci; extra == "oci"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "oci"
+Provides-Extra: kubernetes
+Requires-Dist: kubernetes!=32.0.0,>=20.0.0; extra == "kubernetes"
+Provides-Extra: remote
+Requires-Dist: grpcio!=1.48.0,>=1.32.0; python_version < "3.10" and extra == "remote"
+Requires-Dist: grpcio!=1.48.0,>=1.42.0; python_version >= "3.10" and extra == "remote"
+Requires-Dist: protobuf!=3.19.5,>=3.15.3; extra == "remote"
+Provides-Extra: runpod
+Requires-Dist: runpod>=1.6.1; extra == "runpod"
+Provides-Extra: fluidstack
+Provides-Extra: cudo
+Requires-Dist: cudo-compute>=0.1.10; extra == "cudo"
+Provides-Extra: paperspace
+Provides-Extra: do
+Requires-Dist: pydo>=0.3.0; extra == "do"
+Requires-Dist: azure-core>=1.24.0; extra == "do"
+Requires-Dist: azure-common; extra == "do"
+Provides-Extra: vast
+Requires-Dist: vastai-sdk>=0.1.12; extra == "vast"
+Provides-Extra: vsphere
+Requires-Dist: pyvmomi==8.0.1.0.2; extra == "vsphere"
+Provides-Extra: nebius
+Requires-Dist: nebius>=0.2.0; extra == "nebius"
+Provides-Extra: all
+Requires-Dist: urllib3<2; extra == "all"
+Requires-Dist: awscli>=1.27.10; extra == "all"
+Requires-Dist: botocore>=1.29.10; extra == "all"
+Requires-Dist: boto3>=1.26.1; extra == "all"
+Requires-Dist: colorama<0.4.5; extra == "all"
+Requires-Dist: azure-cli>=2.65.0; extra == "all"
+Requires-Dist: azure-core>=1.31.0; extra == "all"
+Requires-Dist: azure-identity>=1.19.0; extra == "all"
+Requires-Dist: azure-mgmt-network>=27.0.0; extra == "all"
+Requires-Dist: azure-mgmt-compute>=33.0.0; extra == "all"
+Requires-Dist: azure-storage-blob>=12.23.1; extra == "all"
+Requires-Dist: msgraph-sdk; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: google-api-python-client>=2.69.0; extra == "all"
+Requires-Dist: google-cloud-storage; extra == "all"
+Requires-Dist: ibm-cloud-sdk-core; extra == "all"
+Requires-Dist: ibm-vpc; extra == "all"
+Requires-Dist: ibm-platform-services; extra == "all"
+Requires-Dist: ibm-cos-sdk; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: docker; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: urllib3<2; extra == "all"
+Requires-Dist: awscli>=1.27.10; extra == "all"
+Requires-Dist: botocore>=1.29.10; extra == "all"
+Requires-Dist: boto3>=1.26.1; extra == "all"
+Requires-Dist: colorama<0.4.5; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: oci; extra == "all"
+Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
+Requires-Dist: kubernetes!=32.0.0,>=20.0.0; extra == "all"
+Requires-Dist: grpcio!=1.48.0,>=1.32.0; python_version < "3.10" and extra == "all"
+Requires-Dist: grpcio!=1.48.0,>=1.42.0; python_version >= "3.10" and extra == "all"
+Requires-Dist: protobuf!=3.19.5,>=3.15.3; extra == "all"
+Requires-Dist: runpod>=1.6.1; extra == "all"
+Requires-Dist: cudo-compute>=0.1.10; extra == "all"
+Requires-Dist: pydo>=0.3.0; extra == "all"
+Requires-Dist: azure-core>=1.24.0; extra == "all"
+Requires-Dist: azure-common; extra == "all"
+Requires-Dist: vastai-sdk>=0.1.12; extra == "all"
+Requires-Dist: pyvmomi==8.0.1.0.2; extra == "all"
+Requires-Dist: nebius>=0.2.0; extra == "all"
+Dynamic: author
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: license
+Dynamic: project-url
+Dynamic: provides-extra
+Dynamic: requires-dist
+Dynamic: summary
+
+<p align="center">
+  <img alt="SkyPilot" src="https://raw.githubusercontent.com/skypilot-org/skypilot/master/docs/source/images/skypilot-wide-light-1k.png" width=55%>
+</p>
+
+<p align="center">
+  <a href="https://docs.skypilot.co/">
+    <img alt="Documentation" src="https://img.shields.io/badge/docs-gray?logo=readthedocs&logoColor=f5f5f5">
+  </a>
+
+  <a href="https://github.com/skypilot-org/skypilot/releases">
+    <img alt="GitHub Release" src="https://img.shields.io/github/release/skypilot-org/skypilot.svg">
+  </a>
+
+  <a href="http://slack.skypilot.co">
+    <img alt="Join Slack" src="https://img.shields.io/badge/SkyPilot-Join%20Slack-blue?logo=slack">
+  </a>
+
+  <a href="https://github.com/skypilot-org/skypilot/releases">
+    <img alt="Downloads" src="https://img.shields.io/pypi/dm/skypilot">
+  </a>
+
+</p>
+
+<h3 align="center">
+    Run AI on Any Infra — Unified, Faster, Cheaper
+</h3>
+
+----
+:fire: *News* :fire:
+- [Feb 2025] Prepare and serve **Retrieval Augmented Generation (RAG) with DeepSeek-R1**: [**blog post**](https://blog.skypilot.co/deepseek-rag), [**example**](./llm/rag/)
+- [Feb 2025] Run and serve **DeepSeek-R1 671B** using SkyPilot and SGLang with high throughput: [**example**](./llm/deepseek-r1/)
+- [Feb 2025] Prepare and serve large-scale image search with **vector databases**: [**blog post**](https://blog.skypilot.co/large-scale-vector-database/), [**example**](./examples/vector_database/)
+- [Jan 2025] Launch and serve distilled models from **[DeepSeek-R1](https://github.com/deepseek-ai/DeepSeek-R1)** and **[Janus](https://github.com/deepseek-ai/DeepSeek-Janus)** on Kubernetes or any cloud: [**R1 example**](./llm/deepseek-r1-distilled/) and [**Janus example**](./llm/deepseek-janus/)
+- [Oct 2024] :tada: **SkyPilot crossed 1M+ downloads** :tada:: Thank you to our community! [**Twitter/X**](https://x.com/skypilot_org/status/1844770841718067638)
+- [Sep 2024] Point, launch and serve **Llama 3.2** on Kubernetes or any cloud: [**example**](./llm/llama-3_2/)
+- [Sep 2024] Run and deploy [**Pixtral**](./llm/pixtral), the first open-source multimodal model from Mistral AI.
+- [Jun 2024] Reproduce **GPT** with [llm.c](https://github.com/karpathy/llm.c/discussions/481) on any cloud: [**guide**](./llm/gpt-2/)
+- [Apr 2024] Serve [**Qwen-110B**](https://qwenlm.github.io/blog/qwen1.5-110b/) on your infra: [**example**](./llm/qwen/)
+- [Apr 2024] Host [**Ollama**](https://github.com/ollama/ollama) on the cloud to deploy LLMs on CPUs and GPUs: [**example**](./llm/ollama/)
+
+
+**LLM Finetuning Cookbooks**: Finetuning Llama 2 / Llama 3.1 in your own cloud environment, privately: Llama 2 [**example**](./llm/vicuna-llama-2/) and [**blog**](https://blog.skypilot.co/finetuning-llama2-operational-guide/); Llama 3.1 [**example**](./llm/llama-3_1-finetuning/) and [**blog**](https://blog.skypilot.co/finetune-llama-3_1-on-your-infra/)
+
+----
+
+SkyPilot is a framework for running AI and batch workloads on any infra, offering unified execution, high cost savings, and high GPU availability.
+
+SkyPilot **abstracts away infra burdens**:
+- Launch [clusters](https://docs.skypilot.co/en/latest/examples/interactive-development.html), [jobs](https://docs.skypilot.co/en/latest/examples/managed-jobs.html), and [serving](https://docs.skypilot.co/en/latest/serving/sky-serve.html) on any infra
+- Easy job management: queue, run, and auto-recover many jobs
+
+SkyPilot **supports multiple clusters, clouds, and hardware** ([the Sky](https://arxiv.org/abs/2205.07147)):
+- Bring your reserved GPUs, Kubernetes clusters, or 12+ clouds
+- [Flexible provisioning](https://docs.skypilot.co/en/latest/examples/auto-failover.html) of GPUs, TPUs, CPUs, with auto-retry
+
+SkyPilot **cuts your cloud costs & maximizes GPU availability**:
+* [Autostop](https://docs.skypilot.co/en/latest/reference/auto-stop.html): automatic cleanup of idle resources
+* [Managed Spot](https://docs.skypilot.co/en/latest/examples/managed-jobs.html): 3-6x cost savings using spot instances, with preemption auto-recovery
+* [Optimizer](https://docs.skypilot.co/en/latest/examples/auto-failover.html): 2x cost savings by auto-picking the cheapest & most available infra
+
+SkyPilot supports your existing GPU, TPU, and CPU workloads, with no code changes.
+
+Install with pip:
+```bash
+# Choose your clouds:
+pip install -U "skypilot[kubernetes,aws,gcp,azure,oci,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,nebius]"
+```
+To get the latest features and fixes, use the nightly build or [install from source](https://docs.skypilot.co/en/latest/getting-started/installation.html):
+```bash
+# Choose your clouds:
+pip install "skypilot-nightly[kubernetes,aws,gcp,azure,oci,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,nebius]"
+```
+
+
+[Current supported infra](https://docs.skypilot.co/en/latest/getting-started/installation.html) (Kubernetes; AWS, GCP, Azure, OCI, Lambda Cloud, Fluidstack, RunPod, Cudo, Digital Ocean, Paperspace, Cloudflare, Samsung, IBM, Vast.ai, VMware vSphere, Nebius):
+<p align="center">
+  <img alt="SkyPilot" src="https://raw.githubusercontent.com/skypilot-org/skypilot/master/docs/source/images/cloud-logos-light.png" width=85%>
+</p>
+
+
+## Getting Started
+You can find our documentation [here](https://docs.skypilot.co/).
+- [Installation](https://docs.skypilot.co/en/latest/getting-started/installation.html)
+- [Quickstart](https://docs.skypilot.co/en/latest/getting-started/quickstart.html)
+- [CLI reference](https://docs.skypilot.co/en/latest/reference/cli.html)
+
+## SkyPilot in 1 Minute
+
+A SkyPilot task specifies: resource requirements, data to be synced, setup commands, and the task commands.
+
+Once written in this [**unified interface**](https://docs.skypilot.co/en/latest/reference/yaml-spec.html) (YAML or Python API), the task can be launched on any available cloud.  This avoids vendor lock-in, and allows easily moving jobs to a different provider.
+
+Paste the following into a file `my_task.yaml`:
+
+```yaml
+resources:
+  accelerators: A100:8  # 8x NVIDIA A100 GPU
+
+num_nodes: 1  # Number of VMs to launch
+
+# Working directory (optional) containing the project codebase.
+# Its contents are synced to ~/sky_workdir/ on the cluster.
+workdir: ~/torch_examples
+
+# Commands to be run before executing the job.
+# Typical use: pip install -r requirements.txt, git clone, etc.
+setup: |
+  pip install "torch<2.2" torchvision --index-url https://download.pytorch.org/whl/cu121
+
+# Commands to run as a job.
+# Typical use: launch the main program.
+run: |
+  cd mnist
+  python main.py --epochs 1
+```
+
+Prepare the workdir by cloning:
+```bash
+git clone https://github.com/pytorch/examples.git ~/torch_examples
+```
+
+Launch with `sky launch` (note: [access to GPU instances](https://docs.skypilot.co/en/latest/cloud-setup/quota.html) is needed for this example):
+```bash
+sky launch my_task.yaml
+```
+
+SkyPilot then performs the heavy-lifting for you, including:
+1. Find the lowest priced VM instance type across different clouds
+2. Provision the VM, with auto-failover if the cloud returned capacity errors
+3. Sync the local `workdir` to the VM
+4. Run the task's `setup` commands to prepare the VM for running the task
+5. Run the task's `run` commands
+
+<p align="center">
+  <img src="https://i.imgur.com/TgamzZ2.gif" alt="SkyPilot Demo"/>
+</p>
+
+
+Refer to [Quickstart](https://docs.skypilot.co/en/latest/getting-started/quickstart.html) to get started with SkyPilot.
+
+## More Information
+To learn more, see [SkyPilot Overview](https://docs.skypilot.co/en/latest/overview.html), [SkyPilot docs](https://docs.skypilot.co/en/latest/), and [SkyPilot blog](https://blog.skypilot.co/).
+
+<!-- Keep this section in sync with index.rst in SkyPilot Docs -->
+Runnable examples:
+- [**AI Gallery**](https://docs.skypilot.co/en/latest/gallery/index.html)
+- LLMs on SkyPilot
+  - [DeepSeek-R1](./llm/deepseek-r1/)
+  - [DeepSeek-Janus](./llm/deepseek-janus/)
+  - [Llama 3.2: lightweight and vision models](./llm/llama-3_2/)
+  - [Pixtral](./llm/pixtral/)
+  - [Llama 3.1 finetuning](./llm/llama-3_1-finetuning/) and [serving](./llm/llama-3_1/)
+  - [GPT-2 via `llm.c`](./llm/gpt-2/)
+  - [Llama 3](./llm/llama-3/)
+  - [Qwen](./llm/qwen/)
+  - [Databricks DBRX](./llm/dbrx/)
+  - [Gemma](./llm/gemma/)
+  - [Mixtral 8x7B](./llm/mixtral/); [Mistral 7B](https://docs.mistral.ai/self-deployment/skypilot/) (from official Mistral team)
+  - [Code Llama](./llm/codellama/)
+  - [vLLM: Serving LLM 24x Faster On the Cloud](./llm/vllm/) (from official vLLM team)
+  - [SGLang: Fast and Expressive LLM Serving On the Cloud](./llm/sglang/) (from official SGLang team)
+  - [Vicuna chatbots: Training & Serving](./llm/vicuna/) (from official Vicuna team)
+  - [Train your own Vicuna on Llama-2](./llm/vicuna-llama-2/)
+  - [Self-Hosted Llama-2 Chatbot](./llm/llama-2/)
+  - [Ollama: Quantized LLMs on CPUs](./llm/ollama/)
+  - [LoRAX](./llm/lorax/)
+  - [QLoRA](https://github.com/artidoro/qlora/pull/132)
+  - [LLaMA-LoRA-Tuner](https://github.com/zetavg/LLaMA-LoRA-Tuner#run-on-a-cloud-service-via-skypilot)
+  - [Tabby: Self-hosted AI coding assistant](https://github.com/TabbyML/tabby/blob/bed723fcedb44a6b867ce22a7b1f03d2f3531c1e/experimental/eval/skypilot.yaml)
+  - [LocalGPT](./llm/localgpt)
+  - [Falcon](./llm/falcon)
+  - Add yours here & see more in [`llm/`](./llm)!
+- Framework examples: [Vector Database](./examples/vector_database/), [PyTorch DDP](https://github.com/skypilot-org/skypilot/blob/master/examples/resnet_distributed_torch.yaml), [DeepSpeed](./examples/deepspeed-multinode/sky.yaml), [JAX/Flax on TPU](https://github.com/skypilot-org/skypilot/blob/master/examples/tpu/tpuvm_mnist.yaml), [Stable Diffusion](https://github.com/skypilot-org/skypilot/tree/master/examples/stable_diffusion), [Detectron2](https://github.com/skypilot-org/skypilot/blob/master/examples/detectron2_docker.yaml), [Distributed](https://github.com/skypilot-org/skypilot/blob/master/examples/resnet_distributed_tf_app.py) [TensorFlow](https://github.com/skypilot-org/skypilot/blob/master/examples/resnet_app_storage.yaml), [Ray Train](examples/distributed_ray_train/ray_train.yaml), [NeMo](https://github.com/skypilot-org/skypilot/blob/master/examples/nemo/), [programmatic grid search](https://github.com/skypilot-org/skypilot/blob/master/examples/huggingface_glue_imdb_grid_search_app.py), [Docker](https://github.com/skypilot-org/skypilot/blob/master/examples/docker/echo_app.yaml), [Cog](https://github.com/skypilot-org/skypilot/blob/master/examples/cog/), [Unsloth](https://github.com/skypilot-org/skypilot/blob/master/examples/unsloth/unsloth.yaml), [Ollama](https://github.com/skypilot-org/skypilot/blob/master/llm/ollama), [llm.c](https://github.com/skypilot-org/skypilot/tree/master/llm/gpt-2), [Airflow](./examples/airflow/training_workflow) and [many more (`examples/`)](./examples).
+
+Case Studies and Integrations: [Community Spotlights](https://blog.skypilot.co/community/)
+
+Follow updates:
+- [Twitter](https://twitter.com/skypilot_org)
+- [Slack](http://slack.skypilot.co)
+- [SkyPilot Blog](https://blog.skypilot.co/) ([Introductory blog post](https://blog.skypilot.co/introducing-skypilot/))
+
+Read the research:
+- [SkyPilot paper](https://www.usenix.org/system/files/nsdi23-yang-zongheng.pdf) and [talk](https://www.usenix.org/conference/nsdi23/presentation/yang-zongheng) (NSDI 2023)
+- [Sky Computing whitepaper](https://arxiv.org/abs/2205.07147)
+- [Sky Computing vision paper](https://sigops.org/s/conferences/hotos/2021/papers/hotos21-s02-stoica.pdf) (HotOS 2021)
+- [Policy for Managed Spot Jobs](https://www.usenix.org/conference/nsdi24/presentation/wu-zhanghao)  (NSDI 2024)
+
+SkyPilot was initially started at the [Sky Computing Lab](https://sky.cs.berkeley.edu) at UC Berkeley and has since gained many industry contributors. To read about the project's origin and vision, see [Concept: Sky Computing](https://docs.skypilot.co/en/latest/sky-computing.html).
+
+## Support and Questions
+We are excited to hear your feedback!
+* For issues and feature requests, please [open a GitHub issue](https://github.com/skypilot-org/skypilot/issues/new).
+* For questions, please use [GitHub Discussions](https://github.com/skypilot-org/skypilot/discussions).
+
+For general discussions, join us on the [SkyPilot Slack](http://slack.skypilot.co).
+
+## Contributing
+We welcome all contributions to the project! See [CONTRIBUTING](CONTRIBUTING.md) for how to get involved.