skypilot-nightly 1.0.0.dev20250502__py3-none-any.whl → 1.0.0.dev20251203__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- sky/__init__.py +22 -6
- sky/adaptors/aws.py +81 -16
- sky/adaptors/common.py +25 -2
- sky/adaptors/coreweave.py +278 -0
- sky/adaptors/do.py +8 -2
- sky/adaptors/gcp.py +11 -0
- sky/adaptors/hyperbolic.py +8 -0
- sky/adaptors/ibm.py +5 -2
- sky/adaptors/kubernetes.py +149 -18
- sky/adaptors/nebius.py +173 -30
- sky/adaptors/primeintellect.py +1 -0
- sky/adaptors/runpod.py +68 -0
- sky/adaptors/seeweb.py +183 -0
- sky/adaptors/shadeform.py +89 -0
- sky/admin_policy.py +187 -4
- sky/authentication.py +179 -225
- sky/backends/__init__.py +4 -2
- sky/backends/backend.py +22 -9
- sky/backends/backend_utils.py +1323 -397
- sky/backends/cloud_vm_ray_backend.py +1749 -1029
- sky/backends/docker_utils.py +1 -1
- sky/backends/local_docker_backend.py +11 -6
- sky/backends/task_codegen.py +633 -0
- sky/backends/wheel_utils.py +55 -9
- sky/{clouds/service_catalog → catalog}/__init__.py +21 -19
- sky/{clouds/service_catalog → catalog}/aws_catalog.py +27 -8
- sky/{clouds/service_catalog → catalog}/azure_catalog.py +10 -7
- sky/{clouds/service_catalog → catalog}/common.py +90 -49
- sky/{clouds/service_catalog → catalog}/cudo_catalog.py +8 -5
- sky/{clouds/service_catalog → catalog}/data_fetchers/analyze.py +1 -1
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_aws.py +116 -80
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_cudo.py +38 -38
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_gcp.py +70 -16
- sky/catalog/data_fetchers/fetch_hyperbolic.py +136 -0
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_lambda_cloud.py +1 -0
- sky/catalog/data_fetchers/fetch_nebius.py +338 -0
- sky/catalog/data_fetchers/fetch_runpod.py +698 -0
- sky/catalog/data_fetchers/fetch_seeweb.py +329 -0
- sky/catalog/data_fetchers/fetch_shadeform.py +142 -0
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_vast.py +1 -1
- sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_vsphere.py +1 -1
- sky/{clouds/service_catalog → catalog}/do_catalog.py +5 -2
- sky/{clouds/service_catalog → catalog}/fluidstack_catalog.py +6 -3
- sky/{clouds/service_catalog → catalog}/gcp_catalog.py +41 -15
- sky/catalog/hyperbolic_catalog.py +136 -0
- sky/{clouds/service_catalog → catalog}/ibm_catalog.py +9 -6
- sky/{clouds/service_catalog → catalog}/kubernetes_catalog.py +36 -24
- sky/{clouds/service_catalog → catalog}/lambda_catalog.py +9 -6
- sky/{clouds/service_catalog → catalog}/nebius_catalog.py +9 -7
- sky/{clouds/service_catalog → catalog}/oci_catalog.py +9 -6
- sky/{clouds/service_catalog → catalog}/paperspace_catalog.py +5 -2
- sky/catalog/primeintellect_catalog.py +95 -0
- sky/{clouds/service_catalog → catalog}/runpod_catalog.py +11 -4
- sky/{clouds/service_catalog → catalog}/scp_catalog.py +9 -6
- sky/catalog/seeweb_catalog.py +184 -0
- sky/catalog/shadeform_catalog.py +165 -0
- sky/catalog/ssh_catalog.py +167 -0
- sky/{clouds/service_catalog → catalog}/vast_catalog.py +6 -3
- sky/{clouds/service_catalog → catalog}/vsphere_catalog.py +5 -2
- sky/check.py +533 -185
- sky/cli.py +5 -5975
- sky/client/{cli.py → cli/command.py} +2591 -1956
- sky/client/cli/deprecation_utils.py +99 -0
- sky/client/cli/flags.py +359 -0
- sky/client/cli/table_utils.py +322 -0
- sky/client/cli/utils.py +79 -0
- sky/client/common.py +78 -32
- sky/client/oauth.py +82 -0
- sky/client/sdk.py +1219 -319
- sky/client/sdk_async.py +827 -0
- sky/client/service_account_auth.py +47 -0
- sky/cloud_stores.py +82 -3
- sky/clouds/__init__.py +13 -0
- sky/clouds/aws.py +564 -164
- sky/clouds/azure.py +105 -83
- sky/clouds/cloud.py +140 -40
- sky/clouds/cudo.py +68 -50
- sky/clouds/do.py +66 -48
- sky/clouds/fluidstack.py +63 -44
- sky/clouds/gcp.py +339 -110
- sky/clouds/hyperbolic.py +293 -0
- sky/clouds/ibm.py +70 -49
- sky/clouds/kubernetes.py +570 -162
- sky/clouds/lambda_cloud.py +74 -54
- sky/clouds/nebius.py +210 -81
- sky/clouds/oci.py +88 -66
- sky/clouds/paperspace.py +61 -44
- sky/clouds/primeintellect.py +317 -0
- sky/clouds/runpod.py +164 -74
- sky/clouds/scp.py +89 -86
- sky/clouds/seeweb.py +477 -0
- sky/clouds/shadeform.py +400 -0
- sky/clouds/ssh.py +263 -0
- sky/clouds/utils/aws_utils.py +10 -4
- sky/clouds/utils/gcp_utils.py +87 -11
- sky/clouds/utils/oci_utils.py +38 -14
- sky/clouds/utils/scp_utils.py +231 -167
- sky/clouds/vast.py +99 -77
- sky/clouds/vsphere.py +51 -40
- sky/core.py +375 -173
- sky/dag.py +15 -0
- sky/dashboard/out/404.html +1 -1
- sky/dashboard/out/_next/static/96_E2yl3QAiIJGOYCkSpB/_buildManifest.js +1 -0
- sky/dashboard/out/_next/static/chunks/1141-e6aa9ab418717c59.js +11 -0
- sky/dashboard/out/_next/static/chunks/1272-1ef0bf0237faccdb.js +1 -0
- sky/dashboard/out/_next/static/chunks/1871-7e202677c42f43fe.js +6 -0
- sky/dashboard/out/_next/static/chunks/2260-7703229c33c5ebd5.js +1 -0
- sky/dashboard/out/_next/static/chunks/2350.fab69e61bac57b23.js +1 -0
- sky/dashboard/out/_next/static/chunks/2369.fc20f0c2c8ed9fe7.js +15 -0
- sky/dashboard/out/_next/static/chunks/2755.edd818326d489a1d.js +26 -0
- sky/dashboard/out/_next/static/chunks/3294.20a8540fe697d5ee.js +1 -0
- sky/dashboard/out/_next/static/chunks/3785.7e245f318f9d1121.js +1 -0
- sky/dashboard/out/_next/static/chunks/3800-7b45f9fbb6308557.js +1 -0
- sky/dashboard/out/_next/static/chunks/3850-ff4a9a69d978632b.js +1 -0
- sky/dashboard/out/_next/static/chunks/3937.210053269f121201.js +1 -0
- sky/dashboard/out/_next/static/chunks/4725.172ede95d1b21022.js +1 -0
- sky/dashboard/out/_next/static/chunks/4937.a2baa2df5572a276.js +15 -0
- sky/dashboard/out/_next/static/chunks/5739-d67458fcb1386c92.js +8 -0
- sky/dashboard/out/_next/static/chunks/6130-2be46d70a38f1e82.js +1 -0
- sky/dashboard/out/_next/static/chunks/616-3d59f75e2ccf9321.js +39 -0
- sky/dashboard/out/_next/static/chunks/6212-7bd06f60ba693125.js +13 -0
- sky/dashboard/out/_next/static/chunks/6856-8f27d1c10c98def8.js +1 -0
- sky/dashboard/out/_next/static/chunks/6989-01359c57e018caa4.js +1 -0
- sky/dashboard/out/_next/static/chunks/6990-9146207c4567fdfd.js +1 -0
- sky/dashboard/out/_next/static/chunks/7359-c8d04e06886000b3.js +30 -0
- sky/dashboard/out/_next/static/chunks/7411-b15471acd2cba716.js +41 -0
- sky/dashboard/out/_next/static/chunks/7615-019513abc55b3b47.js +1 -0
- sky/dashboard/out/_next/static/chunks/8640.5b9475a2d18c5416.js +16 -0
- sky/dashboard/out/_next/static/chunks/8969-452f9d5cbdd2dc73.js +1 -0
- sky/dashboard/out/_next/static/chunks/9025.fa408f3242e9028d.js +6 -0
- sky/dashboard/out/_next/static/chunks/9353-cff34f7e773b2e2b.js +1 -0
- sky/dashboard/out/_next/static/chunks/9360.a536cf6b1fa42355.js +31 -0
- sky/dashboard/out/_next/static/chunks/9847.3aaca6bb33455140.js +30 -0
- sky/dashboard/out/_next/static/chunks/fd9d1056-86323a29a8f7e46a.js +1 -0
- sky/dashboard/out/_next/static/chunks/framework-cf60a09ccd051a10.js +33 -0
- sky/dashboard/out/_next/static/chunks/main-app-587214043926b3cc.js +1 -0
- sky/dashboard/out/_next/static/chunks/main-f15ccb73239a3bf1.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/_app-bde01e4a2beec258.js +34 -0
- sky/dashboard/out/_next/static/chunks/pages/_error-c66a4e8afc46f17b.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/clusters/[cluster]/[job]-792db96d918c98c9.js +16 -0
- sky/dashboard/out/_next/static/chunks/pages/clusters/[cluster]-abfcac9c137aa543.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/clusters-ee39056f9851a3ff.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/config-dfb9bf07b13045f4.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/index-444f1804401f04ea.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/infra/[context]-c0b5935149902e6f.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/infra-aed0ea19df7cf961.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/jobs/[job]-d66997e2bfc837cf.js +16 -0
- sky/dashboard/out/_next/static/chunks/pages/jobs/pools/[pool]-9faf940b253e3e06.js +21 -0
- sky/dashboard/out/_next/static/chunks/pages/jobs-2072b48b617989c9.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/users-f42674164aa73423.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/volumes-b84b948ff357c43e.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/workspace/new-3f88a1c7e86a3f86.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/workspaces/[name]-84a40f8c7c627fe4.js +1 -0
- sky/dashboard/out/_next/static/chunks/pages/workspaces-531b2f8c4bf89f82.js +1 -0
- sky/dashboard/out/_next/static/chunks/webpack-64e05f17bf2cf8ce.js +1 -0
- sky/dashboard/out/_next/static/css/0748ce22df867032.css +3 -0
- sky/dashboard/out/clusters/[cluster]/[job].html +1 -1
- sky/dashboard/out/clusters/[cluster].html +1 -1
- sky/dashboard/out/clusters.html +1 -1
- sky/dashboard/out/config.html +1 -0
- sky/dashboard/out/index.html +1 -1
- sky/dashboard/out/infra/[context].html +1 -0
- sky/dashboard/out/infra.html +1 -0
- sky/dashboard/out/jobs/[job].html +1 -1
- sky/dashboard/out/jobs/pools/[pool].html +1 -0
- sky/dashboard/out/jobs.html +1 -1
- sky/dashboard/out/users.html +1 -0
- sky/dashboard/out/volumes.html +1 -0
- sky/dashboard/out/workspace/new.html +1 -0
- sky/dashboard/out/workspaces/[name].html +1 -0
- sky/dashboard/out/workspaces.html +1 -0
- sky/data/data_utils.py +137 -1
- sky/data/mounting_utils.py +269 -84
- sky/data/storage.py +1460 -1807
- sky/data/storage_utils.py +43 -57
- sky/exceptions.py +126 -2
- sky/execution.py +216 -63
- sky/global_user_state.py +2390 -586
- sky/jobs/__init__.py +7 -0
- sky/jobs/client/sdk.py +300 -58
- sky/jobs/client/sdk_async.py +161 -0
- sky/jobs/constants.py +15 -8
- sky/jobs/controller.py +848 -275
- sky/jobs/file_content_utils.py +128 -0
- sky/jobs/log_gc.py +193 -0
- sky/jobs/recovery_strategy.py +402 -152
- sky/jobs/scheduler.py +314 -189
- sky/jobs/server/core.py +836 -255
- sky/jobs/server/server.py +156 -115
- sky/jobs/server/utils.py +136 -0
- sky/jobs/state.py +2109 -706
- sky/jobs/utils.py +1306 -215
- sky/logs/__init__.py +21 -0
- sky/logs/agent.py +108 -0
- sky/logs/aws.py +243 -0
- sky/logs/gcp.py +91 -0
- sky/metrics/__init__.py +0 -0
- sky/metrics/utils.py +453 -0
- sky/models.py +78 -1
- sky/optimizer.py +164 -70
- sky/provision/__init__.py +90 -4
- sky/provision/aws/config.py +147 -26
- sky/provision/aws/instance.py +136 -50
- sky/provision/azure/instance.py +11 -6
- sky/provision/common.py +13 -1
- sky/provision/cudo/cudo_machine_type.py +1 -1
- sky/provision/cudo/cudo_utils.py +14 -8
- sky/provision/cudo/cudo_wrapper.py +72 -71
- sky/provision/cudo/instance.py +10 -6
- sky/provision/do/instance.py +10 -6
- sky/provision/do/utils.py +4 -3
- sky/provision/docker_utils.py +140 -33
- sky/provision/fluidstack/instance.py +13 -8
- sky/provision/gcp/__init__.py +1 -0
- sky/provision/gcp/config.py +301 -19
- sky/provision/gcp/constants.py +218 -0
- sky/provision/gcp/instance.py +36 -8
- sky/provision/gcp/instance_utils.py +18 -4
- sky/provision/gcp/volume_utils.py +247 -0
- sky/provision/hyperbolic/__init__.py +12 -0
- sky/provision/hyperbolic/config.py +10 -0
- sky/provision/hyperbolic/instance.py +437 -0
- sky/provision/hyperbolic/utils.py +373 -0
- sky/provision/instance_setup.py +101 -20
- sky/provision/kubernetes/__init__.py +5 -0
- sky/provision/kubernetes/config.py +9 -52
- sky/provision/kubernetes/constants.py +17 -0
- sky/provision/kubernetes/instance.py +919 -280
- sky/provision/kubernetes/manifests/fusermount-server-daemonset.yaml +1 -2
- sky/provision/kubernetes/network.py +27 -17
- sky/provision/kubernetes/network_utils.py +44 -43
- sky/provision/kubernetes/utils.py +1221 -534
- sky/provision/kubernetes/volume.py +343 -0
- sky/provision/lambda_cloud/instance.py +22 -16
- sky/provision/nebius/constants.py +50 -0
- sky/provision/nebius/instance.py +19 -6
- sky/provision/nebius/utils.py +237 -137
- sky/provision/oci/instance.py +10 -5
- sky/provision/paperspace/instance.py +10 -7
- sky/provision/paperspace/utils.py +1 -1
- sky/provision/primeintellect/__init__.py +10 -0
- sky/provision/primeintellect/config.py +11 -0
- sky/provision/primeintellect/instance.py +454 -0
- sky/provision/primeintellect/utils.py +398 -0
- sky/provision/provisioner.py +117 -36
- sky/provision/runpod/__init__.py +5 -0
- sky/provision/runpod/instance.py +27 -6
- sky/provision/runpod/utils.py +51 -18
- sky/provision/runpod/volume.py +214 -0
- sky/provision/scp/__init__.py +15 -0
- sky/provision/scp/config.py +93 -0
- sky/provision/scp/instance.py +707 -0
- sky/provision/seeweb/__init__.py +11 -0
- sky/provision/seeweb/config.py +13 -0
- sky/provision/seeweb/instance.py +812 -0
- sky/provision/shadeform/__init__.py +11 -0
- sky/provision/shadeform/config.py +12 -0
- sky/provision/shadeform/instance.py +351 -0
- sky/provision/shadeform/shadeform_utils.py +83 -0
- sky/provision/ssh/__init__.py +18 -0
- sky/provision/vast/instance.py +13 -8
- sky/provision/vast/utils.py +10 -7
- sky/provision/volume.py +164 -0
- sky/provision/vsphere/common/ssl_helper.py +1 -1
- sky/provision/vsphere/common/vapiconnect.py +2 -1
- sky/provision/vsphere/common/vim_utils.py +4 -4
- sky/provision/vsphere/instance.py +15 -10
- sky/provision/vsphere/vsphere_utils.py +17 -20
- sky/py.typed +0 -0
- sky/resources.py +845 -119
- sky/schemas/__init__.py +0 -0
- sky/schemas/api/__init__.py +0 -0
- sky/schemas/api/responses.py +227 -0
- sky/schemas/db/README +4 -0
- sky/schemas/db/env.py +90 -0
- sky/schemas/db/global_user_state/001_initial_schema.py +124 -0
- sky/schemas/db/global_user_state/002_add_workspace_to_cluster_history.py +35 -0
- sky/schemas/db/global_user_state/003_fix_initial_revision.py +61 -0
- sky/schemas/db/global_user_state/004_is_managed.py +34 -0
- sky/schemas/db/global_user_state/005_cluster_event.py +32 -0
- sky/schemas/db/global_user_state/006_provision_log.py +41 -0
- sky/schemas/db/global_user_state/007_cluster_event_request_id.py +34 -0
- sky/schemas/db/global_user_state/008_skylet_ssh_tunnel_metadata.py +34 -0
- sky/schemas/db/global_user_state/009_last_activity_and_launched_at.py +89 -0
- sky/schemas/db/global_user_state/010_save_ssh_key.py +66 -0
- sky/schemas/db/global_user_state/011_is_ephemeral.py +34 -0
- sky/schemas/db/kv_cache/001_initial_schema.py +29 -0
- sky/schemas/db/script.py.mako +28 -0
- sky/schemas/db/serve_state/001_initial_schema.py +67 -0
- sky/schemas/db/serve_state/002_yaml_content.py +34 -0
- sky/schemas/db/skypilot_config/001_initial_schema.py +30 -0
- sky/schemas/db/spot_jobs/001_initial_schema.py +97 -0
- sky/schemas/db/spot_jobs/002_cluster_pool.py +42 -0
- sky/schemas/db/spot_jobs/003_pool_hash.py +34 -0
- sky/schemas/db/spot_jobs/004_job_file_contents.py +42 -0
- sky/schemas/db/spot_jobs/005_logs_gc.py +38 -0
- sky/schemas/db/spot_jobs/006_controller_pid_started_at.py +34 -0
- sky/schemas/db/spot_jobs/007_config_file_content.py +34 -0
- sky/schemas/generated/__init__.py +0 -0
- sky/schemas/generated/autostopv1_pb2.py +36 -0
- sky/schemas/generated/autostopv1_pb2.pyi +43 -0
- sky/schemas/generated/autostopv1_pb2_grpc.py +146 -0
- sky/schemas/generated/jobsv1_pb2.py +86 -0
- sky/schemas/generated/jobsv1_pb2.pyi +254 -0
- sky/schemas/generated/jobsv1_pb2_grpc.py +542 -0
- sky/schemas/generated/managed_jobsv1_pb2.py +76 -0
- sky/schemas/generated/managed_jobsv1_pb2.pyi +278 -0
- sky/schemas/generated/managed_jobsv1_pb2_grpc.py +278 -0
- sky/schemas/generated/servev1_pb2.py +58 -0
- sky/schemas/generated/servev1_pb2.pyi +115 -0
- sky/schemas/generated/servev1_pb2_grpc.py +322 -0
- sky/serve/autoscalers.py +357 -5
- sky/serve/client/impl.py +310 -0
- sky/serve/client/sdk.py +47 -139
- sky/serve/client/sdk_async.py +130 -0
- sky/serve/constants.py +12 -9
- sky/serve/controller.py +68 -17
- sky/serve/load_balancer.py +106 -60
- sky/serve/load_balancing_policies.py +116 -2
- sky/serve/replica_managers.py +434 -249
- sky/serve/serve_rpc_utils.py +179 -0
- sky/serve/serve_state.py +569 -257
- sky/serve/serve_utils.py +775 -265
- sky/serve/server/core.py +66 -711
- sky/serve/server/impl.py +1093 -0
- sky/serve/server/server.py +21 -18
- sky/serve/service.py +192 -89
- sky/serve/service_spec.py +144 -20
- sky/serve/spot_placer.py +3 -0
- sky/server/auth/__init__.py +0 -0
- sky/server/auth/authn.py +50 -0
- sky/server/auth/loopback.py +38 -0
- sky/server/auth/oauth2_proxy.py +202 -0
- sky/server/common.py +478 -182
- sky/server/config.py +85 -23
- sky/server/constants.py +44 -6
- sky/server/daemons.py +295 -0
- sky/server/html/token_page.html +185 -0
- sky/server/metrics.py +160 -0
- sky/server/middleware_utils.py +166 -0
- sky/server/requests/executor.py +558 -138
- sky/server/requests/payloads.py +364 -24
- sky/server/requests/preconditions.py +21 -17
- sky/server/requests/process.py +112 -29
- sky/server/requests/request_names.py +121 -0
- sky/server/requests/requests.py +822 -226
- sky/server/requests/serializers/decoders.py +82 -31
- sky/server/requests/serializers/encoders.py +140 -22
- sky/server/requests/threads.py +117 -0
- sky/server/rest.py +455 -0
- sky/server/server.py +1309 -285
- sky/server/state.py +20 -0
- sky/server/stream_utils.py +327 -61
- sky/server/uvicorn.py +217 -3
- sky/server/versions.py +270 -0
- sky/setup_files/MANIFEST.in +11 -1
- sky/setup_files/alembic.ini +160 -0
- sky/setup_files/dependencies.py +139 -31
- sky/setup_files/setup.py +44 -42
- sky/sky_logging.py +114 -7
- sky/skylet/attempt_skylet.py +106 -24
- sky/skylet/autostop_lib.py +129 -8
- sky/skylet/configs.py +29 -20
- sky/skylet/constants.py +216 -25
- sky/skylet/events.py +101 -21
- sky/skylet/job_lib.py +345 -164
- sky/skylet/log_lib.py +297 -18
- sky/skylet/log_lib.pyi +44 -1
- sky/skylet/providers/ibm/node_provider.py +12 -8
- sky/skylet/providers/ibm/vpc_provider.py +13 -12
- sky/skylet/ray_patches/__init__.py +17 -3
- sky/skylet/ray_patches/autoscaler.py.diff +18 -0
- sky/skylet/ray_patches/cli.py.diff +19 -0
- sky/skylet/ray_patches/command_runner.py.diff +17 -0
- sky/skylet/ray_patches/log_monitor.py.diff +20 -0
- sky/skylet/ray_patches/resource_demand_scheduler.py.diff +32 -0
- sky/skylet/ray_patches/updater.py.diff +18 -0
- sky/skylet/ray_patches/worker.py.diff +41 -0
- sky/skylet/runtime_utils.py +21 -0
- sky/skylet/services.py +568 -0
- sky/skylet/skylet.py +72 -4
- sky/skylet/subprocess_daemon.py +104 -29
- sky/skypilot_config.py +506 -99
- sky/ssh_node_pools/__init__.py +1 -0
- sky/ssh_node_pools/core.py +135 -0
- sky/ssh_node_pools/server.py +233 -0
- sky/task.py +685 -163
- sky/templates/aws-ray.yml.j2 +11 -3
- sky/templates/azure-ray.yml.j2 +2 -1
- sky/templates/cudo-ray.yml.j2 +1 -0
- sky/templates/do-ray.yml.j2 +2 -1
- sky/templates/fluidstack-ray.yml.j2 +1 -0
- sky/templates/gcp-ray.yml.j2 +62 -1
- sky/templates/hyperbolic-ray.yml.j2 +68 -0
- sky/templates/ibm-ray.yml.j2 +2 -1
- sky/templates/jobs-controller.yaml.j2 +27 -24
- sky/templates/kubernetes-loadbalancer.yml.j2 +2 -0
- sky/templates/kubernetes-ray.yml.j2 +611 -50
- sky/templates/lambda-ray.yml.j2 +2 -1
- sky/templates/nebius-ray.yml.j2 +34 -12
- sky/templates/oci-ray.yml.j2 +1 -0
- sky/templates/paperspace-ray.yml.j2 +2 -1
- sky/templates/primeintellect-ray.yml.j2 +72 -0
- sky/templates/runpod-ray.yml.j2 +10 -1
- sky/templates/scp-ray.yml.j2 +4 -50
- sky/templates/seeweb-ray.yml.j2 +171 -0
- sky/templates/shadeform-ray.yml.j2 +73 -0
- sky/templates/sky-serve-controller.yaml.j2 +22 -2
- sky/templates/vast-ray.yml.j2 +1 -0
- sky/templates/vsphere-ray.yml.j2 +1 -0
- sky/templates/websocket_proxy.py +212 -37
- sky/usage/usage_lib.py +31 -15
- sky/users/__init__.py +0 -0
- sky/users/model.conf +15 -0
- sky/users/permission.py +397 -0
- sky/users/rbac.py +121 -0
- sky/users/server.py +720 -0
- sky/users/token_service.py +218 -0
- sky/utils/accelerator_registry.py +35 -5
- sky/utils/admin_policy_utils.py +84 -38
- sky/utils/annotations.py +38 -5
- sky/utils/asyncio_utils.py +78 -0
- sky/utils/atomic.py +1 -1
- sky/utils/auth_utils.py +153 -0
- sky/utils/benchmark_utils.py +60 -0
- sky/utils/cli_utils/status_utils.py +159 -86
- sky/utils/cluster_utils.py +31 -9
- sky/utils/command_runner.py +354 -68
- sky/utils/command_runner.pyi +93 -3
- sky/utils/common.py +35 -8
- sky/utils/common_utils.py +314 -91
- sky/utils/config_utils.py +74 -5
- sky/utils/context.py +403 -0
- sky/utils/context_utils.py +242 -0
- sky/utils/controller_utils.py +383 -89
- sky/utils/dag_utils.py +31 -12
- sky/utils/db/__init__.py +0 -0
- sky/utils/db/db_utils.py +485 -0
- sky/utils/db/kv_cache.py +149 -0
- sky/utils/db/migration_utils.py +137 -0
- sky/utils/directory_utils.py +12 -0
- sky/utils/env_options.py +13 -0
- sky/utils/git.py +567 -0
- sky/utils/git_clone.sh +460 -0
- sky/utils/infra_utils.py +195 -0
- sky/utils/kubernetes/cleanup-tunnel.sh +62 -0
- sky/utils/kubernetes/config_map_utils.py +133 -0
- sky/utils/kubernetes/create_cluster.sh +15 -29
- sky/utils/kubernetes/delete_cluster.sh +10 -7
- sky/utils/kubernetes/deploy_ssh_node_pools.py +1177 -0
- sky/utils/kubernetes/exec_kubeconfig_converter.py +22 -31
- sky/utils/kubernetes/generate_kind_config.py +6 -66
- sky/utils/kubernetes/generate_kubeconfig.sh +4 -1
- sky/utils/kubernetes/gpu_labeler.py +18 -8
- sky/utils/kubernetes/k8s_gpu_labeler_job.yaml +2 -1
- sky/utils/kubernetes/k8s_gpu_labeler_setup.yaml +16 -16
- sky/utils/kubernetes/kubernetes_deploy_utils.py +284 -114
- sky/utils/kubernetes/rsync_helper.sh +11 -3
- sky/utils/kubernetes/ssh-tunnel.sh +379 -0
- sky/utils/kubernetes/ssh_utils.py +221 -0
- sky/utils/kubernetes_enums.py +8 -15
- sky/utils/lock_events.py +94 -0
- sky/utils/locks.py +416 -0
- sky/utils/log_utils.py +82 -107
- sky/utils/perf_utils.py +22 -0
- sky/utils/resource_checker.py +298 -0
- sky/utils/resources_utils.py +249 -32
- sky/utils/rich_utils.py +217 -39
- sky/utils/schemas.py +955 -160
- sky/utils/serialize_utils.py +16 -0
- sky/utils/status_lib.py +10 -0
- sky/utils/subprocess_utils.py +29 -15
- sky/utils/tempstore.py +70 -0
- sky/utils/thread_utils.py +91 -0
- sky/utils/timeline.py +26 -53
- sky/utils/ux_utils.py +84 -15
- sky/utils/validator.py +11 -1
- sky/utils/volume.py +165 -0
- sky/utils/yaml_utils.py +111 -0
- sky/volumes/__init__.py +13 -0
- sky/volumes/client/__init__.py +0 -0
- sky/volumes/client/sdk.py +150 -0
- sky/volumes/server/__init__.py +0 -0
- sky/volumes/server/core.py +270 -0
- sky/volumes/server/server.py +124 -0
- sky/volumes/volume.py +215 -0
- sky/workspaces/__init__.py +0 -0
- sky/workspaces/core.py +655 -0
- sky/workspaces/server.py +101 -0
- sky/workspaces/utils.py +56 -0
- sky_templates/README.md +3 -0
- sky_templates/__init__.py +3 -0
- sky_templates/ray/__init__.py +0 -0
- sky_templates/ray/start_cluster +183 -0
- sky_templates/ray/stop_cluster +75 -0
- skypilot_nightly-1.0.0.dev20251203.dist-info/METADATA +676 -0
- skypilot_nightly-1.0.0.dev20251203.dist-info/RECORD +611 -0
- {skypilot_nightly-1.0.0.dev20250502.dist-info → skypilot_nightly-1.0.0.dev20251203.dist-info}/WHEEL +1 -1
- skypilot_nightly-1.0.0.dev20251203.dist-info/top_level.txt +2 -0
- sky/benchmark/benchmark_state.py +0 -256
- sky/benchmark/benchmark_utils.py +0 -641
- sky/clouds/service_catalog/constants.py +0 -7
- sky/dashboard/out/_next/static/GWvVBSCS7FmUiVmjaL1a7/_buildManifest.js +0 -1
- sky/dashboard/out/_next/static/chunks/236-2db3ee3fba33dd9e.js +0 -6
- sky/dashboard/out/_next/static/chunks/312-c3c8845990db8ffc.js +0 -15
- sky/dashboard/out/_next/static/chunks/37-0a572fe0dbb89c4d.js +0 -6
- sky/dashboard/out/_next/static/chunks/678-206dddca808e6d16.js +0 -59
- sky/dashboard/out/_next/static/chunks/845-9e60713e0c441abc.js +0 -1
- sky/dashboard/out/_next/static/chunks/979-7bf73a4c7cea0f5c.js +0 -1
- sky/dashboard/out/_next/static/chunks/fd9d1056-2821b0f0cabcd8bd.js +0 -1
- sky/dashboard/out/_next/static/chunks/framework-87d061ee6ed71b28.js +0 -33
- sky/dashboard/out/_next/static/chunks/main-app-241eb28595532291.js +0 -1
- sky/dashboard/out/_next/static/chunks/main-e0e2335212e72357.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/_app-e6b013bc3f77ad60.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/_error-1be831200e60c5c0.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/clusters/[cluster]/[job]-6ac338bc2239cb45.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/clusters/[cluster]-f383db7389368ea7.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/clusters-a93b93e10b8b074e.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/index-f9f039532ca8cbc4.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/jobs/[job]-1c519e1afc523dc9.js +0 -1
- sky/dashboard/out/_next/static/chunks/pages/jobs-a75029b67aab6a2e.js +0 -1
- sky/dashboard/out/_next/static/chunks/webpack-830f59b8404e96b8.js +0 -1
- sky/dashboard/out/_next/static/css/c6933bbb2ce7f4dd.css +0 -3
- sky/jobs/dashboard/dashboard.py +0 -223
- sky/jobs/dashboard/static/favicon.ico +0 -0
- sky/jobs/dashboard/templates/index.html +0 -831
- sky/jobs/server/dashboard_utils.py +0 -69
- sky/skylet/providers/scp/__init__.py +0 -2
- sky/skylet/providers/scp/config.py +0 -149
- sky/skylet/providers/scp/node_provider.py +0 -578
- sky/templates/kubernetes-ssh-jump.yml.j2 +0 -94
- sky/utils/db_utils.py +0 -100
- sky/utils/kubernetes/deploy_remote_cluster.sh +0 -308
- sky/utils/kubernetes/ssh_jump_lifecycle_manager.py +0 -191
- skypilot_nightly-1.0.0.dev20250502.dist-info/METADATA +0 -361
- skypilot_nightly-1.0.0.dev20250502.dist-info/RECORD +0 -396
- skypilot_nightly-1.0.0.dev20250502.dist-info/top_level.txt +0 -1
- /sky/{clouds/service_catalog → catalog}/config.py +0 -0
- /sky/{benchmark → catalog/data_fetchers}/__init__.py +0 -0
- /sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_azure.py +0 -0
- /sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_fluidstack.py +0 -0
- /sky/{clouds/service_catalog → catalog}/data_fetchers/fetch_ibm.py +0 -0
- /sky/{clouds/service_catalog/data_fetchers → client/cli}/__init__.py +0 -0
- /sky/dashboard/out/_next/static/{GWvVBSCS7FmUiVmjaL1a7 → 96_E2yl3QAiIJGOYCkSpB}/_ssgManifest.js +0 -0
- {skypilot_nightly-1.0.0.dev20250502.dist-info → skypilot_nightly-1.0.0.dev20251203.dist-info}/entry_points.txt +0 -0
- {skypilot_nightly-1.0.0.dev20250502.dist-info → skypilot_nightly-1.0.0.dev20251203.dist-info}/licenses/LICENSE +0 -0
|
@@ -1,361 +0,0 @@
|
|
|
1
|
-
Metadata-Version: 2.4
|
|
2
|
-
Name: skypilot-nightly
|
|
3
|
-
Version: 1.0.0.dev20250502
|
|
4
|
-
Summary: SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper.
|
|
5
|
-
Author: SkyPilot Team
|
|
6
|
-
License: Apache 2.0
|
|
7
|
-
Project-URL: Homepage, https://github.com/skypilot-org/skypilot
|
|
8
|
-
Project-URL: Issues, https://github.com/skypilot-org/skypilot/issues
|
|
9
|
-
Project-URL: Discussion, https://github.com/skypilot-org/skypilot/discussions
|
|
10
|
-
Project-URL: Documentation, https://docs.skypilot.co/
|
|
11
|
-
Classifier: Programming Language :: Python :: 3.7
|
|
12
|
-
Classifier: Programming Language :: Python :: 3.8
|
|
13
|
-
Classifier: Programming Language :: Python :: 3.9
|
|
14
|
-
Classifier: Programming Language :: Python :: 3.10
|
|
15
|
-
Classifier: Programming Language :: Python :: 3.11
|
|
16
|
-
Classifier: License :: OSI Approved :: Apache Software License
|
|
17
|
-
Classifier: Operating System :: OS Independent
|
|
18
|
-
Classifier: Topic :: Software Development :: Libraries :: Python Modules
|
|
19
|
-
Classifier: Topic :: System :: Distributed Computing
|
|
20
|
-
Description-Content-Type: text/markdown
|
|
21
|
-
License-File: LICENSE
|
|
22
|
-
Requires-Dist: wheel<0.46.0
|
|
23
|
-
Requires-Dist: cachetools
|
|
24
|
-
Requires-Dist: click>=7.0
|
|
25
|
-
Requires-Dist: colorama
|
|
26
|
-
Requires-Dist: cryptography
|
|
27
|
-
Requires-Dist: jinja2>=3.0
|
|
28
|
-
Requires-Dist: jsonschema
|
|
29
|
-
Requires-Dist: networkx
|
|
30
|
-
Requires-Dist: pandas>=1.3.0
|
|
31
|
-
Requires-Dist: pendulum
|
|
32
|
-
Requires-Dist: PrettyTable>=2.0.0
|
|
33
|
-
Requires-Dist: python-dotenv
|
|
34
|
-
Requires-Dist: rich
|
|
35
|
-
Requires-Dist: tabulate
|
|
36
|
-
Requires-Dist: typing_extensions
|
|
37
|
-
Requires-Dist: filelock>=3.6.0
|
|
38
|
-
Requires-Dist: packaging
|
|
39
|
-
Requires-Dist: psutil
|
|
40
|
-
Requires-Dist: pulp
|
|
41
|
-
Requires-Dist: pyyaml!=5.4.*,>3.13
|
|
42
|
-
Requires-Dist: requests
|
|
43
|
-
Requires-Dist: fastapi
|
|
44
|
-
Requires-Dist: uvicorn[standard]
|
|
45
|
-
Requires-Dist: pydantic!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,<3,>2
|
|
46
|
-
Requires-Dist: python-multipart
|
|
47
|
-
Requires-Dist: aiofiles
|
|
48
|
-
Requires-Dist: httpx
|
|
49
|
-
Requires-Dist: setproctitle
|
|
50
|
-
Provides-Extra: aws
|
|
51
|
-
Requires-Dist: awscli>=1.27.10; extra == "aws"
|
|
52
|
-
Requires-Dist: botocore>=1.29.10; extra == "aws"
|
|
53
|
-
Requires-Dist: boto3>=1.26.1; extra == "aws"
|
|
54
|
-
Requires-Dist: colorama<0.4.5; extra == "aws"
|
|
55
|
-
Provides-Extra: azure
|
|
56
|
-
Requires-Dist: azure-cli>=2.65.0; extra == "azure"
|
|
57
|
-
Requires-Dist: azure-core>=1.31.0; extra == "azure"
|
|
58
|
-
Requires-Dist: azure-identity>=1.19.0; extra == "azure"
|
|
59
|
-
Requires-Dist: azure-mgmt-network>=27.0.0; extra == "azure"
|
|
60
|
-
Requires-Dist: azure-mgmt-compute>=33.0.0; extra == "azure"
|
|
61
|
-
Requires-Dist: azure-storage-blob>=12.23.1; extra == "azure"
|
|
62
|
-
Requires-Dist: msgraph-sdk; extra == "azure"
|
|
63
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "azure"
|
|
64
|
-
Provides-Extra: gcp
|
|
65
|
-
Requires-Dist: google-api-python-client>=2.69.0; extra == "gcp"
|
|
66
|
-
Requires-Dist: google-cloud-storage; extra == "gcp"
|
|
67
|
-
Provides-Extra: ibm
|
|
68
|
-
Requires-Dist: ibm-cloud-sdk-core; extra == "ibm"
|
|
69
|
-
Requires-Dist: ibm-vpc; extra == "ibm"
|
|
70
|
-
Requires-Dist: ibm-platform-services>=0.48.0; extra == "ibm"
|
|
71
|
-
Requires-Dist: ibm-cos-sdk; extra == "ibm"
|
|
72
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "ibm"
|
|
73
|
-
Provides-Extra: docker
|
|
74
|
-
Requires-Dist: docker; extra == "docker"
|
|
75
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "docker"
|
|
76
|
-
Provides-Extra: lambda
|
|
77
|
-
Provides-Extra: cloudflare
|
|
78
|
-
Requires-Dist: awscli>=1.27.10; extra == "cloudflare"
|
|
79
|
-
Requires-Dist: botocore>=1.29.10; extra == "cloudflare"
|
|
80
|
-
Requires-Dist: boto3>=1.26.1; extra == "cloudflare"
|
|
81
|
-
Requires-Dist: colorama<0.4.5; extra == "cloudflare"
|
|
82
|
-
Provides-Extra: scp
|
|
83
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "scp"
|
|
84
|
-
Provides-Extra: oci
|
|
85
|
-
Requires-Dist: oci; extra == "oci"
|
|
86
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "oci"
|
|
87
|
-
Provides-Extra: kubernetes
|
|
88
|
-
Requires-Dist: kubernetes!=32.0.0,>=20.0.0; extra == "kubernetes"
|
|
89
|
-
Requires-Dist: websockets; extra == "kubernetes"
|
|
90
|
-
Provides-Extra: remote
|
|
91
|
-
Requires-Dist: grpcio!=1.48.0,>=1.32.0; python_version < "3.10" and extra == "remote"
|
|
92
|
-
Requires-Dist: grpcio!=1.48.0,>=1.42.0; python_version >= "3.10" and extra == "remote"
|
|
93
|
-
Requires-Dist: protobuf!=3.19.5,>=3.15.3; extra == "remote"
|
|
94
|
-
Provides-Extra: runpod
|
|
95
|
-
Requires-Dist: runpod>=1.6.1; extra == "runpod"
|
|
96
|
-
Provides-Extra: fluidstack
|
|
97
|
-
Provides-Extra: cudo
|
|
98
|
-
Requires-Dist: cudo-compute>=0.1.10; extra == "cudo"
|
|
99
|
-
Provides-Extra: paperspace
|
|
100
|
-
Provides-Extra: do
|
|
101
|
-
Requires-Dist: pydo>=0.3.0; extra == "do"
|
|
102
|
-
Requires-Dist: azure-core>=1.24.0; extra == "do"
|
|
103
|
-
Requires-Dist: azure-common; extra == "do"
|
|
104
|
-
Provides-Extra: vast
|
|
105
|
-
Requires-Dist: vastai-sdk>=0.1.12; extra == "vast"
|
|
106
|
-
Provides-Extra: vsphere
|
|
107
|
-
Requires-Dist: pyvmomi==8.0.1.0.2; extra == "vsphere"
|
|
108
|
-
Provides-Extra: nebius
|
|
109
|
-
Requires-Dist: nebius>=0.2.0; extra == "nebius"
|
|
110
|
-
Requires-Dist: awscli>=1.27.10; extra == "nebius"
|
|
111
|
-
Requires-Dist: botocore>=1.29.10; extra == "nebius"
|
|
112
|
-
Requires-Dist: boto3>=1.26.1; extra == "nebius"
|
|
113
|
-
Requires-Dist: colorama<0.4.5; extra == "nebius"
|
|
114
|
-
Provides-Extra: all
|
|
115
|
-
Requires-Dist: awscli>=1.27.10; extra == "all"
|
|
116
|
-
Requires-Dist: botocore>=1.29.10; extra == "all"
|
|
117
|
-
Requires-Dist: boto3>=1.26.1; extra == "all"
|
|
118
|
-
Requires-Dist: colorama<0.4.5; extra == "all"
|
|
119
|
-
Requires-Dist: azure-cli>=2.65.0; extra == "all"
|
|
120
|
-
Requires-Dist: azure-core>=1.31.0; extra == "all"
|
|
121
|
-
Requires-Dist: azure-identity>=1.19.0; extra == "all"
|
|
122
|
-
Requires-Dist: azure-mgmt-network>=27.0.0; extra == "all"
|
|
123
|
-
Requires-Dist: azure-mgmt-compute>=33.0.0; extra == "all"
|
|
124
|
-
Requires-Dist: azure-storage-blob>=12.23.1; extra == "all"
|
|
125
|
-
Requires-Dist: msgraph-sdk; extra == "all"
|
|
126
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
|
|
127
|
-
Requires-Dist: google-api-python-client>=2.69.0; extra == "all"
|
|
128
|
-
Requires-Dist: google-cloud-storage; extra == "all"
|
|
129
|
-
Requires-Dist: ibm-cloud-sdk-core; extra == "all"
|
|
130
|
-
Requires-Dist: ibm-vpc; extra == "all"
|
|
131
|
-
Requires-Dist: ibm-platform-services>=0.48.0; extra == "all"
|
|
132
|
-
Requires-Dist: ibm-cos-sdk; extra == "all"
|
|
133
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
|
|
134
|
-
Requires-Dist: docker; extra == "all"
|
|
135
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
|
|
136
|
-
Requires-Dist: awscli>=1.27.10; extra == "all"
|
|
137
|
-
Requires-Dist: botocore>=1.29.10; extra == "all"
|
|
138
|
-
Requires-Dist: boto3>=1.26.1; extra == "all"
|
|
139
|
-
Requires-Dist: colorama<0.4.5; extra == "all"
|
|
140
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
|
|
141
|
-
Requires-Dist: oci; extra == "all"
|
|
142
|
-
Requires-Dist: ray[default]!=2.6.0,>=2.2.0; extra == "all"
|
|
143
|
-
Requires-Dist: kubernetes!=32.0.0,>=20.0.0; extra == "all"
|
|
144
|
-
Requires-Dist: websockets; extra == "all"
|
|
145
|
-
Requires-Dist: grpcio!=1.48.0,>=1.32.0; python_version < "3.10" and extra == "all"
|
|
146
|
-
Requires-Dist: grpcio!=1.48.0,>=1.42.0; python_version >= "3.10" and extra == "all"
|
|
147
|
-
Requires-Dist: protobuf!=3.19.5,>=3.15.3; extra == "all"
|
|
148
|
-
Requires-Dist: runpod>=1.6.1; extra == "all"
|
|
149
|
-
Requires-Dist: cudo-compute>=0.1.10; extra == "all"
|
|
150
|
-
Requires-Dist: pydo>=0.3.0; extra == "all"
|
|
151
|
-
Requires-Dist: azure-core>=1.24.0; extra == "all"
|
|
152
|
-
Requires-Dist: azure-common; extra == "all"
|
|
153
|
-
Requires-Dist: vastai-sdk>=0.1.12; extra == "all"
|
|
154
|
-
Requires-Dist: pyvmomi==8.0.1.0.2; extra == "all"
|
|
155
|
-
Requires-Dist: nebius>=0.2.0; extra == "all"
|
|
156
|
-
Requires-Dist: awscli>=1.27.10; extra == "all"
|
|
157
|
-
Requires-Dist: botocore>=1.29.10; extra == "all"
|
|
158
|
-
Requires-Dist: boto3>=1.26.1; extra == "all"
|
|
159
|
-
Requires-Dist: colorama<0.4.5; extra == "all"
|
|
160
|
-
Dynamic: author
|
|
161
|
-
Dynamic: classifier
|
|
162
|
-
Dynamic: description
|
|
163
|
-
Dynamic: description-content-type
|
|
164
|
-
Dynamic: license
|
|
165
|
-
Dynamic: license-file
|
|
166
|
-
Dynamic: project-url
|
|
167
|
-
Dynamic: provides-extra
|
|
168
|
-
Dynamic: requires-dist
|
|
169
|
-
Dynamic: summary
|
|
170
|
-
|
|
171
|
-
<p align="center">
|
|
172
|
-
<img alt="SkyPilot" src="https://raw.githubusercontent.com/skypilot-org/skypilot/master/docs/source/images/skypilot-wide-light-1k.png" width=55%>
|
|
173
|
-
</p>
|
|
174
|
-
|
|
175
|
-
<p align="center">
|
|
176
|
-
<a href="https://docs.skypilot.co/">
|
|
177
|
-
<img alt="Documentation" src="https://img.shields.io/badge/docs-gray?logo=readthedocs&logoColor=f5f5f5">
|
|
178
|
-
</a>
|
|
179
|
-
|
|
180
|
-
<a href="https://github.com/skypilot-org/skypilot/releases">
|
|
181
|
-
<img alt="GitHub Release" src="https://img.shields.io/github/release/skypilot-org/skypilot.svg">
|
|
182
|
-
</a>
|
|
183
|
-
|
|
184
|
-
<a href="http://slack.skypilot.co">
|
|
185
|
-
<img alt="Join Slack" src="https://img.shields.io/badge/SkyPilot-Join%20Slack-blue?logo=slack">
|
|
186
|
-
</a>
|
|
187
|
-
|
|
188
|
-
<a href="https://github.com/skypilot-org/skypilot/releases">
|
|
189
|
-
<img alt="Downloads" src="https://img.shields.io/pypi/dm/skypilot">
|
|
190
|
-
</a>
|
|
191
|
-
|
|
192
|
-
</p>
|
|
193
|
-
|
|
194
|
-
<h3 align="center">
|
|
195
|
-
Run AI on Any Infra — Unified, Faster, Cheaper
|
|
196
|
-
</h3>
|
|
197
|
-
|
|
198
|
-
----
|
|
199
|
-
:fire: *News* :fire:
|
|
200
|
-
- [Apr 2025] Spin up **Qwen3** on your cluster/cloud: [**example**](./llm/qwen/)
|
|
201
|
-
- [Mar 2025] Run and serve **Google Gemma 3** using SkyPilot [**example**](./llm/gemma3/)
|
|
202
|
-
- [Feb 2025] Prepare and serve **Retrieval Augmented Generation (RAG) with DeepSeek-R1**: [**blog post**](https://blog.skypilot.co/deepseek-rag), [**example**](./llm/rag/)
|
|
203
|
-
- [Feb 2025] Run and serve **DeepSeek-R1 671B** using SkyPilot and SGLang with high throughput: [**example**](./llm/deepseek-r1/)
|
|
204
|
-
- [Feb 2025] Prepare and serve large-scale image search with **vector databases**: [**blog post**](https://blog.skypilot.co/large-scale-vector-database/), [**example**](./examples/vector_database/)
|
|
205
|
-
- [Jan 2025] Launch and serve distilled models from **[DeepSeek-R1](https://github.com/deepseek-ai/DeepSeek-R1)** and **[Janus](https://github.com/deepseek-ai/DeepSeek-Janus)** on Kubernetes or any cloud: [**R1 example**](./llm/deepseek-r1-distilled/) and [**Janus example**](./llm/deepseek-janus/)
|
|
206
|
-
- [Oct 2024] :tada: **SkyPilot crossed 1M+ downloads** :tada:: Thank you to our community! [**Twitter/X**](https://x.com/skypilot_org/status/1844770841718067638)
|
|
207
|
-
- [Sep 2024] Point, launch and serve **Llama 3.2** on Kubernetes or any cloud: [**example**](./llm/llama-3_2/)
|
|
208
|
-
- [Sep 2024] Run and deploy [**Pixtral**](./llm/pixtral), the first open-source multimodal model from Mistral AI.
|
|
209
|
-
- [Jun 2024] Reproduce **GPT** with [llm.c](https://github.com/karpathy/llm.c/discussions/481) on any cloud: [**guide**](./llm/gpt-2/)
|
|
210
|
-
- [Apr 2024] Serve [**Qwen-110B**](https://qwenlm.github.io/blog/qwen1.5-110b/) on your infra: [**example**](./llm/qwen/)
|
|
211
|
-
- [Apr 2024] Host [**Ollama**](https://github.com/ollama/ollama) on the cloud to deploy LLMs on CPUs and GPUs: [**example**](./llm/ollama/)
|
|
212
|
-
|
|
213
|
-
|
|
214
|
-
**LLM Finetuning Cookbooks**: Finetuning Llama 2 / Llama 3.1 in your own cloud environment, privately: Llama 2 [**example**](./llm/vicuna-llama-2/) and [**blog**](https://blog.skypilot.co/finetuning-llama2-operational-guide/); Llama 3.1 [**example**](./llm/llama-3_1-finetuning/) and [**blog**](https://blog.skypilot.co/finetune-llama-3_1-on-your-infra/)
|
|
215
|
-
|
|
216
|
-
----
|
|
217
|
-
|
|
218
|
-
SkyPilot is an open-source framework for running AI and batch workloads on any infra.
|
|
219
|
-
|
|
220
|
-
SkyPilot **is easy to use for AI users**:
|
|
221
|
-
- Quickly spin up compute on your own infra
|
|
222
|
-
- Environment and job as code — simple and portable
|
|
223
|
-
- Easy job management: queue, run, and auto-recover many jobs
|
|
224
|
-
|
|
225
|
-
SkyPilot **unifies multiple clusters, clouds, and hardware**:
|
|
226
|
-
- One interface to use reserved GPUs, Kubernetes clusters, or 16+ clouds
|
|
227
|
-
- [Flexible provisioning](https://docs.skypilot.co/en/latest/examples/auto-failover.html) of GPUs, TPUs, CPUs, with auto-retry
|
|
228
|
-
- [Team deployment](https://docs.skypilot.co/en/latest/reference/api-server/api-server.html) and resource sharing
|
|
229
|
-
|
|
230
|
-
SkyPilot **cuts your cloud costs & maximizes GPU availability**:
|
|
231
|
-
* Autostop: automatic cleanup of idle resources
|
|
232
|
-
* [Spot instance support](https://docs.skypilot.co/en/latest/examples/managed-jobs.html#running-on-spot-instances): 3-6x cost savings, with preemption auto-recovery
|
|
233
|
-
* Intelligent scheduling: automatically run on the cheapest & most available infra
|
|
234
|
-
|
|
235
|
-
SkyPilot supports your existing GPU, TPU, and CPU workloads, with no code changes.
|
|
236
|
-
|
|
237
|
-
Install with pip:
|
|
238
|
-
```bash
|
|
239
|
-
# Choose your clouds:
|
|
240
|
-
pip install -U "skypilot[kubernetes,aws,gcp,azure,oci,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,nebius]"
|
|
241
|
-
```
|
|
242
|
-
To get the latest features and fixes, use the nightly build or [install from source](https://docs.skypilot.co/en/latest/getting-started/installation.html):
|
|
243
|
-
```bash
|
|
244
|
-
# Choose your clouds:
|
|
245
|
-
pip install "skypilot-nightly[kubernetes,aws,gcp,azure,oci,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,nebius]"
|
|
246
|
-
```
|
|
247
|
-
|
|
248
|
-
<p align="center">
|
|
249
|
-
<img src="docs/source/_static/intro.gif" alt="SkyPilot">
|
|
250
|
-
</p>
|
|
251
|
-
|
|
252
|
-
Current supported infra: Kubernetes, AWS, GCP, Azure, OCI, Lambda Cloud, Fluidstack,
|
|
253
|
-
RunPod, Cudo, Digital Ocean, Paperspace, Cloudflare, Samsung, IBM, Vast.ai,
|
|
254
|
-
VMware vSphere, Nebius.
|
|
255
|
-
<p align="center">
|
|
256
|
-
<img alt="SkyPilot" src="https://raw.githubusercontent.com/skypilot-org/skypilot/master/docs/source/images/cloud-logos-light.png" width=85%>
|
|
257
|
-
</p>
|
|
258
|
-
<!-- source xcf file: https://drive.google.com/drive/folders/1S_acjRsAD3T14qMeEnf6FFrIwHu_Gs_f?usp=drive_link -->
|
|
259
|
-
|
|
260
|
-
|
|
261
|
-
## Getting started
|
|
262
|
-
You can find our documentation [here](https://docs.skypilot.co/).
|
|
263
|
-
- [Installation](https://docs.skypilot.co/en/latest/getting-started/installation.html)
|
|
264
|
-
- [Quickstart](https://docs.skypilot.co/en/latest/getting-started/quickstart.html)
|
|
265
|
-
- [CLI reference](https://docs.skypilot.co/en/latest/reference/cli.html)
|
|
266
|
-
|
|
267
|
-
## SkyPilot in 1 minute
|
|
268
|
-
|
|
269
|
-
A SkyPilot task specifies: resource requirements, data to be synced, setup commands, and the task commands.
|
|
270
|
-
|
|
271
|
-
Once written in this [**unified interface**](https://docs.skypilot.co/en/latest/reference/yaml-spec.html) (YAML or Python API), the task can be launched on any available cloud. This avoids vendor lock-in, and allows easily moving jobs to a different provider.
|
|
272
|
-
|
|
273
|
-
Paste the following into a file `my_task.yaml`:
|
|
274
|
-
|
|
275
|
-
```yaml
|
|
276
|
-
resources:
|
|
277
|
-
accelerators: A100:8 # 8x NVIDIA A100 GPU
|
|
278
|
-
|
|
279
|
-
num_nodes: 1 # Number of VMs to launch
|
|
280
|
-
|
|
281
|
-
# Working directory (optional) containing the project codebase.
|
|
282
|
-
# Its contents are synced to ~/sky_workdir/ on the cluster.
|
|
283
|
-
workdir: ~/torch_examples
|
|
284
|
-
|
|
285
|
-
# Commands to be run before executing the job.
|
|
286
|
-
# Typical use: pip install -r requirements.txt, git clone, etc.
|
|
287
|
-
setup: |
|
|
288
|
-
pip install "torch<2.2" torchvision --index-url https://download.pytorch.org/whl/cu121
|
|
289
|
-
|
|
290
|
-
# Commands to run as a job.
|
|
291
|
-
# Typical use: launch the main program.
|
|
292
|
-
run: |
|
|
293
|
-
cd mnist
|
|
294
|
-
python main.py --epochs 1
|
|
295
|
-
```
|
|
296
|
-
|
|
297
|
-
Prepare the workdir by cloning:
|
|
298
|
-
```bash
|
|
299
|
-
git clone https://github.com/pytorch/examples.git ~/torch_examples
|
|
300
|
-
```
|
|
301
|
-
|
|
302
|
-
Launch with `sky launch` (note: [access to GPU instances](https://docs.skypilot.co/en/latest/cloud-setup/quota.html) is needed for this example):
|
|
303
|
-
```bash
|
|
304
|
-
sky launch my_task.yaml
|
|
305
|
-
```
|
|
306
|
-
|
|
307
|
-
SkyPilot then performs the heavy-lifting for you, including:
|
|
308
|
-
1. Find the lowest priced VM instance type across different clouds
|
|
309
|
-
2. Provision the VM, with auto-failover if the cloud returned capacity errors
|
|
310
|
-
3. Sync the local `workdir` to the VM
|
|
311
|
-
4. Run the task's `setup` commands to prepare the VM for running the task
|
|
312
|
-
5. Run the task's `run` commands
|
|
313
|
-
|
|
314
|
-
|
|
315
|
-
See [Quickstart](https://docs.skypilot.co/en/latest/getting-started/quickstart.html) to get started with SkyPilot.
|
|
316
|
-
|
|
317
|
-
## Runnable examples
|
|
318
|
-
|
|
319
|
-
See [**SkyPilot examples**](https://docs.skypilot.co/en/docs-examples/examples/index.html) that cover: development, training, serving, LLM models, AI apps, and common frameworks.
|
|
320
|
-
|
|
321
|
-
Latest featured examples:
|
|
322
|
-
|
|
323
|
-
| Task | Examples |
|
|
324
|
-
|----------|----------|
|
|
325
|
-
| Training | [PyTorch](https://docs.skypilot.co/en/latest/getting-started/tutorial.html), [DeepSpeed](https://docs.skypilot.co/en/latest/examples/training/deepspeed.html), [Finetune Llama 3](https://docs.skypilot.co/en/latest/examples/training/llama-3_1-finetuning.html), [NeMo](https://docs.skypilot.co/en/latest/examples/training/nemo.html), [Ray](https://docs.skypilot.co/en/latest/examples/training/ray.html), [Unsloth](https://docs.skypilot.co/en/latest/examples/training/unsloth.html), [Jax/TPU](https://docs.skypilot.co/en/latest/examples/training/tpu.html) |
|
|
326
|
-
| Serving | [vLLM](https://docs.skypilot.co/en/latest/examples/serving/vllm.html), [SGLang](https://docs.skypilot.co/en/latest/examples/serving/sglang.html), [Ollama](https://docs.skypilot.co/en/latest/examples/serving/ollama.html) |
|
|
327
|
-
| Models | [DeepSeek-R1](https://docs.skypilot.co/en/latest/examples/models/deepseek-r1.html), [Llama 3](https://docs.skypilot.co/en/latest/examples/models/llama-3.html), [CodeLlama](https://docs.skypilot.co/en/latest/examples/models/codellama.html), [Qwen](https://docs.skypilot.co/en/latest/examples/models/qwen.html), [Mixtral](https://docs.skypilot.co/en/latest/examples/models/mixtral.html) |
|
|
328
|
-
| AI apps | [RAG](https://docs.skypilot.co/en/latest/examples/applications/rag.html), [vector databases](https://docs.skypilot.co/en/latest/examples/applications/vector_database.html) (ChromaDB, CLIP) |
|
|
329
|
-
| Common frameworks | [Airflow](https://docs.skypilot.co/en/latest/examples/frameworks/airflow.html), [Jupyter](https://docs.skypilot.co/en/latest/examples/frameworks/jupyter.html) |
|
|
330
|
-
|
|
331
|
-
Source files and more examples can be found in [`llm/`](https://github.com/skypilot-org/skypilot/tree/master/llm) and [`examples/`](https://github.com/skypilot-org/skypilot/tree/master/examples).
|
|
332
|
-
|
|
333
|
-
## More information
|
|
334
|
-
To learn more, see [SkyPilot Overview](https://docs.skypilot.co/en/latest/overview.html), [SkyPilot docs](https://docs.skypilot.co/en/latest/), and [SkyPilot blog](https://blog.skypilot.co/).
|
|
335
|
-
|
|
336
|
-
Case studies and integrations: [Community Spotlights](https://blog.skypilot.co/community/)
|
|
337
|
-
|
|
338
|
-
Follow updates:
|
|
339
|
-
- [Slack](http://slack.skypilot.co)
|
|
340
|
-
- [X / Twitter](https://twitter.com/skypilot_org)
|
|
341
|
-
- [LinkedIn](https://www.linkedin.com/company/skypilot-oss/)
|
|
342
|
-
- [SkyPilot Blog](https://blog.skypilot.co/) ([Introductory blog post](https://blog.skypilot.co/introducing-skypilot/))
|
|
343
|
-
|
|
344
|
-
Read the research:
|
|
345
|
-
- [SkyPilot paper](https://www.usenix.org/system/files/nsdi23-yang-zongheng.pdf) and [talk](https://www.usenix.org/conference/nsdi23/presentation/yang-zongheng) (NSDI 2023)
|
|
346
|
-
- [Sky Computing whitepaper](https://arxiv.org/abs/2205.07147)
|
|
347
|
-
- [Sky Computing vision paper](https://sigops.org/s/conferences/hotos/2021/papers/hotos21-s02-stoica.pdf) (HotOS 2021)
|
|
348
|
-
- [SkyServe: AI serving across regions and clouds](https://arxiv.org/pdf/2411.01438) (EuroSys 2025)
|
|
349
|
-
- [Managed jobs spot instance policy](https://www.usenix.org/conference/nsdi24/presentation/wu-zhanghao) (NSDI 2024)
|
|
350
|
-
|
|
351
|
-
SkyPilot was initially started at the [Sky Computing Lab](https://sky.cs.berkeley.edu) at UC Berkeley and has since gained many industry contributors. To read about the project's origin and vision, see [Concept: Sky Computing](https://docs.skypilot.co/en/latest/sky-computing.html).
|
|
352
|
-
|
|
353
|
-
## Questions and feedback
|
|
354
|
-
We are excited to hear your feedback:
|
|
355
|
-
* For issues and feature requests, please [open a GitHub issue](https://github.com/skypilot-org/skypilot/issues/new).
|
|
356
|
-
* For questions, please use [GitHub Discussions](https://github.com/skypilot-org/skypilot/discussions).
|
|
357
|
-
|
|
358
|
-
For general discussions, join us on the [SkyPilot Slack](http://slack.skypilot.co).
|
|
359
|
-
|
|
360
|
-
## Contributing
|
|
361
|
-
We welcome all contributions to the project! See [CONTRIBUTING](CONTRIBUTING.md) for how to get involved.
|