@colony2/jobdb 0.0.15 → 0.0.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -45
- package/package.json +17 -17
package/README.md
CHANGED
|
@@ -21,6 +21,12 @@ Verify the command is available:
|
|
|
21
21
|
jobdb --help
|
|
22
22
|
```
|
|
23
23
|
|
|
24
|
+
## Container Image
|
|
25
|
+
|
|
26
|
+
The Postgres container is released from the
|
|
27
|
+
[`pgjobdb` repository](https://github.com/colony-2/pgjobdb) as
|
|
28
|
+
`ghcr.io/colony-2/pgjobdb:<release-tag>`.
|
|
29
|
+
|
|
24
30
|
## Quick Start
|
|
25
31
|
|
|
26
32
|
Run the default SQLite-backed server:
|
|
@@ -79,57 +85,23 @@ for durable execution.
|
|
|
79
85
|
jobdb toy --listen 127.0.0.1:9047
|
|
80
86
|
```
|
|
81
87
|
|
|
82
|
-
###
|
|
83
|
-
|
|
84
|
-
The direct backend uses Postgres for job and chapter records, and a blobstore
|
|
85
|
-
URI for large artifact bytes. It installs or verifies the `pgwf` schema on
|
|
86
|
-
startup.
|
|
87
|
-
|
|
88
|
-
```bash
|
|
89
|
-
JOBDB_POSTGRES_DSN='postgres://user:pass@localhost:5432/jobdb?sslmode=disable' \
|
|
90
|
-
jobdb direct --blob-store-uri 's3://jobdb-artifacts?region=us-east-1' --listen 127.0.0.1:9047
|
|
91
|
-
```
|
|
88
|
+
### Postgres
|
|
92
89
|
|
|
93
|
-
|
|
90
|
+
The base `jobdb` CLI provides SQLite and toy backends. The Postgres runtime,
|
|
91
|
+
`direct` and `serve` commands, and container image are provided by
|
|
92
|
+
[`pgjobdb`](https://github.com/colony-2/pgjobdb). It composes JobDB's public
|
|
93
|
+
runtime core with the typed Postgres scheduler.
|
|
94
94
|
|
|
95
|
-
|
|
96
|
-
- `--blob-store-uri`: blob bucket URL for large artifacts. The `jobdb`
|
|
97
|
-
executable includes Go CDK providers, so it supports `file://`, `gs://`,
|
|
98
|
-
`s3://`, and `azblob://`; defaults to local `blobfs://`.
|
|
99
|
-
- `--listen`: HTTP listen address. Defaults to `127.0.0.1:9047`.
|
|
100
|
-
|
|
101
|
-
Environment:
|
|
102
|
-
|
|
103
|
-
- `JOBDB_POSTGRES_DSN`: Postgres DSN used when `--postgres-dsn` is not set.
|
|
104
|
-
|
|
105
|
-
Blob URL examples:
|
|
106
|
-
|
|
107
|
-
- Local filesystem: `file:///var/lib/jobdb/blobs` or legacy
|
|
108
|
-
`blobfs:///var/lib/jobdb/blobs`.
|
|
109
|
-
- Google Cloud Storage: `gs://jobdb-artifacts?prefix=prod/`.
|
|
110
|
-
- Amazon S3: `s3://jobdb-artifacts?region=us-east-1&prefix=prod/`.
|
|
111
|
-
- Azure Blob Storage: `azblob://jobdb-artifacts?prefix=prod/`.
|
|
112
|
-
|
|
113
|
-
Credential resolution is handled by the Go CDK provider drivers, so `jobdb`
|
|
114
|
-
does not need separate credential flags:
|
|
115
|
-
|
|
116
|
-
- GCS uses Application Default Credentials. Use
|
|
117
|
-
`GOOGLE_APPLICATION_CREDENTIALS`, `gcloud auth application-default login`, or
|
|
118
|
-
attached Google Cloud service account credentials in VM/container
|
|
119
|
-
environments.
|
|
120
|
-
- S3 uses the AWS SDK for Go v2 configuration chain. Provide `AWS_REGION` and
|
|
121
|
-
credentials through environment variables, shared `~/.aws/config` and
|
|
122
|
-
`~/.aws/credentials` profiles, or attached instance/task roles.
|
|
123
|
-
- Azure Blob Storage uses Go CDK's Azure driver. Provide
|
|
124
|
-
`AZURE_STORAGE_ACCOUNT` with `AZURE_STORAGE_KEY`, a connection string, a SAS
|
|
125
|
-
token, or Azure default credentials such as environment credentials, Azure
|
|
126
|
-
CLI credentials, or managed identity.
|
|
127
|
-
|
|
128
|
-
Library embedders of `runtime/sqlite` or `runtime/direct` only get `blobfs://`
|
|
95
|
+
Library embedders of `runtime/sqlite` only gets `blobfs://`
|
|
129
96
|
support by default. Import
|
|
130
97
|
`github.com/colony-2/jobdb/pkg/jobdb/blobstore/gocdk` from executable/server
|
|
131
98
|
code to enable Go CDK provider URI registration.
|
|
132
99
|
|
|
100
|
+
Library users can import `github.com/colony-2/pgjobdb/pkg/pgjobdb/runtime`
|
|
101
|
+
for Postgres or import another runtime implementation. The public
|
|
102
|
+
`github.com/colony-2/jobdb/pkg/jobdb` and `runtime/core` packages do not
|
|
103
|
+
import pgjobdb.
|
|
104
|
+
|
|
133
105
|
References:
|
|
134
106
|
|
|
135
107
|
- [Go CDK blob storage guide](https://gocloud.dev/howto/blob/)
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@colony2/jobdb",
|
|
3
3
|
"type": "module",
|
|
4
|
-
"version": "0.0.
|
|
4
|
+
"version": "0.0.17",
|
|
5
5
|
"description": "jobdb job system",
|
|
6
6
|
"scripts": {
|
|
7
7
|
"postinstall": "node install.js",
|
|
@@ -30,54 +30,57 @@
|
|
|
30
30
|
},
|
|
31
31
|
"archives": {
|
|
32
32
|
"darwin-arm64": {
|
|
33
|
-
"name": "jobdb_0.0.
|
|
34
|
-
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.
|
|
33
|
+
"name": "jobdb_0.0.17_Darwin_arm64.tar.gz",
|
|
34
|
+
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.17/jobdb_0.0.17_Darwin_arm64.tar.gz",
|
|
35
35
|
"bins": [
|
|
36
36
|
"jobdb"
|
|
37
37
|
],
|
|
38
38
|
"format": "tar.gz",
|
|
39
39
|
"checksum": {
|
|
40
40
|
"algorithm": "sha256",
|
|
41
|
-
"digest": "
|
|
41
|
+
"digest": "e1e11f94e870ad56db9742f9bbfcf56df3208e4c74b81e147593fc84592d3360"
|
|
42
42
|
}
|
|
43
43
|
},
|
|
44
44
|
"darwin-x64": {
|
|
45
|
-
"name": "jobdb_0.0.
|
|
46
|
-
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.
|
|
45
|
+
"name": "jobdb_0.0.17_Darwin_x86_64.tar.gz",
|
|
46
|
+
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.17/jobdb_0.0.17_Darwin_x86_64.tar.gz",
|
|
47
47
|
"bins": [
|
|
48
48
|
"jobdb"
|
|
49
49
|
],
|
|
50
50
|
"format": "tar.gz",
|
|
51
51
|
"checksum": {
|
|
52
52
|
"algorithm": "sha256",
|
|
53
|
-
"digest": "
|
|
53
|
+
"digest": "ac81ffc25587ac7db7b622de910357411983c914e3d5ab72de04928aff967954"
|
|
54
54
|
}
|
|
55
55
|
},
|
|
56
56
|
"linux-arm64": {
|
|
57
|
-
"name": "jobdb_0.0.
|
|
58
|
-
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.
|
|
57
|
+
"name": "jobdb_0.0.17_Linux_arm64.tar.gz",
|
|
58
|
+
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.17/jobdb_0.0.17_Linux_arm64.tar.gz",
|
|
59
59
|
"bins": [
|
|
60
60
|
"jobdb"
|
|
61
61
|
],
|
|
62
62
|
"format": "tar.gz",
|
|
63
63
|
"checksum": {
|
|
64
64
|
"algorithm": "sha256",
|
|
65
|
-
"digest": "
|
|
65
|
+
"digest": "88f749d2b99f8adaafe23e037f691b10637515ec89a33260b349ef1be677ceb8"
|
|
66
66
|
}
|
|
67
67
|
},
|
|
68
68
|
"linux-x64": {
|
|
69
|
-
"name": "jobdb_0.0.
|
|
70
|
-
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.
|
|
69
|
+
"name": "jobdb_0.0.17_Linux_x86_64.tar.gz",
|
|
70
|
+
"url": "https://github.com/colony-2/jobdb/releases/download/v0.0.17/jobdb_0.0.17_Linux_x86_64.tar.gz",
|
|
71
71
|
"bins": [
|
|
72
72
|
"jobdb"
|
|
73
73
|
],
|
|
74
74
|
"format": "tar.gz",
|
|
75
75
|
"checksum": {
|
|
76
76
|
"algorithm": "sha256",
|
|
77
|
-
"digest": "
|
|
77
|
+
"digest": "c9b3fa9d6a15e15f1e105ab4f1fd178ff2637e0339eed4e73fca8b39d55dfe86"
|
|
78
78
|
}
|
|
79
79
|
}
|
|
80
80
|
},
|
|
81
|
+
"engines": {
|
|
82
|
+
"node": "\u003e=14.0.0"
|
|
83
|
+
},
|
|
81
84
|
"keywords": [
|
|
82
85
|
"sandbox",
|
|
83
86
|
"docker",
|
|
@@ -85,8 +88,5 @@
|
|
|
85
88
|
"agent",
|
|
86
89
|
"cli",
|
|
87
90
|
"security"
|
|
88
|
-
]
|
|
89
|
-
"engines": {
|
|
90
|
-
"node": "\u003e=14.0.0"
|
|
91
|
-
}
|
|
91
|
+
]
|
|
92
92
|
}
|