ductwork 0.21.0 → 0.23.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG-PRO.md +4 -0
- data/CHANGELOG.md +8 -0
- data/README.md +1 -1
- data/lib/ductwork/dsl/definition_builder.rb +2 -1
- data/lib/ductwork/models/pipeline.rb +1 -0
- data/lib/ductwork/version.rb +1 -1
- metadata +1 -1
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 686d40932f01858794198573db83781441b957b5f1b6feb40c573fae0d6b875c
|
|
4
|
+
data.tar.gz: e8c518dbbf9efd739469acf901818e01d1ef2bcdce6dbbbb27be02374f1f252a
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: a5f4c347af00d90e6ae287588d9c66c2056a67ddd687080dd0943d81a12e9bd587c43516034d40312fe7fd28d3c9d20587931caa6288e56644f8789e6c0e1227
|
|
7
|
+
data.tar.gz: 8f152357a0230fbc53230ac70f2e56c687c040909f00493e037c2710b0fa2f754c6e38745b736c60e78bce5a7f75b230d8aeb69c6aebf301a0ad36f8a26e9732
|
data/CHANGELOG-PRO.md
CHANGED
|
@@ -1,5 +1,9 @@
|
|
|
1
1
|
# Ductwork Pro Changelog
|
|
2
2
|
|
|
3
|
+
## [0.5.0]
|
|
4
|
+
|
|
5
|
+
- feat: enqueue jobs in batches when expanding and support starting delays
|
|
6
|
+
|
|
3
7
|
## [0.4.0]
|
|
4
8
|
|
|
5
9
|
- feat: release pipeline or job claim if not finished by shutdown timeout - this is basically the same as what happens when a step times out except we don't restart the thread because we're shutting down
|
data/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,13 @@
|
|
|
1
1
|
# Ductwork Changelog
|
|
2
2
|
|
|
3
|
+
## [0.23.0]
|
|
4
|
+
|
|
5
|
+
- chore: add `paused` pipeline status to enum
|
|
6
|
+
|
|
7
|
+
## [0.22.0]
|
|
8
|
+
|
|
9
|
+
- feat: add optional `to` keyword argument to `chain` transition - this makes the DSL a bit more aligned
|
|
10
|
+
|
|
3
11
|
## [0.21.0]
|
|
4
12
|
|
|
5
13
|
- feat: enqueue jobs in batches when expanding - this marks a major performance improvement
|
data/README.md
CHANGED
|
@@ -103,7 +103,7 @@ class EnrichUserDataPipeline < Ductwork::Pipeline
|
|
|
103
103
|
.divide(to: [FetchDataFromSourceA, # Split into parallel branches
|
|
104
104
|
FetchDataFromSourceB])
|
|
105
105
|
.combine(into: CollateUserData) # Merge branches back together
|
|
106
|
-
.chain(UpdateUserData)
|
|
106
|
+
.chain(to: UpdateUserData) # Sequential processing
|
|
107
107
|
.collapse(into: ReportSuccess) # Gather expanded steps
|
|
108
108
|
end
|
|
109
109
|
end
|
data/lib/ductwork/version.rb
CHANGED