med_pipe 0.1.0.4 → 0.1.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/README.md +8 -0
- data/lib/med_pipe/pipeline_plan_consumer.rb +1 -1
- data/lib/med_pipe/version.rb +1 -1
- metadata +4 -19
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 254b6d0a324f400418ad4ead68cc2741f779e77a1a18f01b0e865737d783358b
|
|
4
|
+
data.tar.gz: ab801a44a97d8ff5a9f6bba5ca023bd0dc1712707d20b7d3754981f6c7528228
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 8d94037e54f43df01d53f95057e21597660afa3c4eedb24d107ed2ffeb5d7d5c823f4ed9f0ea28a9267bd26d58be6fc22e7dbc6eb918ddb059bbead9db85f418
|
|
7
|
+
data.tar.gz: 0c744341829cb8f970acbd26da6e3b6708534b18e2ad0a34cc8641b7ba48d313a6f788de486827c37b7ffd0238d33227f76130e40ddc5753159b53f12af3dee9
|
data/README.md
CHANGED
|
@@ -48,6 +48,14 @@ gem "med_pipe"
|
|
|
48
48
|
$ rails med_pipe:install:migrations
|
|
49
49
|
```
|
|
50
50
|
|
|
51
|
+
### Test
|
|
52
|
+
|
|
53
|
+
Add this line to your test.rb to use factories in med_pipe
|
|
54
|
+
|
|
55
|
+
```test.rb
|
|
56
|
+
config.factory_bot.definition_file_paths << MedPipe::Engine.root.join('spec/factories')
|
|
57
|
+
```
|
|
58
|
+
|
|
51
59
|
## Contributing
|
|
52
60
|
Bug reports and pull requests are welcome.
|
|
53
61
|
|
|
@@ -28,7 +28,7 @@ class MedPipe::PipelinePlanConsumer
|
|
|
28
28
|
target_pipeline_plan = @pipeline_group.pipeline_plans.lock.status_enqueued.order(priority: :desc).first
|
|
29
29
|
return if target_pipeline_plan.nil?
|
|
30
30
|
|
|
31
|
-
target_pipeline_plan.update!(status: :running)
|
|
31
|
+
target_pipeline_plan.update!(status: :running, started_at: Time.current)
|
|
32
32
|
target_pipeline_plan
|
|
33
33
|
end
|
|
34
34
|
end
|
data/lib/med_pipe/version.rb
CHANGED
metadata
CHANGED
|
@@ -1,14 +1,14 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: med_pipe
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 0.1.
|
|
4
|
+
version: 0.1.1
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
7
|
- mpg-taichi-sato
|
|
8
8
|
autorequire:
|
|
9
9
|
bindir: bin
|
|
10
10
|
cert_chain: []
|
|
11
|
-
date: 2024-11-
|
|
11
|
+
date: 2024-11-28 00:00:00.000000000 Z
|
|
12
12
|
dependencies:
|
|
13
13
|
- !ruby/object:Gem::Dependency
|
|
14
14
|
name: rails
|
|
@@ -30,23 +30,8 @@ dependencies:
|
|
|
30
30
|
- - "<"
|
|
31
31
|
- !ruby/object:Gem::Version
|
|
32
32
|
version: '8.0'
|
|
33
|
-
description:
|
|
34
|
-
|
|
35
|
-
MedPipe::PipelineTask\nPipeline に登録する処理の単位です。 \nDB からの読み込みや、S3 へのアップロード等やることを分割してタスク化します。
|
|
36
|
-
\ \n大量データを扱う際には Enumerable::Lazy を使うことで分割して処理をすることができます。 \ncall を実装する必要があります\n\n```.rb\n@param
|
|
37
|
-
context [Hash] Stores data during pipeline execution\n@param prev_result [Object]
|
|
38
|
-
The result of the previous task\ndef call(context, prev_result)\n yield 次のTaskに渡すデータ\nend\n```\n\n###
|
|
39
|
-
MedPipe::PipelinePlan\nPipeline の状態、オプション、結果を保存するためのモデルです。 \nTask で使うためのオプションを渡す方法は
|
|
40
|
-
PipelinePlan から取得するか、contextで伝搬するかの二択です。\n\n### MedPipe::PipelineGroup\n一つのジョブで実行する
|
|
41
|
-
Plan をまとめるためのモデルです。 \n実行中に parallel_limit を 0 にすることで中断することができます。\n\n## Usage\n\n1.
|
|
42
|
-
Reader, Uploader 等の PipelineTask を作成 [Samples](https://github.com/medpeer-dev/med_pipe/tree/main/spec/dummy/app/models/pipeline_task)\n2.
|
|
43
|
-
PipelineRunner を作成 [Sample](https://github.com/medpeer-dev/med_pipe/blob/main/spec/dummy/app/models/sample_pipeline_runner.rb)\n3.
|
|
44
|
-
Pipeline を並列実行するためのジョブを作成 [Sample](https://github.com/medpeer-dev/med_pipe/blob/main/spec/dummy/app/jobs/sample_execute_pipeline_job.rb)\n4.
|
|
45
|
-
PipelinePlan を登録するコードを記述\n5. 実行\n\n## Installation\nAdd this line to your application's
|
|
46
|
-
Gemfile:\n\n```ruby\ngem \"med_pipe\"\n```\n\n### migrationファイルの追加\n\n```shell\n$
|
|
47
|
-
rails med_pipe:install:migrations\n```\n\n## Contributing\nBug reports and pull
|
|
48
|
-
requests are welcome.\n\n## License\nThe gem is available as open source under the
|
|
49
|
-
terms of the [MIT License](https://opensource.org/licenses/MIT).\n"
|
|
33
|
+
description: Provides a system for processing data ranging from 1 million to several
|
|
34
|
+
billion records
|
|
50
35
|
email:
|
|
51
36
|
executables: []
|
|
52
37
|
extensions: []
|