karafka 1.4.15 → 2.0.0.alpha1

Sign up to get free protection for your applications and to get access to all the features.
Files changed (128) hide show
  1. checksums.yaml +4 -4
  2. checksums.yaml.gz.sig +0 -0
  3. data/.github/FUNDING.yml +3 -0
  4. data/.github/workflows/ci.yml +74 -24
  5. data/.ruby-version +1 -1
  6. data/CHANGELOG.md +38 -39
  7. data/Gemfile +6 -0
  8. data/Gemfile.lock +50 -52
  9. data/LICENSE +14 -0
  10. data/LICENSE-COMM +89 -0
  11. data/LICENSE-LGPL +165 -0
  12. data/README.md +59 -14
  13. data/bin/benchmarks +85 -0
  14. data/bin/create_token +28 -0
  15. data/bin/integrations +160 -0
  16. data/bin/stress +13 -0
  17. data/certs/karafka-pro.pem +11 -0
  18. data/certs/mensfeld.pem +23 -24
  19. data/config/errors.yml +4 -38
  20. data/docker-compose.yml +11 -3
  21. data/karafka.gemspec +10 -20
  22. data/lib/active_job/consumer.rb +22 -0
  23. data/lib/active_job/karafka.rb +18 -0
  24. data/lib/active_job/queue_adapters/karafka_adapter.rb +29 -0
  25. data/lib/active_job/routing_extensions.rb +15 -0
  26. data/lib/karafka/app.rb +13 -20
  27. data/lib/karafka/base_consumer.rb +103 -34
  28. data/lib/karafka/cli/base.rb +4 -4
  29. data/lib/karafka/cli/info.rb +43 -8
  30. data/lib/karafka/cli/install.rb +3 -8
  31. data/lib/karafka/cli/server.rb +17 -30
  32. data/lib/karafka/cli.rb +4 -11
  33. data/lib/karafka/connection/client.rb +279 -93
  34. data/lib/karafka/connection/listener.rb +137 -38
  35. data/lib/karafka/connection/messages_buffer.rb +57 -0
  36. data/lib/karafka/connection/pauses_manager.rb +46 -0
  37. data/lib/karafka/connection/rebalance_manager.rb +62 -0
  38. data/lib/karafka/contracts/config.rb +25 -7
  39. data/lib/karafka/contracts/consumer_group.rb +0 -173
  40. data/lib/karafka/contracts/consumer_group_topic.rb +17 -7
  41. data/lib/karafka/contracts/server_cli_options.rb +1 -9
  42. data/lib/karafka/contracts.rb +1 -1
  43. data/lib/karafka/env.rb +46 -0
  44. data/lib/karafka/errors.rb +14 -18
  45. data/lib/karafka/helpers/multi_delegator.rb +2 -2
  46. data/lib/karafka/instrumentation/callbacks/error.rb +40 -0
  47. data/lib/karafka/instrumentation/callbacks/statistics.rb +42 -0
  48. data/lib/karafka/instrumentation/monitor.rb +14 -21
  49. data/lib/karafka/instrumentation/stdout_listener.rb +64 -91
  50. data/lib/karafka/instrumentation.rb +21 -0
  51. data/lib/karafka/licenser.rb +65 -0
  52. data/lib/karafka/{params → messages}/batch_metadata.rb +7 -13
  53. data/lib/karafka/messages/builders/batch_metadata.rb +30 -0
  54. data/lib/karafka/messages/builders/message.rb +38 -0
  55. data/lib/karafka/messages/builders/messages.rb +40 -0
  56. data/lib/karafka/{params/params.rb → messages/message.rb} +7 -12
  57. data/lib/karafka/messages/messages.rb +64 -0
  58. data/lib/karafka/{params → messages}/metadata.rb +4 -6
  59. data/lib/karafka/messages/seek.rb +9 -0
  60. data/lib/karafka/patches/rdkafka/consumer.rb +22 -0
  61. data/lib/karafka/processing/executor.rb +96 -0
  62. data/lib/karafka/processing/executors_buffer.rb +49 -0
  63. data/lib/karafka/processing/jobs/base.rb +18 -0
  64. data/lib/karafka/processing/jobs/consume.rb +28 -0
  65. data/lib/karafka/processing/jobs/revoked.rb +22 -0
  66. data/lib/karafka/processing/jobs/shutdown.rb +23 -0
  67. data/lib/karafka/processing/jobs_queue.rb +121 -0
  68. data/lib/karafka/processing/worker.rb +57 -0
  69. data/lib/karafka/processing/workers_batch.rb +22 -0
  70. data/lib/karafka/railtie.rb +65 -0
  71. data/lib/karafka/routing/builder.rb +15 -14
  72. data/lib/karafka/routing/consumer_group.rb +10 -18
  73. data/lib/karafka/routing/consumer_mapper.rb +1 -2
  74. data/lib/karafka/routing/router.rb +1 -1
  75. data/lib/karafka/routing/subscription_group.rb +53 -0
  76. data/lib/karafka/routing/subscription_groups_builder.rb +51 -0
  77. data/lib/karafka/routing/topic.rb +47 -25
  78. data/lib/karafka/runner.rb +59 -0
  79. data/lib/karafka/serialization/json/deserializer.rb +6 -15
  80. data/lib/karafka/server.rb +62 -25
  81. data/lib/karafka/setup/config.rb +86 -159
  82. data/lib/karafka/status.rb +13 -3
  83. data/lib/karafka/templates/example_consumer.rb.erb +16 -0
  84. data/lib/karafka/templates/karafka.rb.erb +14 -50
  85. data/lib/karafka/time_trackers/base.rb +19 -0
  86. data/lib/karafka/time_trackers/pause.rb +84 -0
  87. data/lib/karafka/time_trackers/poll.rb +65 -0
  88. data/lib/karafka/version.rb +1 -1
  89. data/lib/karafka.rb +30 -44
  90. data.tar.gz.sig +0 -0
  91. metadata +96 -132
  92. metadata.gz.sig +0 -0
  93. data/MIT-LICENCE +0 -18
  94. data/lib/karafka/assignment_strategies/round_robin.rb +0 -13
  95. data/lib/karafka/attributes_map.rb +0 -63
  96. data/lib/karafka/backends/inline.rb +0 -16
  97. data/lib/karafka/base_responder.rb +0 -226
  98. data/lib/karafka/cli/flow.rb +0 -48
  99. data/lib/karafka/cli/missingno.rb +0 -19
  100. data/lib/karafka/code_reloader.rb +0 -67
  101. data/lib/karafka/connection/api_adapter.rb +0 -158
  102. data/lib/karafka/connection/batch_delegator.rb +0 -55
  103. data/lib/karafka/connection/builder.rb +0 -23
  104. data/lib/karafka/connection/message_delegator.rb +0 -36
  105. data/lib/karafka/consumers/batch_metadata.rb +0 -10
  106. data/lib/karafka/consumers/callbacks.rb +0 -71
  107. data/lib/karafka/consumers/includer.rb +0 -64
  108. data/lib/karafka/consumers/responders.rb +0 -24
  109. data/lib/karafka/consumers/single_params.rb +0 -15
  110. data/lib/karafka/contracts/responder_usage.rb +0 -54
  111. data/lib/karafka/fetcher.rb +0 -42
  112. data/lib/karafka/helpers/class_matcher.rb +0 -88
  113. data/lib/karafka/helpers/config_retriever.rb +0 -46
  114. data/lib/karafka/helpers/inflector.rb +0 -26
  115. data/lib/karafka/params/builders/batch_metadata.rb +0 -30
  116. data/lib/karafka/params/builders/params.rb +0 -38
  117. data/lib/karafka/params/builders/params_batch.rb +0 -25
  118. data/lib/karafka/params/params_batch.rb +0 -60
  119. data/lib/karafka/patches/ruby_kafka.rb +0 -47
  120. data/lib/karafka/persistence/client.rb +0 -29
  121. data/lib/karafka/persistence/consumers.rb +0 -45
  122. data/lib/karafka/persistence/topics.rb +0 -48
  123. data/lib/karafka/responders/builder.rb +0 -36
  124. data/lib/karafka/responders/topic.rb +0 -55
  125. data/lib/karafka/routing/topic_mapper.rb +0 -53
  126. data/lib/karafka/serialization/json/serializer.rb +0 -31
  127. data/lib/karafka/setup/configurators/water_drop.rb +0 -36
  128. data/lib/karafka/templates/application_responder.rb.erb +0 -11
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 611ba9b66a65ca5ba6b0b39201b416d522bfd4fcef20d7241fa64337f9b34431
4
- data.tar.gz: 0bb87fe1569b54d03b42d2921b03f722fc6996f46d94c4ff1037896a42d9c7b4
3
+ metadata.gz: a441a124346099aa31fb36a2241c2abfbc242ab6f3f9ad197b82d8786e78232e
4
+ data.tar.gz: 81a706d58e469ecc48759dfe28c30e3779baab848122b72c194c30e06a7cdd7d
5
5
  SHA512:
6
- metadata.gz: 69c3fb16f1213d25bc40f65d2ddfec0aa7f16cf4be00d0f79330e8ec2d399d18f2e4171d337acd68990550613bc32c64a56a874fd6f4fd40e6673950fa1295a5
7
- data.tar.gz: 24d3398e30f84d10a6b975758cbb32eeb33ed3ae2d0bc5c2d05615156e32ca6de954aa38e5cc5c46cb03e7a0e8382346c3c9070e35b2dde3427818493f9b1b9a
6
+ metadata.gz: bf9ebff340150913cf273bc3f09c9f3dd3c02e6ffe427fd00ead842995e5f146d554609cd1ff4d1039ee96ef349b8e7712e2c557abc322a9e0300886bc765b6a
7
+ data.tar.gz: 054cf8240a33a133c2c9dce5f1c3c2ac26877006c8a823c1e58c903fccd8cac7c31b5d0c0d2ec22257d8959d40bb69d49bf5676f378c33004807a78413278b3e
checksums.yaml.gz.sig CHANGED
Binary file
@@ -0,0 +1,3 @@
1
+ # These are supported funding model platforms
2
+
3
+ open_collective: karafka
@@ -9,6 +9,36 @@ on:
9
9
  - cron: '0 1 * * *'
10
10
 
11
11
  jobs:
12
+ diffend:
13
+ runs-on: ubuntu-latest
14
+ strategy:
15
+ fail-fast: false
16
+ steps:
17
+ - uses: actions/checkout@v2
18
+ with:
19
+ fetch-depth: 0
20
+ - name: Set up Ruby
21
+ uses: ruby/setup-ruby@v1
22
+ with:
23
+ ruby-version: 3.1
24
+ - name: Install latest bundler
25
+ run: gem install bundler --no-document
26
+ - name: Install Diffend plugin
27
+ run: bundle plugin install diffend
28
+ - name: Bundle Secure
29
+ run: bundle secure
30
+
31
+ coditsu:
32
+ runs-on: ubuntu-latest
33
+ strategy:
34
+ fail-fast: false
35
+ steps:
36
+ - uses: actions/checkout@v2
37
+ with:
38
+ fetch-depth: 0
39
+ - name: Run Coditsu
40
+ run: \curl -sSL https://api.coditsu.io/run/ci | bash
41
+
12
42
  specs:
13
43
  runs-on: ubuntu-latest
14
44
  needs: diffend
@@ -26,51 +56,71 @@ jobs:
26
56
  - uses: actions/checkout@v2
27
57
  - name: Install package dependencies
28
58
  run: "[ -e $APT_DEPS ] || sudo apt-get install -y --no-install-recommends $APT_DEPS"
59
+
60
+ - name: Run Kafka with docker-compose
61
+ run: |
62
+ docker-compose up -d
63
+ sleep 10
64
+
29
65
  - name: Set up Ruby
30
66
  uses: ruby/setup-ruby@v1
31
67
  with:
32
68
  ruby-version: ${{matrix.ruby}}
33
- - name: Install latest bundler
69
+
70
+ - name: Install latest Bundler
34
71
  run: |
35
72
  gem install bundler --no-document
36
73
  bundle config set without 'tools benchmarks docs'
74
+
37
75
  - name: Bundle install
38
76
  run: |
39
77
  bundle config set without development
40
78
  bundle install --jobs 4 --retry 3
41
- - name: Run Kafka with docker-compose
42
- run: docker-compose up -d
43
- - name: Run all tests
79
+
80
+ - name: Run all specs
44
81
  env:
45
82
  GITHUB_COVERAGE: ${{matrix.coverage}}
46
83
  run: bundle exec rspec
47
84
 
48
- diffend:
85
+ integrations:
49
86
  runs-on: ubuntu-latest
87
+ needs: diffend
50
88
  strategy:
51
89
  fail-fast: false
90
+ matrix:
91
+ ruby:
92
+ - '3.1'
93
+ - '3.0'
94
+ - '2.7'
95
+ include:
96
+ - ruby: '3.1'
97
+ coverage: 'true'
52
98
  steps:
53
99
  - uses: actions/checkout@v2
54
- with:
55
- fetch-depth: 0
100
+ - name: Install package dependencies
101
+ run: "[ -e $APT_DEPS ] || sudo apt-get install -y --no-install-recommends $APT_DEPS"
102
+
103
+ - name: Run Kafka with docker-compose
104
+ run: |
105
+ docker-compose up -d
106
+ sleep 5
107
+
56
108
  - name: Set up Ruby
57
109
  uses: ruby/setup-ruby@v1
58
110
  with:
59
- ruby-version: 3.1
60
- - name: Install latest bundler
61
- run: gem install bundler --no-document
62
- - name: Install Diffend plugin
63
- run: bundle plugin install diffend
64
- - name: Bundle Secure
65
- run: bundle secure
111
+ ruby-version: ${{matrix.ruby}}
66
112
 
67
- coditsu:
68
- runs-on: ubuntu-latest
69
- strategy:
70
- fail-fast: false
71
- steps:
72
- - uses: actions/checkout@v2
73
- with:
74
- fetch-depth: 0
75
- - name: Run Coditsu
76
- run: \curl -sSL https://api.coditsu.io/run/ci | bash
113
+ - name: Install latest Bundler
114
+ run: |
115
+ gem install bundler --no-document
116
+ bundle config set without 'tools benchmarks docs'
117
+
118
+ - name: Bundle install
119
+ run: |
120
+ bundle config set without development
121
+ bundle install --jobs 4 --retry 3
122
+
123
+ - name: Run integration tests
124
+ env:
125
+ GITHUB_COVERAGE: ${{matrix.coverage}}
126
+ run: bundle exec bin/integrations
data/.ruby-version CHANGED
@@ -1 +1 @@
1
- 3.1.2
1
+ 3.1.0
data/CHANGELOG.md CHANGED
@@ -1,44 +1,43 @@
1
1
  # Karafka framework changelog
2
2
 
3
- ## 1.4.15 (2023-06-19)
4
-
5
- ```
6
- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
7
- ~~~ CRITICAL NOTICE ON KARAFKA 1.4 reliability ~~~
8
- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
9
-
10
- Karafka 1.4 is no longer supported and contains critical errors, included but not limited to:
11
-
12
- - Double processing of messages
13
- - Skipping messages
14
- - Hanging during processing
15
- - Unexpectedly stopping message processing
16
- - Failure to deliver messages to Kafka
17
- - Resetting the consumer group and starting from the beginning
18
-
19
- To resolve these issues, it is highly recommended to upgrade to Karafka 2.1 or higher.
20
-
21
- If you want to ignore this message and continue, set the I_ACCEPT_CRITICAL_ERRORS_IN_KARAFKA_1_4 env variable to true.
22
-
23
- Apologies for any inconvenience caused by this release.
24
- There is no other way to make sure, that you are notified about those issues and their severity.
25
-
26
- If you need help with the upgrade, we do have a Slack channel you can join: https://slack.karafka.io/
27
-
28
- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
29
- ```
30
-
31
- ## 1.4.14 (2022-10-14)
32
- - Fix `concurrent-ruby` missing as a dependency (Azdaroth)
33
- - Warn about upcoming end of 1.4 support.
34
-
35
- ## 1.4.13 (2022-02-19)
36
- - Drop support for ruby 2.6
37
- - Add mfa requirement
38
-
39
- ## 1.4.12 (2022-01-13)
40
- - Ruby 3.1 support
41
- - `irb` dependency removal (vbyno)
3
+ ## 2.0.0-alpha1 (Unreleased)
4
+ - Change license to `LGPL-3.0`
5
+ - Introduce a Pro subscription
6
+ - Switch from `ruby-kafka` to `librdkafka` as an underlying driver
7
+ - Introduce fully automatic integration tests that go through the whole server lifecycle
8
+ - Integrate WaterDrop tightly with autoconfiguration inheritance and an option to redefine it
9
+ - Multi-threaded support for concurrent jobs consumption (when in separate topics and/or partitions)
10
+ - Introduce subscriptions groups concept for better resources management
11
+ - Remove completely all the callbacks in favour of finalizer method `#on_shutdown`
12
+ - Provide `on_revoked` method for taking actions upon topic revoke
13
+ - Remove single message consumption mode in favour of documentation on how to do it easily by yourself
14
+ - Provide sync and async offset management with async preferred
15
+ - Introduce seamless Ruby on Rails integration via `Rails::Railte`
16
+ - Update `cli info` to reflect the `2.0` details
17
+ - Remove responders in favour of WaterDrop `2.0` producer
18
+ - Remove pidfiles support
19
+ - Remove daemonization support
20
+ - Stop validating `kafka` configuration beyond minimum as it is handled by `librdkafka`
21
+ - Remove topics mappers concept
22
+ - Reorganize monitoring to match new concepts
23
+ - Notify on fatal worker processing errors
24
+ - Rename `Karafka::Params::BatchMetadata` to `Karafka::Messages::BatchMetadata`
25
+ - Rename `Karafka::Params::Params` to `Karafka::Messages::Message`
26
+ - Rename `#params_batch` in consumers to `#messages`
27
+ - Rename `Karafka::Params::Metadata` to `Karafka::Messages::Metadata`
28
+ - Allow for processing work of multiple consumer groups by the same worker poll
29
+ - Rename `Karafka::Fetcher` to `Karafka::Runner` and align notifications key names
30
+ - Update install templates
31
+ - `sidekiq-backend` is no longer supported
32
+ - `testing` gem for RSpec has been updated
33
+ - `WaterDrop` `2.1+` support
34
+ - Simple routing style (`0.5`) now builds a single consumer group instead of one per topic
35
+ - Example apps were updated
36
+ - Hook for underlying statistics emitted from librdkafka have been added
37
+ - Hook for underlying async errors emitted from librdkafka have been added
38
+ - ActiveJob Rails adapter
39
+ - Added benchmarks that can be used to profile Karafka
40
+ - Standardize error hook for all error reporting
42
41
 
43
42
  ## 1.4.11 (2021-12-04)
44
43
  - Source code metadata url added to the gemspec
data/Gemfile CHANGED
@@ -6,6 +6,12 @@ plugin 'diffend'
6
6
 
7
7
  gemspec
8
8
 
9
+ # Karafka gem does not require this but we add it here so we can test the integration with
10
+ # ActiveJob much easier
11
+ group :integrations do
12
+ gem 'activejob'
13
+ end
14
+
9
15
  group :test do
10
16
  gem 'byebug'
11
17
  gem 'factory_bot'
data/Gemfile.lock CHANGED
@@ -1,61 +1,56 @@
1
1
  PATH
2
2
  remote: .
3
3
  specs:
4
- karafka (1.4.14)
5
- concurrent-ruby
6
- dry-configurable (~> 0.16)
7
- dry-inflector (~> 0.2)
4
+ karafka (2.0.0.pre.alpha1)
5
+ dry-configurable (~> 0.13)
8
6
  dry-monitor (~> 0.5)
9
7
  dry-validation (~> 1.7)
10
- envlogic (~> 1.1)
11
- ruby-kafka (>= 1.3.0)
12
- thor (>= 1.1)
13
- waterdrop (~> 1.4)
14
- zeitwerk (~> 2.6)
8
+ rdkafka (>= 0.10)
9
+ thor (>= 0.20)
10
+ waterdrop (>= 2.1.0, < 3.0.0)
11
+ zeitwerk (~> 2.3)
15
12
 
16
13
  GEM
17
14
  remote: https://rubygems.org/
18
15
  specs:
19
- activesupport (7.0.3)
16
+ activejob (7.0.1)
17
+ activesupport (= 7.0.1)
18
+ globalid (>= 0.3.6)
19
+ activesupport (7.0.1)
20
20
  concurrent-ruby (~> 1.0, >= 1.0.2)
21
21
  i18n (>= 1.6, < 2)
22
22
  minitest (>= 5.1)
23
23
  tzinfo (~> 2.0)
24
24
  byebug (11.1.3)
25
- concurrent-ruby (1.1.10)
26
- delivery_boy (1.1.0)
27
- king_konf (~> 1.0)
28
- ruby-kafka (~> 1.0)
25
+ concurrent-ruby (1.1.9)
29
26
  diff-lcs (1.5.0)
30
- digest-crc (0.6.4)
31
- rake (>= 12.0.0, < 14.0.0)
32
27
  docile (1.4.0)
33
- dry-configurable (0.16.1)
28
+ dry-configurable (0.14.0)
29
+ concurrent-ruby (~> 1.0)
34
30
  dry-core (~> 0.6)
35
- zeitwerk (~> 2.6)
36
- dry-container (0.11.0)
31
+ dry-container (0.9.0)
37
32
  concurrent-ruby (~> 1.0)
38
- dry-core (0.8.1)
33
+ dry-configurable (~> 0.13, >= 0.13.0)
34
+ dry-core (0.7.1)
39
35
  concurrent-ruby (~> 1.0)
40
36
  dry-events (0.3.0)
41
37
  concurrent-ruby (~> 1.0)
42
38
  dry-core (~> 0.5, >= 0.5)
43
- dry-inflector (0.3.0)
39
+ dry-inflector (0.2.1)
44
40
  dry-initializer (3.1.1)
45
41
  dry-logic (1.2.0)
46
42
  concurrent-ruby (~> 1.0)
47
43
  dry-core (~> 0.5, >= 0.5)
48
- dry-monitor (0.6.3)
44
+ dry-monitor (0.5.0)
49
45
  dry-configurable (~> 0.13, >= 0.13.0)
50
46
  dry-core (~> 0.5, >= 0.5)
51
47
  dry-events (~> 0.2)
52
- zeitwerk (~> 2.5)
53
- dry-schema (1.10.6)
48
+ dry-schema (1.8.0)
54
49
  concurrent-ruby (~> 1.0)
55
50
  dry-configurable (~> 0.13, >= 0.13.0)
56
51
  dry-core (~> 0.5, >= 0.5)
57
52
  dry-initializer (~> 3.0)
58
- dry-logic (~> 1.2)
53
+ dry-logic (~> 1.0)
59
54
  dry-types (~> 1.5)
60
55
  dry-types (1.5.1)
61
56
  concurrent-ruby (~> 1.0)
@@ -63,59 +58,62 @@ GEM
63
58
  dry-core (~> 0.5, >= 0.5)
64
59
  dry-inflector (~> 0.1, >= 0.1.2)
65
60
  dry-logic (~> 1.0, >= 1.0.2)
66
- dry-validation (1.8.1)
61
+ dry-validation (1.7.0)
67
62
  concurrent-ruby (~> 1.0)
68
63
  dry-container (~> 0.7, >= 0.7.1)
69
64
  dry-core (~> 0.5, >= 0.5)
70
65
  dry-initializer (~> 3.0)
71
66
  dry-schema (~> 1.8, >= 1.8.0)
72
- envlogic (1.1.5)
73
- dry-inflector (~> 0.1)
74
- factory_bot (6.2.1)
67
+ factory_bot (6.2.0)
75
68
  activesupport (>= 5.0.0)
76
- i18n (1.10.0)
69
+ ffi (1.15.5)
70
+ globalid (1.0.0)
71
+ activesupport (>= 5.0)
72
+ i18n (1.9.1)
77
73
  concurrent-ruby (~> 1.0)
78
- king_konf (1.0.1)
74
+ mini_portile2 (2.7.1)
79
75
  minitest (5.15.0)
80
76
  rake (13.0.6)
81
- rspec (3.11.0)
82
- rspec-core (~> 3.11.0)
83
- rspec-expectations (~> 3.11.0)
84
- rspec-mocks (~> 3.11.0)
85
- rspec-core (3.11.0)
86
- rspec-support (~> 3.11.0)
87
- rspec-expectations (3.11.0)
77
+ rdkafka (0.11.1)
78
+ ffi (~> 1.15)
79
+ mini_portile2 (~> 2.6)
80
+ rake (> 12)
81
+ rspec (3.10.0)
82
+ rspec-core (~> 3.10.0)
83
+ rspec-expectations (~> 3.10.0)
84
+ rspec-mocks (~> 3.10.0)
85
+ rspec-core (3.10.2)
86
+ rspec-support (~> 3.10.0)
87
+ rspec-expectations (3.10.2)
88
88
  diff-lcs (>= 1.2.0, < 2.0)
89
- rspec-support (~> 3.11.0)
90
- rspec-mocks (3.11.1)
89
+ rspec-support (~> 3.10.0)
90
+ rspec-mocks (3.10.3)
91
91
  diff-lcs (>= 1.2.0, < 2.0)
92
- rspec-support (~> 3.11.0)
93
- rspec-support (3.11.0)
94
- ruby-kafka (1.5.0)
95
- digest-crc
92
+ rspec-support (~> 3.10.0)
93
+ rspec-support (3.10.3)
96
94
  simplecov (0.21.2)
97
95
  docile (~> 1.1)
98
96
  simplecov-html (~> 0.11)
99
97
  simplecov_json_formatter (~> 0.1)
100
98
  simplecov-html (0.12.3)
101
- simplecov_json_formatter (0.1.4)
99
+ simplecov_json_formatter (0.1.3)
102
100
  thor (1.2.1)
103
101
  tzinfo (2.0.4)
104
102
  concurrent-ruby (~> 1.0)
105
- waterdrop (1.4.4)
106
- delivery_boy (>= 0.2, < 2.x)
103
+ waterdrop (2.1.0)
104
+ concurrent-ruby (>= 1.1)
107
105
  dry-configurable (~> 0.13)
108
106
  dry-monitor (~> 0.5)
109
107
  dry-validation (~> 1.7)
110
- ruby-kafka (>= 1.3.0)
111
- zeitwerk (~> 2.4)
112
- zeitwerk (2.6.1)
108
+ rdkafka (>= 0.10)
109
+ zeitwerk (~> 2.3)
110
+ zeitwerk (2.5.4)
113
111
 
114
112
  PLATFORMS
115
- x86_64-darwin-18
116
113
  x86_64-linux
117
114
 
118
115
  DEPENDENCIES
116
+ activejob
119
117
  byebug
120
118
  factory_bot
121
119
  karafka!
@@ -123,4 +121,4 @@ DEPENDENCIES
123
121
  simplecov
124
122
 
125
123
  BUNDLED WITH
126
- 2.3.11
124
+ 2.3.5
data/LICENSE ADDED
@@ -0,0 +1,14 @@
1
+ Copyright (c) Maciej Mensfeld
2
+
3
+ Karafka is an Open Source project licensed under the terms of
4
+ the LGPLv3 license. Please see <https://github.com/karafka/karafka/blob/master/LGPL>
5
+ for license text.
6
+
7
+ Karafka has also commercial-friendly license, commercial support and commercial components.
8
+
9
+ All of the commercial components are present in the lib/karafka/pro directory of this repository
10
+ and their usage requires commercial license agreement.
11
+
12
+ You can find the commercial license in LICENSE-COM.
13
+
14
+ Please see https://karafka.io for purchasing options.
data/LICENSE-COMM ADDED
@@ -0,0 +1,89 @@
1
+ END-USER LICENSE AGREEMENT
2
+
3
+ ------------------------------------------------------------------------------
4
+
5
+ IMPORTANT: THIS SOFTWARE END-USER LICENSE AGREEMENT ("EULA") IS A LEGAL AGREEMENT (“Agreement”) BETWEEN YOU (THE CUSTOMER, EITHER AS AN INDIVIDUAL OR, IF PURCHASED OR OTHERWISE ACQUIRED BY OR FOR AN ENTITY, AS AN ENTITY) AND MACIEJ MENSFELD. READ IT CAREFULLY BEFORE COMPLETING THE INSTALLATION PROCESS AND USING KARAFKA PRO AND RELATED SOFTWARE COMPONENTS (“SOFTWARE”). IT PROVIDES A LICENSE TO USE THE SOFTWARE AND CONTAINS WARRANTY INFORMATION AND LIABILITY DISCLAIMERS. BY INSTALLING AND USING THE SOFTWARE, YOU ARE CONFIRMING YOUR ACCEPTANCE OF THE SOFTWARE AND AGREEING TO BECOME BOUND BY THE TERMS OF THIS AGREEMENT.
6
+
7
+ ------------------------------------------------------------------------------
8
+
9
+ In order to use the Software under this Agreement, you must receive an application token at the time of purchase, in accordance with the scope of use and other terms specified for each type of Software and as set forth in this Section 1 of this Agreement.
10
+
11
+ 1. License Grant
12
+
13
+ 1.1 General Use. This Agreement grants you a non-exclusive, non-transferable, limited license to the use rights for the Software, without the right to grant sublicenses, subject to the terms and conditions in this Agreement. The Software is licensed, not sold.
14
+
15
+ 1.2 Pro License. If you purchased a Pro License (included with the Karafka Pro Software), you may install the Software on an unlimited number of Hosts. “Host” means any physical or virtual machine which is controlled by you. You may also run an unlimited number of Workers. “Worker” means a thread within a Karafka server process which executes jobs. You may concurrently run the software on an unlimited number of Hosts, with each host running an unlimited number of Workers.
16
+
17
+ 1.3 Archive Copies. You are entitled to make a reasonable amount of copies of the Software for archival purposes. Each copy must reproduce all copyright and other proprietary rights notices on or in the Software Product.
18
+
19
+ 1.4 Electronic Delivery. All Software and license documentation shall be delivered by electronic means unless otherwise specified on the applicable invoice or at the time of purchase. Software shall be deemed delivered when it is made available for download by you (“Delivery”).
20
+
21
+ 2. Modifications. Maciej Mensfeld shall provide you with source code so that you can create Modifications of the original software. “Modification” means: (a) any addition to or deletion from the contents of a file included in the original Software or previous Modifications created by You, or (b) any new file that contains any part of the original Software or previous Modifications. While you retain all rights to any original work authored by you as part of the Modifications, We continue to own all copyright and other intellectual property rights in the Software.
22
+
23
+ 3. Restricted Uses.
24
+
25
+ 3.1 You shall not (and shall not allow any third party to): (a) decompile, disassemble, or otherwise reverse engineer the Software or attempt to reconstruct or discover any source code, underlying ideas, algorithms, file formats or programming interfaces of the Software by any means whatsoever (except and only to the extent that applicable law prohibits or restricts reverse engineering restrictions); (b) distribute, sell, sublicense, rent, lease or use the Software for time sharing, hosting, service provider or like purposes, except as expressly permitted under this Agreement; (c) redistribute the Software or Modifications other than by including the Software or a portion thereof within your own product, which must have substantially different functionality than the Software or Modifications and must not allow any third party to use the Software or Modifications, or any portions thereof, for software development or application development purposes; (d) redistribute the Software as part of a product, "appliance" or "virtual server"; (e) redistribute the Software on any server which is not directly under your control; (f) remove any product identification, proprietary, copyright or other notices contained in the Software; (g) modify any part of the Software, create a derivative work of any part of the Software (except as permitted in Section 4), or incorporate the Software, except to the extent expressly authorized in writing by Maciej Mensfeld; (h) publicly disseminate performance information or analysis (including, without limitation, benchmarks) from any source relating to the Software; (i) utilize any equipment, device, software, or other means designed to circumvent or remove any form of token verification or copy protection used by Maciej Mensfeld in connection with the Software, or use the Software together with any authorization code, Source URL, serial number, or other copy protection device not supplied by Maciej Mensfeld; (j) use the Software to develop a product which is competitive with any Maciej Mensfeld product offerings; or (k) use unauthorized Source URLS or keycode(s) or distribute or publish Source URLs or keycode(s), except as may be expressly permitted by Maciej Mensfeld in writing. If your unique application token is ever published, Maciej Mensfeld reserves the right to terminate your access without notice.
26
+
27
+ 3.2 UNDER NO CIRCUMSTANCES MAY YOU USE THE SOFTWARE AS PART OF A PRODUCT OR SERVICE THAT PROVIDES SIMILAR FUNCTIONALITY TO THE SOFTWARE ITSELF.
28
+
29
+ The Open Source version of the Software (“LGPL Version”) is licensed under the terms of the GNU Lesser General Public License version 3.0 (“LGPL”) and not under this EULA.
30
+
31
+ 4. Ownership. Notwithstanding anything to the contrary contained herein, except for the limited license rights expressly provided herein, Maciej Mensfeld and its suppliers have and will retain all rights, title and interest (including, without limitation, all patent, copyright, trademark, trade secret and other intellectual property rights) in and to the Software and all copies, modifications and derivative works thereof (including any changes which incorporate any of your ideas, feedback or suggestions). You acknowledge that you are obtaining only a limited license right to the Software, and that irrespective of any use of the words “purchase”, “sale” or like terms hereunder no ownership rights are being conveyed to you under this Agreement or otherwise.
32
+
33
+ 5. Fees and Payment. The Software license fees will be due and payable in full as set forth in the applicable invoice or at the time of purchase. If the Software does not function properly within two weeks of purchase, please contact us within those two weeks for a refund. You shall be responsible for all taxes, withholdings, duties and levies arising from the order (excluding taxes based on the net income of Maciej Mensfeld).
34
+
35
+ 6. Support, Maintenance and Services. Subject to the terms and conditions of this Agreement, as set forth in your invoice, and as set forth on the Karafka Pro support page (https://github.com/karafka/karafka/wiki/Commercial-Support), support and maintenance services may be included with the purchase of your license subscription.
36
+
37
+ 7. Term of Agreement.
38
+
39
+ 7.1 Term. This Agreement is effective as of the Delivery of the Software and expires at such time as all license and service subscriptions hereunder have expired in accordance with their own terms (the “Term”). For clarification, the term of your license under this Agreement may be perpetual, limited for Evaluation Version, or designated as a fixed-term license in the Invoice, and shall be specified at your time of purchase. Either party may terminate this Agreement (including all related Invoices) if the other party: (a) fails to cure any material breach of this Agreement within thirty (30) days after written notice of such breach, provided that Maciej Mensfeld may terminate this Agreement immediately upon any breach of Section 3 or if you exceed any other restrictions contained in Section 1, unless otherwise specified in this agreement; (b) ceases operation without a successor; or (c) seeks protection under any bankruptcy, receivership, trust deed, creditors arrangement, composition or comparable proceeding, or if any such proceeding is instituted against such party (and not dismissed within sixty (60) days)). Termination is not an exclusive remedy and the exercise by either party of any remedy under this Agreement will be without prejudice to any other remedies it may have under this Agreement, by law, or otherwise.
40
+
41
+ 7.2 Termination. Upon any termination of this Agreement, you shall cease any and all use of any Software and destroy all copies thereof.
42
+
43
+ 7.3 Expiration of License. Upon the expiration of any term under this Agreement, (a) all Software updates and services pursuant to the license shall cease, (b) you may only continue to run existing installations of the Software, (c) you may not install the Software on any additional Hosts, and (d) any new installation of the Software shall require the purchase of a new license subscription from Maciej Mensfeld.
44
+
45
+ 8. Disclaimer of Warranties. The Software is provided "as is," with all faults, defects and errors, and without warranty of any kind. Maciej Mensfeld does not warrant that the Software will be free of bugs, errors, viruses or other defects, and Maciej Mensfeld shall have no liability of any kind for the use of or inability to use the Software, the Software content or any associated service, and you acknowledge that it is not technically practicable for Maciej Mensfeld to do so.
46
+
47
+ To the maximum extent permitted by applicable law, Maciej Mensfeld disclaims all warranties, express, implied, arising by law or otherwise, regarding the Software, the Software content and their respective performance or suitability for your intended use, including without limitation any implied warranty of merchantability, fitness for a particular purpose.
48
+
49
+ 9. Limitation of Liability.
50
+
51
+ In no event will Maciej Mensfeld be liable for any direct, indirect, consequential, incidental, special, exemplary, or punitive damages or liabilities whatsoever arising from or relating to the Software, the Software content or this Agreement, whether based on contract, tort (including negligence), strict liability or other theory, even if Maciej Mensfeld has been advised of the possibility of such damages.
52
+
53
+ In no event will Maciej Mensfeld' liability exceed the Software license price as indicated in the invoice. The existence of more than one claim will not enlarge or extend this limit.
54
+
55
+ 10. Remedies. Your exclusive remedy and Maciej Mensfeld' entire liability for breach of this Agreement shall be limited, at Maciej Mensfeld' sole and exclusive discretion, to (a) replacement of any defective software or documentation; or (b) refund of the license fee paid to Maciej Mensfeld, payable in accordance with Maciej Mensfeld' refund policy.
56
+
57
+ 11. Acknowledgements.
58
+
59
+ 11.1 Consent to the Use of Data. You agree that Maciej Mensfeld and its affiliates may collect and use technical information gathered as part of the product support services. Maciej Mensfeld may use this information solely to improve products and services and will not disclose this information in a form that personally identifies you.
60
+
61
+ 11.2 Verification. We or a certified auditor acting on our behalf, may, upon its reasonable request and at its expense, audit you with respect to the use of the Software. Such audit may be conducted by mail, electronic means or through an in-person visit to your place of business. Any such in-person audit shall be conducted during regular business hours at your facilities and shall not unreasonably interfere with your business activities. We shall not remove, copy, or redistribute any electronic material during the course of an audit. If an audit reveals that you are using the Software in a way that is in material violation of the terms of the EULA, then you shall pay our reasonable costs of conducting the audit. In the case of a material violation, you agree to pay Us any amounts owing that are attributable to the unauthorized use. In the alternative, We reserve the right, at our sole option, to terminate the licenses for the Software.
62
+
63
+ 11.3 Government End Users. If the Software and related documentation are supplied to or purchased by or on behalf of the United States Government, then the Software is deemed to be "commercial software" as that term is used in the Federal Acquisition Regulation system. Rights of the United States shall not exceed the minimum rights set forth in FAR 52.227-19 for "restricted computer software". All other terms and conditions of this Agreement apply.
64
+
65
+ 12. Third Party Software. External components included in Software may provide links to third party libraries or code (collectively “Third Party Software”) to implement various functions. Third Party Software does not comprise part of the Software. In some cases, access to Third Party Software may be included along with the Software delivery as a convenience for demonstration purposes. Such source code and libraries do not comprise the Software. Licensee acknowledges (1) that some part of Third Party Software may require additional licensing of copyright and patents from the owners of such, and (2) that distribution of any of the Software referencing or including any portion of a Third Party Software may require appropriate licensing from such third parties.
66
+
67
+ 13. Miscellaneous
68
+
69
+ 13.1 Entire Agreement. This Agreement sets forth our entire agreement with respect to the Software and the subject matter hereof and supersedes all prior and contemporaneous understandings and agreements whether written or oral.
70
+
71
+ 13.2 Amendment. Maciej Mensfeld reserves the right, in its sole discretion, to amend this Agreement from time. Amendments to this Agreement can be located at: https://github.com/karafka/karafka/blob/main/LICENSE-COMM.
72
+
73
+ 13.3 Assignment. You may not assign this Agreement or any of its rights under this Agreement without the prior written consent of Maciej Mensfeld and any attempted assignment without such consent shall be void.
74
+
75
+ 13.4 Export Compliance. You agree to comply with all applicable laws and regulations, including laws, regulations, orders or other restrictions on export, re-export or redistribution of software.
76
+
77
+ 13.5 Indemnification. You agree to defend, indemnify, and hold harmless Maciej Mensfeld from and against any lawsuits, claims, losses, damages, fines and expenses (including attorneys' fees and costs) arising out of your use of the Software or breach of this Agreement.
78
+
79
+ 13.6 Governing Law. This Agreement is governed by the laws of the Republic of Poland without regard to conflicts of laws provisions thereof, and without regard to the United Nations Convention on the International Sale of Goods or the Uniform Computer Information Transactions Act, as currently enacted by any jurisdiction or as may be codified or amended from time to time by any jurisdiction. The jurisdiction and venue for actions related to the subject matter hereof shall be the Cracow regional court located in Cracow, Poland, and both parties hereby submit to the personal jurisdiction of such courts.
80
+
81
+ 13.7 Attorneys' Fees and Costs. The prevailing party in any action to enforce this Agreement will be entitled to recover its attorneys' fees and costs in connection with such action.
82
+
83
+ 13.8 Severability. If any provision of this Agreement is held by a court of competent jurisdiction to be invalid, illegal, or unenforceable, the remainder of this Agreement will remain in full force and effect.
84
+
85
+ 13.9 Waiver. Failure or neglect by either party to enforce at any time any of the provisions of this licence Agreement shall not be construed or deemed to be a waiver of that party's rights under this Agreement.
86
+
87
+ 13.10 Headings. The headings of sections and paragraphs of this Agreement are for convenience of reference only and are not intended to restrict, affect or be of any weight in the interpretation or construction of the provisions of such sections or paragraphs.
88
+
89
+ 14. Contact Information. If you have any questions about this EULA, or if you want to contact Maciej Mensfeld for any reason, please direct correspondence to contact@karafka.io.