yabeda-sidekiq 0.12.0 → 0.13.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 3a429f27fdff4c0295a99045e54af89fac47d0ed6bcae3e13988c1c1b811e8b0
4
- data.tar.gz: 6508f78bfc9d19697b688fef975c82de7be3177ee05df1aceea9befc0e271b6f
3
+ metadata.gz: 3706bf67e5af718e54dc6c1d20c7a33c00296d0ce718b0bf5b089970cbe74ecc
4
+ data.tar.gz: 31452c0d618e80fef930974e8c7857a485f669a2cf453586a3fd0f4ed1968745
5
5
  SHA512:
6
- metadata.gz: 127a4ffc2ad85ac7f472dc4de218df07be1612b05c145ceb8edc14c14cbb31390e45c1608a676c03bcfa927fe2a1398f7d2855731ee4d42a547388e8f45d975c
7
- data.tar.gz: 362af4e3b0058f6d8453a0f8fc19ee81ce2963f285a5a82aafbfc4e7f09ae5a73ce5b73ccdfe044b60c83c31a9ce5a9408b9a07852d57c0dd5e51cb671abd642
6
+ metadata.gz: b9f047f8b9a1a0c4c397dd886bb7eee582b586da033bcd79c3038bc836257f8744734cd10340f918b3bf733a2679e58edb64e14d616945145b6f8bea692626b1
7
+ data.tar.gz: 7731398ecce804d79a9687e1cee1fe25f092485427e7ffea7d5d25422f34f5dbabc030f9cde726728300ab3068440093c774d0774868d97b5814df3c598cfd1c
data/CHANGELOG.md CHANGED
@@ -7,6 +7,32 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
7
7
 
8
8
  ## Unreleased
9
9
 
10
+ ## 0.13.0 - 2026-11-19
11
+
12
+ ### Added
13
+
14
+ - `buckets` configuration setting to customize buckets of `sidekiq_job_latency` and `sidekiq_job_runtime` histograms.
15
+
16
+ Pull request [#44](https://github.com/yabeda-rb/yabeda-sidekiq/pull/44) by [@CaseyDanger]
17
+
18
+ - `dead_segmented_by_queue` and `scheduled_segmented_by_queue` configuration settings to allow segmentation of dead and scheduled job counts by queue (like `retries_segmented_by_queue`).
19
+
20
+ When enabled, `queue` label is added to `sidekiq_jobs_dead_count` and `sidekiq_jobs_scheduled_count` metrics. They are disabled by default as they require to iterate over all jobs in dead or scheduled set and may be very slow if these sets are huge.
21
+
22
+ Pull request [#43](https://github.com/yabeda-rb/yabeda-sidekiq/pull/43) by [@duaasajid94]
23
+
24
+ - `filter_queues_by_current_process` configuration setting to collect per-queue cluster metrics only for queues that current Sidekiq process works on.
25
+
26
+ Applies to queue sizes, queue latencies, and retry/dead/scheduled job counts when they are segmented by queue. In Sidekiq 7+ queues of all capsules are taken into account. Useful when running multiple Sidekiq processes with different queue assignments and you want each process to report only its own queues. Do not enable in separate metric exporter processes.
27
+
28
+ Pull request [#41](https://github.com/yabeda-rb/yabeda-sidekiq/pull/41) by [@sobrinho]
29
+
30
+ ### Changed
31
+
32
+ - When retry, dead, or scheduled job counts are segmented by queue, gauges are now published for every known Sidekiq queue (reporting `0` for queues without jobs in the set), so a queue that has been emptied doesn't leave a stale series.
33
+
34
+ Pull request [#43](https://github.com/yabeda-rb/yabeda-sidekiq/pull/43) by [@duaasajid94]
35
+
10
36
  ## 0.12.0 - 2024-03-08
11
37
 
12
38
  ### Added
@@ -145,3 +171,6 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
145
171
  [@LukinEgor]: https://github.com/LukinEgor "Egor Lukin"
146
172
  [@SxDx]: https://github.com/SxDx "René Koller"
147
173
  [@niborg]: https://github.com/niborg "Nick Knipe"
174
+ [@sobrinho]: https://github.com/sobrinho "Gabriel Sobrinho"
175
+ [@CaseyDanger]: https://github.com/CaseyDanger "CaseyDanger"
176
+ [@duaasajid94]: https://github.com/duaasajid94 "duaasajid94"
data/README.md CHANGED
@@ -54,9 +54,9 @@ Metrics representing state of the whole Sidekiq installation (queues, processes,
54
54
 
55
55
  - Number of jobs in queues: `sidekiq_jobs_waiting_count` (segmented by queue)
56
56
  - Time of the queue latency `sidekiq_queue_latency` (the difference in seconds since the oldest job in the queue was enqueued)
57
- - Number of scheduled jobs:`sidekiq_jobs_scheduled_count`
58
- - Number of jobs in retry set: `sidekiq_jobs_retry_count`
59
- - Number of jobs in dead set (“morgue”): `sidekiq_jobs_dead_count`
57
+ - Number of scheduled jobs:`sidekiq_jobs_scheduled_count` (optionally segmented by queue)
58
+ - Number of jobs in retry set: `sidekiq_jobs_retry_count` (optionally segmented by queue)
59
+ - Number of jobs in dead set (“morgue”): `sidekiq_jobs_dead_count` (optionally segmented by queue)
60
60
  - Active processes count: `sidekiq_active_processes`
61
61
  - Active servers count: `sidekiq_active_workers_count`
62
62
 
@@ -66,9 +66,9 @@ By default all sidekiq worker processes (servers) collects global metrics about
66
66
 
67
67
  Metrics collected where jobs are being pushed to queues (everywhere):
68
68
 
69
- - Total number of enqueued jobs: `sidekiq_jobs_enqueued_total_count` (segmented by `queue` and `worker` class name)
69
+ - Total number of enqueued jobs: `sidekiq_jobs_enqueued_total` (segmented by `queue` and `worker` class name)
70
70
 
71
- - Total number of rerouted jobs: `sidekiq_jobs_rerouted_total_count` (segmented by origin queue `from_queue`, rerouted queue `to_queue`, and `worker` class name).
71
+ - Total number of rerouted jobs: `sidekiq_jobs_rerouted_total` (segmented by origin queue `from_queue`, rerouted queue `to_queue`, and `worker` class name).
72
72
 
73
73
  Rerouted jobs are jobs that on enqueue were pushed to different queue from the one specified in worker's `sidekiq_options`, most probably by some middleware.
74
74
 
@@ -103,14 +103,21 @@ Configuration is handled by [anyway_config] gem. With it you can load settings f
103
103
  |------------------------------------------------|---------|---------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------|
104
104
  | `collect_cluster_metrics` | boolean | Enabled in Sidekiq worker processes, disabled otherwise | Defines whether this Ruby process should collect and expose metrics representing state of the whole Sidekiq installation (queues, processes, etc). |
105
105
  | `declare_process_metrics` | boolean | Enabled in Sidekiq worker processes, disabled otherwise | Declare metrics that are only tracked inside worker process even outside of them. Useful for multiprocess metric collection. |
106
- | `retries_segmented_by_queue` | boolean | Disabled | Defines wheter retries are segemented by queue or reported as a single metric |
106
+ | `retries_segmented_by_queue` | boolean | Disabled | Defines whether retries are segmented by queue or reported as a single metric. Iterates the retry set. |
107
+ | `dead_segmented_by_queue` | boolean | Disabled | Defines whether dead jobs are segmented by queue or reported as a single metric. Iterates the dead set. |
108
+ | `scheduled_segmented_by_queue` | boolean | Disabled | Defines whether scheduled jobs are segmented by queue or reported as a single metric. Iterates the scheduled set. |
109
+ | `filter_queues_by_current_process` | boolean | Disabled | Collect per-queue cluster metrics (queue sizes, latencies, segmented retry/dead/scheduled counts) only for queues this process works on (all capsules). |
107
110
  | `label_for_error_class_on_sidekiq_jobs_failed` | boolean | Disabled | Defines whether `error` label should be added to `sidekiq_jobs_failed_total` metric. |
111
+ | `buckets` | array | `[0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30, 60, 120, 300, 1800, 3600, 21600]` | Buckets for `sidekiq_job_latency` and `sidekiq_job_runtime` histograms (in seconds) |
108
112
 
109
- # Roadmap (TODO or Help wanted)
113
+ When any of the `*_segmented_by_queue` settings is enabled, that gauge is published for every known
114
+ Sidekiq queue plus any queue still present in the set, so emptied queues report `0` instead of disappearing.
110
115
 
111
- - Implement optional segmentation of schedule/dead sets
116
+ When `filter_queues_by_current_process` is enabled, only queues the current Sidekiq process is configured to work on
117
+ are reported (missing or empty ones as `0`). Note that in non-Sidekiq processes (e.g. a dedicated metrics exporter)
118
+ this is Sidekiq's default queue list (usually just `default`). Non-segmented totals and process/worker counts stay cluster-wide.
112
119
 
113
- It should be disabled by default as it requires to iterate over all jobs in sets and may be very slow on large sets.
120
+ # Roadmap (TODO or Help wanted)
114
121
 
115
122
  - Maybe add some hooks for ease of plugging in metrics for myriads of Sidekiq plugins?
116
123
 
@@ -4,6 +4,11 @@ require "anyway"
4
4
 
5
5
  module Yabeda
6
6
  module Sidekiq
7
+ LONG_RUNNING_JOB_RUNTIME_BUCKETS = [
8
+ 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, # standard (from Prometheus)
9
+ 30, 60, 120, 300, 1800, 3600, 21_600, # Sidekiq tasks may be very long-running
10
+ ].freeze
11
+
7
12
  class Config < ::Anyway::Config
8
13
  config_name :yabeda_sidekiq
9
14
 
@@ -21,8 +26,24 @@ module Yabeda
21
26
  # Disabled by default because it is quite slow if the retry set is large
22
27
  attr_config retries_segmented_by_queue: false
23
28
 
29
+ # Dead jobs are tracked by default as a single metric. If you want to track them separately for each queue, set this to +true+
30
+ # Disabled by default because it is quite slow if the dead set is large
31
+ attr_config dead_segmented_by_queue: false
32
+
33
+ # Scheduled jobs are tracked by default as a single metric. If you want to track them separately for each queue, set this to +true+
34
+ # Disabled by default because it is quite slow if the scheduled set is large
35
+ attr_config scheduled_segmented_by_queue: false
36
+
24
37
  # If set to true, an `:error` label will be added with name of the error class to all failed jobs
25
38
  attr_config label_for_error_class_on_sidekiq_jobs_failed: false
39
+
40
+ # If set to true, per-queue cluster metrics (queue sizes, latencies, and segmented retry/dead/scheduled counts)
41
+ # are only collected for queues the current Sidekiq process works on (in all capsules) instead of all queues.
42
+ # Useful when different Sidekiq processes handle different queues and each should report only its own ones.
43
+ attr_config filter_queues_by_current_process: false
44
+
45
+ # Buckets for job_latency and job_runtime histograms
46
+ attr_config buckets: LONG_RUNNING_JOB_RUNTIME_BUCKETS
26
47
  end
27
48
  end
28
49
  end
@@ -7,7 +7,7 @@ module Yabeda
7
7
  # See https://github.com/mperham/sidekiq/discussions/4971
8
8
  JOB_RECORD_CLASS = defined?(::Sidekiq::JobRecord) ? ::Sidekiq::JobRecord : ::Sidekiq::Job
9
9
 
10
- # rubocop: disable Metrics/AbcSize, Metrics/MethodLength:
10
+ # rubocop: disable Metrics/AbcSize, Metrics/MethodLength
11
11
  def call(worker, job, queue)
12
12
  custom_tags = Yabeda::Sidekiq.custom_tags(worker, job).to_h
13
13
  labels = Yabeda::Sidekiq.labelize(worker, job, queue).merge(custom_tags)
@@ -31,7 +31,7 @@ module Yabeda
31
31
  Yabeda::Sidekiq.jobs_started_at[labels].delete(job["jid"])
32
32
  end
33
33
  end
34
- # rubocop: enable Metrics/AbcSize, Metrics/MethodLength:
34
+ # rubocop: enable Metrics/AbcSize, Metrics/MethodLength
35
35
 
36
36
  private
37
37
 
@@ -2,6 +2,6 @@
2
2
 
3
3
  module Yabeda
4
4
  module Sidekiq
5
- VERSION = "0.12.0"
5
+ VERSION = "0.13.0"
6
6
  end
7
7
  end
@@ -11,11 +11,6 @@ require "yabeda/sidekiq/config"
11
11
 
12
12
  module Yabeda
13
13
  module Sidekiq
14
- LONG_RUNNING_JOB_RUNTIME_BUCKETS = [
15
- 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, # standard (from Prometheus)
16
- 30, 60, 120, 300, 1800, 3600, 21_600, # Sidekiq tasks may be very long-running
17
- ].freeze
18
-
19
14
  def self.config
20
15
  @config ||= Config.new
21
16
  end
@@ -41,26 +36,28 @@ module Yabeda
41
36
  histogram :job_latency, comment: "The job latency, the difference in seconds between enqueued and running time",
42
37
  unit: :seconds, per: :job,
43
38
  tags: %i[queue worker],
44
- buckets: LONG_RUNNING_JOB_RUNTIME_BUCKETS
39
+ buckets: config.buckets
45
40
  histogram :job_runtime, comment: "A histogram of the job execution time.",
46
41
  unit: :seconds, per: :job,
47
42
  tags: %i[queue worker],
48
- buckets: LONG_RUNNING_JOB_RUNTIME_BUCKETS
43
+ buckets: config.buckets
49
44
  end
50
45
 
51
46
  # Metrics not specific for current Sidekiq process, but representing state of the whole Sidekiq installation (queues, processes, etc)
52
47
  # You can opt-out from collecting these by setting YABEDA_SIDEKIQ_COLLECT_CLUSTER_METRICS to falsy value (+no+ or +false+)
53
48
  if config.collect_cluster_metrics # defaults to +::Sidekiq.server?+
54
49
  retry_count_tags = config.retries_segmented_by_queue ? %i[queue] : []
50
+ dead_count_tags = config.dead_segmented_by_queue ? %i[queue] : []
51
+ scheduled_count_tags = config.scheduled_segmented_by_queue ? %i[queue] : []
55
52
 
56
- gauge :jobs_waiting_count, tags: %i[queue], aggregation: :most_recent, comment: "The number of jobs waiting to process in sidekiq."
57
- gauge :active_workers_count, tags: [], aggregation: :most_recent,
53
+ gauge :jobs_waiting_count, tags: %i[queue], aggregation: :most_recent, comment: "The number of jobs waiting to process in sidekiq."
54
+ gauge :active_workers_count, tags: [], aggregation: :most_recent,
58
55
  comment: "The number of currently running machines with sidekiq workers."
59
- gauge :jobs_scheduled_count, tags: [], aggregation: :most_recent, comment: "The number of jobs scheduled for later execution."
60
- gauge :jobs_retry_count, tags: retry_count_tags, aggregation: :most_recent, comment: "The number of failed jobs waiting to be retried"
61
- gauge :jobs_dead_count, tags: [], aggregation: :most_recent, comment: "The number of jobs exceeded their retry count."
62
- gauge :active_processes, tags: [], aggregation: :most_recent, comment: "The number of active Sidekiq worker processes."
63
- gauge :queue_latency, tags: %i[queue], aggregation: :most_recent,
56
+ gauge :jobs_scheduled_count, tags: scheduled_count_tags, aggregation: :most_recent, comment: "The number of jobs scheduled for later execution."
57
+ gauge :jobs_retry_count, tags: retry_count_tags, aggregation: :most_recent, comment: "The number of failed jobs waiting to be retried"
58
+ gauge :jobs_dead_count, tags: dead_count_tags, aggregation: :most_recent, comment: "The number of jobs exceeded their retry count."
59
+ gauge :active_processes, tags: [], aggregation: :most_recent, comment: "The number of active Sidekiq worker processes."
60
+ gauge :queue_latency, tags: %i[queue], aggregation: :most_recent,
64
61
  comment: "The queue latency, the difference in seconds since the oldest job in the queue was enqueued"
65
62
  end
66
63
 
@@ -70,30 +67,38 @@ module Yabeda
70
67
  next unless config.collect_cluster_metrics
71
68
 
72
69
  stats = ::Sidekiq::Stats.new
70
+ process_queues = Yabeda::Sidekiq.process_queue_names if config.filter_queues_by_current_process
71
+ queue_sizes = stats.queues
72
+ queue_sizes = process_queues.to_h { |name| [name, queue_sizes.fetch(name, 0)] } if process_queues
73
73
 
74
- stats.queues.each do |k, v|
74
+ queue_sizes.each do |k, v|
75
75
  sidekiq_jobs_waiting_count.set({ queue: k }, v)
76
76
  end
77
77
  sidekiq_active_workers_count.set({}, stats.workers_size)
78
- sidekiq_jobs_scheduled_count.set({}, stats.scheduled_size)
79
- sidekiq_jobs_dead_count.set({}, stats.dead_size)
80
78
  sidekiq_active_processes.set({}, stats.processes_size)
81
79
 
82
- ::Sidekiq::Queue.all.each do |queue|
80
+ queues = process_queues ? process_queues.map { |name| ::Sidekiq::Queue.new(name) } : ::Sidekiq::Queue.all
81
+ queues.each do |queue|
83
82
  sidekiq_queue_latency.set({ queue: queue.name }, queue.latency)
84
83
  end
85
84
 
86
85
  if config.retries_segmented_by_queue
87
- retries_by_queues =
88
- ::Sidekiq::RetrySet.new.each_with_object(Hash.new(0)) do |job, cntr|
89
- cntr[job["queue"]] += 1
90
- end
91
- retries_by_queues.each do |queue, count|
92
- sidekiq_jobs_retry_count.set({ queue: queue }, count)
93
- end
86
+ Yabeda::Sidekiq.set_jobs_count_by_queue(sidekiq_jobs_retry_count, ::Sidekiq::RetrySet.new, queue_sizes.keys)
94
87
  else
95
88
  sidekiq_jobs_retry_count.set({}, stats.retry_size)
96
89
  end
90
+
91
+ if config.dead_segmented_by_queue
92
+ Yabeda::Sidekiq.set_jobs_count_by_queue(sidekiq_jobs_dead_count, ::Sidekiq::DeadSet.new, queue_sizes.keys)
93
+ else
94
+ sidekiq_jobs_dead_count.set({}, stats.dead_size)
95
+ end
96
+
97
+ if config.scheduled_segmented_by_queue
98
+ Yabeda::Sidekiq.set_jobs_count_by_queue(sidekiq_jobs_scheduled_count, ::Sidekiq::ScheduledSet.new, queue_sizes.keys)
99
+ else
100
+ sidekiq_jobs_scheduled_count.set({}, stats.scheduled_size)
101
+ end
97
102
  end
98
103
  end
99
104
 
@@ -141,6 +146,28 @@ module Yabeda
141
146
  Yabeda.sidekiq.running_job_runtime.set(labels, oldest_job_duration)
142
147
  end
143
148
  end
149
+
150
+ # Counts jobs in a Sidekiq job set (retry, dead, scheduled) per queue.
151
+ # Known queues without jobs in the set are reported as zero, so their series don't go stale.
152
+ # Queues present only in the set (e.g. removed ones) are reported too, unless filtering by current process.
153
+ def set_jobs_count_by_queue(metric, job_set, known_queues)
154
+ counts = job_set.each_with_object(Hash.new(0)) { |job, cntr| cntr[job["queue"]] += 1 }
155
+ queues = config.filter_queues_by_current_process ? known_queues : known_queues | counts.keys
156
+ queues.each { |queue| metric.set({ queue: queue }, counts[queue]) }
157
+ end
158
+
159
+ # Names of queues the current process is configured to work on (across all capsules).
160
+ def process_queue_names
161
+ queues =
162
+ if ::Sidekiq.respond_to?(:default_configuration) # Sidekiq 7+
163
+ ::Sidekiq.default_configuration.capsules.values.flat_map(&:queues)
164
+ elsif ::Sidekiq.respond_to?(:[]) # Sidekiq 6.5+
165
+ ::Sidekiq[:queues]
166
+ else # Sidekiq 5.x – 6.4
167
+ ::Sidekiq.options[:queues]
168
+ end
169
+ queues.uniq # weighted queues are listed multiple times
170
+ end
144
171
  end
145
172
 
146
173
  self.jobs_started_at = Concurrent::Map.new { |hash, key| hash[key] = Concurrent::Map.new }
@@ -19,6 +19,7 @@ Gem::Specification.new do |spec|
19
19
  spec.metadata["source_code_uri"] = spec.homepage
20
20
  spec.metadata["changelog_uri"] = "#{spec.homepage}/blob/master/CHANGELOG.md"
21
21
  spec.metadata["bug_tracker_uri"] = "#{spec.homepage}/issues"
22
+ spec.metadata["rubygems_mfa_required"] = "true"
22
23
 
23
24
  spec.files = `git ls-files -z`.split("\x0").reject do |f|
24
25
  f.match(%r{^(\.|bin/|spec/|tmp/|Gemfile|Rakefile|yabeda-sidekiq-logo\.png)})
@@ -32,7 +33,7 @@ Gem::Specification.new do |spec|
32
33
  spec.add_dependency "yabeda", "~> 0.6"
33
34
 
34
35
  spec.add_development_dependency "activejob", ">= 6.0"
35
- spec.add_development_dependency "bundler", "~> 2.0"
36
+ spec.add_development_dependency "bundler", ">= 2.0"
36
37
  spec.add_development_dependency "rake", "~> 13.0"
37
38
  spec.add_development_dependency "rspec", "~> 3.0"
38
39
  end
metadata CHANGED
@@ -1,14 +1,14 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: yabeda-sidekiq
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.12.0
4
+ version: 0.13.0
5
5
  platform: ruby
6
6
  authors:
7
7
  - Andrey Novikov
8
- autorequire:
8
+ autorequire:
9
9
  bindir: exe
10
10
  cert_chain: []
11
- date: 2024-03-08 00:00:00.000000000 Z
11
+ date: 2026-11-19 00:00:00.000000000 Z
12
12
  dependencies:
13
13
  - !ruby/object:Gem::Dependency
14
14
  name: anyway_config
@@ -76,14 +76,14 @@ dependencies:
76
76
  name: bundler
77
77
  requirement: !ruby/object:Gem::Requirement
78
78
  requirements:
79
- - - "~>"
79
+ - - ">="
80
80
  - !ruby/object:Gem::Version
81
81
  version: '2.0'
82
82
  type: :development
83
83
  prerelease: false
84
84
  version_requirements: !ruby/object:Gem::Requirement
85
85
  requirements:
86
- - - "~>"
86
+ - - ">="
87
87
  - !ruby/object:Gem::Version
88
88
  version: '2.0'
89
89
  - !ruby/object:Gem::Dependency
@@ -139,7 +139,8 @@ metadata:
139
139
  source_code_uri: https://github.com/yabeda-rb/yabeda-sidekiq
140
140
  changelog_uri: https://github.com/yabeda-rb/yabeda-sidekiq/blob/master/CHANGELOG.md
141
141
  bug_tracker_uri: https://github.com/yabeda-rb/yabeda-sidekiq/issues
142
- post_install_message:
142
+ rubygems_mfa_required: 'true'
143
+ post_install_message:
143
144
  rdoc_options: []
144
145
  require_paths:
145
146
  - lib
@@ -154,8 +155,8 @@ required_rubygems_version: !ruby/object:Gem::Requirement
154
155
  - !ruby/object:Gem::Version
155
156
  version: '0'
156
157
  requirements: []
157
- rubygems_version: 3.5.3
158
- signing_key:
158
+ rubygems_version: 3.5.22
159
+ signing_key:
159
160
  specification_version: 4
160
161
  summary: Extensible Prometheus exporter for monitoring your Sidekiq
161
162
  test_files: []