leftovers 0.5.4 → 0.7.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: cc87c83e3671055ddbbd445768b73d55576676da6cfff8d83f5ceb57eb1d78e8
-  data.tar.gz: a3cc4945b1d4158817d0a6b5a0c0cc8bc8ad1d2e7a402d0b0a3221cebba7dc02
+  metadata.gz: f27830ef42bcbcec33a78126a3b47582fa394714e1d137e802cd5ab166e35df5
+  data.tar.gz: a111ed33a8345fe8dc5d43cb92206d52cbc47a03bc8e961baee8558d677542b6
 SHA512:
-  metadata.gz: 450162ef45051251a698a5cfbd0451ac50d175339b2a9888edd7790e29071a4360f7677ca4f8d6b927bfdc004b0e4fde747884804c8e480659b76a5b39d0f8e3
-  data.tar.gz: 6ae0474561c71a1eddd0f6ecb0ba184de668eaca4aea36da0460fbeec313f9f095533f913863913de89ad192903b1cadaaffb3231432136138b2720df094f636
+  metadata.gz: e14c6c1b74d4c13ebcbb4d1184d50257d6aacaf05e8e6708282633f61ea1988374156880d66bb26a037bf4b67b58381246f12357bdaa99ff9248db620d94c152
+  data.tar.gz: 34e766e6ca2374858ee6da35e924287641bc4441d8f642e4d08285a0066185aa865724567b90f91de34b17f340f3f182e9b3f326c5fc63bf6abc414c0dc058b3

data/CHANGELOG.md

@@ -1,4 +1,32 @@
-# 0.5.4
+# v0.7.0
+- Rewrite the config parser/validation
+  - to provide clearer error messages with line numbers and everything
+  - to allow removing the json_schemer dependency with its 4 further dependencies
+- Allow `match:` to be used with `has_prefix:` and/or `has_suffix:`. There's not a good use for this but it was easier than encoding 'this can't be used with that' logic especially for it.
+- Add the possibility to quiet the `requires:` config, like:
+  ```yml
+  requires:
+  - 'active_support/inflections'
+  - quiet: './config/initializers/inflections'
+  ```
+- consider all the public methods in rails custom generators to be used, this required some new features:
+  - add filtering methods/constants by public/protected/private
+  - add the possibility to set the privacy of methods and constants with method calls (`set_privacy:`, and `set_default_privacy:`)
+  - add `Method` and `Constant` as options for the `type:` filter
+  - add type filtering to dynamic.
+- check `def self.whatever` as a definition, i didn't realise i wasn't checking this.
+
+# v0.6.0
+- drop ruby 2.4 support, allowing for some performance improvements
+- Add ability to parse JSON and YAML files
+- Add magic comment that points to a particular dynamic rule
+- repeated calls to --write-todo won't have ordering differences
+- fix issue with --write-todo and unused methods defined in test files
+
+# v0.5.5
+- Fix rails resource/resources method signatures
+
+# v0.5.4
 - Add support for slim templates #13 - thanks @veganstraightedge
 - fix the #how-to-resolve link #11 - thanks @veganstraightedge
 

data/README.md

@@ -129,7 +129,7 @@ To do this for all definitions of this name, instead of adding a comment, add th
 
 ### `# leftovers:call`
 _aliases `leftovers:calls`_
-To mark a dynamic call that doesn't use literal values, use `leftovers:call` with the method name listed
+To mark a call that doesn't use literal values, use `leftovers:call` with the method name listed
 ```ruby
 method = [:puts, :warn].sample # leftovers:call puts, warn
 send(method, 'text')
@@ -137,6 +137,26 @@ send(method, 'text')
 
 This would consider `puts` and `warn` to both have been called
 
+### `# leftovers:dynamic:*`
+To mark a dynamic call for literal hash and array values without enumerating everything in the comment again, use `leftovers:dynamic:`  on the same line as the beginning of the array or hash
+
+```ruby
+[ # leftovers:dynamic:call_login
+  :user,
+  :admin
+].each { |method| send("#{method}_login") }
+```
+
+with the following configuration matching the `name: value` to the `leftovers:dynamic:process_name`
+
+```yaml
+dynamic:
+  name: call_login
+  arguments: '*'
+  add_suffix: '_login'
+```
+This would consider `user_login` and `admin_login` to both have been called.
+
 ## Configuration file
 
 The configuration is read from `.leftovers.yml` in your project root.

data/docs/Configuration.md

@@ -9,6 +9,8 @@ Its presence is optional and all of these settings are optional.
 - [`haml_paths:`](#haml_paths)
 - [`slim_paths:`](#slim_paths)
 - [`erb_paths:`](#erb_paths)
+- [`yaml_paths:`](#yaml_paths)
+- [`json_paths:`](#json_paths)
 - [`requires:`](#requires)
 - [`gems:`](#gems)
 - [`keep:`](#keep)
@@ -57,12 +59,17 @@ List filenames/paths that you want to include
 Unlike other `paths:` configuration, each entry is **not** the gitignore pattern format.
 Instead it is strings that can be passed directly to ruby's `require` method (relative paths should start with `./`).
 
-Missing files/gems will be a warning, but not a LoadError.
+```yml
+require: ./config/initializers/my_other_inflections_file
+```
 
-By default, the default [`gems: active_support`]() config `require: activesupport` and `gems: rails` will `require: ./config/initializers/inflections`
+Missing files/gems will be a warning, but not a LoadError.
+To avoid seeing the warning if the file isn't there use `quiet:`.
 
 ```yml
-require: ./config/initializers/my_other_inflections_file
+  requires:
+  - 'active_support/inflections' # will warn if it's missing
+  - quiet: './config/initializers/inflections' # will say nothing
 ```
 
 Arrays are not necessary for single values
@@ -117,6 +124,76 @@ erb_paths:
 
 Arrays are not necessary for single values. `*.erb` is recognized by default
 
+## `yaml_paths:`
+
+list filenames/paths of test directories that are in the yaml format
+Defined using the [.gitignore pattern format](https://git-scm.com/docs/gitignore#_pattern_format)
+
+```yml
+include:
+  - 'config/*.yml'
+yaml_paths:
+  - '*.yml'
+```
+
+These documents will consider yaml tags like `!ruby/class 'MyClass'` to be a call to `MyClass` and render the structure of the yaml as arguments for the [`document:true`](#document-true) rule.
+
+so you could, e.g. read the class name out of a yaml document like:
+
+```yml
+class_name: MyClass
+```
+
+with config like:
+
+```yml
+include_paths:
+  - 'config/*.yml'
+
+dynamic:
+  document: true
+  path: config/*.yml
+  calls:
+    argument: class_name
+```
+
+[`nested:`](#nested) may be useful for more complex yaml structures
+
+## `json_paths:`
+
+list filenames/paths of test directories that are in the json format
+Defined using the [.gitignore pattern format](https://git-scm.com/docs/gitignore#_pattern_format)
+
+```yml
+include:
+  - 'config/*.json'
+json_paths:
+  - '*.json'
+```
+
+These documents render the structure of the yaml as arguments for the [`document:true`](#document-true) rule.
+
+so you could, e.g. read the class name out of a yaml document like:
+
+```json
+{ "class_name": "MyClass" }
+```
+
+with config like:
+
+```yml
+include_paths:
+  - 'config/*.json'
+
+dynamic:
+  document: true
+  path: config/*.json
+  calls:
+    argument: class_name
+```
+
+[`nested:`](#nested) may be useful for more complex json structures
+
 ## `gems:`
 _alias `gem:`_
 
@@ -141,10 +218,12 @@ Each entry can be a string (an exact match for a method, constant, or variable n
   or the properties from `names:`
   - [`has_prefix:`](#has_prefix)
   - [`has_suffix:`](#has_suffix)
-  - [`matches:`](#matches) (can't be used in the same entry as `has_prefix:` or `has_suffix:`)
+  - [`matches:`](#matches)
 - [`paths:`](#paths)
 - [`has_arguments:`](#has_arguments)
 - [`has_receiver:`](#has_receiver)
+- [`type:`](#type)
+- [`privacy:`](#privacy)
 - [`unless`](#unless)
 
 Arrays are not necessary for single values
@@ -170,7 +249,7 @@ Each entry can be a string (an exact match for a method, constant, or variable n
   or the properties from `names:`
   - [`has_prefix:`](#has_prefix)
   - [`has_suffix:`](#has_suffix)
-  - [`matches:`](#matches) (can't be used in the same entry as `has_prefix:` or `has_suffix:`)
+  - [`matches:`](#matches)
 - [`paths:`](#paths)
 - [`has_arguments:`](#has_arguments)
 - [`unless`](#unless)
@@ -202,11 +281,14 @@ Each entry must have at least one of the following properties to restrict which
 - [`paths:`](#paths)
 - [`has_arguments:`](#has_arguments)
 - [`has_receiver:`](#has_receiver)
-- [`unless`](#unless)
+- [`unless:`](#unless)
+- [`document: true`](#document-true)
 
-And must have one or both of
+And must have at least one of
 - ['calls:`](#calls-defines)
 - [`defines:`](#calls-defines)
+- [`set_privacy:](#set-privacy)
+- [`set_default_privacy:`](#set-default-privacy)
 
 Arrays are not necessary for single values.
 
@@ -232,7 +314,7 @@ This is a list of methods/constants/variables, and can be used in [`dynamic:`](#
 Each entry can be a string (an exact match for a method, constant, or variable name that includes the sigil), or have at least one of the following properties:
 - [`has_prefix:`](#has_prefix)
 - [`has_suffix:`](#has_suffix)
-- [`matches:`](#matches) (this can't be used in the same entry as `has_prefix:` or `has_suffix:`)
+- [`matches:`](#matches)
 
 Arrays are not necessary for single values
 
@@ -299,10 +381,37 @@ keep:
     path: /app/helpers
 ```
 
+## `document: true`
+
+Instructs to consider the whole document. this is useful when parsing [YAML](#yaml-paths) or [JSON](#json-paths) config files for various values.
+
+e.g.
+
+```yml
+includes: /config/roles.yml
+dynamic:
+  - document: true
+    path: /config/roles.yml
+    defines:
+      arguments: '*'
+      add_suffix: '?'
+      add_prefix: can_
+```
+
+will parse "config/roles.yml"
+```yml
+- build_house
+- drive_car
+```
+
+and consider it to have created methods like `can_build_house?` and `can_drive_car?`
+
+[`nested:`](#nested) may be useful for more complex data structures
+
 ## `calls:`, `defines:`
 _aliases `call:`, `define:`_
 
-At least one of these must be used in each entry in [`dynamic:`](#dynamic)
+These may be used as entries in [`dynamic:`](#dynamic)
 
 This is a list of values that are called or defined dynamically by the matched method, or eventually after being assigned to the the matched constant or variable.
 
@@ -354,6 +463,43 @@ dynamic:
   calls: 1
 ```
 
+## `set_privacy:`
+
+Set privacy has the same requirements as [`calls:` & `defines:`](#calls-defines).
+
+additional it requires a `to:` with one of either `private`, `public`, or `protected`.
+
+For example, from the ruby config:
+```yml
+dynamic:
+  name: private_class_method
+  has_argument: 0
+  set_privacy:
+    argument: '*'
+    to: private
+```
+
+which sets all methods named by the arguments to the privacy_class_method method to private.
+
+these methods could then be filtered using the [`privacy:`](#privacy) method in another [`dynamic:`](#dynamic) or [`keep:`](#keep) rule.
+
+Leftovers limits this to only affect methods defined in the same file.
+
+## `set_default_privacy:`
+
+This must be one of `public`, `private`, or `protected` and will set all subsequent method definitions in this file to that default privacy (unless its then overridden by [`set_privacy`](#set_privacy))
+
+For example, from the default ruby config:
+```yml
+dynamic:
+  name: private
+  unless:
+    has_argument: 0
+  set_default_privacy: private
+```
+
+these methods could then be filtered using the [`privacy:`](#privacy) method in another [`dynamic:`](#dynamic) or [`keep:`](#keep) rule.
+
 ## `arguments:`
 _alias `argument:`_
 
@@ -366,7 +512,9 @@ It can have any of these properties:
 - [`at:`](#at)
 - [`has_value:`](#has_value_has_receiver)
 
-Arrays are not necessary for single values and if the rule contains only `at:` it can be omitted, and the values moved up a level
+Arrays are not necessary for single values and if the rule contains only `at:` it can be omitted, and the values moved up a level.
+
+Positional arguments are zero indexed
 
 ## `has_arguments:`
 _alias `has_argument:`_
@@ -384,6 +532,8 @@ It can have any of these properties:
 
 Arrays are not necessary for single values and if the rule contains only `at:` it can be omitted, and the values moved up a level
 
+Positional arguments are zero indexed
+
 ## `keywords:`
 When the keyword argument **keywords** are the thing being called.
 
@@ -418,7 +568,7 @@ Each entry can be any of:
 - or have at least one of the following properties to match the keyword/hash key string or symbol:
   - [`has_prefix:`](#has_prefix)
   - [`has_suffix:`](#has_suffix)
-  - [`matches:`](#matches) (this can't be used in the same entry as `has_prefix:` or `has_suffix:`)
+  - [`matches:`](#matches)
 
 Arrays are not necessary for single values
 
@@ -429,10 +579,10 @@ filter [`arguments:`](#arguments), [`has_arguments:`](#has_arguments), and [`key
 Each entry can be one of
 - `true`, `false`, `nil`, or an Integer. matches the literal value
 - a String. matches the literal string or symbol value
-- or have at least one of the following properties to match a string or symbol:
+- or have at least one of the following properties to match the name:
   - [`has_prefix:`](#has_prefix)
   - [`has_suffix:`](#has_suffix)
-  - [`matches:`](#matches) (this can't be used in the same entry as `has_prefix:` or `has_suffix:`)
+  - [`matches:`](#matches)
 - or have at least one of the following properties to match within an array or hash:
   - [`at`](#at)
   - [`has_value`](#has_value_has_receiver)
@@ -441,17 +591,35 @@ Each entry can be one of
 - or have the following property to match the receiver
   - [`has_receiver`](#has_value_has_receiver)
 
+## `privacy:`
+
+filter [`dynamic:`](#dynamic) and [`keep:`](#keep) by method/constant privacy
+
+e.g.
+
+```yml
+keep:
+  - path: '**/generators/**/*_generator.rb'
+    privacy: public
+    type: Method
+```
+
+considers all public methods defined in rails generators to be called.
+
 ## `type:`
 
-Filter [`has_value`](#has_value_has_receiver), by the argument/assigned value type
+Filter by the literal type
 
 Each entry can be one of
-- `'String'`
-- `'Symbol'`
-- `'Integer'`
-- `'Float'`
-- `'Array'`
-- `'Hash'`
+- `'String'` a literal string, defined with "" or '' (not String.new)
+- `'Symbol'` a literal symbol
+- `'Integer'` a literal integer
+- `'Float'` a literal float
+- `'Array'` a literal array defined with [] (not Array.new)
+- `'Hash'` a literal hash, defined with {} (not Hash.new)
+- `'Proc'` a literal proc/lambda, defined with lambda {}, proc {}, or -> {} (not Proc.new)
+- `'Method'` a method call or definition defined with def, (not define_method {})
+- `'Constant'` a constant assignment, or a literal module or class defined with keywords, (not Module/Class.new)
 
 Arrays are not necessary for single values
 

data/leftovers.gemspec

@@ -17,7 +17,9 @@ Gem::Specification.new do |spec|
   spec.metadata['homepage_uri'] = spec.homepage
   spec.metadata['source_code_uri'] = 'http://github.com/robotdana/leftovers'
   spec.metadata['changelog_uri'] = 'http://github.com/robotdana/leftovers/blob/main/CHANGELOG.md'
-  spec.required_ruby_version = '>= 2.4.0'
+
+  spec.metadata['rubygems_mfa_required'] = 'true'
+  spec.required_ruby_version = '>= 2.5.0'
 
   spec.files = Dir.glob('{lib,exe,docs}/**/{*,.*}') + %w{
     CHANGELOG.md
@@ -33,13 +35,15 @@ Gem::Specification.new do |spec|
   spec.add_development_dependency 'activesupport'
   spec.add_development_dependency 'benchmark-ips'
   spec.add_development_dependency 'bundler', '~> 2.0'
+  spec.add_development_dependency 'did_you_mean'
   spec.add_development_dependency 'haml'
   spec.add_development_dependency 'pry', '~> 0.1'
   spec.add_development_dependency 'rake', '>= 13'
   spec.add_development_dependency 'rspec', '~> 3.0'
-  spec.add_development_dependency 'rubocop', '~> 0.93.1'
-  spec.add_development_dependency 'rubocop-performance', '~> 1.8.1'
-  spec.add_development_dependency 'rubocop-rspec', '~> 1.44.1'
+  spec.add_development_dependency 'rubocop'
+  spec.add_development_dependency 'rubocop-performance'
+  spec.add_development_dependency 'rubocop-rake'
+  spec.add_development_dependency 'rubocop-rspec'
   spec.add_development_dependency 'simplecov', '>= 0.18.5'
   spec.add_development_dependency 'simplecov-console'
   spec.add_development_dependency 'slim'
@@ -48,7 +52,6 @@ Gem::Specification.new do |spec|
 
   spec.add_development_dependency 'spellr', '>= 0.8.1'
   spec.add_dependency 'fast_ignore', '>= 0.15.1'
-  spec.add_dependency 'json_schemer'
   spec.add_dependency 'parallel'
   spec.add_dependency 'parser'
 end

data/lib/config/actionmailer.yml

@@ -9,14 +9,14 @@ keep:
   - delivered_email
 
 dynamic:
-  names:
-    - deliver_now
-    - deliver_later
-  calls:
-    value:
-      deliver
-  names:
-    - before_action
-    - after_action
-    - around_action
-  calls: ['*', if, unless]
+  - names:
+      - deliver_now
+      - deliver_later
+    calls:
+      value:
+        deliver
+  - names:
+      - before_action
+      - after_action
+      - around_action
+    calls: ['*', if, unless]

data/lib/config/actionpack.yml

@@ -73,8 +73,12 @@ dynamic:
   - name:
       - resource
       - resources
+    has_argument: 0
     calls:
       - argument: only
+      - argument: only
+        nested:
+          argument: '*'
       - argument: controller
         camelize: true
         add_suffix: Controller
@@ -82,6 +86,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -96,6 +101,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -110,6 +116,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -124,6 +131,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -138,6 +146,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -152,6 +161,7 @@ dynamic:
   - name:
     - resource
     - resources
+    has_argument: 0
     unless:
       has_argument:
         - at: only
@@ -165,6 +175,7 @@ dynamic:
       - value: destroy
   - name:
       - resources
+      - resource
       - controller
       - namespace
     calls:

data/lib/config/activesupport.yml

@@ -2,7 +2,7 @@ requires:
   - 'active_support'
   - 'active_support/core_ext/string'
   - 'active_support/inflections'
-  - './config/initializers/inflections'
+  - quiet: './config/initializers/inflections'
 
 # THIS IS INCOMPLETE (you can help by expanding it)
 # rails is _really complicated_ and has a lot of magic which calls methods for you.

data/lib/config/rails.yml

@@ -3,7 +3,6 @@
 # some is currently impossible to handle (with_options).
 # Some is just corners of rails I haven't hit yet.
 gems:
-  - actioncable
   - actionmailer
   - actionpack
   - actionview
@@ -11,6 +10,7 @@ gems:
   - activemodel
   - activerecord
   - activesupport
+  - railties
 
 keep:
   - default_url_options # called by url_for, unsure what gem does

data/lib/config/railties.yml

@@ -0,0 +1,11 @@
+keep:
+  - # https://guides.rubyonrails.org/generators.html#generators-lookup
+    path: '**/generators/**/*_generator.rb'
+    # "When a generator is invoked, each public method in the generator is executed sequentially in
+    # the order that it is defined When a generator is invoked, each public method in the generator
+    # is executed sequentially in the order that it is defined"
+    #
+    # https://guides.rubyonrails.org/generators.html
+    privacy: public
+    type: Method
+

data/lib/config/ruby.yml

@@ -10,6 +10,13 @@ include_paths:
   - '*.erb'
   - '*.rb'
 
+yaml_paths:
+  - '*.yml'
+  - '*.yaml'
+
+json_paths:
+  - '*.json'
+
 test_paths:
   - /tests/
   - /test/
@@ -91,3 +98,75 @@ dynamic:
       - instance_variable_set
       - class_variable_set
     defines: 0
+
+  # Module
+  - name: public
+    unless:
+      has_argument: 0
+    set_default_privacy: public
+
+  - name:
+      - public
+      - public_class_method
+      - public_constant
+    has_argument: 0
+    set_privacy:
+      argument: '*'
+      to: public
+
+  - name:
+      - public
+      - public_class_method
+    has_argument: 0
+    unless:
+      has_argument: 1
+    set_privacy:
+      argument: 0
+      nested:
+        argument: '*'
+      to: public
+
+  - name: protected
+    unless:
+      has_argument: 0
+    set_default_privacy: protected
+
+  - name: protected
+    has_argument: 0
+    set_privacy:
+      argument: '*'
+      to: protected
+
+  - name: protected
+    has_argument: 0
+    unless:
+      has_argument: 1
+    set_privacy:
+      argument: 0
+      nested:
+        argument: '*'
+      to: protected
+
+  - name: private
+    unless:
+      has_argument: 0
+    set_default_privacy: private
+
+  - name:
+      - private
+      - private_class_method
+      - private_constant
+    has_argument: 0
+    set_privacy:
+      argument: '*'
+      to: private
+
+  - name: private
+    has_argument: 0
+    unless:
+      has_argument: 1
+    set_privacy:
+      argument: 0
+      nested:
+        argument: '*'
+      to: private