json_data_extractor 0.0.9 → 0.0.10

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: bdd75c436a18caa753cb6c35536852852b8d876b44684de7f45d66678d012c6b
-  data.tar.gz: 612d1cb976811a479e6e3f6c377186d90bd7d8fe900def4009dfeb7e2d63c81d
+  metadata.gz: be51d8200f061eb267a9c591934a29072729462d242c349c6057e48cb5e77627
+  data.tar.gz: 88213a955399a735f2cd15546d9c0b9ad22ba38de8798e9070d5a35e4a47902f
 SHA512:
-  metadata.gz: 3137a8b5ecbf8850bbc8f96b46cb9c24688760e1d9c634a0735611a4beadafdf24fb6f1baa66de4f486157a31fbde3b36d1c489e887c1f27c1281225b944748e
-  data.tar.gz: 1bdf6749d6c7ba7a86f7c076f0f22a113731938456b801084cbfbd9cb6bd8e15f12a3748a521d4c267a6ad59cacbf40e22ad86d78cb62cc9c09fc0f534ef3076
+  metadata.gz: f724f3a5b3542644abe1103d8831bdefa0e6bbf2f073d8bfe928cce6f8d42992ecf570527f4adceba4b8a01f12fe0146511ae2ef80301f1a48a52b7e0f5c697a
+  data.tar.gz: e4318e950ec778eb19558cc1a7da37234f730ba977b42ff19f5be4d5b86c8b7a4b8a7e50a85705fa38c89d41d9cb0f39493d8f6c0bfa1e79215956f2e9817528

data/README.md

@@ -3,13 +3,15 @@
 NOTE: This is still a very early beta.
 
 Transform JSON data structures with the help of a simple schema and JsonPath expressions.
-Use the JsonDataExtractor gem to extract and modify data from complex JSON structures using a straightforward syntax
+Use the JsonDataExtractor gem to extract and modify data from complex JSON structures using a
+straightforward syntax
 and a range of built-in or custom modifiers.
 
 _Another try to make something for JSON that is XSLT for XML.
 We transform one JSON into another JSON with the help of a third JSON!!!111!!eleventy!!_
 
-Remap one JSON structure into another with some basic rules and [jsonpath](https://github.com/joshbuddy/jsonpath).
+Remap one JSON structure into another with some basic rules
+and [jsonpath](https://github.com/joshbuddy/jsonpath).
 
 Heavily inspired by [xml_data_extractor](https://github.com/monde-sistemas/xml_data_extractor).
 
@@ -32,8 +34,8 @@ Or install it yourself as:
 ## Usage
 
 JsonDataExtractor allows you to remap one JSON structure into another with some basic rules
-and [JSONPath](https://goessner.net/articles/JsonPath/) expressions. The process involves defining a schema that maps
-the input JSON structure to the desired output structure.
+and [JSONPath](https://goessner.net/articles/JsonPath/) expressions. The process involves defining a
+schema that maps the input JSON structure to the desired output structure.
 
 We'll base our examples on the following source:
 
@@ -78,15 +80,15 @@ We'll base our examples on the following source:
 
 ### Defining a Schema
 
-A schema consists of one or more mappings that specify how to extract data from the input JSON and where to place it in
-the output JSON.
+A schema consists of one or more mappings that specify how to extract data from the input JSON and
+where to place it in the output JSON.
 
-Each mapping has a path field that specifies the JsonPath expression to use for data extraction, and an optional
-modifier field that specifies one or more modifiers to apply to the extracted data. Modifiers are used to transform the
-data in some way before placing it in the output JSON.
+Each mapping has a path field that specifies the JsonPath expression to use for data extraction, and
+an optional modifier field that specifies one or more modifiers to apply to the extracted data.
+Modifiers are used to transform the data in some way before placing it in the output JSON.
 
-Here's an example schema that extracts the authors and categories from a JSON structure similar to the one used in the
-previous example (here it's in YAML just for readability):
+Here's an example schema that extracts the authors and categories from a JSON structure similar to
+the one used in the previous example (here it's in YAML just for readability):
 
 ```yaml
 schemas:
@@ -116,23 +118,66 @@ The resulting json will be:
 
 ```
 
-Modifiers can be supplied on object creation and/or added later by calling `#add_modifier` method. Please see specs for
-examples.
+### Modifiers
+
+Modifiers can be supplied on object creation and/or added later by calling `#add_modifier` method.
+Please see specs for examples.
+Modifiers allow you to perform transformations on the extracted data before it is returned. You can
+use modifiers to clean up the data, format it, or apply any custom logic you need.
+
+Modifiers can be defined in two ways: by providing a symbol corresponding to the name of the method
+or lambda that should be called on each extracted value, or by providing an anonymous lambda. Here's
+an example schema that uses both types of modifiers:
+
+```ruby
+schema = {
+  name:  '$.name',
+  age:   { path: '$.age', modifier: :to_i },
+  email: { path: '$.contact.email', modifiers: [:downcase, lambda { |email| email.gsub(/\s/, '') }] }
+}
+
+```
+
+In this schema, the name value is simply extracted as-is. The age value is extracted from the JSON,
+but it is modified with the `to_i` method, which converts the value to an integer. The email value
+is extracted from a nested object, and then passed through two modifiers: first `downcase` is called
+to convert the email address to all lowercase letters, and then an anonymous lambda is called to
+remove any whitespace in the email address.
+
+You can also define custom modifiers by passing a lambda to the `add_modifier` method on a
+JsonDataExtractor instance:
+
+```ruby
+extractor = JsonDataExtractor.new(json_data)
+extractor.add_modifier(:remove_newlines) { |value| value.gsub("\n", '') }
+
+schema = {
+  name: 'name',
+  bio:  { path: 'bio', modifiers: [:remove_newlines] }
+}
+
+results = extractor.extract(schema)
+
+```
+
+Modifiers are called in the order in which they are defined, so keep that in mind when defining your
+schema.
 
 ### Nested schemas
 
-JDE supports nested schemas. Just provide your element with a type of `array` and add a `schema` key for its data.
+JDE supports nested schemas. Just provide your element with a type of `array` and add a `schema` key
+for its data.
 
 E.g. this is a valid real-life schema with nested data:
 
 ```json
 {
-  "name":      "$.Name",
-  "code":      "$.Code",
-  "services":  "$.Services[*].Code",
+  "name": "$.Name",
+  "code": "$.Code",
+  "services": "$.Services[*].Code",
   "locations": {
-    "path":   "$.Locations[*]",
-    "type":   "array",
+    "path": "$.Locations[*]",
+    "type": "array",
     "schema": {
       "name": "$.Name",
       "type": "$.Type",
@@ -148,25 +193,32 @@ Update this readme for better usage cases. Add info on arrays and modifiers.
 
 ## Development
 
-After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can
+After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run
+the tests. You can
 also run `bin/console` for an interactive prompt that will allow you to experiment.
 
-To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the
-version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version,
+To install this gem onto your local machine, run `bundle exec rake install`. To release a new
+version, update the
+version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag
+for the version,
 push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
 
 ## Contributing
 
-Bug reports and pull requests are welcome on GitHub at https://github.com/austerlitz/json_data_extractor. This project
-is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to
+Bug reports and pull requests are welcome on GitHub
+at https://github.com/austerlitz/json_data_extractor. This project
+is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere
+to
 the [Contributor Covenant](http://contributor-covenant.org) code of conduct.
 
 ## License
 
-The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
+The gem is available as open source under the terms of
+the [MIT License](https://opensource.org/licenses/MIT).
 
 ## Code of Conduct
 
-Everyone interacting in the JsonDataExtractor project’s codebases, issue trackers, chat rooms and mailing lists is
+Everyone interacting in the JsonDataExtractor project’s codebases, issue trackers, chat rooms and
+mailing lists is
 expected to follow
 the [code of conduct](https://github.com/austerlitz/json_data_extractor/blob/master/CODE_OF_CONDUCT.md).

data/lib/json_data_extractor.rb

@@ -22,7 +22,16 @@ class JsonDataExtractor
       if val.is_a?(Hash)
         val.transform_keys!(&:to_sym)
         path       = val[:path]
-        modifiers  = Array(val[:modifiers] || val[:modifier]).map(&:to_sym)
+        modifiers  = Array(val[:modifiers] || val[:modifier]).map do |mod|
+          case mod
+          when Symbol, Proc
+            mod
+          when String
+            mod.to_sym
+          else
+            raise ArgumentError, "Invalid modifier: #{mod.inspect}"
+          end
+        end
         array_type = 'array' == val[:type]
         nested     = val.dup.delete(:schema)
       else

data/lib/src/version.rb

@@ -1,3 +1,3 @@
 class JsonDataExtractor
-  VERSION = '0.0.9'
+  VERSION = '0.0.10'
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: json_data_extractor
 version: !ruby/object:Gem::Version
-  version: 0.0.9
+  version: 0.0.10
 platform: ruby
 authors:
 - Max Buslaev
 autorequire: 
 bindir: exe
 cert_chain: []
-date: 2023-05-11 00:00:00.000000000 Z
+date: 2023-05-12 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler