kimurai 1.4.0 → 2.0.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (47) hide show
  1. checksums.yaml +4 -4
  2. data/.rubocop.yml +9 -0
  3. data/CHANGELOG.md +25 -0
  4. data/Gemfile +2 -2
  5. data/README.md +476 -648
  6. data/Rakefile +6 -6
  7. data/bin/console +3 -4
  8. data/exe/kimurai +0 -1
  9. data/kimurai.gemspec +38 -37
  10. data/lib/kimurai/base/saver.rb +15 -19
  11. data/lib/kimurai/base/storage.rb +1 -1
  12. data/lib/kimurai/base.rb +38 -38
  13. data/lib/kimurai/base_helper.rb +5 -4
  14. data/lib/kimurai/browser_builder/mechanize_builder.rb +121 -119
  15. data/lib/kimurai/browser_builder/selenium_chrome_builder.rb +160 -152
  16. data/lib/kimurai/browser_builder/selenium_firefox_builder.rb +162 -160
  17. data/lib/kimurai/browser_builder.rb +1 -7
  18. data/lib/kimurai/capybara_configuration.rb +1 -2
  19. data/lib/kimurai/capybara_ext/driver/base.rb +50 -46
  20. data/lib/kimurai/capybara_ext/mechanize/driver.rb +51 -50
  21. data/lib/kimurai/capybara_ext/selenium/driver.rb +33 -29
  22. data/lib/kimurai/capybara_ext/session.rb +31 -38
  23. data/lib/kimurai/cli/generator.rb +15 -15
  24. data/lib/kimurai/cli.rb +49 -86
  25. data/lib/kimurai/core_ext/array.rb +2 -2
  26. data/lib/kimurai/core_ext/hash.rb +1 -1
  27. data/lib/kimurai/core_ext/numeric.rb +4 -4
  28. data/lib/kimurai/pipeline.rb +2 -1
  29. data/lib/kimurai/runner.rb +6 -6
  30. data/lib/kimurai/template/Gemfile +2 -2
  31. data/lib/kimurai/template/config/boot.rb +4 -4
  32. data/lib/kimurai/template/config/schedule.rb +15 -15
  33. data/lib/kimurai/template/spiders/application_spider.rb +8 -14
  34. data/lib/kimurai/version.rb +1 -1
  35. data/lib/kimurai.rb +7 -3
  36. metadata +58 -65
  37. data/.travis.yml +0 -5
  38. data/lib/kimurai/automation/deploy.yml +0 -54
  39. data/lib/kimurai/automation/setup/chromium_chromedriver.yml +0 -26
  40. data/lib/kimurai/automation/setup/firefox_geckodriver.yml +0 -20
  41. data/lib/kimurai/automation/setup/phantomjs.yml +0 -33
  42. data/lib/kimurai/automation/setup/ruby_environment.yml +0 -124
  43. data/lib/kimurai/automation/setup.yml +0 -44
  44. data/lib/kimurai/browser_builder/poltergeist_phantomjs_builder.rb +0 -175
  45. data/lib/kimurai/capybara_ext/poltergeist/driver.rb +0 -13
  46. data/lib/kimurai/cli/ansible_command_builder.rb +0 -71
  47. data/lib/kimurai/template/config/automation.yml +0 -13
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 9efd6a3590e9df217a803d9e7c806b052d1c3c1cd9887294d7c736ee19fc8e7b
4
- data.tar.gz: 14d14793e808f5122158ae315da53bbb7484772274cc332e96064300016a3974
3
+ metadata.gz: 326378ff2c70df034e5e13ce8006f0c6efbbd53f228e55c241be8d50ed3ee5e7
4
+ data.tar.gz: de727e434b146f8671d3cd524b9b617f147ba1d2e96d4346a07511dc6dc59a88
5
5
  SHA512:
6
- metadata.gz: 6224c7b4bccdbe92b610cd47fa04ed01dc9366fc7b12fb35edac218d71cdd24b7644fd7e5ee5b195d389395f6d147bc7ec8716c33e2d9227fde1cc1204b4a1e4
7
- data.tar.gz: 2c6789e7c62dfe999b641cae172f28c0eb609860de4e123fd0305934ef251fedfa2e6a299d3705f395bdbd483d3cd1004ec1804a98a5517ad218a789d98702f5
6
+ metadata.gz: 3e1776777a7e65328d0ad42a931edf867c4240a5e173083246157a1376880e84608a2fba4564f61752190defbe080af1271695a5329e3f83e4a635dfb43ecae8
7
+ data.tar.gz: a011359fc944037d0305f5041c018d56a0b47d7c30d0e199bd7f5d62570a741ba6810dbdbad4edd2f702b72823712718a7b04495711772340900a2ca49bac4a1
data/.rubocop.yml ADDED
@@ -0,0 +1,9 @@
1
+ AllCops:
2
+ TargetRubyVersion: 3.1.0
3
+
4
+ Style/TrivialAccessors:
5
+ Enabled: false
6
+ Style/RescueModifier:
7
+ Enabled: false
8
+ Style/FrozenStringLiteralComment:
9
+ Enabled: false
data/CHANGELOG.md CHANGED
@@ -1,4 +1,29 @@
1
1
  # CHANGELOG
2
+ ## 2.0.1
3
+ ### Fixes
4
+ * Remove xpath as default Capybara selector type (fixes https://github.com/vifreefly/kimuraframework/issues/28)
5
+
6
+ ## 2.0.0
7
+ ### Breaking changes 2.0.0
8
+ * **Minimum Ruby version is now 3.1+** (due to Ruby 3.0+ keyword argument changes and Ruby 3.4 compatibility requirements)
9
+ * **Removed poltergeist_phantomjs driver** - PhantomJS is no longer maintained. Use `:selenium_chrome`, `:selenium_firefox`, or `:mechanize` engines instead
10
+ * **Removed Ansible automation/deployment feature** - Removed all Ansible playbooks and CLI commands for server setup and deployment
11
+
12
+ ### New
13
+ * **Selenium Manager support** - Selenium 4.6+ automatically downloads and manages webdrivers. No need to manually install chromedriver/geckodriver
14
+
15
+ ### Fixes
16
+ * **Ruby 3.4 compatibility:** Fixed deprecated `Dir.exists?` and `File.exists?` methods (changed to `Dir.exist?` and `File.exist?`)
17
+ * **Ruby 3.4 compatibility:** Added bundled gem dependencies (`mutex_m`, `nkf`, `reline`) that were extracted from Ruby stdlib
18
+ * **Ruby 3.0+ compatibility:** Fixed keyword argument splatting in `Saver` initialization
19
+ * **Ruby 3.0+ compatibility:** Replaced deprecated `URI.escape` with `URI::DEFAULT_PARSER.escape`
20
+ * **Selenium 4.x compatibility:** Updated Chrome options initialization to match new Selenium WebDriver API
21
+ * Updated capybara-mechanize dependency with Ruby 3.4 bundled gems (`mutex_m`, `logger`, `base64`, `nkf`, `reline`)
22
+
23
+ ### Improvements
24
+ * Simplified browser restart logic by removing poltergeist-specific code
25
+ * Updated project templates and documentation to reflect removed poltergeist driver
26
+
2
27
  ## 1.4.0
3
28
  ### New
4
29
  * Add `encoding` config option (see [All available config options](https://github.com/vifreefly/kimuraframework#all-available-config-options))
data/Gemfile CHANGED
@@ -1,6 +1,6 @@
1
- source "https://rubygems.org"
1
+ source 'https://rubygems.org'
2
2
 
3
- git_source(:github) {|repo_name| "https://github.com/#{repo_name}" }
3
+ git_source(:github) { |repo_name| "https://github.com/#{repo_name}" }
4
4
 
5
5
  # Specify your gem's dependencies in kimurai.gemspec
6
6
  gemspec