twitterscraper-ruby 0.2.0 → 0.7.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 6791ebfd82694e768350ec33a19d3a34336c26c5344e57ef92af6bf02a0dddf1
-  data.tar.gz: 351bf02ad483c60993114a828a4a1e39b936ab8e1373237aa66de6d0a3c809a6
+  metadata.gz: 9cfd03782734642da8ac29839788f142399d2a3f4ec601e8b6f47ae1ca38c17f
+  data.tar.gz: 07a398e51fd2fbdc735ae27008d9a23e97dc390632179738045db4c81bd4fcad
 SHA512:
-  metadata.gz: 236d01eaaf4ed8c5c016fff35b5794e1609e840d8d27edfba92e0fc63138dfced1a10f4e2952d919360d9cc5111bc4987422a9e709c3e798434614b734b3b029
-  data.tar.gz: 6831c32b358651e8c75af0772afbd0f2888934e5ef314112ecaa2dab1bcaeb681dc6a350d473eab79e36a83da57059b35dd88d693cb3a2f894789cb03ceb1e8c
+  metadata.gz: 6f417fe3379a3d9d134c308a9ea9d4e01b458018c9c5a3f8508a85e7f5890d01991838cfcabe87b8246f69edf4458c66d17924359798017907862071353f643d
+  data.tar.gz: 758bcb55ded936c3696f99647f64bc9921386b3cb0c783c218510c0e36991ae6b95a9d08fa071e02072c8b727bbadb6674ceeb19a74e356a842d62c1ec4c038f

data/Gemfile.lock

@@ -1,8 +1,9 @@
 PATH
   remote: .
   specs:
-    twitterscraper-ruby (0.2.0)
+    twitterscraper-ruby (0.7.0)
       nokogiri
+      parallel
 
 GEM
   remote: https://rubygems.org/
@@ -11,6 +12,7 @@ GEM
     minitest (5.14.1)
     nokogiri (1.10.10)
       mini_portile2 (~> 2.4.0)
+    parallel (1.19.2)
     rake (12.3.3)
 
 PLATFORMS

data/README.md

@@ -1,46 +1,127 @@
 # twitterscraper-ruby
 
-Welcome to your new gem! In this directory, you'll find the files you need to be able to package up your Ruby library into a gem. Put your Ruby code in the file `lib/twitterscraper/ruby`. To experiment with that code, run `bin/console` for an interactive prompt.
+[![Gem Version](https://badge.fury.io/rb/twitterscraper-ruby.svg)](https://badge.fury.io/rb/twitterscraper-ruby)
 
-TODO: Delete this and the text above, and describe your gem
+A gem to scrape https://twitter.com/search. This gem is inspired by [taspinar/twitterscraper](https://github.com/taspinar/twitterscraper).
 
-## Installation
 
-Add this line to your application's Gemfile:
+## Twitter Search API vs. twitterscraper-ruby
 
-```ruby
-gem 'twitterscraper-ruby'
-```
+### Twitter Search API
+
+- The number of tweets: 180 - 450 requests/15 minutes (18,000 - 45,000 tweets/15 minutes)
+- The time window: the past 7 days
+
+### twitterscraper-ruby
+
+- The number of tweets: Unlimited
+- The time window: from 2006-3-21 to today
 
-And then execute:
 
-    $ bundle install
+## Installation
 
-Or install it yourself as:
+First install the library:
 
-    $ gem install twitterscraper-ruby
+```shell script
+$ gem install twitterscraper-ruby
+````
+    
 
 ## Usage
 
+Command-line interface:
+
+```shell script
+$ twitterscraper --query KEYWORD --start_date 2020-06-01 --end_date 2020-06-30 --lang ja \
+      --limit 100 --threads 10 --proxy --output output.json
+```
+
+From Within Ruby:
+
 ```ruby
 require 'twitterscraper'
+
+options = {
+  start_date: '2020-06-01',
+  end_date:   '2020-06-30',
+  lang:       'ja',
+  limit:      100,
+  threads:    10,
+  proxy:      true
+}
+
+client = Twitterscraper::Client.new
+tweets = client.query_tweets(KEYWORD, options)
+
+tweets.each do |tweet|
+  puts tweet.tweet_id
+  puts tweet.text
+  puts tweet.created_at
+  puts tweet.tweet_url
+end
 ```
 
-## Development
 
-After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake test` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
+## Examples
+
+```shell script
+$ twitterscraper --query twitter --limit 1000
+$ cat tweets.json | jq . | less
+```
+
+```json
+[
+  {
+    "screen_name": "@screenname",
+    "name": "name",
+    "user_id": 1194529546483000000,
+    "tweet_id": 1282659891992000000,
+    "tweet_url": "https://twitter.com/screenname/status/1282659891992000000",
+    "created_at": "2020-07-13 12:00:00 +0000",
+    "text": "Thanks Twitter!"
+  },
+  ...
+]
+```
+
+## Attributes
+
+### Tweet
+
+- tweet_id
+- text
+- user_id
+- screen_name
+- name
+- tweet_url
+- created_at
+
+
+## CLI Options
+
+| Option | Description | Default |
+| ------------- | ------------- | ------------- |
+| `-h`, `--help` | This option displays a summary of twitterscraper. | |
+| `--query` | Specify a keyword used during the search. | |
+| `--start_date` | Set the date from which twitterscraper-ruby should start scraping for your query. | |
+| `--end_date` | Set the enddate which twitterscraper-ruby should use to stop scraping for your query. | |
+| `--lang` | Retrieve tweets written in a specific language. | |
+| `--limit` | Stop scraping when *at least* the number of tweets indicated with --limit is scraped. | 100 |
+| `--threads` | Set the number of threads twitterscraper-ruby should initiate while scraping for your query. | 2 |
+| `--proxy` | Scrape https://twitter.com/search via proxies. | false |
+| `--output` | The name of the output file. | tweets.json |
 
-To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
 
 ## Contributing
 
-Bug reports and pull requests are welcome on GitHub at https://github.com/[USERNAME]/twitterscraper-ruby. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [code of conduct](https://github.com/[USERNAME]/twitterscraper-ruby/blob/master/CODE_OF_CONDUCT.md).
+Bug reports and pull requests are welcome on GitHub at https://github.com/ts-3156/twitterscraper-ruby. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [code of conduct](https://github.com/ts-3156/twitterscraper-ruby/blob/master/CODE_OF_CONDUCT.md).
 
 
 ## License
 
 The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
 
+
 ## Code of Conduct
 
-Everyone interacting in the Twitterscraper::Ruby project's codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/[USERNAME]/twitterscraper-ruby/blob/master/CODE_OF_CONDUCT.md).
+Everyone interacting in the twitterscraper-ruby project's codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/ts-3156/twitterscraper-ruby/blob/master/CODE_OF_CONDUCT.md).

data/bin/twitterscraper

@@ -0,0 +1,13 @@
+#!/usr/bin/env ruby
+
+require_relative '../lib/twitterscraper/cli'
+
+begin
+  cli = Twitterscraper::Cli.new
+  cli.parse
+  cli.run
+rescue => e
+  STDERR.puts e.message
+  STDERR.puts e.backtrace.join("\n")
+  exit 1
+end

data/lib/twitterscraper.rb

@@ -9,10 +9,9 @@ require 'version'
 
 module Twitterscraper
   class Error < StandardError; end
-  # Your code goes here...
 
   def self.logger
-    @logger ||= ::Logger.new(STDOUT)
+    @logger ||= ::Logger.new(STDOUT, level: ::Logger::INFO)
   end
 
   def self.logger=(logger)

data/lib/twitterscraper/cli.rb

@@ -0,0 +1,92 @@
+$stdout.sync = true
+
+require 'json'
+require 'optparse'
+require 'twitterscraper'
+
+module Twitterscraper
+  class Cli
+    def parse
+      @options = parse_options(ARGV)
+      initialize_logger
+    end
+
+    def run
+      print_help || return if print_help?
+      print_version || return if print_version?
+
+      query_options = {
+          start_date: options['start_date'],
+          end_date: options['end_date'],
+          lang: options['lang'],
+          limit: options['limit'],
+          threads: options['threads'],
+          proxy: options['proxy']
+      }
+      client = Twitterscraper::Client.new
+      tweets = client.query_tweets(options['query'], query_options)
+      File.write(options['output'], generate_json(tweets))
+    end
+
+    def generate_json(tweets)
+      if options['pretty']
+        ::JSON.pretty_generate(tweets)
+      else
+        ::JSON.generate(tweets)
+      end
+    end
+
+    def options
+      @options
+    end
+
+    def parse_options(argv)
+      options = argv.getopts(
+          'h',
+          'help',
+          'v',
+          'version',
+          'query:',
+          'start_date:',
+          'end_date:',
+          'lang:',
+          'limit:',
+          'threads:',
+          'output:',
+          'proxy',
+          'pretty',
+          'verbose',
+      )
+
+      options['lang'] ||= ''
+      options['limit'] = (options['limit'] || 100).to_i
+      options['threads'] = (options['threads'] || 2).to_i
+      options['output'] ||= 'tweets.json'
+
+      options
+    end
+
+    def initialize_logger
+      Twitterscraper.logger.level = ::Logger::DEBUG if options['verbose']
+    end
+
+    def print_help?
+      options['h'] || options['help']
+    end
+
+    def print_help
+      puts <<~'SHELL'
+        Usage:
+          twitterscraper --query KEYWORD --limit 100 --threads 10 --start_date 2020-07-01 --end_date 2020-07-10 --lang ja --proxy --output output.json
+      SHELL
+    end
+
+    def print_version?
+      options['v'] || options['version']
+    end
+
+    def print_version
+      puts "twitterscraper-#{Twitterscraper::VERSION}"
+    end
+  end
+end

data/lib/twitterscraper/http.rb

@@ -24,7 +24,8 @@ module Twitterscraper
         req[key] = value
       end
 
-      http.request(req).body
+      res = http.start { http.request(req) }
+      res.body
     end
   end
 end

data/lib/twitterscraper/proxy.rb

@@ -6,22 +6,53 @@ module Twitterscraper
     class RetryExhausted < StandardError
     end
 
+    class Pool
+      def initialize
+        @items = Proxy.get_proxies
+        @cur_index = 0
+      end
+
+      def sample
+        if @cur_index >= @items.size
+          reload
+        end
+        @cur_index += 1
+        item = @items[@cur_index - 1]
+        Twitterscraper.logger.info("Using proxy #{item}")
+        item
+      end
+
+      def size
+        @items.size
+      end
+
+      private
+
+      def reload
+        @items = Proxy.get_proxies
+        @cur_index = 0
+      end
+    end
+
     module_function
 
     def get_proxies(retries = 3)
       response = Twitterscraper::Http.get(PROXY_URL)
       html = Nokogiri::HTML(response)
-      table = html.xpath('//*[@id="proxylisttable"]').first
+      table = html.xpath('//table[@id="proxylisttable"]').first
 
       proxies = []
 
       table.xpath('tbody/tr').each do |tr|
         cells = tr.xpath('td')
-        ip, port = cells[0].text.strip, cells[1].text.strip
+        ip, port, anonymity, https = [0, 1, 4, 6].map { |i| cells[i].text.strip }
+        next unless ['elite proxy', 'anonymous'].include?(anonymity)
+        next if https == 'no'
         proxies << ip + ':' + port
       end
 
-      proxies
+      Twitterscraper.logger.debug "Fetch #{proxies.size} proxies"
+      proxies.shuffle
     rescue => e
       if (retries -= 1) > 0
         retry

data/lib/twitterscraper/query.rb

@@ -1,7 +1,10 @@
+require 'resolv-replace'
 require 'net/http'
 require 'nokogiri'
 require 'date'
 require 'json'
+require 'erb'
+require 'parallel'
 
 module Twitterscraper
   module Query
@@ -14,7 +17,6 @@ module Twitterscraper
         'Opera/9.80 (X11; Linux i686; Ubuntu/14.10) Presto/2.12.388 Version/12.16',
         'Mozilla/5.0 (Windows NT 5.2; RW; rv:7.0a1) Gecko/20091211 SeaMonkey/9.23a1pre',
     ]
-    USER_AGENT = USER_AGENT_LIST.sample
 
     INIT_URL = 'https://twitter.com/search?f=tweets&vertical=default&q=__QUERY__&l=__LANG__'
     RELOAD_URL = 'https://twitter.com/i/search/timeline?f=tweets&vertical=' +
@@ -25,7 +27,7 @@ module Twitterscraper
         'include_available_features=1&include_entities=1&' +
         'max_position={pos}&reset_error_state=false'
 
-    def get_query_url(query, lang, pos, from_user = false)
+    def build_query_url(query, lang, pos, from_user = false)
       # if from_user
       #   if !pos
       #     INIT_URL_USER.format(u = query)
@@ -40,52 +42,50 @@ module Twitterscraper
       end
     end
 
-    def query_single_page(query, lang, pos, retries = 30, from_user = false, timeout = 3, headers: [], proxies: [])
-      query = query.gsub(' ', '%20').gsub('#', '%23').gsub(':', '%3A').gsub('&', '%26')
-      logger.info("Querying #{query}")
-
-      url = get_query_url(query, lang, pos, from_user)
-      logger.debug("Scraping tweets from #{url}")
-
-      response = nil
-      begin
-        proxy = proxies.sample
-        logger.info("Using proxy #{proxy}")
-
-        response = Twitterscraper::Http.get(url, headers, proxy, timeout)
-      rescue => e
-        logger.debug "query_single_page: #{e.inspect}"
-        if (retries -= 1) > 0
-          logger.info("Retrying... (Attempts left: #{retries - 1})")
-          retry
-        else
-          raise
-        end
+    def get_single_page(url, headers, proxies, timeout = 6, retries = 30)
+      return nil if stop_requested?
+      Twitterscraper::Http.get(url, headers, proxies.sample, timeout)
+    rescue => e
+      logger.debug "query_single_page: #{e.inspect}"
+      if (retries -= 1) > 0
+        logger.info("Retrying... (Attempts left: #{retries - 1})")
+        retry
+      else
+        raise
       end
+    end
 
-      html = ''
-      json_resp = nil
+    def parse_single_page(text, html = true)
+      return [nil, nil] if text.nil? || text == ''
 
-      if pos
-        begin
-          json_resp = JSON.parse(response)
-          html = json_resp['items_html'] || ''
-        rescue => e
-          logger.warn("Failed to parse JSON #{e.inspect} while requesting #{url}")
-        end
+      if html
+        json_resp = nil
+        items_html = text
       else
-        html = response || ''
+        json_resp = JSON.parse(text)
+        items_html = json_resp['items_html'] || ''
+        logger.warn json_resp['message'] if json_resp['message'] # Sorry, you are rate limited.
       end
 
+      [items_html, json_resp]
+    end
+
+    def query_single_page(query, lang, pos, from_user = false, headers: [], proxies: [])
+      logger.info("Querying #{query}")
+      query = ERB::Util.url_encode(query)
+
+      url = build_query_url(query, lang, pos, from_user)
+      logger.debug("Scraping tweets from #{url}")
+
+      response = get_single_page(url, headers, proxies)
+      return [], nil if response.nil?
+
+      html, json_resp = parse_single_page(response, pos.nil?)
+
       tweets = Tweet.from_html(html)
 
       if tweets.empty?
-        if json_resp && json_resp['has_more_items']
-          pos = json_resp['min_position']
-        else
-          pos = nil
-        end
-        return [], pos
+        return [], (json_resp && json_resp['has_more_items'] && json_resp['min_position'])
       end
 
       if json_resp
@@ -97,51 +97,112 @@ module Twitterscraper
       end
     end
 
-    def query_tweets(query, start_date: nil, end_date: nil, limit: 100, threads: 2, lang: '')
-      start_date = start_date ? Date.parse(start_date) : Date.parse('2006-3-21')
-      end_date = end_date ? Date.parse(end_date) : Date.today
-      if start_date == end_date
-        raise 'Please specify different values for :start_date and :end_date.'
-      elsif start_date > end_date
-        raise 'The :start_date must occur before :end_date.'
+    OLDEST_DATE = Date.parse('2006-3-21')
+
+    def validate_options!(query, start_date:, end_date:, lang:, limit:, threads:, proxy:)
+      if query.nil? || query == ''
+        raise 'Please specify a search query.'
+      end
+
+      if ERB::Util.url_encode(query).length >= 500
+        raise ':query must be a UTF-8, URL-encoded search query of 500 characters maximum, including operators.'
       end
 
-      # TODO parallel
+      if start_date && end_date
+        if start_date == end_date
+          raise 'Please specify different values for :start_date and :end_date.'
+        elsif start_date > end_date
+          raise ':start_date must occur before :end_date.'
+        end
+      end
 
+      if start_date
+        if start_date < OLDEST_DATE
+          raise ":start_date must be greater than or equal to #{OLDEST_DATE}"
+        end
+      end
+
+      if end_date
+        today = Date.today
+        if end_date > Date.today
+          raise ":end_date must be less than or equal to today(#{today})"
+        end
+      end
+    end
+
+    def build_queries(query, start_date, end_date)
+      if start_date && end_date
+        date_range = start_date.upto(end_date - 1)
+        date_range.map { |date| query + " since:#{date} until:#{date + 1}" }
+      elsif start_date
+        [query + " since:#{start_date}"]
+      elsif end_date
+        [query + " until:#{end_date}"]
+      else
+        [query]
+      end
+    end
+
+    def main_loop(query, lang, limit, headers, proxies)
       pos = nil
-      all_tweets = []
 
-      proxies = Twitterscraper::Proxy.get_proxies
-      logger.info "Using #{proxies.size} proxies"
+      while true
+        new_tweets, new_pos = query_single_page(query, lang, pos, headers: headers, proxies: proxies)
+        unless new_tweets.empty?
+          @mutex.synchronize {
+            @all_tweets.concat(new_tweets)
+            @all_tweets.uniq! { |t| t.tweet_id }
+          }
+        end
+        logger.info("Got #{new_tweets.size} tweets (total #{@all_tweets.size})")
 
-      headers = {'User-Agent': USER_AGENT, 'X-Requested-With': 'XMLHttpRequest'}
-      logger.info("Headers #{headers}")
+        break unless new_pos
+        break if @all_tweets.size >= limit
 
-      start_date.upto(end_date) do |date|
-        break if date == end_date
+        pos = new_pos
+      end
 
-        queries = query + " since:#{date} until:#{date + 1}"
+      if @all_tweets.size >= limit
+        logger.info("Limit reached #{@all_tweets.size}")
+        @stop_requested = true
+      end
+    end
 
-        while true
-          new_tweets, new_pos = query_single_page(queries, lang, pos, headers: headers, proxies: proxies)
-          logger.info("Got #{new_tweets.size} tweets")
-          logger.debug("new_pos=#{new_pos}")
+    def stop_requested?
+      @stop_requested
+    end
 
-          unless new_tweets.empty?
-            all_tweets.concat(new_tweets)
-            all_tweets.uniq! { |t| t.tweet_id }
-          end
+    def query_tweets(query, start_date: nil, end_date: nil, lang: '', limit: 100, threads: 2, proxy: false)
+      start_date = Date.parse(start_date) if start_date && start_date.is_a?(String)
+      end_date = Date.parse(end_date) if end_date && end_date.is_a?(String)
+      queries = build_queries(query, start_date, end_date)
+      threads = queries.size if threads > queries.size
+      proxies = proxy ? Twitterscraper::Proxy::Pool.new : []
 
-          break unless new_pos
-          break if all_tweets.size >= limit
+      validate_options!(queries[0], start_date: start_date, end_date: end_date, lang: lang, limit: limit, threads: threads, proxy: proxy)
 
-          pos = new_pos
-        end
+      logger.info("The number of threads #{threads}")
 
-        break if all_tweets.size >= limit
+      headers = {'User-Agent': USER_AGENT_LIST.sample, 'X-Requested-With': 'XMLHttpRequest'}
+      logger.info("Headers #{headers}")
+
+      @all_tweets = []
+      @mutex = Mutex.new
+      @stop_requested = false
+
+      if threads > 1
+        Parallel.each(queries, in_threads: threads) do |query|
+          main_loop(query, lang, limit, headers, proxies)
+          raise Parallel::Break if stop_requested?
+        end
+      else
+        queries.each do |query|
+          main_loop(query, lang, limit, headers, proxies)
+          break if stop_requested?
+        end
       end
 
-      all_tweets
+      @all_tweets.sort_by { |tweet| -tweet.created_at.to_i }
     end
   end
 end

data/lib/twitterscraper/tweet.rb

@@ -2,7 +2,8 @@ require 'time'
 
 module Twitterscraper
   class Tweet
-    attr_reader :screen_name, :name, :user_id, :tweet_id, :tweet_url, :timestamp, :created_at, :text
+    KEYS = [:screen_name, :name, :user_id, :tweet_id, :tweet_url, :created_at, :text]
+    attr_reader *KEYS
 
     def initialize(attrs)
       attrs.each do |key, value|
@@ -10,6 +11,12 @@ module Twitterscraper
       end
     end
 
+    def to_json(options = {})
+      KEYS.map do |key|
+        [key, send(key)]
+      end.to_h.to_json
+    end
+
     class << self
       def from_html(text)
         html = Nokogiri::HTML(text)
@@ -31,7 +38,6 @@ module Twitterscraper
             user_id: html.attr('data-user-id').to_i,
             tweet_id: html.attr('data-tweet-id').to_i,
             tweet_url: 'https://twitter.com' + html.attr('data-permalink-path'),
-            timestamp: timestamp,
             created_at: Time.at(timestamp, in: '+00:00'),
             text: inner_html.xpath("//div[@class[contains(., 'js-tweet-text-container')]]/p[@class[contains(., 'js-tweet-text')]]").first.text,
         )

data/lib/version.rb

@@ -1,3 +1,3 @@
 module Twitterscraper
-  VERSION = "0.2.0"
+  VERSION = '0.7.0'
 end

data/twitterscraper-ruby.gemspec

@@ -21,9 +21,11 @@ Gem::Specification.new do |spec|
   spec.files         = Dir.chdir(File.expand_path('..', __FILE__)) do
     `git ls-files -z`.split("\x0").reject { |f| f.match(%r{^(test|spec|features)/}) }
   end
-  spec.bindir        = "exe"
-  spec.executables   = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
+  spec.executables   = ["twitterscraper"]
   spec.require_paths = ["lib"]
 
+  spec.required_ruby_version = ">= 2.6.4"
+
   spec.add_dependency "nokogiri"
+  spec.add_dependency "parallel"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: twitterscraper-ruby
 version: !ruby/object:Gem::Version
-  version: 0.2.0
+  version: 0.7.0
 platform: ruby
 authors:
 - ts-3156
 autorequire: 
-bindir: exe
+bindir: bin
 cert_chain: []
-date: 2020-07-12 00:00:00.000000000 Z
+date: 2020-07-13 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: nokogiri
@@ -24,10 +24,25 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: parallel
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 description: A gem  to scrape Tweets
 email:
 - ts_3156@yahoo.co.jp
-executables: []
+executables:
+- twitterscraper
 extensions: []
 extra_rdoc_files: []
 files:
@@ -43,8 +58,10 @@ files:
 - Rakefile
 - bin/console
 - bin/setup
+- bin/twitterscraper
 - lib/twitterscraper-ruby.rb
 - lib/twitterscraper.rb
+- lib/twitterscraper/cli.rb
 - lib/twitterscraper/client.rb
 - lib/twitterscraper/http.rb
 - lib/twitterscraper/lang.rb
@@ -69,7 +86,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
-      version: 2.3.0
+      version: 2.6.4
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="