csvlint 0.3.2 → 1.0.0

data/CONTRIBUTING.md

@@ -0,0 +1,32 @@
+# Contributing to CSVlint.rb
+
+The CSVlint library is open source, and contributions are gratefully accepted!
+Details on how to contribute are below. By participating in this project, you agree to abide by our [Code of Conduct](https://github.com/theodi/csvlint.rb/blob/CODE_OF_CONDUCT.md).
+
+Before you start coding, please reach out to us either on our [gitter channel](https://gitter.im/theodi/toolbox) or by tagging a repository administrator on the issue ticket you are interested in contributing towards to indicate your interest in helping.
+
+If this is your first time contributing to the ODI’s codebase you will need to [create a fork of this repository](https://help.github.com/articles/fork-a-repo/).
+
+Consult our [Getting Started Guide](https://github.com/theodi/toolbox/wiki/Developers-Guide:-Getting-Started) (if necessary) and then follow the [readme instructions](https://github.com/theodi/csvlint.rb/blob/master/README.md#development) to get your Development environment running locally
+
+Ensure that the [tests](https://github.com/theodi/csvlint.rb/blob/master/README.md#tests) pass before working on your contribution
+
+## Code Review Process
+
+All contributions to the codebase - whether fork or pull request - will be reviewed per the below criteria.
+To increase your chances of your push being accepted please be aware of the following
+- Write [well formed commit messages](http://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html)
+- Follow our [style guide recommendations](https://github.com/theodi/toolbox/blob/README.md#code-style-guide)
+- Write tests for all changes (additions or refactors of existing code).
+- Of the github integrations we use two will be utilised to check appraise your contribution. In order of priority these are
+    - Travis ensures that all tests (existing and additions) pass
+    - Travis/Coveralls ensures that overall test coverage for lines of code meets a certain threshold. If this metric dips below what it previously was for the repository you’re pushing to then your PR will be rejected
+    - Gemnasium ensures dependencies are up to date
+- Once your PR is published and passes the above checks a repository administrator will review your contribution. Where appropriate comments may be provided and amendments suggested before your PR is merged into Master.
+- Once your PR is accepted you will be granted push access to the repository you have contributed to! Congratulations on joining our community, you’ll no longer need to work from forks.
+
+If you make a contribution to another repository in the Toolbox you will be expected to repeat this process. Read more about that [here](https://github.com/theodi/toolbox/blob/master/README.md#push-access).
+
+## Code Style Guide
+
+We follow the same code style conventions as detailed in Github’s [Ruby Style Guide](https://github.com/github/rubocop-github/blob/master/STYLEGUIDE.md)

data/Gemfile

@@ -1,6 +1,3 @@
-#ruby=ruby-2.0.0
-#ruby-gemset=csvlintrb
-
 source 'https://rubygems.org'
 
 # Specify your gem's dependencies in csvlint.rb.gemspec

data/README.md

@@ -6,7 +6,46 @@
 
 # CSV Lint
 
-A ruby gem to support validating CSV files to check their syntax and contents.
+A ruby gem to support validating CSV files to check their syntax and contents. You can either use this gem within your own Ruby code, or as a standalone command line application
+
+## Summary of features
+
+* Validation that checks the structural formatting of a CSV file  
+* Validation of a delimiter-separated values (dsv) file accesible via URL, File, or an IO-style object (e.g. StringIO)
+* Validation against [CSV dialects](http://dataprotocols.org/csv-dialect/)  
+* Validation against multiple schema standards; [JSON Table Schema](https://github.com/theodi/csvlint.rb/blob/master/README.md#json-table-schema-support) and [CSV on the Web](https://github.com/theodi/csvlint.rb/blob/master/README.md#csv-on-the-web-validation-support) 
+
+## Development
+
+`ruby version 2.1.4`
+
+### Tests
+
+The codebase includes both rspec and cucumber tests, which can be run together using:
+
+    $ rake
+
+or separately:
+
+    $ rake spec
+    $ rake features
+
+When the cucumber tests are first run, a script will create tests based on the latest version of the [CSV on the Web test suite](http://w3c.github.io/csvw/tests/), including creating a local cache of the test files. This requires an internet connection and some patience. Following that download, the tests will run locally; there's also a batch script:
+
+    $ bin/run-csvw-tests
+
+which will run the tests from the command line.
+
+If you need to refresh the CSV on the Web tests:
+
+    $ rm bin/run-csvw-tests
+    $ rm features/csvw_validation_tests.feature
+    $ rm -r features/fixtures/csvw
+
+and then run the cucumber tests again or:
+
+    $ ruby features/support/load_tests.rb
+
 
 ## Installation
 
@@ -24,7 +63,7 @@ Or install it yourself as:
 
 ## Usage
 
-You can either use this gem within your own Ruby code, or as a standolone command line application
+You can either use this gem within your own Ruby code, or as a standalone command line application
 
 ## On the command line
 
@@ -32,6 +71,9 @@ After installing the gem, you can validate a CSV on the command line like so:
 
 	csvlint myfile.csv
 
+You may need to add the gem exectuable directory to your path, by adding '/usr/local/lib/ruby/gems/2.6.0/bin' 
+or whatever your version is, to your .bash_profile PATH entry. [like so](https://stackoverflow.com/questions/2392293/ruby-gems-returns-command-not-found)
+
 You will then see the validation result, together with any warnings or errors e.g.
 
 ```
@@ -265,7 +307,7 @@ Schema validation provides some additional types of error and warning messages:
 * `:below_minimum` (error) -- a column with a `minimum` constraint contains a value that is below the minimum
 * `:above_maximum` (error) -- a column with a `maximum` constraint contains a value that is above the maximum
 
-## Other validation options
+### Other validation options
 
 You can also provide an optional options hash as the fourth argument to Validator#new. Supported options are:
 
@@ -281,48 +323,13 @@ validator = Csvlint::Validator.new( "http://example.org/data.csv", nil, nil, opt
 * :lambda -- Pass a block of code to be called when each line is validated, this will give you access to the `Validator` object. For example, this will return the current line number for every line validated:
 
 ```
-options = {
-  lambda: ->(validator) { puts validator.current_line }
-}
-validator = Csvlint::Validator.new( "http://example.org/data.csv", nil, nil, options )
-=> 1
-2
-3
-4
-.....
+    options = {
+      lambda: ->(validator) { puts validator.current_line }
+    }
+    validator = Csvlint::Validator.new( "http://example.org/data.csv", nil, nil, options )
+    => 1
+    2
+    3
+    4
+    .....
 ```
-
-## Contributing
-
-1. Fork it
-2. Create your feature branch (`git checkout -b my-new-feature`)
-3. Commit your changes (`git commit -am 'Add some feature'`)
-4. Push to the branch (`git push origin my-new-feature`)
-5. Create new Pull Request
-
-### Testing
-
-The codebase includes both rspec and cucumber tests, which can be run together using:
-
-    $ rake
-
-or separately:
-
-    $ rake spec
-    $ rake features
-
-When the cucumber tests are first run, a script will create tests based on the latest version of the [CSV on the Web test suite](http://w3c.github.io/csvw/tests/), including creating a local cache of the test files. This requires an internet connection and some patience. Following that download, the tests will run locally; there's also a batch script:
-
-    $ bin/run-csvw-tests
-
-which will run the tests from the command line.
-
-If you need to refresh the CSV on the Web tests:
-
-    $ rm bin/run-csvw-tests
-    $ rm features/csvw_validation_tests.feature
-    $ rm -r features/fixtures/csvw
-
-and then run the cucumber tests again or:
-
-    $ ruby features/support/load_tests.rb

data/bin/create_schema

@@ -5,7 +5,7 @@ require 'csvlint'
 
 begin
   puts ARGV[0]
-	csv = CSV.new( open(ARGV[0]) )
+  csv = CSV.new( URI.open(ARGV[0]) )
 	headers = csv.shift
 	
 	name = File.basename( ARGV[0] )
@@ -29,4 +29,4 @@ rescue => e
   puts e
   puts e.backtrace
 	puts "Unable to parse CSV file"
-end
+end

data/csvlint.gemspec

@@ -10,7 +10,7 @@ Gem::Specification.new do |spec|
   spec.email         = ["pezholio@gmail.com"]
   spec.description   = %q{CSV Validator}
   spec.summary       = %q{CSV Validator}
-  spec.homepage      = ""
+  spec.homepage      = "https://github.com/theodi/csvlint.rb"
   spec.license       = "MIT"
 
   spec.files         = `git ls-files`.split($/)
@@ -18,8 +18,9 @@ Gem::Specification.new do |spec|
   spec.test_files    = spec.files.grep(%r{^(test|spec|features)/})
   spec.require_paths = ["lib"]
 
-  spec.add_dependency "mime-types"
-  spec.add_dependency "colorize"
+  spec.required_ruby_version = ['>= 2.5', '< 3.2']
+
+  spec.add_dependency "rainbow"
   spec.add_dependency "open_uri_redirections"
   spec.add_dependency "activesupport"
   spec.add_dependency "addressable"
@@ -27,8 +28,10 @@ Gem::Specification.new do |spec|
   spec.add_dependency "escape_utils"
   spec.add_dependency "uri_template"
   spec.add_dependency "thor"
+  spec.add_dependency "rack"
+  spec.add_dependency "net-http-persistent"
 
-  spec.add_development_dependency "bundler", "~> 1.3"
+  spec.add_development_dependency "bundler", ">= 1.3"
   spec.add_development_dependency "rake"
   spec.add_development_dependency "cucumber"
   spec.add_development_dependency "simplecov"
@@ -39,10 +42,10 @@ Gem::Specification.new do |spec|
   spec.add_development_dependency "rspec-pride"
   spec.add_development_dependency "rspec-expectations"
   spec.add_development_dependency "coveralls"
-  spec.add_development_dependency "pry"
+  spec.add_development_dependency "byebug"
   spec.add_development_dependency "github_changelog_generator"
   spec.add_development_dependency "aruba"
-  spec.add_development_dependency "rdf"
+  spec.add_development_dependency "rdf", "< 4.0"
   spec.add_development_dependency "rdf-turtle"
   spec.add_development_dependency "henry"
 

data/features/fixtures/white space in filename.csv

@@ -0,0 +1,3 @@
+"Foo","Bar","Baz"
+"1","2","3"
+"3","2","1"

data/features/support/aruba.rb

@@ -1,5 +1,4 @@
 require 'aruba'
-require 'aruba/in_process'
 require 'aruba/cucumber'
 
 require 'csvlint/cli'
@@ -52,5 +51,7 @@ module Csvlint
   end
 end
 
-Aruba.process = Aruba::Processes::InProcess
-Aruba.process.main_class = Csvlint::CliRunner
+Aruba.configure do |config|
+  config.command_launcher = :in_process
+  config.main_class = Csvlint::CliRunner
+end

data/features/support/env.rb

@@ -6,7 +6,7 @@ $:.unshift File.join( File.dirname(__FILE__), "..", "..", "lib")
 require 'rspec/expectations'
 require 'cucumber/rspec/doubles'
 require 'csvlint'
-require 'pry'
+require 'byebug'
 
 require 'spork'
 

data/features/support/load_tests.rb

@@ -2,7 +2,7 @@ require 'json'
 require 'open-uri'
 require 'uri'
 
-BASE_URI = "http://www.w3.org/2013/csvw/tests/"
+BASE_URI = "https://w3c.github.io/csvw/tests/"
 BASE_PATH = File.join(File.dirname(__FILE__), "..", "fixtures", "csvw")
 FEATURE_BASE_PATH = File.join(File.dirname(__FILE__), "..")
 VALIDATION_FEATURE_FILE_PATH = File.join(FEATURE_BASE_PATH, "csvw_validation_tests.feature")
@@ -23,7 +23,7 @@ def cache_file(filename)
 		end
 		STDERR.puts("storing #{file} locally")
 		File.open(file, 'wb') do |f|
-			f.puts open(uri, 'rb').read
+      f.puts URI.open(uri, 'rb').read
 		end
 	end
 	return uri, file
@@ -31,14 +31,14 @@ end
 
 File.open(SCRIPT_FILE_PATH, 'w') do |file|
 	File.chmod(0755, SCRIPT_FILE_PATH)
-	manifest = JSON.parse( open("http://www.w3.org/2013/csvw/tests/manifest-validation.jsonld").read )
+  manifest = JSON.parse( URI.open("#{BASE_URI}manifest-validation.jsonld").read )
 	manifest["entries"].each do |entry|
 		type = "valid"
-		case entry["type"] 
-		when "csvt:WarningValidationTest" 
-			type = "warnings" 
-		when "csvt:NegativeValidationTest" 
-			type = "errors" 
+		case entry["type"]
+		when "csvt:WarningValidationTest"
+			type = "warnings"
+		when "csvt:NegativeValidationTest"
+			type = "errors"
 		end
 		file.puts "echo \"#{entry["id"].split("#")[-1]}: #{entry["name"].gsub("`", "'")}\""
 		file.puts "echo \"#{type}: #{entry["comment"].gsub("\"", "\\\"").gsub("`", "'")}\""
@@ -54,14 +54,14 @@ File.open(SCRIPT_FILE_PATH, 'w') do |file|
 end unless File.exist? SCRIPT_FILE_PATH
 
 File.open(VALIDATION_FEATURE_FILE_PATH, 'w') do |file|
-	file.puts "# Auto-generated file based on standard validation CSVW tests from http://www.w3.org/2013/csvw/tests/manifest-validation.jsonld"
+	file.puts "# Auto-generated file based on standard validation CSVW tests from #{BASE_URI}manifest-validation.jsonld"
 	file.puts ""
 
-	manifest = JSON.parse( open("http://www.w3.org/2013/csvw/tests/manifest-validation.jsonld").read )
+  manifest = JSON.parse( URI.open("#{BASE_URI}manifest-validation.jsonld").read )
 
 	file.puts "Feature: #{manifest["label"]}"
 	file.puts ""
-	
+
 	manifest["entries"].each do |entry|
 		action_uri, action_file = cache_file(entry["action"])
 		metadata = nil
@@ -85,7 +85,7 @@ File.open(VALIDATION_FEATURE_FILE_PATH, 'w') do |file|
 			end
 			provided_files << action_uri.to_s
 			if entry["name"].include?("/.well-known/csvm")
-				file.puts "\t\tAnd I have a file called \"w3.org/.well-known/csvm\" at the url \"http://www.w3.org/.well-known/csvm\""
+				file.puts "\t\tAnd I have a file called \"w3.org/.well-known/csvm\" at the url \"https://www.w3.org/.well-known/csvm\""
 	  			missing_files << "#{action_uri}.json"
 	  			missing_files << URI.join(action_uri, 'csvm.json').to_s
 			else

data/features/support/webmock.rb

@@ -1 +1,3 @@
 require 'webmock/cucumber'
+
+WebMock.disable_net_connect!(allow: %r{csvw/tests})

data/lib/csvlint/cli.rb

@@ -1,5 +1,6 @@
 require 'csvlint'
-require 'colorize'
+require 'rainbow'
+require 'active_support/json'
 require 'json'
 require 'pp'
 require 'thor'
@@ -10,15 +11,20 @@ module Csvlint
   class Cli < Thor
 
     desc "myfile.csv OR csvlint http://example.com/myfile.csv", "Supports validating CSV files to check their syntax and contents"
+
     option :dump_errors, desc: "Pretty print error and warning objects.", type: :boolean, aliases: :d
     option :schema, banner: "FILENAME OR URL", desc: "Schema file", aliases: :s
     option :json, desc: "Output errors as JSON", type: :boolean, aliases: :j
+    option :werror, desc: "Make all warnings into errors", type: :boolean, aliases: :w
+
     def validate(source = nil)
       source = read_source(source)
       @schema = get_schema(options[:schema]) if options[:schema]
       fetch_schema_tables(@schema, options) if source.nil?
 
-      valid = validate_csv(source, @schema, options[:dump], options[:json])
+      Rainbow.enabled = $stdout.tty?
+
+      valid = validate_csv(source, @schema, options[:dump_errors], options[:json], options[:werror])
       exit 1 unless valid
     end
 
@@ -53,7 +59,7 @@ module Csvlint
 
       def get_schema(schema)
         begin
-          schema = Csvlint::Schema.load_from_json(schema, false)
+          schema = Csvlint::Schema.load_from_uri(schema, false)
         rescue Csvlint::Csvw::MetadataError => e
           return_error "invalid metadata: #{e.message}#{" at " + e.path if e.path}"
         rescue OpenURI::HTTPError, Errno::ENOENT
@@ -80,7 +86,7 @@ module Csvlint
           rescue Errno::ENOENT
             return_error "#{source} not found"
           end unless source =~ /^http(s)?/
-          valid &= validate_csv(source, schema, options[:dump], nil)
+          valid &= validate_csv(source, schema, options[:dump_errors], nil, options[:werror])
         end
 
         exit 1 unless valid
@@ -103,11 +109,7 @@ module Csvlint
         output_string += ". #{location}" unless location.empty?
         output_string += ". #{error.content}" if error.content
 
-        if $stdout.tty?
-          puts output_string.colorize(color)
-        else
-          puts output_string
-        end
+        puts Rainbow(output_string).color(color)
 
         if dump
           pp error
@@ -121,15 +123,11 @@ module Csvlint
       end
 
       def return_error(message)
-        if $stdout.tty?
-          puts message.colorize(:red)
-        else
-          puts message
-        end
+        puts Rainbow(message).red
         exit 1
       end
 
-      def validate_csv(source, schema, dump, json)
+      def validate_csv(source, schema, dump, json, werror)
         @error_count = 0
 
         if json === true
@@ -157,16 +155,12 @@ module Csvlint
           }.to_json
           print json
         else
-          if $stdout.tty?
-            puts "\r\n#{csv} is #{validator.valid? ? "VALID".green : "INVALID".red}"
-          else
-            puts "\r\n#{csv} is #{validator.valid? ? "VALID" : "INVALID"}"
-          end
-
-          print_errors(validator.errors, dump)
+          puts "\r\n#{csv} is #{validator.valid? ? Rainbow("VALID").green : Rainbow("INVALID").red}"
+          print_errors(validator.errors,   dump)
           print_errors(validator.warnings, dump)
         end
 
+        return false if werror && validator.warnings.size > 0
         return validator.valid?
       end
 
@@ -191,9 +185,9 @@ module Csvlint
         lambda do |row|
           new_errors = row.errors.count
           if new_errors > @error_count
-            print "!".red
+            print Rainbow("!").red
           else
-            print ".".green
+            print Rainbow(".").green
           end
           @error_count = new_errors
         end

data/lib/csvlint/csvw/property_checker.rb

@@ -11,7 +11,14 @@ module Csvlint
             value, warnings = check_common_property_value(value, base_url, lang)
             return value, warnings, :annotation
           else
-            return value, :invalid_property, nil
+            # property name must be an absolute URI
+            begin
+              return value, :invalid_property, nil if URI(property).scheme.nil?
+              value, warnings = check_common_property_value(value, base_url, lang)
+              return value, warnings, :annotation
+            rescue
+              return value, :invalid_property, nil
+            end
           end
         end
 
@@ -448,7 +455,7 @@ module Csvlint
               schema_url = URI.join(base_url, value).to_s
               schema_base_url = schema_url
               schema_ref = schema_url.start_with?("file:") ? File.new(schema_url[5..-1]) : schema_url
-              schema = JSON.parse( open(schema_ref).read )
+              schema = JSON.parse( URI.open(schema_ref).read )
               schema["@id"] = schema["@id"] ? URI.join(schema_url, schema["@id"]).to_s : schema_url
               if schema["@context"]
                 if schema["@context"].instance_of?(Array) && schema["@context"].length > 1

data/lib/csvlint/csvw/table.rb

@@ -62,7 +62,8 @@ module Csvlint
         if validate
           unless @primary_key.nil?
             key = @primary_key.map { |column| column.validate(values[column.number - 1], row) }
-            build_errors(:duplicate_key, :schema, row, nil, key.join(","), @primary_key_values[key]) if @primary_key_values.include?(key)
+            colnum = if primary_key.length == 1 then primary_key[0].number else nil end
+            build_errors(:duplicate_key, :schema, row, colnum, key.join(","), @primary_key_values[key]) if @primary_key_values.include?(key)
             @primary_key_values[key] = row
           end
           # build a record of the unique values that are referenced by foreign keys from other tables
@@ -103,11 +104,12 @@ module Csvlint
         reset
         local = @foreign_key_reference_values[foreign_key]
         context = { "from" => { "url" => remote_url.to_s.split("/")[-1], "columns" => foreign_key["columnReference"] }, "to" => { "url" => @url.to_s.split("/")[-1], "columns" => foreign_key["reference"]["columnReference"] }}
-        remote.each do |r|
+        colnum = if foreign_key["referencing_columns"].length == 1 then foreign_key["referencing_columns"][0].number else nil end
+        remote.each_with_index do |r,i|
           if local[r]
-            build_errors(:multiple_matched_rows, :schema, nil, nil, r, context) if local[r].length > 1
+            build_errors(:multiple_matched_rows, :schema, i+1, colnum, r, context) if local[r].length > 1
           else
-            build_errors(:unmatched_foreign_key_reference, :schema, nil, nil, r, context)
+            build_errors(:unmatched_foreign_key_reference, :schema, i+1, colnum, r, context)
           end
         end
         return valid?

data/lib/csvlint/schema.rb

@@ -16,6 +16,8 @@ module Csvlint
 
     class << self
 
+      extend Gem::Deprecate
+
       def from_json_table(uri, json)
         fields = []
         json["fields"].each do |field_desc|
@@ -29,19 +31,32 @@ module Csvlint
         return Csvlint::Csvw::TableGroup.from_json(uri, json)
       end
 
+      # Deprecated method signature
       def load_from_json(uri, output_errors = true)
+        load_from_uri(uri, output_errors)
+      end
+      deprecate :load_from_json, :load_from_uri, 2018, 1
+
+      def load_from_uri(uri, output_errors = true)
+        load_from_string(uri, URI.open(uri).read, output_errors)
+      rescue OpenURI::HTTPError, Errno::ENOENT => e
+        raise e
+      end
+
+      def load_from_string(uri, string, output_errors = true)
         begin
-          json = JSON.parse( open(uri).read )
+          json = JSON.parse( string )
           if json["@context"]
             uri = "file:#{File.expand_path(uri)}" unless uri.to_s =~ /^http(s)?/
             return Schema.from_csvw_metadata(uri,json)
           else
             return Schema.from_json_table(uri,json)
           end
+        rescue TypeError => e
+          # NO IDEA what this was even trying to do - SP 20160526
+
         rescue Csvlint::Csvw::MetadataError => e
           raise e
-        rescue OpenURI::HTTPError, Errno::ENOENT => e
-          raise e
         rescue => e
           if output_errors === true
             STDERR.puts e.class

data/lib/csvlint/validate.rb

@@ -38,13 +38,15 @@ module Csvlint
         ESCAPE_RE[@re_chars][@re_esc][str]
       end
 
-      # Optimization: Disable the CSV library's converters feature.
-      # @see https://github.com/ruby/ruby/blob/v2_2_3/lib/csv.rb#L2100
-      def init_converters(options, field_name = :converters)
-        @converters = []
-        @header_converters = []
-        options.delete(:unconverted_fields)
-        options.delete(field_name)
+      if RUBY_VERSION < '2.5'
+        # Optimization: Disable the CSV library's converters feature.
+        # @see https://github.com/ruby/ruby/blob/v2_2_3/lib/csv.rb#L2100
+        def init_converters(options, field_name = :converters)
+          @converters = []
+          @header_converters = []
+          options.delete(:unconverted_fields)
+          options.delete(field_name)
+        end
       end
     end
 
@@ -56,6 +58,7 @@ module Csvlint
         "Missing or stray quote" => :stray_quote,
         "Illegal quoting" => :whitespace,
         "Unclosed quoted field" => :unclosed_quote,
+        "Any value after quoted field isn't allowed" => :unclosed_quote,
         "Unquoted fields do not allow \\r or \\n" => :line_breaks,
     }
 
@@ -123,6 +126,7 @@ module Csvlint
         validate_metadata
       end
       request.on_body do |chunk|
+        chunk.force_encoding(Encoding::UTF_8) if chunk.encoding == Encoding::ASCII_8BIT
         io = StringIO.new(chunk)
         io.each_line do |line|
           break if line_limit_reached?
@@ -178,9 +182,9 @@ module Csvlint
       @csv_options[:encoding] = @encoding
 
       begin
-        row = LineCSV.parse_line(stream, @csv_options)
+        row = LineCSV.parse_line(stream, **@csv_options)
       rescue LineCSV::MalformedCSVError => e
-        build_exception_messages(e, stream, current_line)
+        build_exception_messages(e, stream, current_line) unless e.message.include?("UTF") && @reported_invalid_encoding
       end
 
       if row
@@ -249,7 +253,7 @@ module Csvlint
         if rel == "describedby" && param == "type" && ["application/csvm+json", "application/ld+json", "application/json"].include?(param_value)
           begin
             url = URI.join(@source_url, uri)
-            schema = Schema.load_from_json(url)
+            schema = Schema.load_from_uri(url)
             if schema.instance_of? Csvlint::Csvw::TableGroup
               if schema.tables[@source_url]
                 @schema = schema
@@ -433,7 +437,8 @@ module Csvlint
         when StringIO
           return
         when File
-          @source_url = "file:#{File.expand_path(@source)}"
+          uri_parser = URI::Parser.new
+          @source_url = "file:#{uri_parser.escape(File.expand_path(@source))}"
         else
           @source_url = @source
       end
@@ -448,7 +453,7 @@ module Csvlint
       if @source_url =~ /^http(s)?/
         begin
           well_known_uri = URI.join(@source_url, "/.well-known/csvm")
-          paths = open(well_known_uri).read.split("\n")
+          paths = URI.open(well_known_uri.to_s).read.split("\n")
         rescue OpenURI::HTTPError, URI::BadURIError
         end
       end
@@ -459,7 +464,7 @@ module Csvlint
           path = template.expand('url' => @source_url)
           url = URI.join(@source_url, path)
           url = File.new(url.to_s.sub(/^file:/, "")) if url.to_s =~ /^file:/
-          schema = Schema.load_from_json(url)
+          schema = Schema.load_from_uri(url)
           if schema.instance_of? Csvlint::Csvw::TableGroup
             if schema.tables[@source_url]
               @schema = schema

data/lib/csvlint/version.rb

@@ -1,3 +1,3 @@
 module Csvlint
-  VERSION = "0.3.2"
+  VERSION = "1.0.0"
 end

data/lib/csvlint.rb

@@ -7,7 +7,7 @@ require 'typhoeus'
 
 require 'active_support/core_ext/date/conversions'
 require 'active_support/core_ext/time/conversions'
-require 'mime/types'
+require 'active_support/core_ext/object'
 require 'open_uri_redirections'
 require 'uri_template'