htslib 0.2.0 → 0.2.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 87b06f64c496150db76d689f2cd06ba61e8ff424511be781bf17abbdf5d92d6c
-  data.tar.gz: 10126e01757aafb8fbb18c4f5d2f58541511226ddf922ffb253d29ccaf6c2027
+  metadata.gz: d26f2d2af0e353b349235ec153e4127288ecd602362254dafd91e015f61dc0a2
+  data.tar.gz: 567d03329907f3f53424511f74a4c9fd6f745ef7c2b0c6c14e8dff6da957dbdb
 SHA512:
-  metadata.gz: 2bb5806ae23d58192a74c567767de193ed21f2b8f8f87cf2bef4ef9beccc62da684ce5a0b8a6a2b96afbdbd84fb13c14b27ea2738a4d70829b7d3c1a57396430
-  data.tar.gz: 9e49efbb3bdce645013e0aaa33dec335204a0c62f48cd0ab4b5128314b97f6237b5faec6a0acf0059d8a276e26323d93ad53c4b5e7e2c36b273592b970b7dfe4
+  metadata.gz: 4c51ee0ed3c259da9e5e7353ae92bcbc7faad622453c8875ff749e8bb0a861c6c28fa09df7dac79ca37d15a0e6f83afb200d4065028e7da63910eab8f9c6e7a4
+  data.tar.gz: c62b5c7e95ba91a9f465b6822170c0faa05cf9626af8c63c486ecb55edb1af7f3d841cfa8b2d5adcd9cd1ac6df75088b85ea3145ae78a645eb2b7e3390ca11bd

data/README.md

@@ -6,11 +6,11 @@
 [![DOI](https://zenodo.org/badge/247078205.svg)](https://zenodo.org/badge/latestdoi/247078205)
 [![Docs Stable](https://img.shields.io/badge/docs-stable-blue.svg)](https://rubydoc.info/gems/htslib)
 
-Ruby-htslib is the [Ruby](https://www.ruby-lang.org) bindings to [HTSlib](https://github.com/samtools/htslib), a C library for high-throughput sequencing data formats. It allows you to read and write file formats commonly used in genomics, such as [SAM, BAM, VCF, and BCF](http://samtools.github.io/hts-specs/) in the Ruby language.
+Ruby-htslib is the [Ruby](https://www.ruby-lang.org) bindings to [HTSlib](https://github.com/samtools/htslib), a C library for high-throughput sequencing data formats. It allows you to read and write file formats commonly used in genomics, such as [SAM, BAM, VCF, and BCF](http://samtools.github.io/hts-specs/), in the Ruby language.
 
 :apple: Feel free to fork it out if you can develop it! 
 
-:bowtie: alpha stage.
+:bowtie: Alpha stage.
 
 ## Requirements
 
@@ -83,6 +83,19 @@ end
 bcf.close
 ```
 
+<details>
+<summary><b>Faidx</b></summary>
+
+```ruby
+fa = HTS::Faidx.open("c.fa")
+
+fa.fetch("chr1:1-10")
+
+fa.close
+```
+
+</details>
+
 ### Low level API
 
 `HTS::LibHTS` provides native C functions. 
@@ -96,11 +109,11 @@ p b[:category]
 p b[:format]
 ```
 
-Note: htslib makes extensive use of macro functions for speed. you cannot use C macro functions in Ruby if they are not reimplemented in ruby-htslib. Only small number of C structs are implemented with FFI's ManagedStruct, which frees memory when Ruby's garbage collection fires. Other structs will need to be freed manually. 
+Note: htslib makes extensive use of macro functions for speed. You cannot use C macro functions in Ruby if they are not reimplemented in ruby-htslib. Only small number of C structs are implemented with FFI's ManagedStruct, which frees memory when Ruby's garbage collection fires. Other structs will need to be freed manually. 
 
 ### Need more speed?
 
-Try Crystal. [htslib.cr](https://github.com/bio-crystal/htslib.cr) is implemented in Crystal language and provides an API compatible with ruby-htslib. Crsytal language is not as flexible as Ruby language. You can not use `eval` methods, and you must always be careful with the data types. Writing one-time scripts in Crystal or playing with REPL may not be as much fun. However, if you have a clear idea of what you want to do in your mind, have already written code in Ruby, and need to run them over and over, try creating a command line tool in Crystal.  The Crystal language is fast, as fast as the Rust and C languages. It will give you great power to create tools.
+Try Crystal. [htslib.cr](https://github.com/bio-crystal/htslib.cr) is implemented in Crystal language and provides an API compatible with ruby-htslib. Crystal language is not as flexible as Ruby language. You can not use `eval` methods, and you must always be careful with the data types. Writing one-time scripts in Crystal or playing with REPL may not be as much fun. However, if you have a clear idea of what you want to do in your mind, have already written code in Ruby, and need to run them over and over, try creating a command line tool in Crystal.  The Crystal language is fast, as fast as the Rust and C languages. It will give you great power to create tools.
 
 ## Documentation
 
@@ -125,8 +138,8 @@ Many macro functions are used in HTSlib. Since these macro functions cannot be c
 
 * Use the new version of Ruby to take full advantage of Ruby's potential.
   * This is possible because we have a small number of users. What a deal!
-* Remain compatibile with [htslib.cr](https://github.com/bio-crystal/htslib.cr).
-  * The most difficult part is the return value. In the Crystal language, methods are expected to return only one type. On the other hand, in the Ruby language, methods that return multiple classes are very common. For example, in the Crystal language, the compiler gets confused if the return value is one of six types: Int32, Int64, Float32, Float64, Nil, or String. In fact Crystal can do this. But the code gets a little messy. In Ruby, this is very common and doesn't cause any problems. 
+* Remain compatible with [htslib.cr](https://github.com/bio-crystal/htslib.cr).
+  * The most challenging part is the return value. In the Crystal language, methods are expected to return only one type. On the other hand, in the Ruby language, methods that return multiple classes are very common. For example, in the Crystal language, the compiler gets confused if the return value is one of six types: Int32, Int64, Float32, Float64, Nil, or String. In fact Crystal can do this. But the code gets a little messy. In Ruby, this is very common and doesn't cause any problems. 
 
 In the script directory, there are several tools to help implement ruby-htslib. These tools may be forked into independent repository in the future.
 

data/lib/hts/bam.rb

@@ -139,23 +139,51 @@ module HTS
       self
     end
 
-    # query [WIP]
-    def query(region)
+    def query(region, copy: false, &block)
+      if copy
+        query_copy(region, &block)
+      else
+        query_reuse(region, &block)
+      end
+    end
+
+    private def query_copy(region)
       check_closed
       raise "Index file is required to call the query method." unless index_loaded?
+      return to_enum(__method__, region) unless block_given?
 
       qiter = LibHTS.sam_itr_querys(@idx, header, region)
+
       begin
-        bam1 = LibHTS.bam_init1
-        slen = LibHTS.sam_itr_next(@hts_file, qiter, bam1)
-        while slen > 0
-          yield Record.new(bam1, header)
+        loop do
           bam1 = LibHTS.bam_init1
           slen = LibHTS.sam_itr_next(@hts_file, qiter, bam1)
+          break if slen == -1
+          raise if slen < -1
+
+          yield Record.new(bam1, header)
         end
       ensure
         LibHTS.hts_itr_destroy(qiter)
       end
+      self
+    end
+
+    private def query_reuse(region)
+      check_closed
+      raise "Index file is required to call the query method." unless index_loaded?
+      return to_enum(__method__, region) unless block_given?
+
+      qiter = LibHTS.sam_itr_querys(@idx, header, region)
+
+      bam1 = LibHTS.bam_init1
+      record = Record.new(bam1, header)
+      begin
+        yield record while LibHTS.sam_itr_next(@hts_file, qiter, bam1) > 0
+      ensure
+        LibHTS.hts_itr_destroy(qiter)
+      end
+      self
     end
 
     # @!macro [attach] define_getter

data/lib/hts/bcf/header_record.rb

@@ -0,0 +1,11 @@
+# frozen_string_literal: true
+
+module HTS
+  class Bcf < Hts
+    class HeaderRecord
+      def initialize
+        @bcf_hrec
+      end
+    end
+  end
+end

data/lib/hts/bcf.rb

@@ -132,8 +132,7 @@ module HTS
 
     private def each_record_reuse
       check_closed
-      # Each does not always start at the beginning of the file.
-      # This is the common behavior of IO objects in Ruby.
+
       return to_enum(__method__) unless block_given?
 
       bcf1 = LibHTS.bcf_init
@@ -142,6 +141,76 @@ module HTS
       self
     end
 
+    def query(...)
+      querys(...) # Fixme
+    end
+
+    # def queryi
+    # end
+
+    def querys(region, copy: false, &block)
+      if copy
+        querys_copy(region, &block)
+      else
+        querys_reuse(region, &block)
+      end
+    end
+
+    # private def queryi_copy
+    # end
+
+    # private def queryi_reuse
+    # end
+
+    private def querys_copy(region)
+      check_closed
+
+      raise "query is only available for BCF files" unless file_format == "bcf"
+      raise "Index file is required to call the query method." unless index_loaded?
+      return to_enum(__method__, region) unless block_given?
+
+      qitr = LibHTS.bcf_itr_querys(@idx, header, region)
+
+      begin
+        loop do
+          bcf1 = LibHTS.bcf_init
+          slen = LibHTS.hts_itr_next(@hts_file[:fp][:bgzf], qitr, bcf1, ::FFI::Pointer::NULL)
+          break if slen == -1
+          raise if slen < -1
+
+          yield Record.new(bcf1, header)
+        end
+      ensure
+        LibHTS.bcf_itr_destroy(qitr)
+      end
+      self
+    end
+
+    private def querys_reuse(region)
+      check_closed
+
+      raise "query is only available for BCF files" unless file_format == "bcf"
+      raise "Index file is required to call the query method." unless index_loaded?
+      return to_enum(__method__, region) unless block_given?
+
+      qitr = LibHTS.bcf_itr_querys(@idx, header, region)
+
+      bcf1 = LibHTS.bcf_init
+      record = Record.new(bcf1, header)
+      begin
+        loop do
+          slen = LibHTS.hts_itr_next(@hts_file[:fp][:bgzf], qitr, bcf1, ::FFI::Pointer::NULL)
+          break if slen == -1
+          raise if slen < -1
+
+          yield record
+        end
+      ensure
+        LibHTS.bcf_itr_destroy(qitr)
+      end
+      self
+    end
+
     # @!macro [attach] define_getter
     #   @method $1
     #   Get $1 array
@@ -197,7 +266,7 @@ module HTS
 
     def each_info(key)
       check_closed
-      return to_enum(__method__) unless block
+      return to_enum(__method__, key) unless block
 
       each do |r|
         yield r.info(key)
@@ -206,7 +275,7 @@ module HTS
 
     def each_format(key)
       check_closed
-      return to_enum(__method__) unless block
+      return to_enum(__method__, key) unless block
 
       each do |r|
         yield r.format(key)

data/lib/hts/faidx.rb

@@ -38,6 +38,11 @@ module HTS
       LibHTS.fai_destroy(@fai)
     end
 
+    # FIXME: This doesn't seem to work as expected
+    # def closed?
+    #   @fai.null?
+    # end
+
     # the number of sequences in the index.
     def length
       LibHTS.faidx_nseq(@fai)
@@ -46,10 +51,7 @@ module HTS
 
     # return the length of the requested chromosome.
     def chrom_size(chrom)
-      unless chrom.is_a?(String) || chrom.is_a?(Symbol)
-        # FIXME
-        raise ArgumentError, "Expect chrom to be String or Symbol"
-      end
+      raise ArgumentError, "Expect chrom to be String or Symbol" unless chrom.is_a?(String) || chrom.is_a?(Symbol)
 
       chrom = chrom.to_s
       result = LibHTS.faidx_seq_len(@fai, chrom)
@@ -57,12 +59,41 @@ module HTS
     end
     alias chrom_length chrom_size
 
-    # FIXME: naming and syntax
-    # def cget; end
+    # return the length of the requested chromosome.
+    def chrom_names
+      Array.new(length) { |i| LibHTS.faidx_iseq(@fai, i) }
+    end
+
+    # @overload fetch(name)
+    #   Fetch the sequence as a String.
+    #   @param name [String] chr1:0-10
+    # @overload fetch(name, start, stop)
+    #   Fetch the sequence as a String.
+    #   @param name [String] the name of the chromosome
+    #   @param start [Integer] the start position of the sequence (0-based)
+    #   @param stop [Integer] the end position of the sequence (0-based)
+    #   @return [String] the sequence
+
+    def seq(name, start = nil, stop = nil)
+      name = name.to_s
+      rlen = FFI::MemoryPointer.new(:int)
 
-    # FIXME: naming and syntax
-    # def get; end
+      if start.nil? && stop.nil?
+        result = LibHTS.fai_fetch(@fai, name, rlen)
+      else
+        start < 0    && raise(ArgumentError, "Expect start to be >= 0")
+        stop  < 0    && raise(ArgumentError, "Expect stop to be >= 0")
+        start > stop && raise(ArgumentError, "Expect start to be <= stop")
 
-    # __iter__
+        result = LibHTS.faidx_fetch_seq(@fai, name, start, stop, rlen)
+      end
+
+      case rlen.read_int
+      when -2 then raise "Invalid chromosome name: #{name}"
+      when -1 then raise "Error fetching sequence: #{name}:#{start}-#{stop}"
+      end
+
+      result
+    end
   end
 end

data/lib/hts/libhts/constants.rb

@@ -403,6 +403,7 @@ module HTS
         :n,              :int
     end
 
+    # Complete textual representation of a header line
     class BcfHrec < FFI::Struct
       layout \
         :type,           :int,
@@ -413,21 +414,6 @@ module HTS
         :vals,           :pointer
     end
 
-    class BcfFmt < FFI::BitStruct
-      layout \
-        :id,             :int,
-        :n,              :int,
-        :size,           :int,
-        :type,           :int,
-        :p,              :pointer, # uint8_t
-        :p_len,          :uint32,
-        :_p_off_free,    :uint32 # bit_fields
-
-      bit_fields :_p_off_free,
-                 :p_off,  31,
-                 :p_free, 1
-    end
-
     class BcfInfo < FFI::BitStruct
       layout \
         :key,            :int,
@@ -477,6 +463,21 @@ module HTS
         :m,              [:int, 3]
     end
 
+    class BcfFmt < FFI::BitStruct
+      layout \
+        :id,             :int,
+        :n,              :int,
+        :size,           :int,
+        :type,           :int,
+        :p,              :pointer, # uint8_t
+        :p_len,          :uint32,
+        :_p_off_free,    :uint32 # bit_fields
+
+      bit_fields :_p_off_free,
+                 :p_off,  31,
+                 :p_free, 1
+    end
+
     class BcfDec < FFI::Struct
       layout \
         :m_fmt,          :int,

data/lib/hts/libhts/sam_funcs.rb

@@ -30,7 +30,7 @@ module HTS
       end
 
       def bam_cigar_opchr(c)
-        ("#{BAM_CIGAR_STR}??????")[bam_cigar_op(c)]
+        "#{BAM_CIGAR_STR}??????"[bam_cigar_op(c)]
       end
 
       def bam_cigar_gen(l, o)
@@ -91,10 +91,49 @@ module HTS
       end
 
       def bam_seqi(s, i)
-        s[(i) >> 1].read_uint8 >> ((~i & 1) << 2) & 0xf
+        s[i >> 1].read_uint8 >> ((~i & 1) << 2) & 0xf
       end
 
-      # def bam_set_seqi(s, i, b)
+      def bam_set_seqi(s, i, b)
+        s[i >> 1] = (s[i >> 1] & (0xf0 >> ((~i & 1) << 2))) | ((b) << ((~i & 1) << 2))
+      end
+
+      def sam_hdr_find_hd(h, ks)
+        sam_hdr_find_line_id(h, "HD", nil, nil, ks)
+      end
+
+      def sam_hdr_find_tag_hd(h, key, ks)
+        sam_hdr_find_tag_id(h, "HD", nil, nil, key, ks)
+      end
+
+      def sam_hdr_update_hd(h, *args)
+        sam_hdr_update_line(h, "HD", nil, nil, *args, nil)
+      end
+
+      def sam_hdr_remove_tag_hd(h, key)
+        sam_hdr_remove_tag_id(h, "HD", nil, nil, key)
+      end
+
+      BAM_USER_OWNS_STRUCT = 1
+      BAM_USER_OWNS_DATA   = 2
+
+      alias bam_itr_destroy hts_itr_destroy
+      alias bam_itr_queryi sam_itr_queryi
+      alias bam_itr_querys sam_itr_querys
+      alias bam_itr_next sam_itr_next
+
+      def bam_index_load(fn)
+        hts_idx_load(fn, HTS_FMT_BAI)
+      end
+
+      alias bam_index_build sam_index_build
+
+      alias sam_itr_destroy hts_itr_destroy
+
+      alias sam_open hts_open
+      alias sam_open_format hts_open_format
+      alias sam_flush hts_flush
+      alias sam_close hts_close
     end
   end
 end

data/lib/hts/libhts/vcf_funcs.rb

@@ -139,15 +139,15 @@ module HTS
       end
 
       def bcf_gt_is_missing(val)
-        ((val) >> 1 ? 0 : 1)
+        (val >> 1 ? 0 : 1)
       end
 
       def bcf_gt_is_phased(idx)
-        ((idx) & 1)
+        (idx & 1)
       end
 
       def bcf_gt_allele(val)
-        (((val) >> 1) - 1)
+        ((val >> 1) - 1)
       end
 
       def bcf_alleles2gt(a, b)
@@ -233,6 +233,32 @@ module HTS
           LibHTS::BcfIdpair.size * int_id # offset
         )[:val][:info][type] & 0xf
       end
+
+      # def bcf_hdr_idinfo_exists
+
+      # def bcf_hdr_id2hrec
+
+      alias bcf_itr_destroy hts_itr_destroy
+
+      def bcf_itr_queryi(idx, tid, beg, _end)
+        hts_itr_query(idx, tid, beg, _end, @@bcf_readrec)
+      end
+
+      @@bcf_hdr_name2id = proc do |hdr, id|
+        LibHTS.bcf_hdr_name2id(hdr, id)
+      end
+
+      def bcf_itr_querys(idx, hdr, s)
+        hts_itr_querys(idx, s, @@bcf_hdr_name2id, hdr, @@hts_itr_query, @@bcf_readrec)
+      end
+
+      def bcf_index_load(fn)
+        hts_idx_load(fn, HTS_FMT_CSI)
+      end
+
+      def bcf_index_seqnames(idx, hdr, nptr)
+        hts_idx_seqnames(idx, nptr, @@bcf_hdr_id2name, hdr)
+      end
     end
   end
 end

data/lib/hts/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module HTS
-  VERSION = "0.2.0"
+  VERSION = "0.2.1"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: htslib
 version: !ruby/object:Gem::Version
-  version: 0.2.0
+  version: 0.2.1
 platform: ruby
 authors:
 - kojix2
-autorequire: 
+autorequire:
 bindir: bin
 cert_chain: []
-date: 2022-05-29 00:00:00.000000000 Z
+date: 2022-08-01 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: ffi
@@ -122,7 +122,7 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
-description: 
+description:
 email:
 - 2xijok@gmail.com
 executables: []
@@ -140,6 +140,7 @@ files:
 - lib/hts/bcf.rb
 - lib/hts/bcf/format.rb
 - lib/hts/bcf/header.rb
+- lib/hts/bcf/header_record.rb
 - lib/hts/bcf/info.rb
 - lib/hts/bcf/record.rb
 - lib/hts/faidx.rb
@@ -164,11 +165,12 @@ files:
 - lib/hts/tbx.rb
 - lib/hts/version.rb
 - lib/htslib.rb
+- vendor/libhts.dylib
 homepage: https://github.com/kojix2/ruby-htslib
 licenses:
 - MIT
 metadata: {}
-post_install_message: 
+post_install_message:
 rdoc_options: []
 require_paths:
 - lib
@@ -184,7 +186,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
 requirements: []
 rubygems_version: 3.3.7
-signing_key: 
+signing_key:
 specification_version: 4
 summary: HTSlib bindings for Ruby
 test_files: []