rbbt 1.2.5 → 2.0.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: ccb5da58d650ebae30d3a24f39eaf8c12e864f160e83d4b2ba382d6ea487e758
+  data.tar.gz: '0963980b784617afdfdcf8c20b3545ed2cd95175f98366707d67d8a0077e9eca'
+SHA512:
+  metadata.gz: 3fbc5b33566884fd427a6844de3c1eed4b394512cd5c7e3d725d6669a151743979925344f592c7da8bbb1fc7504998e653acdefa67d4d5465e0b0fe5322fcbf3
+  data.tar.gz: c8a62ea9e741658c398ae286a468c72307c917d0e6d070488a46c9c21e71395e9d52e8f19f4986a363844e33c131a1540c7064d8c7f0cb0e8f4670588a08a491

data/README.rdoc

@@ -1,140 +1,4 @@
-= rbbt
+This is the meta-package for the Rbbt. It produces a gem that installs rbbt-util, rbbt-rest, and rbbt-sources.
 
-Rbbt stands for Ruby Bio-Text, it started as an API for text mining developed
-for SENT[http://sent.dacya.ucm.es], but its functionality has been used
-for other applications as well, such as MARQ[http://marq.dacya.ucm.es].
+I'm working on a documentation page: http://mikisvaz.github.io/rbbt
 
-== Important Note
-
-Some unexpected gem dependencies may appear.
-
-Rbbt covers several functionalities, some will work right away, some require to
-install dependencies or download and process data from the internet. Since not
-all users are likely to need all the functionalities, this gems dependencies
-include only the very basic requirements. Dependencies may appear unexpectedly
-when using new parts of the API. 
-
-== Functionality
-
-=== Data sources interface
-
-PubMed:: Making queries and retrieving articles.
-
-BioMart:: Making queries to BioMart programmatically. It can divide a large query into smaller ones and merge the results.
-
-Entrez:: Retrieving gene entries, associated articles, and gene synonyms and aliases.
-
-Biocreative:: Using the competition test and training data to train and evaluate Named Entity Extraction models and Gene Mention Normalization.
-
-
-=== Text mining tasks
-
-BagOfWords:: Bag-of-words representation of text. Chunk text into terms, which can be unigrams or bi-grams, remove stopwords, build a term thesaurus using a TF_IDF (term frequency inverse document frequency) or a KL (Kullback-Leibler divergence) Dictionary, and extract a bag-of-words representations suitable for the Classifier.
-
-Classifier:: Using R to build classification models and to use them to classify new entires. Currently the models are Support Vector Machines. 
-
-NER:: Named Entity Extraction. Currently there are 3 alternatives to do this Abner, Banner, RegExpNER, and NER. The first two are third party Java systems that require the rjb[rjb.rubyforge.org/] (Ruby Java Bridge) gem to be installed. The third one, RegExpNER, is a simple regular-expression based system which can be used when there is not enough data to train a CRF based system, for example, to find Polysearch terms. The last one, the default, is a reimplementation of a CRF-based system, such as Abner and Banner, completely configurable using a simple DSL (domain specific language).
-
-Normalizer:: Resolve gene mentions to the actual genes they refer to. It compares the gene mention to all possible gene names and synonyms to find the best match. It is configurable using a DSL.
-
-=== Organisms support
-
-Using configuration files rbbt can support different organisms. The system is prepared to parse organism specific database files and merge them with Entrez and BioMart. Basically producing the following information
-
-Lexicon:: Listing the synonyms for each gene
-
-Identifiers:: Listing different identifiers for each gene like Entrez Gene Ids, Unigene, Affymetrix probe ids, etc. This is not the same as the lexicon which holds names, not identifiers.
-
-GO:: Listing associations of genes to GO terms.
-
-PubMed articles:: List articles associated to each gene, as listed in Entrez or listed to support of GO associations.
-
-With this information rbbt offers the following functionality via the Organism class
-
-NER and Normalization:: Loads custom models for Named Entity Extraction and Gene Mention Normalization
-
-Identifiers translation:: Translates gene identifiers between formats.
-
-Organisms in rbbt are identified using a keyword. This is the list of organisms currently supported with their associated keywords:
-
-Candida albicans:: Cal
-Mus musculus:: Mmu
-Rattus norvegicus:: Rno
-Saccharomyces cerevisiae:: Sce
-Arabidopsis thaliana:: Ata
-Caenorhabditis elegans:: Cel
-Homo sapiens:: Hsa
-Schizosaccharomyces pombe:: Spo
-
-
-=== Other
-
-Cache:: The system caches PubMed articles and Entrez gene entries, this is considered a persistent cache since these items are unlikely to change. Also caches any data downloaded from the internet, like BioMart queries for example, into a non-persistent cache that can be purged to perform updates to the system. 
-
-Tab separated file helpers:: The data in rbbt is saved into tab separated files and is loaded into Hash. Modules like Open or ArrayHash help dealing with these files and data structures.
-
-= Installation
-
-Install the gem normally <tt>gem install rbbt</tt>. The gem includes a configuration tool rbbt_config. The first time you run it it will ask you to configure some paths. After that you may use it to process data for different tasks. Lets see some scenarios:
-
-=== Using rbbt to translate identifiers
-
-1. Do <tt>rbbt_config prepare identifiers</tt> to do deploy the configuration files and download entrez data, this needs to be done just once.
-3. Now you may do <tt>rbbt_config install organisms</tt> toprocess all the organisms, or <tt>rbbt_config install organisms -o Sce</tt> to process only yeast (Sce).
-4. You may now use a script like this to translate gene identifiers from yeast feed from the standard input
-  require 'rbbt/sources/organism'
-
-  index = Organism.id_index('Sce', :native => 'Entrez Gene Id')
-
-  STDIN.each_line{|l| puts "#{l.chomp} => #{index[l.chomp]}"}
-
-=== Using rbbt to find gene mentions in text
-
-First prepare the organisms as you did in the previous section. Next, if you want to use the default NER module:
-
-1. Install the Biocreative data used to train the model and compile the CRF++ plugin, <tt>rbbt_config prepare rner</tt>. You may need at this point to install ParseTree and ruby2ruby
-2. Build the module for a particular organism <tt>rbbt_config install ner -o Sce</tt>. You need to have the gems ParseTree and ruby2ruby for this to work. This process can take a long time.
-
-Or, if you wan to use Abner or Banner:
-
-1. Download and install the packages <tt>rbbt_config prepare java_ner</tt> 
-
-You may now, for example, find mentions to genes in articles from a PubMed query using this script
-
-    require 'rbbt/sources/organism'
-    require 'rbbt/sources/pubmed'
-
-    # type = :abner
-    # type = :banner
-    type = :rner
-
-    ner = Organism.ner('Sce', type )
-    pmids = PubMed.query(ARGV[0], 500)
-
-    PubMed.get_article(pmids).each{|pmid,article|
-      mentions = ner.extract(article.text)
-      puts pmid
-      puts article.text
-      puts "Mentions: " << mentions.uniq.join(", ")
-      puts
-    }
-
-== More Installation Guidelines 
-
-This is the complete list of gem requirements: <tt>ParseTree ruby2ruby simpleconsole rjb rsruby stemmer rand rake progress-monitor</tt>. Some of these gems to not work with ruby 1.9 at the time, or may be a bit more complicated to install, for that reason *they are not reported as dependencies and are only required when they are about to be used*. Note that some of these gems are in the gemcutter repository, you may need to install the <tt>gemcutter</tt> gem and do <tt>gem tumble</tt>
-
-Some of the API requires to have some data processed using rbbt_config. This command is used to install third party software, download data from the internet, or build models. The command <tt>rbbt_config prepare all</tt> will install and process everything, this will take a long time, specially building the NER models. So you might want to start with the basic install and include more things as they are needed. 
-
-
-= Note on Patches/Pull Requests
- 
-* Fork the project.
-* Make your feature addition or bug fix.
-* Add tests for it. This is important so I don't break it in a future version unintentionally.
-* Commit, do not mess with rakefile, version, or history.
-  (if you want to have your own version, that is fine, but bump version in a commit by itself that I can ignore when I pull)
-* Send me a pull request. Bonus points for topic branches.
-
-= Copyright
-
-Copyright (c) 2009 Miguel Vazquez. See LICENSE for details.

metadata

@@ -1,244 +1,99 @@
---- !ruby/object:Gem::Specification 
+--- !ruby/object:Gem::Specification
 name: rbbt
-version: !ruby/object:Gem::Version 
-  prerelease: false
-  segments: 
-  - 1
-  - 2
-  - 5
-  version: 1.2.5
+version: !ruby/object:Gem::Version
+  version: 2.0.0
 platform: ruby
-authors: 
+authors:
 - Miguel Vazquez
 autorequire: 
 bindir: bin
 cert_chain: []
-
-date: 2010-10-22 00:00:00 +02:00
-default_executable: rbbt_config
-dependencies: 
-- !ruby/object:Gem::Dependency 
-  name: rake
-  prerelease: false
-  requirement: &id001 !ruby/object:Gem::Requirement 
-    none: false
-    requirements: 
+date: 2020-05-28 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: rbbt-util
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
     - - ">="
-      - !ruby/object:Gem::Version 
-        segments: 
-        - 0
-        - 8
-        - 4
-        version: 0.8.4
+      - !ruby/object:Gem::Version
+        version: '0'
   type: :runtime
-  version_requirements: *id001
-- !ruby/object:Gem::Dependency 
-  name: simpleconsole
   prerelease: false
-  requirement: &id002 !ruby/object:Gem::Requirement 
-    none: false
-    requirements: 
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rbbt-rest
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
     - - ">="
-      - !ruby/object:Gem::Version 
-        segments: 
-        - 0
-        version: "0"
+      - !ruby/object:Gem::Version
+        version: '0'
   type: :runtime
-  version_requirements: *id002
-- !ruby/object:Gem::Dependency 
-  name: stemmer
   prerelease: false
-  requirement: &id003 !ruby/object:Gem::Requirement 
-    none: false
-    requirements: 
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
     - - ">="
-      - !ruby/object:Gem::Version 
-        segments: 
-        - 0
-        version: "0"
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rbbt-sources
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
   type: :runtime
-  version_requirements: *id003
-- !ruby/object:Gem::Dependency 
-  name: progress-monitor
   prerelease: false
-  requirement: &id004 !ruby/object:Gem::Requirement 
-    none: false
-    requirements: 
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rbbt-dm
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
     - - ">="
-      - !ruby/object:Gem::Version 
-        segments: 
-        - 0
-        version: "0"
+      - !ruby/object:Gem::Version
+        version: '0'
   type: :runtime
-  version_requirements: *id004
-- !ruby/object:Gem::Dependency 
-  name: simpleconsole
   prerelease: false
-  requirement: &id005 !ruby/object:Gem::Requirement 
-    none: false
-    requirements: 
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
     - - ">="
-      - !ruby/object:Gem::Version 
-        segments: 
-        - 0
-        version: "0"
-  type: :runtime
-  version_requirements: *id005
-description: |-
-  This toolbox includes modules for text-mining, like Named Entity Recognition and Normalization and document
-      classification, as well as data integration modules that interface with PubMed, Entrez Gene, BioMart.
-email: miguel.vazquez@fdi.ucm.es
-executables: 
-- rbbt_config
+      - !ruby/object:Gem::Version
+        version: '0'
+description: Meta package for a gem that requires the basic Rbbt packages
+email: miguel.vazquez@cnio.es
+executables: []
 extensions: []
-
-extra_rdoc_files: 
-- LICENSE
+extra_rdoc_files:
 - README.rdoc
-files: 
-- bin/rbbt_config
-- install_scripts/classifier/R/classify.R
-- install_scripts/classifier/Rakefile
-- install_scripts/get_abner.sh
-- install_scripts/get_banner.sh
-- install_scripts/get_biocreative.sh
-- install_scripts/get_crf++.sh
-- install_scripts/get_entrez.sh
-- install_scripts/get_go.sh
-- install_scripts/get_polysearch.sh
-- install_scripts/ner/Rakefile
-- install_scripts/ner/config/default.rb
-- install_scripts/norm/Rakefile
-- install_scripts/norm/config/cue_default.rb
-- install_scripts/norm/config/tokens_default.rb
-- install_scripts/norm/functions.sh
-- install_scripts/organisms/Ath.Rakefile
-- install_scripts/organisms/Cal.Rakefile
-- install_scripts/organisms/Cel.Rakefile
-- install_scripts/organisms/Hsa.Rakefile
-- install_scripts/organisms/Mmu.Rakefile
-- install_scripts/organisms/Rakefile
-- install_scripts/organisms/Rno.Rakefile
-- install_scripts/organisms/Sce.Rakefile
-- install_scripts/organisms/Spo.Rakefile
-- install_scripts/organisms/rake-include.rb
-- install_scripts/wordlists/consonants
-- install_scripts/wordlists/stopwords
-- lib/rbbt.rb
-- lib/rbbt/bow/bow.rb
-- lib/rbbt/bow/classifier.rb
-- lib/rbbt/bow/dictionary.rb
-- lib/rbbt/ner/abner.rb
-- lib/rbbt/ner/banner.rb
-- lib/rbbt/ner/dictionaryNER.rb
-- lib/rbbt/ner/regexpNER.rb
-- lib/rbbt/ner/rner.rb
-- lib/rbbt/ner/rnorm.rb
-- lib/rbbt/ner/rnorm/cue_index.rb
-- lib/rbbt/ner/rnorm/tokens.rb
-- lib/rbbt/sources/biocreative.rb
-- lib/rbbt/sources/biomart.rb
-- lib/rbbt/sources/entrez.rb
-- lib/rbbt/sources/go.rb
-- lib/rbbt/sources/gscholar.rb
-- lib/rbbt/sources/organism.rb
-- lib/rbbt/sources/polysearch.rb
-- lib/rbbt/sources/pubmed.rb
-- lib/rbbt/util/arrayHash.rb
-- lib/rbbt/util/filecache.rb
-- lib/rbbt/util/index.rb
-- lib/rbbt/util/misc.rb
-- lib/rbbt/util/open.rb
-- lib/rbbt/util/rake.rb
-- lib/rbbt/util/simpleDSL.rb
-- lib/rbbt/util/tmpfile.rb
-- tasks/install.rake
-- LICENSE
+files:
 - README.rdoc
-- test/test_rbbt.rb
-- test/rbbt/bow/test_bow.rb
-- test/rbbt/bow/test_classifier.rb
-- test/rbbt/bow/test_dictionary.rb
-- test/rbbt/sources/test_organism.rb
-- test/rbbt/sources/test_biomart.rb
-- test/rbbt/sources/test_pubmed.rb
-- test/rbbt/sources/test_polysearch.rb
-- test/rbbt/sources/test_biocreative.rb
-- test/rbbt/sources/test_entrez.rb
-- test/rbbt/sources/test_go.rb
-- test/rbbt/ner/test_rner.rb
-- test/rbbt/ner/test_dictionaryNER.rb
-- test/rbbt/ner/test_banner.rb
-- test/rbbt/ner/test_rnorm.rb
-- test/rbbt/ner/test_regexpNER.rb
-- test/rbbt/ner/test_abner.rb
-- test/rbbt/ner/rnorm/test_cue_index.rb
-- test/rbbt/ner/rnorm/test_tokens.rb
-- test/rbbt/util/test_misc.rb
-- test/rbbt/util/test_tmpfile.rb
-- test/rbbt/util/test_arrayHash.rb
-- test/rbbt/util/test_filecache.rb
-- test/rbbt/util/test_simpleDSL.rb
-- test/rbbt/util/test_open.rb
-- test/rbbt/util/test_index.rb
-- test/test_helper.rb
-has_rdoc: true
 homepage: http://github.com/mikisvaz/rbbt
 licenses: []
-
+metadata: {}
 post_install_message: 
-rdoc_options: 
-- --charset=UTF-8
-require_paths: 
+rdoc_options: []
+require_paths:
 - lib
-required_ruby_version: !ruby/object:Gem::Requirement 
-  none: false
-  requirements: 
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
   - - ">="
-    - !ruby/object:Gem::Version 
-      segments: 
-      - 0
-      version: "0"
-required_rubygems_version: !ruby/object:Gem::Requirement 
-  none: false
-  requirements: 
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
   - - ">="
-    - !ruby/object:Gem::Version 
-      segments: 
-      - 0
-      version: "0"
+    - !ruby/object:Gem::Version
+      version: '0'
 requirements: []
-
-rubyforge_project: 
-rubygems_version: 1.3.7
+rubygems_version: 3.0.6
 signing_key: 
-specification_version: 3
-summary: Bioinformatics and text mining toolbox
-test_files: 
-- test/test_rbbt.rb
-- test/rbbt/bow/test_bow.rb
-- test/rbbt/bow/test_classifier.rb
-- test/rbbt/bow/test_dictionary.rb
-- test/rbbt/sources/test_organism.rb
-- test/rbbt/sources/test_biomart.rb
-- test/rbbt/sources/test_pubmed.rb
-- test/rbbt/sources/test_polysearch.rb
-- test/rbbt/sources/test_biocreative.rb
-- test/rbbt/sources/test_entrez.rb
-- test/rbbt/sources/test_go.rb
-- test/rbbt/ner/test_rner.rb
-- test/rbbt/ner/test_dictionaryNER.rb
-- test/rbbt/ner/test_banner.rb
-- test/rbbt/ner/test_rnorm.rb
-- test/rbbt/ner/test_regexpNER.rb
-- test/rbbt/ner/test_abner.rb
-- test/rbbt/ner/rnorm/test_cue_index.rb
-- test/rbbt/ner/rnorm/test_tokens.rb
-- test/rbbt/util/test_misc.rb
-- test/rbbt/util/test_tmpfile.rb
-- test/rbbt/util/test_arrayHash.rb
-- test/rbbt/util/test_filecache.rb
-- test/rbbt/util/test_simpleDSL.rb
-- test/rbbt/util/test_open.rb
-- test/rbbt/util/test_index.rb
-- test/test_helper.rb
+specification_version: 4
+summary: Ruby bioinformatics toolbox. Meta package
+test_files: []