meeseeker 0.0.6 → 2.0.0.pre.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: ad89ce6d8e55cafd5dcca2f0ddc2455c23ece9dab83c2d5e1a3f0a59df6c6a4a
-  data.tar.gz: e709c970eddc2c22c92d6f9482757305b851efc9603ccc725892e1feeb5a966d
+  metadata.gz: 9bb58923eb232294d7a41e43e963543cfbf09f90e4fa5b20d8dfa5eb62ed05ab
+  data.tar.gz: 04b201a7c6e1b8c4f4b7e19e58f7bc5eaa09c5a184c43a21add8d411fb57dc2e
 SHA512:
-  metadata.gz: 2a443c55716a8b6c605cb8cd5e72aee8008ba12f5641df0d1dd717e7db2535b4df9895b3d011ca07ab4c80df8164806243ff41eb82de68aa1fdfd0ce76962356
-  data.tar.gz: 53d277d9d1a8c848691bee1c4ecf6406ca61987a3b5010c657bad7485b87a25fd579fef8d7fc06108c2e06b91b50b97ff4b94e70414b2d2afefb1e2c7390b5dd
+  metadata.gz: 1e0ce806be69a0b9af06df823b443a498a8789bd93fc323367c5de3e556ce8d9bae569ef54dcf880a555d7e937491eb003ef4ff8c2a01388fb295f65887d19bc
+  data.tar.gz: e27cdfe179c60ab9faf17855ab5c6a4522dfb2b8ae892326ee256095513b4a8a70e8228d7eba331a52eb6ddbda94e3c9334f5b7f58284940bf4c5cf0d92e8af8

data/README.md

@@ -1,6 +1,8 @@
  # meeseeker
 
-Redis based block follower is an efficient way for multiple apps to stream the Steem Blockchain.
+Redis based block follower is an efficient way for multiple apps to stream the Hive Blockchain.
+
+[![Build Status](https://travis-ci.org/inertia186/meeseeker.svg?branch=master)](https://travis-ci.org/inertia186/meeseeker)
 
 If you have multiple applications that need to perform actions as operations occur, `meeseeker` will allow your apps to each perform actions for specific operations without each app having to stream the entire blockchain.
 
@@ -62,10 +64,22 @@ To specify an alternative redis source:
 MEESEEKER_REDIS_URL=redis://:p4ssw0rd@10.0.1.1:6380/15 meeseeker sync
 ```
 
-You can also specify an alternative Steem node:
+You can also specify am alternative Hive node:
 
 ```bash
-MEESEEKER_NODE_URL=https://api.steemit.com meeseeker sync
+MEESEEKER_NODE_URL=http://anyx.io meeseeker sync
+```
+
+You can also specify a Steem node instead of Hive (if that's your thing):
+
+```bash
+MEESEEKER_NODE_URL=https://api.steemit.com meeseeker sync[steem]
+```
+
+Or, you can have meeseeker automatically use random Hive nodes:
+
+```bash
+MEESEEKER_NODE_URL=shuffle meeseeker sync
 ```
 
 To sync from the head block instead of the last irreversible block:
@@ -80,7 +94,7 @@ To ignore virtual operations (useful if the node doesn't enable `get_ops_in_bloc
 MEESEEKER_INCLUDE_VIRTUAL=false meeseeker sync
 ```
 
-Normally, block headers are added to the `steem:block` channel.  This requires one additional API call for each block.  If you don't need block headers, you can configure the `steem:block` channel to only publish with the `block_num`:
+Normally, block headers are added to the `hive:block` channel.  This requires one additional API call for each block.  If you don't need block headers, you can configure the `hive:block` channel to only publish with the `block_num`:
 
 ```bash
 MEESEEKER_INCLUDE_BLOCK_HEADER=false meeseeker sync
@@ -99,6 +113,12 @@ If you never want the keys to expire (not recommended), set
 MEESEEKER_EXPIRE_KEYS=-1 meeseeker sync
 ```
 
+Normally, sync will create keys until it uses up all available memory.  If you would like to only sync a certain number of keys, then sleep until those keys expire so it can pick up where it left off, set `MEESEEKER_MAX_KEYS` to a positive value:
+
+```bash
+MEESEEKER_MAX_KEYS=99 meeseeker sync
+```
+
 ### Usage
 
 When `meeseeker sync` starts for the first time, it initializes from the last irreversible block number.  If the sync is interrupted, it will resume from the last block sync'd unless that block is older than `MEESEEKER_EXPIRE_KEYS` in which case it will skip to the last irreversible block number.
@@ -111,35 +131,35 @@ For `redis-cli`, please see: https://redis.io/topics/pubsub
 
 When running `meeseeker sync`, the following channels are available:
 
-* `steem:block`
-* `steem:transaction`
-* `steem:op:vote`
-* `steem:op:comment`
-* `steem:op:comment_options`
-* `steem:op:whatever` (replace "whatever" with the op you want)
-* `steem:op:custom_json:whatever` (if enabled, replace "whatever" with the `custom_json.id` you want)
+* `hive:block`
+* `hive:transaction`
+* `hive:op:vote`
+* `hive:op:comment`
+* `hive:op:comment_options`
+* `hive:op:whatever` (replace "whatever" with the op you want)
+* `hive:op:custom_json:whatever` (if enabled, replace "whatever" with the `custom_json.id` you want)
 
-As mentioned in the first `whatever` example, for ops, [all operation types](https://developers.steem.io/apidefinitions/broadcast-ops) can be subscribed to as channels, including virtual operations, if enabled.
+As mentioned in the first `whatever` example, for ops, [all operation types](https://developers.hive.io/apidefinitions/broadcast-ops) can be subscribed to as channels, including virtual operations, if enabled.
 
-In the second `whatever` example, for `custom_json.id`, if you want to subscribe to the `follow` channel, use `steem:op:custom_json:follow`.  Or if you want to subscribe to the `sm_team_reveal` channel, use `steem:op:custom_json:follow`.  The `custom_json.id` channels are not enabled by default.  To enable it, set the `MEESEEKER_PUBLISH_OP_CUSTOM_ID` to `true` (see example below).
+In the second `whatever` example, for `custom_json.id`, if you want to subscribe to the `follow` channel, use `hive:op:custom_json:follow`.  Or if you want to subscribe to the `sm_team_reveal` channel, use `hive:op:custom_json:sm_team_reveal`.  The `custom_json.id` channels are not enabled by default.  To enable it, set the `MEESEEKER_PUBLISH_OP_CUSTOM_ID` to `true` (see example below).
 
 For example, from `redis-cli`, if we wanted to stream block numbers:
 
 ```bash
 $ redis-cli
-127.0.0.1:6379> subscribe steem:block
+127.0.0.1:6379> subscribe hive:block
 Reading messages... (press Ctrl-C to quit)
 1) "subscribe"
-2) "steem:block"
+2) "hive:block"
 3) (integer) 1
 1) "message"
-2) "steem:block"
+2) "hive:block"
 3) "{\"block_num\":29861068,\"previous\":\"01c7a4cb4424b4dc0cb0cc72fd36b1644f8aeba5\",\"timestamp\":\"2019-01-28T20:55:03\",\"witness\":\"ausbitbank\",\"transaction_merkle_root\":\"a318bb82625bd78af8d8b506ccd4f53116372c8e\",\"extensions\":[]}"
 1) "message"
-2) "steem:block"
+2) "hive:block"
 3) "{\"block_num\":29861069,\"previous\":\"01c7a4cc1bed060876cab57476846a91568a9f8a\",\"timestamp\":\"2019-01-28T20:55:06\",\"witness\":\"followbtcnews\",\"transaction_merkle_root\":\"834e05d40b9666e5ef50deb9f368c63070c0105b\",\"extensions\":[]}"
 1) "message"
-2) "steem:block"
+2) "hive:block"
 3) "{\"block_num\":29861070,\"previous\":\"01c7a4cd3bbf872895654765faa4409a8e770e91\",\"timestamp\":\"2019-01-28T20:55:09\",\"witness\":\"timcliff\",\"transaction_merkle_root\":\"b2366ce9134d627e00423b28d33cc57f1e6e453f\",\"extensions\":[]}"
 ```
 
@@ -153,26 +173,26 @@ Which allows subscription to specific `id` patterns:
 
 ```
 $ redis-cli
-127.0.0.1:6379> subscribe steem:op:custom_json:sm_team_reveal
+127.0.0.1:6379> subscribe hive:op:custom_json:sm_team_reveal
 Reading messages... (press Ctrl-C to quit)
 1) "subscribe"
-2) "steem:op:custom_json:sm_team_reveal"
+2) "hive:op:custom_json:sm_team_reveal"
 3) (integer) 1
 1) "message"
-2) "steem:op:custom_json:sm_team_reveal"
-3) "{\"key\":\"steem:29890790:bcfa68d9be10b3587d81039b85fd0536ddeddffb:0:custom_json\"}"
+2) "hive:op:custom_json:sm_team_reveal"
+3) "{\"key\":\"hive:29890790:bcfa68d9be10b3587d81039b85fd0536ddeddffb:0:custom_json\"}"
 1) "message"
-2) "steem:op:custom_json:sm_team_reveal"
-3) "{\"key\":\"steem:29890792:3f3b921ec6706bcd259f5cc6ac922dc59bbe2de5:0:custom_json\"}"
+2) "hive:op:custom_json:sm_team_reveal"
+3) "{\"key\":\"hive:29890792:3f3b921ec6706bcd259f5cc6ac922dc59bbe2de5:0:custom_json\"}"
 1) "message"
-2) "steem:op:custom_json:sm_team_reveal"
-3) "{\"key\":\"steem:29890792:4ceca16dd114b1851140086a82a5fb3a6eb6ec42:0:custom_json\"}"
+2) "hive:op:custom_json:sm_team_reveal"
+3) "{\"key\":\"hive:29890792:4ceca16dd114b1851140086a82a5fb3a6eb6ec42:0:custom_json\"}"
 1) "message"
-2) "steem:op:custom_json:sm_team_reveal"
-3) "{\"key\":\"steem:29890792:00930eff76b3f0af8ed7215e88cf351cc671490b:0:custom_json\"}"
+2) "hive:op:custom_json:sm_team_reveal"
+3) "{\"key\":\"hive:29890792:00930eff76b3f0af8ed7215e88cf351cc671490b:0:custom_json\"}"
 1) "message"
-2) "steem:op:custom_json:sm_team_reveal"
-3) "{\"key\":\"steem:29890799:01483bd252ccadb05f546051bb20a4ba9afea243:0:custom_json\"}"
+2) "hive:op:custom_json:sm_team_reveal"
+3) "{\"key\":\"hive:29890799:01483bd252ccadb05f546051bb20a4ba9afea243:0:custom_json\"}"
 ```
 
 A `ruby` application can subscribe to a channel as well, using the `redis` gem:
@@ -183,7 +203,7 @@ require 'redis'
 url = 'redis://127.0.0.1:6379/0'
 ctx = Redis.new(url: url)
 
-Redis.new(url: url).subscribe('steem:op:comment') do |on|
+Redis.new(url: url).subscribe('hive:op:comment') do |on|
   on.message do |channel, message|
     payload = JSON[message]
     comment = JSON[ctx.get(payload['key'])]
@@ -197,19 +217,19 @@ Many other clients are supported: https://redis.io/clients
 
 ##### Witness Schedule
 
-When running `meeseeker witness:schedule`, the `steem:witness:schedule` channel is available.  This is offered as a separate command because most applications don't need to worry about this level of blockchain logistics.
+When running `meeseeker witness:schedule`, the `hive:witness:schedule` channel is available.  This is offered as a separate command because most applications don't need to worry about this level of blockchain logistics.
 
 For example, from `redis-cli`, if we wanted to subscribe to the witness schedule:
 
 ```
 $ redis-cli
-127.0.0.1:6379> subscribe steem:witness:schedule
+127.0.0.1:6379> subscribe hive:witness:schedule
 Reading messages... (press Ctrl-C to quit)
 1) "subscribe"
-2) "steem:witness:schedule"
+2) "hive:witness:schedule"
 3) (integer) 1
 1) "message"
-2) "steem:witness:schedule"
+2) "hive:witness:schedule"
 3) "{\"id\":0,\"current_virtual_time\":\"415293532210075480213212125\",\"next_shuffle_block_num\":30035208,\"current_shuffled_witnesses\":[\"thecryptodrive\",\"timcliff\",\"utopian-io\",\"themarkymark\",\"aggroed\",\"smooth.witness\",\"someguy123\",\"gtg\",\"followbtcnews\",\"yabapmatt\",\"therealwolf\",\"ausbitbank\",\"curie\",\"clayop\",\"drakos\",\"blocktrades\",\"good-karma\",\"roelandp\",\"lukestokes.mhth\",\"liondani\",\"anyx\"],\"num_scheduled_witnesses\":21,\"elected_weight\":1,\"timeshare_weight\":5,\"miner_weight\":1,\"witness_pay_normalization_factor\":25,\"median_props\":{\"account_creation_fee\":{\"amount\":\"3000\",\"precision\":3,\"nai\":\"@@000000021\"},\"maximum_block_size\":65536,\"sbd_interest_rate\":0,\"account_subsidy_budget\":797,\"account_subsidy_decay\":347321},\"majority_version\":\"0.20.8\",\"max_voted_witnesses\":20,\"max_miner_witnesses\":0,\"max_runner_witnesses\":1,\"hardfork_required_witnesses\":17,\"account_subsidy_rd\":{\"resource_unit\":10000,\"budget_per_time_unit\":797,\"pool_eq\":157691079,\"max_pool_size\":157691079,\"decay_params\":{\"decay_per_time_unit\":347321,\"decay_per_time_unit_denom_shift\":36},\"min_decay\":0},\"account_subsidy_witness_rd\":{\"resource_unit\":10000,\"budget_per_time_unit\":996,\"pool_eq\":9384019,\"max_pool_size\":9384019,\"decay_params\":{\"decay_per_time_unit\":7293741,\"decay_per_time_unit_denom_shift\":36},\"min_decay\":257},\"min_witness_account_subsidy_decay\":0}"
 ```
 
@@ -230,107 +250,120 @@ See: https://redis.io/commands/scan#scan-basic-usage
 Once your sync has started, you can begin doing queries against redis, for example, in the `redis-cli`:
 
 ```bash
-redis-cli --scan --pattern 'steem:*:vote'
+redis-cli --scan --pattern 'hive:*:vote'
 ```
 
 This returns the keys, for example:
 
 ```
-steem:29811083:7fd2ea1c73e6cc08ab6e24cf68e67ff19a05896a:0:vote
-steem:29811085:091c3df76322ec7f0dc51a6ed526ff9a9f69869e:0:vote
-steem:29811085:24bfc199501779b6c2be2370fab1785f58062c5a:0:vote
-steem:29811086:36761db678fe89df48d2c5d11a23cdafe57b2476:0:vote
-steem:29811085:f904ac2e5e338263b03b640a4d1ff2d5fd01169e:0:vote
-steem:29811085:44036fde09f20d91afda8fc2072b383935c0b615:0:vote
-steem:29811086:570abf0fbeeeb0bb5c1e26281f0acb1daf175c39:0:vote
-steem:29811083:e3ee518c4958a10f0d0c5ed39e3dc736048e8ec7:0:vote
-steem:29811083:e06be9ade6758df59e179160b749d1ace3508044:0:vote
+hive:29811083:7fd2ea1c73e6cc08ab6e24cf68e67ff19a05896a:0:vote
+hive:29811085:091c3df76322ec7f0dc51a6ed526ff9a9f69869e:0:vote
+hive:29811085:24bfc199501779b6c2be2370fab1785f58062c5a:0:vote
+hive:29811086:36761db678fe89df48d2c5d11a23cdafe57b2476:0:vote
+hive:29811085:f904ac2e5e338263b03b640a4d1ff2d5fd01169e:0:vote
+hive:29811085:44036fde09f20d91afda8fc2072b383935c0b615:0:vote
+hive:29811086:570abf0fbeeeb0bb5c1e26281f0acb1daf175c39:0:vote
+hive:29811083:e3ee518c4958a10f0d0c5ed39e3dc736048e8ec7:0:vote
+hive:29811083:e06be9ade6758df59e179160b749d1ace3508044:0:vote
 ```
 
 To get the actual vote operation for a particular key, use:
 
 ```bash
-redis-cli get steem:29811085:f904ac2e5e338263b03b640a4d1ff2d5fd01169e:0:vote
+redis-cli get hive:29811085:f904ac2e5e338263b03b640a4d1ff2d5fd01169e:0:vote
 ```
 
 If, on the other hand, you want `custom_json` only:
 
 ```bash
-redis-cli --scan --pattern 'steem:*:custom_json'
+redis-cli --scan --pattern 'hive:*:custom_json'
 ```
 
 This only returns the related keys, for example:
 
 ```
-steem:29811084:43f1e1a367b97ea4e05fbd3a80a42146d97121a2:0:custom_json
-steem:29811085:5795ff73234d64a11c1fb78edcae6f5570409d8e:0:custom_json
-steem:29811083:2d6635a093243ef7a779f31a01adafe6db8c53c9:0:custom_json
-steem:29811086:31ecb9c85e9eabd7ca2460fdb4f3ce4a7ca6ec32:0:custom_json
-steem:29811083:7fbbde120aef339511f5af1a499f62464fbf4118:0:custom_json
-steem:29811083:04a6ddc83a63d024b90ca13996101b83519ba8f5:0:custom_json
+hive:29811084:43f1e1a367b97ea4e05fbd3a80a42146d97121a2:0:custom_json
+hive:29811085:5795ff73234d64a11c1fb78edcae6f5570409d8e:0:custom_json
+hive:29811083:2d6635a093243ef7a779f31a01adafe6db8c53c9:0:custom_json
+hive:29811086:31ecb9c85e9eabd7ca2460fdb4f3ce4a7ca6ec32:0:custom_json
+hive:29811083:7fbbde120aef339511f5af1a499f62464fbf4118:0:custom_json
+hive:29811083:04a6ddc83a63d024b90ca13996101b83519ba8f5:0:custom_json
 ```
 
 To get the actual custom json operation for a particular key, use:
 
 ```bash
-redis-cli get steem:29811083:7fbbde120aef339511f5af1a499f62464fbf4118:0:custom_json
+redis-cli get hive:29811083:7fbbde120aef339511f5af1a499f62464fbf4118:0:custom_json
 ```
 
 To get all transactions for a particular block number:
 
 ```bash
-redis-cli --scan --pattern 'steem:29811085:*'
+redis-cli --scan --pattern 'hive:29811085:*'
 ```
 
 Or to get all ops for a particular transaction:
 
 ```bash
-redis-cli --scan --pattern 'steem:*:31ecb9c85e9eabd7ca2460fdb4f3ce4a7ca6ec32:*'
+redis-cli --scan --pattern 'hive:*:31ecb9c85e9eabd7ca2460fdb4f3ce4a7ca6ec32:*'
 ```
 
-### Steem Engine Support
+### Hive Engine Support
 
-As of `v0.0.6`, meeseeker can also follow the Steem Engine side-chain.  This is optional and requires a separate process.
+As of `v0.0.6`, meeseeker can also follow the Hive Engine side-chain.  This is optional and requires a separate process.
 
-To sync Steem Engine to your local redis source (also defaults to `redis://127.0.0.1:6379/0`):
+To sync Hive Engine to your local redis source (also defaults to `redis://127.0.0.1:6379/0`):
 
 ```bash
-meeseeker sync steem_engine
-```
-
-When running `meeseeker sync steem_engine`, the following channels are available:
-
-* `steem_engine:block`
-* `steem_engine:transaction`
-* `steem_engine:market:buy`
-* `steem_engine:market:cancel`
-* `steem_engine:market:sell`
-* `steem_engine:sscstore:buy`
-* `steem_engine:steempegged:buy`
-* `steem_engine:steempegged:removeWithdrawal`
-* `steem_engine:steempegged:withdraw`
-* `steem_engine:tokens:create`
-* `steem_engine:tokens:issue`
-* `steem_engine:tokens:transfer`
-* `steem_engine:tokens:updateMetadata`
-* `steem_engine:tokens:updateUrl`
+meeseeker sync hive_engine
+```
+
+When running `meeseeker sync hive_engine`, the following channels are available:
+
+* `hive_engine:block`
+* `hive_engine:transaction`
+* `hive_engine:virtual_transaction`
+* `hive_engine:contract`
+* `hive_engine:contract:deploy`
+* `hive_engine:contract:update`
+* `hive_engine:market`
+* `hive_engine:market:buy`
+* `hive_engine:market:cancel`
+* `hive_engine:market:sell`
+* `hive_engine:sscstore`
+* `hive_engine:sscstore:buy`
+* `hive_engine:steempegged`
+* `hive_engine:steempegged:buy`
+* `hive_engine:steempegged:removeWithdrawal`
+* `hive_engine:steempegged:withdraw`
+* `hive_engine:tokens`
+* `hive_engine:tokens:checkPendingUnstake`
+* `hive_engine:tokens:create`
+* `hive_engine:tokens:enableStaking`
+* `hive_engine:tokens:issue`
+* `hive_engine:tokens:transfer`
+* `hive_engine:tokens:transferOwnership`
+* `hive_engine:tokens:unstake`
+* `hive_engine:tokens:updateMetadata`
+* `hive_engine:tokens:updateParams`
+* `hive_engine:tokens:updateUrl`
 
 The above "channel/action" patterns are the ones that are known that the time of writing.  In addition, if a new contract is added or updated, meeseeker will automatically publish to these corresponding channels as they appear, without needing to update or even restart meeseeker.
 
 See main section on [Using `SUBSCRIBE`](#using-subscribe).
 
-Once your SteemEngine sync has started, you can begin doing queries against redis, for example, in the `redis-cli`:
+Once your HiveEngine sync has started, you can begin doing queries against redis, for example, in the `redis-cli`:
 
 ```bash
-redis-cli --scan --pattern 'steem_engine:*:tokens:transfer'
+redis-cli --scan --pattern 'hive_engine:*:tokens:transfer'
 ```
 
 This returns the keys, for example:
 
 ```
-steem_engine:18000:d414373db84e6a642f289641ea1433fda22b8a4d:0:tokens:transfer
-steem_engine:18004:c9e06c8449d2d04b4a0a31ec7b80d2f62009a5f0:0:tokens:transfer
-steem_engine:17994:faf097391760ad896b19d5854e2822f62dee284b:0:tokens:transfer
+hive_engine:18000:d414373db84e6a642f289641ea1433fda22b8a4d:0:tokens:transfer
+hive_engine:18004:c9e06c8449d2d04b4a0a31ec7b80d2f62009a5f0:0:tokens:transfer
+hive_engine:17994:faf097391760ad896b19d5854e2822f62dee284b:0:tokens:transfer
 ```
 
 See main section on [Using `SCAN`](#using-scan).
@@ -361,11 +394,11 @@ Also see: https://hub.docker.com/r/inertia/meeseeker/
   <img src="https://i.imgur.com/Y3Sa2GW.jpg" />
 </center>
 
-See some of my previous Ruby How To posts in: [#radiator](https://steemit.com/created/radiator) [#ruby](https://steemit.com/created/ruby)
+See some of my previous Ruby How To posts in: [#radiator](https://hive.blog/created/radiator) [#ruby](https://hive.blog/created/ruby)
 
 ## Get in touch!
 
-If you're using Radiator, I'd love to hear from you.  Drop me a line and tell me what you think!  I'm @inertia on STEEM.
+If you're using Radiator, I'd love to hear from you.  Drop me a line and tell me what you think!  I'm @inertia on Hive.
   
 ## License
 

data/Rakefile

@@ -52,29 +52,35 @@ task :check_schema do
 end
 
 task(:sync, [:chain, :at_block_num] => [:check_schema]) do |t, args|
-  chain = (args[:chain] || 'steem').to_sym
+  chain = args[:chain] if args[:chain]
+  chain ||= Meeseeker.default_chain_key_prefix
   
-  job = case chain
-  when :steem
-    Meeseeker::BlockFollowerJob.new
+  job = case chain.to_sym
   when :steem_engine
     Meeseeker::SteemEngine::FollowerJob.new
-  else; abort("Unknown chain: #{chain}")
+  when :hive_engine
+    Meeseeker::HiveEngine::FollowerJob.new
+  else
+    Meeseeker::BlockFollowerJob.new
   end
   
-  job.perform(at_block_num: args[:at_block_num])
+  job.perform(chain: chain, at_block_num: args[:at_block_num])
 end
 
 namespace :witness do
-  desc 'Publish the witness schedule every minute or so (steem:witness:schedule).'
-  task :schedule do
+  desc 'Publish the witness schedule every minute or so (e.g.: hive:witness:schedule).'
+  task :schedule, [:chain] do |t, args|
+    chain = args[:chain] if args[:chain]
+    chain ||= Meeseeker.default_chain_key_prefix
+    
     job = Meeseeker::WitnessScheduleJob.new
-    job.perform
+    job.perform(chain: chain)
   end
 end
 
 task(:find, [:what, :key, :chain] => [:check_schema]) do |t, args|
-  chain = (args[:chain] || 'steem').downcase.to_sym
+  chain = args[:chain] if args[:chain]
+  chain ||= Meeseeker.default_chain_key_prefix
   redis = Meeseeker.redis
   
   match = case args[:what].downcase.to_sym
@@ -92,10 +98,23 @@ task(:find, [:what, :key, :chain] => [:check_schema]) do |t, args|
   end
 end
 
-task reset: [:check_schema] do
-  print 'Dropping keys ...'
-  keys = Meeseeker.redis.keys('steem:*')
-  keys += Meeseeker.redis.keys('steem_engine:*')
+task :reset, [:chain] => [:check_schema] do |t, args|
+  chain = (args[:chain] || 'all').to_sym
+  keys = []
+  
+  print 'Dropping keys for set: %s ...' % chain.to_s
+  
+  case chain
+  when :steem_engine then keys += Meeseeker.redis.keys('steem_engine:*')
+  when :hive_engine then keys += Meeseeker.redis.keys('hive_engine:*')
+  when :all
+    keys += Meeseeker.redis.keys('steem:*')
+    keys += Meeseeker.redis.keys('hive:*')
+    keys += Meeseeker.redis.keys('steem_engine:*')
+    keys += Meeseeker.redis.keys('hive_engine:*')
+  else
+    keys += Meeseeker.redis.keys("#{chain}:*")
+  end
   
   if keys.any?
     print " found #{keys.size} keys ..."
@@ -108,10 +127,13 @@ end
 
 namespace :verify do
   desc 'Verifies transactions land where they should.'
-  task :block_org, [:max_blocks] do |t, args|
+  task :block_org, [:chain, :max_blocks] do |t, args|
+    chain = args[:chain] if args[:chain]
+    chain ||= Meeseeker.default_chain_key_prefix
+    chain_key_prefix = chain.to_s
     max_blocks = args[:max_blocks]
-    node_url = ENV.fetch('MEESEEKER_NODE_URL', 'https://api.steemit.com')
-    database_api = Steem::DatabaseApi.new(url: node_url)
+    node_url = Meeseeker.shuffle_node_url(chain)
+    database_api = Meeseeker.database_api_class(chain).new(url: node_url)
     mode = ENV.fetch('MEESEEKER_STREAM_MODE', 'head').to_sym
     until_block_num = if !!max_blocks
       database_api.get_dynamic_global_properties do |dgpo|
@@ -122,7 +144,7 @@ namespace :verify do
         when :irreversible then dgpo.last_irreversible_block_num
         else; abort "Unknown block mode: #{mode}"
         end
-      end + max_blocks.to_i
+      end + max_blocks.to_i + 1
     end
     
     Thread.new do
@@ -130,7 +152,7 @@ namespace :verify do
       
       loop do
         begin
-          job.perform(mode: mode, until_block_num: until_block_num)
+          job.perform(chain: chain, mode: mode, until_block_num: until_block_num)
         rescue => e
           puts e.inspect
           sleep 5
@@ -143,8 +165,8 @@ namespace :verify do
     end
     
     begin
-      block_api = Steem::BlockApi.new(url: node_url)
-      block_channel = 'steem:block'
+      block_api = Meeseeker.block_api_class(chain).new(url: node_url)
+      block_channel = "#{chain_key_prefix}:block"
       redis_url = ENV.fetch('MEESEEKER_REDIS_URL', 'redis://127.0.0.1:6379/0')
       subscription = Redis.new(url: redis_url)
       ctx = Redis.new(url: redis_url)
@@ -177,14 +199,21 @@ namespace :verify do
             end
           end
             
-          while ctx.keys("steem:#{next_block_num}:*").size == 0
+          5.times do
+            break unless ctx.keys("#{chain_key_prefix}:#{next_block_num}:*").size == 0
+            
             # This ensures at least the next block has been indexed before
             # proceeding.
             
-            puts "Waiting for block: #{next_block_num} ..."
+            puts "Waiting for block (verify:block_org): #{next_block_num} ..."
+            
             sleep 6
           end
           
+          if ctx.keys("#{chain_key_prefix}:#{next_block_num}:*").size == 0
+            puts "Gave up waiting for block (check current_aslot slippage): #{next_block_num}"
+          end
+          
           database_api.get_dynamic_global_properties do |dgpo|
             raise 'Got empty dynamic_global_properties result.' if dgpo.nil?
             
@@ -198,7 +227,7 @@ namespace :verify do
           end
           
           # In theory, we should have all the keys using this pattern.
-          keys = ctx.keys("steem:#{block_num}:*")
+          keys = ctx.keys("#{chain_key_prefix}:#{block_num}:*")
           
           # If we have all the keys, we should also have all transaction ids.
           expected_ids = keys.map { |k| k.split(':')[2] }.uniq
@@ -243,18 +272,35 @@ namespace :verify do
     end
   end
   
+  desc 'Verifies Hive Engine transactions land where they should.'
+  task :hive_engine_block_org, [:max_blocks] do |t, args|
+    Rake::Task['verify:engine_block_org'].invoke('hive_engine', args[:max_blocks])
+  end
+  
   desc 'Verifies Steem Engine transactions land where they should.'
   task :steem_engine_block_org, [:max_blocks] do |t, args|
+    Rake::Task['verify:engine_block_org'].invoke('steem_engine', args[:max_blocks])
+  end
+  
+  desc 'Verifies Steem/Hive Engine transactions land where they should.'
+  task :engine_block_org, [:chain_key_prefix, :max_blocks] do |t, args|
+    chain_key_prefix = args[:chain_key_prefix]
     max_blocks = args[:max_blocks]
-    node_url = ENV.fetch('MEESEEKER_STEEM_ENGINE_NODE_URL', 'https://api.steem-engine.com/rpc')
-    agent = Meeseeker::SteemEngine::Agent.new(url: node_url)
+    case chain_key_prefix.to_sym
+    when :steem_engine
+      node_url = ENV.fetch('MEESEEKER_STEEM_ENGINE_NODE_URL', 'https://api.steem-engine.com/rpc')
+      agent = Meeseeker::SteemEngine::Agent.new(url: node_url)
+      job = Meeseeker::SteemEngine::FollowerJob.new
+    when :hive_engine
+      node_url = ENV.fetch('MEESEEKER_HIVE_ENGINE_NODE_URL', 'https://api.hive-engine.com/rpc')
+      agent = Meeseeker::HiveEngine::Agent.new(url: node_url)
+      job = Meeseeker::HiveEngine::FollowerJob.new
+    end
     until_block_num = if !!max_blocks
       agent.latest_block_info['blockNumber']
     end
     
     Thread.new do
-      job = Meeseeker::SteemEngine::FollowerJob.new
-      
       loop do
         begin
           at_block_num = agent.latest_block_info["blockNumber"] - max_blocks.to_i
@@ -272,7 +318,7 @@ namespace :verify do
     end
     
     begin
-      block_channel = 'steem_engine:block'
+      block_channel = "#{chain_key_prefix}:block"
       redis_url = ENV.fetch('MEESEEKER_REDIS_URL', 'redis://127.0.0.1:6379/0')
       subscription = Redis.new(url: redis_url)
       ctx = Redis.new(url: redis_url)
@@ -304,25 +350,26 @@ namespace :verify do
             end
           end
           
-          while ctx.keys("steem_engine:#{next_block_num}:*").size == 0
+          while ctx.keys("#{chain_key_prefix}:#{next_block_num}:*").size == 0
             # This ensures at least the next block has been indexed before
             # proceeding.
             
-            puts "Waiting for block: #{next_block_num} ..."
+            puts "Waiting for block (verify:#{chain_key_prefix}_engine_block_org): #{next_block_num} ..."
             sleep 6
           end
           
           # In theory, we should have all the keys using this pattern.
-          keys = ctx.keys("steem_engine:#{block_num}:*")
+          keys = ctx.keys("#{chain_key_prefix}:#{block_num}:*")
           
           # If we have all the keys, we should also have all transaction ids.
           expected_ids = keys.map { |k| k.split(':')[2] }.uniq
+          expected_ids -= [Meeseeker::VIRTUAL_TRX_ID]
           actual_ids = nil
           
           agent.block(block_num).tap do |block|
             raise 'Got empty block result.' if block.nil?
             
-            actual_ids = block['transactions'].map{|trx| trx['transactionId'].split('-').first}.uniq
+            actual_ids = block['transactions'].map{|trx| trx['transactionId'].to_s.split('-').first}.uniq
           end
           
           # We do an intersection to make sure there's no difference between
@@ -354,14 +401,105 @@ namespace :verify do
         end
       end
     end
+    
+    agent.shutdown
+  end
+  
+  desc 'Verifies Hive Engine sidechain against the mainnet.'
+  task :hive_engine_ref_blocks do |t|
+    Rake::Task['verify:engine_ref_blocks'].invoke('hive_engine')
+  end
+  
+  desc 'Verifies Steem Engine sidechain against the mainnet.'
+  task :steem_engine_ref_blocks do |t|
+    Rake::Task['verify:engine_ref_blocks'].invoke('steem_engine')
+  end
+  
+  desc 'Verifies Steem/Hive Engine sidechain against the mainnet.'
+  task :engine_ref_blocks, [:chain_key_prefix] do |t, args|
+    chain_key_prefix = args[:chain_key_prefix]
+    redis_url = ENV.fetch('MEESEEKER_REDIS_URL', 'redis://127.0.0.1:6379/0')
+    ctx = ctx = Redis.new(url: redis_url)
+    keys = ctx.keys("#{chain_key_prefix}:*:*")
+    mainchain, mainchain_url = case chain_key_prefix
+    when 'steem_engine' then ['steem', 'https://api.steemit.com']
+    when 'hive_engine' then ['hive', 'https://api.openhive.network']
+    end
+    block_api = Meeseeker.block_api_class(mainchain).new(url: mainchain_url)
+    block_trxs = {}
+    
+    puts "Checking #{chain_key_prefix} keys: #{keys.size}"
+    
+    keys.each do |key|
+      transaction = JSON[ctx.get(key)]
+      
+      next if transaction.class == Integer
+      
+      block_num = case chain_key_prefix
+      when 'steem_engine' then transaction.fetch('refSteemBlockNumber')
+      when 'hive_engine' then transaction.fetch('refHiveBlockNumber')
+      end.to_i
+      
+      block_trxs[block_num] ||= []
+      block_trxs[block_num] << transaction['transactionId'].to_s.split('-').first
+    end
+    
+    puts "Related mainnet blocks: #{block_trxs.keys.size}"
+    
+    skipped_blocks = []
+    
+    next if block_trxs.empty?
+    
+    block_api.get_blocks(block_range: block_trxs.keys) do |block, block_num|
+      if block.nil? || block[:transaction_ids].nil?
+        print 'S'
+        skipped_blocks << block_num
+        
+        next
+      else
+        print '.'
+      end
+      
+      trx_ids = block_trxs[block_num] - [Meeseeker::VIRTUAL_TRX_ID]
+      
+      if trx_ids.any? && (block.transaction_ids & trx_ids).none?
+        puts "\nNo intersection in #{block_num}!"
+        puts "Expected the following sidechain trx_ids: #{trx_ids.join(', ')}"
+      end
+    end
+    
+    puts "\nBlocks to retry: #{skipped_blocks.size}"
+    
+    skipped_blocks.each do |block_num|
+      block_found = false
+      
+      block_api.get_block(block_num: block_num) do |result|
+        break unless !!result.block
+        
+        block = result.block
+        block_found = true
+        trx_ids = block_trxs[block_num] - [Meeseeker::VIRTUAL_TRX_ID]
+        
+        if trx_ids.any? && (block.transaction_ids & trx_ids).none?
+          puts "No intersection in #{block_num}!"
+          puts "Expected the following sidechain trx_ids: #{trx_ids.join(', ')}"
+        end
+      end
+      
+      redo unless block_found
+    end
+    
+    puts "Done."
   end
     
   namespace :witness do
     desc 'Verifies witnessses in the schedule produced a block.'
-    task :schedule, [:max_blocks] do |t, args|
+    task :schedule, [:chain, :max_blocks] do |t, args|
+      chain = args[:chain] if !!args[:chain]
+      chain ||= Meeseeker.default_chain_key_prefix
       max_blocks = args[:max_blocks]
-      node_url = ENV.fetch('MEESEEKER_NODE_URL', 'https://api.steemit.com')
-      database_api = Steem::DatabaseApi.new(url: node_url)
+      node_url = Meeseeker.shuffle_node_url(chain)
+      database_api = Meeseeker.database_api_class(chain).new(url: node_url)
       mode = ENV.fetch('MEESEEKER_STREAM_MODE', 'head').to_sym
       until_block_num = if !!max_blocks
         database_api.get_dynamic_global_properties do |dgpo|
@@ -380,7 +518,7 @@ namespace :verify do
         
         loop do
           begin
-            job.perform(mode: mode, until_block_num: until_block_num)
+            job.perform(chain: chain, mode: mode, until_block_num: until_block_num)
           rescue => e
             puts e.inspect
             sleep 5
@@ -393,11 +531,12 @@ namespace :verify do
       end
     
       begin
-        block_api = Steem::BlockApi.new(url: node_url)
-        schedule_channel = 'steem:witness:schedule'
+        block_api = Meeseeker.block_api_class(chain).new(url: node_url)
+        chain_key_prefix = chain.to_s if args[:chain]
+        chain_key_prefix ||= Meeseeker.default_chain_key_prefix
+        schedule_channel = "#{chain_key_prefix}:witness:schedule"
         redis_url = ENV.fetch('MEESEEKER_REDIS_URL', 'redis://127.0.0.1:6379/0')
         subscription = Redis.new(url: redis_url)
-        ctx = Redis.new(url: redis_url)
         timeout = (max_blocks).to_i * 3
         
         subscribe_mode, subscribe_args = if timeout > 0
@@ -454,7 +593,10 @@ namespace :verify do
                   unless !!header
                     # Can happen when there's excess p2p latency and/or jussi
                     # cache is under load.
-                    puts "Waiting for block header: #{block_num}"
+                    puts "Waiting for block header (witness:schedule): #{block_num}"
+                    
+                    node_url = Meeseeker.shuffle_node_url(chain)
+                    block_api = Meeseeker.block_api_class(chain).new(url: node_url)
                     
                     next
                   end