cylons 0.0.1 → 0.0.2

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: eb519882f4bf37d3a0b69e51a1d84517965d122f
+  data.tar.gz: a1f350512a94e1ead21987957b9e75e91cb30de5
+SHA512:
+  metadata.gz: b6a2a8b849ced51a30dd7ba062f72d5f51a6a6a8afde706e2011eef6fe1f4cb23fa3a2c7e73a3400a1a7d4413800832d2df1d9360c27556cf65e9eb857ba2893
+  data.tar.gz: 6ac49e71477cb817fb05ad9396145739d81b9f477c4757628d915e401c77a4a906dc67a49e2bac36800e39031c8ee8483af1bb8d80c893b9a12d7dd245aef4af

data/.gitignore

@@ -1,5 +1,7 @@
 *.gem
 *.rbc
+*.db
+*.log
 .bundle
 .config
 .yardoc

data/.rspec

@@ -0,0 +1 @@
+--color

data/Gemfile

@@ -1,4 +1,5 @@
 source 'https://rubygems.org'
-
-# Specify your gem's dependencies in skynext.gemspec
+#dcell needs https://github.com/celluloid/dcell/pull/72 to be merged or fix the alias_method issue
+gem 'dcell', github: 'jasonayre/dcell',        branch: 'master'
+# gem "dcell", :path => "~/gems/dcell"
 gemspec

data/Guardfile

@@ -0,0 +1,39 @@
+# A sample Guardfile
+# More info at https://github.com/guard/guard#readme
+
+guard :bundler do
+  watch('Gemfile')
+  # Uncomment next line if your Gemfile contains the `gemspec' command.
+  # watch(/^.+\.gemspec/)
+end
+
+# Note: The cmd option is now required due to the increasing number of ways
+#       rspec may be run, below are examples of the most common uses.
+#  * bundler: 'bundle exec rspec'
+#  * bundler binstubs: 'bin/rspec'
+#  * spring: 'bin/rsspec' (This will use spring if running and you have
+#                          installed the spring binstubs per the docs)
+#  * zeus: 'zeus rspec' (requires the server to be started separetly)
+#  * 'just' rspec: 'rspec'
+guard :rspec, cmd: 'bundle exec rspec' do
+  watch(%r{^spec/.+_spec\.rb$})
+  watch(%r{^lib/(.+)\.rb$})     { |m| "spec/lib/#{m[1]}_spec.rb" }
+  watch('spec/spec_helper.rb')  { "spec" }
+
+  # Rails example
+  watch(%r{^app/(.+)\.rb$})                           { |m| "spec/#{m[1]}_spec.rb" }
+  watch(%r{^app/(.*)(\.erb|\.haml|\.slim)$})          { |m| "spec/#{m[1]}#{m[2]}_spec.rb" }
+  watch(%r{^app/controllers/(.+)_(controller)\.rb$})  { |m| ["spec/routing/#{m[1]}_routing_spec.rb", "spec/#{m[2]}s/#{m[1]}_#{m[2]}_spec.rb", "spec/acceptance/#{m[1]}_spec.rb"] }
+  watch(%r{^spec/support/(.+)\.rb$})                  { "spec" }
+  watch('config/routes.rb')                           { "spec/routing" }
+  watch('app/controllers/application_controller.rb')  { "spec/controllers" }
+  watch('spec/rails_helper.rb')                       { "spec" }
+
+  # Capybara features specs
+  watch(%r{^app/views/(.+)/.*\.(erb|haml|slim)$})     { |m| "spec/features/#{m[1]}_spec.rb" }
+
+  # Turnip features and steps
+  watch(%r{^spec/acceptance/(.+)\.feature$})
+  watch(%r{^spec/acceptance/steps/(.+)_steps\.rb$})   { |m| Dir[File.join("**/#{m[1]}.feature")][0] || 'spec/acceptance' }
+end
+

data/README.md

@@ -1,78 +1,132 @@
 # Cylons
 
-Collectively intelligent remote models which behave very much like models they are claiming to be. (Zero configuration SOA Framework).
+Collectively intelligent remote models which behave very much like models they are claiming to be. (Or the first zero configuration RPC/SOA framework).
 
-Cylons lets your models in one Rails app, act very much like your ActiveRecord models in another Rails app, providing a base for a SOA infrastructure. I hope to be able to make it applicable to more than just AR models as well, however, I also hope to make it past cool proof of concept stage that works, but isn't exactly suitable for a production system, WHICH IS THE STATE IT IS CURRENTLY IN. You've been warned.
+Cylons lets your models in one Rails app, act very much like your ActiveRecord models in another Rails app, providing a foundation for building an SOA infrastructure. Not exactly production ready, but getting there.
 
-### Quick Explanation
+### Quick Explanation / Scenario
 
+Youve got a product model in one app, a category model in another. A category has many remote products. Then youve got another app, with a front end, that you want to use data from in both of those apps. Its as simple as:
+(note you just need to include gem and initializers additionally)
+
+**App 1**
+*Product Model:*
+``` ruby
+class Product < ActiveRecord::Base
+  include ::Cylons::Remote
+  remote_belongs_to :category
+end
+```
+*Category Agent:*
+``` ruby
+class Category < Cylons::Agent
+
+end
+```
+
+**App 2**
+*Category Model:*
+``` ruby
+class Category < ActiveRecord::Base
+  include ::Cylons::Remote
+  remote_has_many :products
+end
+```
+*Product Agent:*
+``` ruby
+class Product < Cylons::Agent
+
+end
+```
+
+That minimal amount of code will enable you to do things from app 3 such as:
+
+*App 3*
+``` ruby
+category = Category.first
+category.products
+
+Product.create
+Category.create
+```
+
+So on a so forth. Extensive examples provided down further.
 
 ### Depends heavily on:
-DCell
-Zookeeper (for now, only even though )
+* DCell
+* Zookeeper
 
 ### Heavily inspired by
-This concept - http://www.youtube.com/watch?v=Hu-jvAWTZ9o&feature=autoplay&list=PLF88804CB7380F32C&playnext=1#t=4m59s
-ActiveRemote - https://github.com/liveh2o/active_remote
-DCell - https://github.com/celluloid/dcell
+* This concept - http://www.youtube.com/watch?v=Hu-jvAWTZ9o&feature=autoplay&list=PLF88804CB7380F32C&playnext=1#t=4m59s
+* ActiveRemote - https://github.com/liveh2o/active_remote
+* DCell - https://github.com/celluloid/dcell
 
 ### Alternatives
-Ill list more later, because I've literally tried at least the 90% majority of the ruby soa "solutions", but if you are looking for an "enterprise" level SOA framework, I'd recommend:
+Right now, the gem is still in sketchy mode. If you are looking for a heavy duty rpc ruby framework, I'd recommend:
 
-ActiveRemote - https://github.com/liveh2o/active_remote
-Protobuf - https://github.com/localshred/protobuf
-
-Add those two together == winning.
-
-### Reasons for building
-Originally it started as a way to communicate between my raspberry pis, because http is so last summer. Soon I found myself wanting a database connection. So I ended up making it more active_record like. Those aren't reasons but brain tired done typing yep.
+* ActiveRemote - https://github.com/liveh2o/active_remote
+* Protobuf - https://github.com/localshred/protobuf
 
 
 ### Quick start
 
-
 ### How it works?
 
 ### Install ZK, Clone and run the examples
 
 ```
 git clone https://github.com/jasonayre/cylons_demo
-
 ```
 
-open 4 new terminal windows/tabs
+open 2 new terminal windows/tabs
 
-*Prepare the inventory management service, inventory*
-
-```
-cd inventory
-SKIP_CYLONS=true bundle exec rake db:create && rake db:migrate && rake db:seed
-```
-
-*Prepare the user credentials service, identify*
+*Prepare & start the fake user credentials service, identify*
 ```
 cd identify
-SKIP_CYLONS=true bundle exec rake db:create && rake db:migrate && rake db:seed
+bundle exec rake db:create && rake db:migrate && rake db:seed
+bundle exec cylons start
 ```
 
-*Prepare the categorization service, taxon*
+*cd into admin service in other window, launch console and run some commands*
+
+``` ruby
+cd static_admin
+bundle
+RPC=1 bundle exec rails c
 ```
-cd taxon
-SKIP_CYLONS=true bundle exec rake db:create && rake db:migrate && rake db:seed
+
+*Then run some rails console commands on the remote cylons service*
+``` ruby
+User.all
+User.first
+u = User.create(:name => "asdasd", :email => "bill@initech.com")
+u.name = "blumbergh"
+u.save
+
+u = User.create(:name => "asdasd", :email => "asdasd@asdasd.com", :password => "asdasd")
+{:error=>"unknown attribute: password"}
+
+u = User.create(:email => "asdasd@asdasd")
+puts u.errors
+#<ActiveModel::Errors:0x343a4ddd @base=#<User created_at: nil, email: "asdasd@asdasd", id: nil, name: nil, updated_at: nil>, @messages={:name=>["can't be blank", "can't be blank"]}
+
+users = User.search(:name => "blumbergh")
+[#<User created_at: "2014-11-04 22:23:10.697000", email: "bill@initech.com", id: 2013, name: "blumbergh", updated_at: "2014-11-04 22:23:25.993000">]
+
+#(when ::Cylons::RemotePagination included into remote model, results will be a will paginate collection)
+users.current_page
+
+#dont know why this isnt returning integer thats a bug..
+users.current_page
+ => page 1
 ```
+
 *Start Zookeeper, and start each service up with:*
 ```
 bundle exec cylons start
 ```
 
-*Load that sample data, note the admin app has no database at all, only remote models*
-```
-cd admin
-bx rake db:seed
-```
-
-Note: there will be quite a few N+1 queries happening, intentionally. This is to demonstrate communication between the services, and speed. Each record that is created will make a call to Inventory, to check if that record already exists. If not, it will build the record by doing a Category.first_or_create (Taxon Service), to get the category_id, then it will make 3 additional calls to the Inventory service, 1 for manufacturer, 1 for department, and then finally one to actually create the Product.
-
+*NOTE: You just need to pass a flag RPC=1 to force connection when running rails c or rails s -- RPC env var just needs to exist to force connection
 
 ## Installation
 

data/bin/cylons

@@ -2,32 +2,32 @@
 
 require 'thor'
 require 'cylons'
+
+ENV["RPC"] ||= "1"
+
 class Services < ::Thor
   class_option :app, :default => "./config/environment.rb"
-  
+
   desc "start", "Start cylon services"
   def start
     puts "Starting services"
     require options[:app]
-    
-    raise ::Cylons::CouldNotConnectToRegistry unless ::Cylons::Connection.connected?
-    
-    ::Dir.glob(::Rails.root.join('app', 'models', "*.rb")).each{ |file| load file }
-    
+
+    ::Cylons.load_models
+
     ::Cylons.logger.info "Cylon Remotes: #{::Cylons::RemoteRegistry.remotes}"
-    
+
     ::Cylons::RemoteRegistry.register_schemas
-    
+
     ::Cylons::ServiceManager.start
 
-    loop do
-    
-    end
+    sleep
   end
 end
 
 ::Services.start
 
+
 [:INT, :QUIT, :TERM].each do |signal|
   trap(signal) do
     ::Cylons.logger.info "Stopping Cylon Services"
@@ -35,4 +35,3 @@ end
     exit 0
   end
 end
-

data/cylons.gemspec

@@ -17,24 +17,29 @@ Gem::Specification.new do |spec|
   spec.executables   = spec.files.grep(%r{^bin/}) { |f| File.basename(f) }
   spec.test_files    = spec.files.grep(%r{^(test|spec|features)/})
   spec.require_paths = ["lib"]
-  
-  spec.add_dependency "active_attr"
+
   spec.add_dependency "active_attr"
-  spec.add_dependency "dcell", "0.15.0"
   spec.add_dependency "thor"
   spec.add_dependency "zk"
-  spec.add_dependency 'pry'
   spec.add_dependency "will_paginate"
-  spec.add_dependency "ransack"
+  spec.add_dependency "dcell"
+
+  spec.add_runtime_dependency "pry"
 
   spec.add_development_dependency "bundler", "~> 1.3"
   spec.add_development_dependency "rake"
-  spec.add_development_dependency "pry"
   spec.add_development_dependency "activerecord"
-  # spec.add_development_dependency "sqlite3"
-  spec.add_development_dependency "rake"
+  spec.add_development_dependency "sqlite3"
   spec.add_development_dependency "rspec"
   spec.add_development_dependency "rspec-pride"
   spec.add_development_dependency "pry-nav"
   spec.add_development_dependency "simplecov"
+  spec.add_development_dependency 'rspec-its', '~> 1'
+  spec.add_development_dependency 'rspec-collection_matchers', '~> 1'
+  spec.add_development_dependency 'guard', '~> 2'
+  spec.add_development_dependency 'guard-rspec', '~> 4'
+  spec.add_development_dependency 'guard-bundler', '~> 2'
+  spec.add_development_dependency 'rb-fsevent'
+  spec.add_development_dependency 'terminal-notifier-guard'
+
 end

data/lib/cylons.rb

@@ -5,16 +5,20 @@ require 'active_support/core_ext/hash'
 require 'active_support/inflector'
 require 'active_support/json'
 require 'will_paginate'
+require 'will_paginate/array'
 require "cylons/version"
 
 require 'cylons/attributes'
+require 'cylons/agent'
 require 'cylons/connection'
-require 'cylons/configuration'
+# require 'cylons/configuration'
+require 'cylons/config'
 require 'cylons/errors'
+require 'cylons/logging'
 require 'cylons/remote'
 require 'cylons/remote_registry'
 require 'cylons/remote_discovery'
-require 'cylons/remote_proxy'
+require 'cylons/remote_pagination'
 require 'cylons/registry_adapter'
 require 'cylons/service'
 require 'cylons/service_manager'
@@ -22,36 +26,61 @@ require 'dcell'
 require 'socket'
 require 'zk'
 require 'dcell/registries/zk_adapter'
-require 'cylons/railtie'
 require 'pry'
-# require 'cylons/railtie' if defined?(Rails)
 
 module Cylons
-  #dont load remotes if test env or SKIP_CYLONS=true (such as when running rake tasks)  
+  def self.connect?
+    !!ENV["RPC"]
+  end
+
+  def self.load_models
+    ::Dir.glob(model_paths).each{ |file|
+        puts "loading #{file}"
+       load file }
+  end
+
+  def self.model_paths
+    if configuration.model_paths
+      return configuration.model_paths
+    elsif defined?(::Rails)
+      [::Rails.root.join('app', 'models', "*.rb"), ::Rails.root.join('app', 'models', "**", "*.rb")]
+    else
+      []
+    end
+  end
+
   def self.skip_cylons?
-    !!ENV["SKIP_CYLONS"]
+    !connect?
   end
-    
+
   def self.silence?
     skip_cylons? || (defined?(Rails) && Rails.env == "test")
   end
-  
+
   class << self
-    attr_accessor :configuration, :logger
-    
+    attr_accessor :configuration
+
     def configuration
-      @configuration ||= ::Cylons::Configuration.new
+      @configuration ||= ::Cylons::Config.new
     end
 
     def configure
       yield(configuration) if block_given?
-      
+
       @logger = configuration.logger
-      
+
       ::ActiveSupport.run_load_hooks(:cylons, self)
     end
-    
     alias_method :config, :configuration
+
+    def logger
+      ::Cylons.config.logger
+    end
+
+
+    delegate :connect, :to => ::Cylons::Connection
+    delegate :connected?, :to => ::Cylons::Connection
   end
 end
 
+require 'cylons/railtie' if defined?(Rails)

data/lib/cylons/active_record_extensions.rb

@@ -2,21 +2,23 @@ require 'cylons/remote_discovery'
 
 module Cylons
   module ActiveRecordExtensions
+    extend ::ActiveSupport::Concern
+
+    SEARCH_OPTION_KEYS = [:opts, :options].freeze
+    MAX_PER_PAGE = 1000
+
     module ClassMethods
-      
-      SEARCH_OPTION_KEYS = [:opts, :options].freeze
-      
       def reload_remotes!
         ::Cylons::RemoteDiscovery.load_remotes unless ::Cylons.silence?
       end
-      
+
       def remote_schema
         ::Cylons::RemoteRegistry.get_remote_schema(self.name) unless ::Cylons.silence?
       end
-      
+
       def remote_belongs_to(*args)
         options = args.extract_options!
-        
+
         args.each do |arg|
           options[:foreign_key] = "#{arg}_id"
           association_hash = {:name => arg, :association_type => :belongs_to, :options => options}
@@ -24,36 +26,27 @@ module Cylons
           build_remote_belongs_to_association(association_hash)
         end
       end
-      
-      #store remote has many assoc globally, then define it locally. 
+
+      #store remote has many assoc globally, then define it locally.
       def remote_has_many(*args)
         options = args.extract_options!
-        
+
         args.each do |arg|
           association_hash = {:name => arg, :association_type => :has_many, :options => options}
           self.remote_associations << association_hash
           build_remote_has_many_association(association_hash)
         end
       end
-      
-      #TODO: Hacky, but something strange is going on here, and syntax will need to chagne for rails4... hrmmm
-      def scope_by(params = {})
+
+      def search(params = {})
         search_options = params.extract!(*SEARCH_OPTION_KEYS)
-        
+
         search_options.delete_if {|k,v| v.nil? }
-        
-        if search_options.present?
-          scoped_search = params.inject(scoped) do |combined_scope, param|
-            combined_scope.send("by_#{param.first}", param.last)
-          end.paginate(:page => search_options[:options][:page], :per_page => search_options[:options][:per_page])
-        else
-          scoped_search = params.inject(scoped) do |combined_scope, param|
-            combined_scope.send("by_#{param.first}", param.last)
-          end
-        end
-        
-        scoped_search
-      end      
+
+        query_scope = params.inject(all) do |query, hash_pair|
+          query.__send__("by_#{hash_pair[0]}", hash_pair[1]).all
+        end.all
+      end
     end
   end
-end
+end