enjin 0.0.1

Sign up to get free protection for your applications and to get access to all the features.
Files changed (3) hide show
  1. data/LICENSE +24 -0
  2. data/README.md +126 -0
  3. metadata +102 -0
data/LICENSE ADDED
@@ -0,0 +1,24 @@
1
+ ## License
2
+
3
+ (The MIT License)
4
+
5
+ Copyright (c) 2011 Wilson Bilkovich
6
+
7
+ Permission is hereby granted, free of charge, to any person obtaining a copy
8
+ of this software and associated documentation files (the "Software"), to
9
+ deal in the Software without restriction, including without limitation the
10
+ rights to use, copy, modify, merge, publish, distribute, sublicense, and/or
11
+ sell copies of the Software, and to permit persons to whom the Software is
12
+ furnished to do so, subject to the following conditions:
13
+
14
+ The above copyright notice and this permission notice shall be included in
15
+ all copies or substantial portions of the Software.
16
+
17
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
18
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
19
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
20
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
21
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
22
+ FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS
23
+ IN THE SOFTWARE.
24
+
@@ -0,0 +1,126 @@
1
+ ### enjin: Meta as a Service | 円陣: クラウドのむこう
2
+
3
+ > clouds endless clouds climbing beyond
4
+ >
5
+ > ask nothing from words on a page
6
+ >
7
+ > 一休宗純 (Ikkyu)
8
+
9
+ ### Description
10
+
11
+ Pick your own altitude in the cloud. Always a work in progress.
12
+
13
+ Today's popular cloud implementations generally target a single abstraction of computing, and offer a product or set of products using it. Customers often have complex and evolving needs however, and most clouds either abdicate automation of key infrastructure (e.g. failure recovery, DNS), or box customers in a limited platform abstraction to simplify maintenance. This is understandable, and many such products are successful. If customer needs change enough, previous decisions can start to look like fierce technical debt.
14
+
15
+ ### Goals
16
+
17
+ * Learn from the domain of hierarchical protection to unify IaaS and PaaS
18
+ * Be rid of clouds that can't deploy themselves
19
+ * Build a truly fault-tolerant open-source multi-cloud abstraction
20
+ * Strive to be paranoid enough
21
+
22
+ What does that mean? Just as UNIX systems can create unprivileged users, the IaaS layer should be able to call upon the resources of PaaS-style service implementations.
23
+
24
+ ### Concepts
25
+
26
+ ring 0 is Meta as a Service, ring 1 is Infrastructure as a Service, ring 2 is Platform as a Service.
27
+
28
+ * a 'ring 0' node communicates on the ring 0 network and is expected to be able to supervise 'ring 1' nodes
29
+ * a 'ring 1' node communicates on the ring 1 network and is expected to be able to supervise 'ring 2' nodes
30
+ * a 'ring 2' node typically supervises only its own internal processes
31
+
32
+ One possible ring 2 node is a UNIX user, but it could be a nested VM or FreeBSD jail.
33
+ In a PaaS offering a ring 2 node would generally be serving HTTP traffic on a port allocated to it by ring 1.
34
+
35
+ A ring 0 node could be a physical machine, a VM with the privileges required to instantiate others like itself, or anything else with suitable resources.
36
+
37
+ Each ring manages the ACLs and keys for the ring it contains.
38
+ Rings communicate with private pub/sub networks e.g. ZeroMQ, NATS, &c.
39
+ Private channels accept onl signed messages from whitelisted origins.
40
+
41
+ ### Infrastructure as a Service (IaaS)
42
+
43
+ Groups of machines that share a locality, either physical (in the same rack) or logical (on some mysteriously-fast private network with each other) are a key abstraction for infrastructure.
44
+ Let's call them 'Compartments'. They might as well be able to contain other compartments, and be a directed graph. Think NUMA shenanigans. Ring 0 cares about these though ring 1 agents have limited ability to request to be instantiated in a specific one.
45
+
46
+ > I would like to collect power usage metrics at this level as well, especially since actual machines in racks these days tend to be homogenous. HP has their neat vertically-cooled blades, Cisco has the 'Unified Computing System', &c.
47
+
48
+ These compartments can share private communications with each other, and agree on reciprocal access to each other if needed. Assume such links have the semantics of OpenVPN.
49
+ In an IaaS offering, both ring 1 (the services running the product) and ring 2 (customer instances) may be running on the same hypervisor.
50
+
51
+ ### Platform as a Service (PaaS)
52
+
53
+ In a PaaS offering, ring 2 nodes are 'applications', rather than VMs.
54
+ Plan for multi-tenant capabilities; once you have them, single-tenant is a degenerate case.
55
+ Practical options for multi-tenant, lightest to heaviest:
56
+
57
+ * ring 1 is a UNIX box where apps run as separate locked-down users
58
+ * ring 1 is a FreeBSD box (lol) where apps run in separate jails
59
+ * ring 1 is a box running a hypervisor where apps run in separate VMs
60
+ * ring 1 is a mysterious combination of the above
61
+
62
+ Ring 2 nodes are therefore PaaS apps and are in the end simply open sockets managed by the ring 1 agent.
63
+ Successfully presenting that illusion requires various other machinery running in ring 1, such as HTTP routers, a watchdog process for apps, &c.
64
+ Arguably a 'ring 2 compartment' is analogous to 'customer application environment running various instances' at this layer. The chosen configuration (using the various implemented strategies) determines what actually happens at the end of the day. There are as many possible clouds as there are potential managed product offerings.
65
+
66
+ ### What Goes Where
67
+
68
+ ring 0 services:
69
+
70
+ * meta http api
71
+ * key generation
72
+ * node authentication
73
+ * traffic managers, bastions
74
+ * ring 0 resource allocation (bootstrap)
75
+ * ring 1 resource allocation
76
+
77
+ ring 1 services:
78
+
79
+ * http api
80
+ * user authentication
81
+ * distributed data
82
+ * package management (os packages,gems, &c)
83
+ * vm pool management
84
+ * infrastructure monitoring
85
+ * job execution (code updates, periodic tasks, &c)
86
+ * ring 2 resource allocation (e.g. running multi-tenant user code)
87
+
88
+ ring 2 services:
89
+
90
+ * deployment packaging
91
+ * sockets and traffic management
92
+ * application monitoring
93
+ * backup and recovery
94
+ * logging
95
+ * metric collection
96
+
97
+ ### Whats That Go Where
98
+
99
+ User
100
+ Role
101
+ Membership
102
+ Network
103
+ NetworkInterface
104
+ > ring
105
+ > strategy (e.g. vpn or local)
106
+ AccessRuleSet
107
+ AccessRule
108
+ Compartment
109
+ > ring
110
+ > parent_compartment
111
+ Node
112
+ > uuid
113
+ > ring
114
+ > label
115
+ > supervision_strategy
116
+ > compartment
117
+ JobOffer
118
+ NodeObservation
119
+ > node_id
120
+ > observation_strategy
121
+ > state
122
+ > timestamp
123
+
124
+ ![Mimosa](http://farm2.static.flickr.com/1124/909585864_b603258792_m.jpg "Mimosa")
125
+
126
+ つずく。。
metadata ADDED
@@ -0,0 +1,102 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: enjin
3
+ version: !ruby/object:Gem::Version
4
+ version: 0.0.1
5
+ prerelease:
6
+ platform: ruby
7
+ authors:
8
+ - Wilson Bilkovich
9
+ autorequire:
10
+ bindir: bin
11
+ cert_chain: []
12
+ date: 2011-06-20 00:00:00.000000000Z
13
+ dependencies:
14
+ - !ruby/object:Gem::Dependency
15
+ name: nats
16
+ requirement: &2155953660 !ruby/object:Gem::Requirement
17
+ none: false
18
+ requirements:
19
+ - - ~>
20
+ - !ruby/object:Gem::Version
21
+ version: 0.4.10
22
+ type: :runtime
23
+ prerelease: false
24
+ version_requirements: *2155953660
25
+ - !ruby/object:Gem::Dependency
26
+ name: em-http-request
27
+ requirement: &2155953020 !ruby/object:Gem::Requirement
28
+ none: false
29
+ requirements:
30
+ - - ~>
31
+ - !ruby/object:Gem::Version
32
+ version: 0.3.0
33
+ type: :runtime
34
+ prerelease: false
35
+ version_requirements: *2155953020
36
+ - !ruby/object:Gem::Dependency
37
+ name: goliath
38
+ requirement: &2155952360 !ruby/object:Gem::Requirement
39
+ none: false
40
+ requirements:
41
+ - - ~>
42
+ - !ruby/object:Gem::Version
43
+ version: 0.9.1
44
+ type: :runtime
45
+ prerelease: false
46
+ version_requirements: *2155952360
47
+ - !ruby/object:Gem::Dependency
48
+ name: bcrypt-ruby
49
+ requirement: &2155951780 !ruby/object:Gem::Requirement
50
+ none: false
51
+ requirements:
52
+ - - ~>
53
+ - !ruby/object:Gem::Version
54
+ version: 2.1.4
55
+ type: :runtime
56
+ prerelease: false
57
+ version_requirements: *2155951780
58
+ - !ruby/object:Gem::Dependency
59
+ name: ruby-hmac
60
+ requirement: &2155951100 !ruby/object:Gem::Requirement
61
+ none: false
62
+ requirements:
63
+ - - ~>
64
+ - !ruby/object:Gem::Version
65
+ version: 0.4.0
66
+ type: :runtime
67
+ prerelease: false
68
+ version_requirements: *2155951100
69
+ description: An ongoing project to build a maintainable and fault-tolerant cloud platform.
70
+ email:
71
+ - wilson@supremetyrant.com
72
+ executables: []
73
+ extensions: []
74
+ extra_rdoc_files: []
75
+ files:
76
+ - README.md
77
+ - LICENSE
78
+ homepage: http://github.com/wilson/enjin
79
+ licenses: []
80
+ post_install_message:
81
+ rdoc_options: []
82
+ require_paths:
83
+ - lib
84
+ required_ruby_version: !ruby/object:Gem::Requirement
85
+ none: false
86
+ requirements:
87
+ - - ~>
88
+ - !ruby/object:Gem::Version
89
+ version: 1.9.2
90
+ required_rubygems_version: !ruby/object:Gem::Requirement
91
+ none: false
92
+ requirements:
93
+ - - ! '>='
94
+ - !ruby/object:Gem::Version
95
+ version: '0'
96
+ requirements: []
97
+ rubyforge_project:
98
+ rubygems_version: 1.8.5
99
+ signing_key:
100
+ specification_version: 3
101
+ summary: An open cloud for any altitude
102
+ test_files: []