@genobank/biofs 1.8.2 β 1.8.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +120 -171
- package/dist/commands/biofiles.d.ts +9 -0
- package/dist/commands/biofiles.d.ts.map +1 -0
- package/dist/commands/biofiles.js +112 -0
- package/dist/commands/biofiles.js.map +1 -0
- package/dist/commands/labs/list.d.ts +19 -0
- package/dist/commands/labs/list.d.ts.map +1 -0
- package/dist/commands/labs/list.js +98 -0
- package/dist/commands/labs/list.js.map +1 -0
- package/dist/commands/share.d.ts +10 -0
- package/dist/commands/share.d.ts.map +1 -0
- package/dist/commands/share.js +186 -0
- package/dist/commands/share.js.map +1 -0
- package/dist/commands/verify.d.ts +9 -0
- package/dist/commands/verify.d.ts.map +1 -0
- package/dist/commands/verify.js +138 -0
- package/dist/commands/verify.js.map +1 -0
- package/dist/index.js +99 -42
- package/dist/index.js.map +1 -1
- package/dist/lib/ai/classifier.d.ts +1 -3
- package/dist/lib/ai/classifier.d.ts.map +1 -1
- package/dist/lib/ai/classifier.js +17 -37
- package/dist/lib/ai/classifier.js.map +1 -1
- package/dist/lib/api/client.d.ts +46 -0
- package/dist/lib/api/client.d.ts.map +1 -1
- package/dist/lib/api/client.js +159 -19
- package/dist/lib/api/client.js.map +1 -1
- package/dist/lib/auth/server.d.ts.map +1 -1
- package/dist/lib/auth/server.js +2 -11
- package/dist/lib/auth/server.js.map +1 -1
- package/dist/lib/biofiles/fingerprint.d.ts.map +1 -1
- package/dist/lib/biofiles/fingerprint.js +11 -40
- package/dist/lib/biofiles/fingerprint.js.map +1 -1
- package/dist/lib/biofiles/resolver.d.ts.map +1 -1
- package/dist/lib/biofiles/resolver.js +59 -75
- package/dist/lib/biofiles/resolver.js.map +1 -1
- package/dist/lib/config/constants.d.ts +1 -0
- package/dist/lib/config/constants.d.ts.map +1 -1
- package/dist/lib/config/constants.js +3 -3
- package/dist/lib/config/constants.js.map +1 -1
- package/dist/lib/utils/logger.d.ts +5 -6
- package/dist/lib/utils/logger.d.ts.map +1 -1
- package/dist/lib/utils/logger.js +5 -23
- package/dist/lib/utils/logger.js.map +1 -1
- package/dist/types/api.d.ts +21 -0
- package/dist/types/api.d.ts.map +1 -1
- package/dist/types/biofiles.d.ts +2 -2
- package/dist/types/biofiles.d.ts.map +1 -1
- package/package.json +2 -3
- package/.claude/settings.local.json +0 -33
- package/BIOFS_CLI_NODE_CONVERGENCE_ANALYSIS.md +0 -932
- package/BIOFS_FEDERATED_NETWORK_ARCHITECTURE.md +0 -1071
- package/BIOFS_NODE_CLIENT_ARCHITECTURE.md +0 -557
- package/BIOFS_NODE_IMPLEMENTATION_PLAN.md +0 -2164
- package/BIOROUTER_IMPLEMENTATION_CHECKLIST.md +0 -618
- package/BUBBLEWRAP_INTEGRATION.md +0 -486
- package/BUBBLEWRAP_QUICKSTART.md +0 -356
- package/BUBBLEWRAP_README.md +0 -466
- package/BUBBLEWRAP_STRATEGIC_ANALYSIS.md +0 -625
- package/EXECUTIVE_SUMMARY_BIOROUTER_CONVERGENCE.md +0 -323
- package/GEMINI_REMOVAL_COMPLETE.md +0 -311
- package/debug_credentials.js +0 -60
- package/dist/commands/sandbox.d.ts +0 -10
- package/dist/commands/sandbox.d.ts.map +0 -1
- package/dist/commands/sandbox.js +0 -418
- package/dist/commands/sandbox.js.map +0 -1
- package/dist/lib/sandbox/bubblewrap.d.ts +0 -125
- package/dist/lib/sandbox/bubblewrap.d.ts.map +0 -1
- package/dist/lib/sandbox/bubblewrap.js +0 -343
- package/dist/lib/sandbox/bubblewrap.js.map +0 -1
- package/examples/sandbox-usage.ts +0 -361
|
@@ -1,1071 +0,0 @@
|
|
|
1
|
-
# π BioFS Federated Network Architecture
|
|
2
|
-
|
|
3
|
-
**Date**: October 24, 2025
|
|
4
|
-
**Vision**: Decentralized genomic data network with GenoBank.io as Master Node
|
|
5
|
-
**Status**: Architecture Design Phase
|
|
6
|
-
|
|
7
|
-
---
|
|
8
|
-
|
|
9
|
-
## π― Core Concept: Hub-and-Spoke Topology
|
|
10
|
-
|
|
11
|
-
```
|
|
12
|
-
ββββββββββββββββββββββββββ
|
|
13
|
-
β GenoBank.io β
|
|
14
|
-
β MASTER NODE β
|
|
15
|
-
β β
|
|
16
|
-
β β’ Multi-lab orchestratorβ
|
|
17
|
-
β β’ Data replication β
|
|
18
|
-
β β’ Sponsored services β
|
|
19
|
-
β β’ Failover backup β
|
|
20
|
-
βββββββββββββ¬βββββββββββββ
|
|
21
|
-
β
|
|
22
|
-
βββββββββββββββββΌββββββββββββββββ
|
|
23
|
-
β β β
|
|
24
|
-
βββββββββΌβββββββ βββββββΌβββββββ βββββββΌβββββββ
|
|
25
|
-
β AUGenomics β β UCSFMed β β MayoClinic β
|
|
26
|
-
β LAB NODE β β LAB NODE β β LAB NODE β
|
|
27
|
-
β β β β β β
|
|
28
|
-
β β’ S3 bucket β β β’ S3 bucketβ β β’ S3 bucketβ
|
|
29
|
-
β β’ Local API β β β’ Local APIβ β β’ Local APIβ
|
|
30
|
-
β β’ Researchersβ β β’ Research β β β’ Research β
|
|
31
|
-
ββββββββ¬ββββββββ βββββββ¬βββββββ βββββββ¬βββββββ
|
|
32
|
-
β β β
|
|
33
|
-
ββββββββΌβββββββ βββββββΌβββββββ βββββββΌβββββββ
|
|
34
|
-
β Dr. Claudia β β Dr. Smith β β Dr. Jones β
|
|
35
|
-
β biofs-cli β β biofs-cli β β biofs-cli β
|
|
36
|
-
βββββββββββββββ ββββββββββββββ ββββββββββββββ
|
|
37
|
-
```
|
|
38
|
-
|
|
39
|
-
---
|
|
40
|
-
|
|
41
|
-
## ποΈ Node Types
|
|
42
|
-
|
|
43
|
-
### **1. Master Node** (GenoBank.io) π
|
|
44
|
-
|
|
45
|
-
**Purpose**: Orchestrator, backup, and service provider
|
|
46
|
-
|
|
47
|
-
**Features**:
|
|
48
|
-
```yaml
|
|
49
|
-
type: master
|
|
50
|
-
capabilities:
|
|
51
|
-
- multi_lab_management
|
|
52
|
-
- data_replication
|
|
53
|
-
- sponsored_services
|
|
54
|
-
- failover_backup
|
|
55
|
-
- global_discovery
|
|
56
|
-
- cross_node_licensing
|
|
57
|
-
- unified_audit_trail
|
|
58
|
-
- billing_and_accounting
|
|
59
|
-
|
|
60
|
-
services_provided:
|
|
61
|
-
anthropic_api:
|
|
62
|
-
sponsored: true
|
|
63
|
-
api_key: ${GENOBANK_ANTHROPIC_KEY}
|
|
64
|
-
quota_per_researcher_per_month: 1000000 # 1M tokens
|
|
65
|
-
|
|
66
|
-
story_protocol:
|
|
67
|
-
executor_key: ${GENOBANK_EXECUTOR_KEY}
|
|
68
|
-
lab_wallet: ${GENOBANK_LAB_WALLET}
|
|
69
|
-
sponsored_gas: true
|
|
70
|
-
max_gas_per_lab_per_month: 0.5 ETH
|
|
71
|
-
|
|
72
|
-
storage:
|
|
73
|
-
primary: "s3://vault.genobank.io/master/"
|
|
74
|
-
replicas:
|
|
75
|
-
- "s3://vault-replica-us-west.genobank.io/"
|
|
76
|
-
- "s3://vault-replica-eu-central.genobank.io/"
|
|
77
|
-
backup_lab_data: true
|
|
78
|
-
|
|
79
|
-
labs_managed:
|
|
80
|
-
- augenomics
|
|
81
|
-
- ucsfmed
|
|
82
|
-
- mayoclinic
|
|
83
|
-
- stanfordmed
|
|
84
|
-
```
|
|
85
|
-
|
|
86
|
-
**API Endpoints**:
|
|
87
|
-
```typescript
|
|
88
|
-
// Master Node Management
|
|
89
|
-
POST /master/labs/register // Lab registers with master
|
|
90
|
-
GET /master/labs/list // List all labs in network
|
|
91
|
-
POST /master/labs/:id/enable // Enable/disable lab
|
|
92
|
-
GET /master/labs/:id/health // Check lab health
|
|
93
|
-
|
|
94
|
-
// Sponsored Services
|
|
95
|
-
POST /master/sponsored/anthropic // Proxy to Anthropic with master key
|
|
96
|
-
POST /master/sponsored/story // Proxy to Story Protocol with master gas
|
|
97
|
-
GET /master/sponsored/quota // Check researcher's remaining quota
|
|
98
|
-
|
|
99
|
-
// Data Replication
|
|
100
|
-
POST /master/replicate/:lab_id // Trigger replication from lab to master
|
|
101
|
-
GET /master/replicas/:dataset_id // Get replica locations
|
|
102
|
-
POST /master/failover/:lab_id // Switch to master replica
|
|
103
|
-
|
|
104
|
-
// Cross-Node Licensing
|
|
105
|
-
GET /master/licenses/verify // Verify license across all nodes
|
|
106
|
-
POST /master/licenses/propagate // Propagate license to all nodes
|
|
107
|
-
|
|
108
|
-
// Monitoring
|
|
109
|
-
GET /master/health/network // Global network health
|
|
110
|
-
GET /master/metrics/usage // Network-wide usage metrics
|
|
111
|
-
```
|
|
112
|
-
|
|
113
|
-
---
|
|
114
|
-
|
|
115
|
-
### **2. Lab Node** (AUGenomics, UCSF, etc.) ποΈ
|
|
116
|
-
|
|
117
|
-
**Purpose**: Institutional data provider with optional sponsored services
|
|
118
|
-
|
|
119
|
-
**Features**:
|
|
120
|
-
```yaml
|
|
121
|
-
type: lab
|
|
122
|
-
lab_info:
|
|
123
|
-
name: "AUGenomics Genomics Core"
|
|
124
|
-
wallet: "0xAUGenomics..."
|
|
125
|
-
registered_with_master: true
|
|
126
|
-
master_node_url: "https://master.genobank.io"
|
|
127
|
-
|
|
128
|
-
storage:
|
|
129
|
-
primary: "s3://augenomics-genomics"
|
|
130
|
-
replicate_to_master: true
|
|
131
|
-
replication_interval: "1h"
|
|
132
|
-
backup_enabled: true
|
|
133
|
-
|
|
134
|
-
services_provided:
|
|
135
|
-
# Optional: Lab provides own Anthropic key
|
|
136
|
-
anthropic_api:
|
|
137
|
-
sponsored: true # If true, lab pays for its researchers
|
|
138
|
-
api_key: ${AUGENOMICS_ANTHROPIC_KEY} # Optional, falls back to master
|
|
139
|
-
quota_per_researcher_per_month: 500000 # 500k tokens
|
|
140
|
-
|
|
141
|
-
# Optional: Lab provides own executor for Story Protocol
|
|
142
|
-
story_protocol:
|
|
143
|
-
executor_key: ${AUGENOMICS_EXECUTOR_KEY} # Optional, falls back to master
|
|
144
|
-
lab_wallet: ${AUGENOMICS_LAB_WALLET}
|
|
145
|
-
sponsored_gas: true # Lab pays gas, not researchers
|
|
146
|
-
max_gas_per_month: 0.2 ETH
|
|
147
|
-
|
|
148
|
-
researchers:
|
|
149
|
-
registered:
|
|
150
|
-
- wallet: "0xDrClaudia..."
|
|
151
|
-
role: "data_scientist"
|
|
152
|
-
quota_multiplier: 2.0 # VIP researcher, 2x quota
|
|
153
|
-
- wallet: "0xDrSmith..."
|
|
154
|
-
role: "analyst"
|
|
155
|
-
quota_multiplier: 1.0
|
|
156
|
-
|
|
157
|
-
discovery:
|
|
158
|
-
announce_to_master: true
|
|
159
|
-
announce_datasets: true
|
|
160
|
-
visible_in_global_catalog: true
|
|
161
|
-
|
|
162
|
-
failover:
|
|
163
|
-
master_can_serve: true # Master can serve if lab goes down
|
|
164
|
-
health_check_interval: "5m"
|
|
165
|
-
auto_failover: true
|
|
166
|
-
```
|
|
167
|
-
|
|
168
|
-
**Decision Tree for Sponsored Services**:
|
|
169
|
-
```
|
|
170
|
-
Researcher requests Anthropic API:
|
|
171
|
-
ββ Does Lab Node have own API key?
|
|
172
|
-
β ββ YES β Use lab key (lab pays)
|
|
173
|
-
β ββ NO β Forward to Master Node (GenoBank pays)
|
|
174
|
-
β
|
|
175
|
-
ββ Check quota:
|
|
176
|
-
ββ Lab quota: 500k tokens/month
|
|
177
|
-
ββ Master fallback quota: 1M tokens/month
|
|
178
|
-
ββ Total available: 1.5M tokens/month
|
|
179
|
-
|
|
180
|
-
Researcher mints NFT on Story Protocol:
|
|
181
|
-
ββ Does Lab Node have executor key?
|
|
182
|
-
β ββ YES β Use lab executor (lab pays gas)
|
|
183
|
-
β ββ NO β Forward to Master executor (GenoBank pays gas)
|
|
184
|
-
β
|
|
185
|
-
ββ Check gas quota:
|
|
186
|
-
ββ Lab gas budget: 0.2 ETH/month
|
|
187
|
-
ββ Master fallback: 0.5 ETH/month
|
|
188
|
-
ββ Total available: 0.7 ETH/month
|
|
189
|
-
```
|
|
190
|
-
|
|
191
|
-
---
|
|
192
|
-
|
|
193
|
-
### **3. Client** (Dr. Claudia's laptop) π»
|
|
194
|
-
|
|
195
|
-
**Purpose**: Researcher's personal CLI
|
|
196
|
-
|
|
197
|
-
**Behavior**:
|
|
198
|
-
```bash
|
|
199
|
-
# Researcher connects to lab node
|
|
200
|
-
biofs login --wallet 0xDrClaudia...
|
|
201
|
-
biofs config set-node https://node.augenomics.org
|
|
202
|
-
|
|
203
|
-
# All services transparently sponsored
|
|
204
|
-
biofs job create "Find cancer variants" genome.vcf
|
|
205
|
-
# β Uses AUGenomics Anthropic key (or falls back to GenoBank)
|
|
206
|
-
|
|
207
|
-
biofs tokenize hereditary-cancer-results.csv
|
|
208
|
-
# β Uses AUGenomics executor (or falls back to GenoBank)
|
|
209
|
-
|
|
210
|
-
# Researcher doesn't see complexity
|
|
211
|
-
# Just gets: "β
Analysis complete" or "β
NFT minted"
|
|
212
|
-
```
|
|
213
|
-
|
|
214
|
-
---
|
|
215
|
-
|
|
216
|
-
## π° Sponsored Services Architecture
|
|
217
|
-
|
|
218
|
-
### **Anthropic API Sponsorship**
|
|
219
|
-
|
|
220
|
-
```typescript
|
|
221
|
-
// Lab Node receives request
|
|
222
|
-
async handleAnthropicRequest(researcher: string, prompt: string) {
|
|
223
|
-
// 1. Check lab-level sponsorship
|
|
224
|
-
if (this.config.anthropic_api.sponsored && this.config.anthropic_api.api_key) {
|
|
225
|
-
const quota = await this.checkLabQuota(researcher);
|
|
226
|
-
if (quota.available > 0) {
|
|
227
|
-
return await this.callAnthropicWithLabKey(prompt);
|
|
228
|
-
}
|
|
229
|
-
}
|
|
230
|
-
|
|
231
|
-
// 2. Fallback to master sponsorship
|
|
232
|
-
const masterQuota = await this.masterNode.checkQuota(researcher);
|
|
233
|
-
if (masterQuota.available > 0) {
|
|
234
|
-
return await this.masterNode.callAnthropicWithMasterKey(prompt);
|
|
235
|
-
}
|
|
236
|
-
|
|
237
|
-
// 3. No quota available
|
|
238
|
-
throw new Error('Quota exceeded. Contact lab admin or GenoBank support.');
|
|
239
|
-
}
|
|
240
|
-
```
|
|
241
|
-
|
|
242
|
-
### **Story Protocol Gas Sponsorship**
|
|
243
|
-
|
|
244
|
-
```typescript
|
|
245
|
-
// Lab Node receives NFT mint request
|
|
246
|
-
async mintNFT(researcher: string, metadata: any) {
|
|
247
|
-
// 1. Check lab-level gas sponsorship
|
|
248
|
-
if (this.config.story_protocol.sponsored && this.config.story_protocol.executor_key) {
|
|
249
|
-
const gasQuota = await this.checkLabGasQuota(researcher);
|
|
250
|
-
if (gasQuota.available > 0) {
|
|
251
|
-
return await this.mintWithLabExecutor(metadata);
|
|
252
|
-
}
|
|
253
|
-
}
|
|
254
|
-
|
|
255
|
-
// 2. Fallback to master gas sponsorship
|
|
256
|
-
const masterGasQuota = await this.masterNode.checkGasQuota(researcher);
|
|
257
|
-
if (masterGasQuota.available > 0) {
|
|
258
|
-
return await this.masterNode.mintWithMasterExecutor(metadata);
|
|
259
|
-
}
|
|
260
|
-
|
|
261
|
-
// 3. Require researcher to pay gas themselves
|
|
262
|
-
throw new Error('Gas quota exceeded. Please mint with your own gas.');
|
|
263
|
-
}
|
|
264
|
-
```
|
|
265
|
-
|
|
266
|
-
---
|
|
267
|
-
|
|
268
|
-
## π Data Replication Strategy
|
|
269
|
-
|
|
270
|
-
### **Replication Flow**
|
|
271
|
-
|
|
272
|
-
```
|
|
273
|
-
ββββββββββββββββββββ ββββββββββββββββββββ
|
|
274
|
-
β Lab Node S3 β ββββ Sync ββββββ> β Master Node S3 β
|
|
275
|
-
β augenomics/ β Every 1 hour β replicas/ β
|
|
276
|
-
β - genome1.vcf β β augenomics/ β
|
|
277
|
-
β - genome2.vcf β β - genome1.vcf β
|
|
278
|
-
ββββββββββββββββββββ β - genome2.vcf β
|
|
279
|
-
ββββββββββββββββββββ
|
|
280
|
-
β
|
|
281
|
-
ββββββββββ΄βββββββββ
|
|
282
|
-
β β
|
|
283
|
-
βββββββΌβββββββ ββββββββΌββββββ
|
|
284
|
-
β US-West β β EU-Central β
|
|
285
|
-
β Replica β β Replica β
|
|
286
|
-
ββββββββββββββ ββββββββββββββ
|
|
287
|
-
```
|
|
288
|
-
|
|
289
|
-
### **Replication Configuration**
|
|
290
|
-
|
|
291
|
-
```yaml
|
|
292
|
-
# Lab Node config
|
|
293
|
-
replication:
|
|
294
|
-
enabled: true
|
|
295
|
-
master_url: "https://master.genobank.io"
|
|
296
|
-
schedule: "0 * * * *" # Every hour
|
|
297
|
-
method: "incremental" # Only new/modified files
|
|
298
|
-
encryption: true
|
|
299
|
-
compression: true
|
|
300
|
-
|
|
301
|
-
filters:
|
|
302
|
-
include:
|
|
303
|
-
- "*.vcf"
|
|
304
|
-
- "*.bam"
|
|
305
|
-
- "*.fastq.gz"
|
|
306
|
-
exclude:
|
|
307
|
-
- "*.tmp"
|
|
308
|
-
- "*_temp_*"
|
|
309
|
-
|
|
310
|
-
bandwidth_limit: "100 Mbps"
|
|
311
|
-
max_file_size: "10 GB"
|
|
312
|
-
|
|
313
|
-
metadata_sync:
|
|
314
|
-
sync_permissions: true
|
|
315
|
-
sync_licenses: true
|
|
316
|
-
sync_audit_logs: true
|
|
317
|
-
```
|
|
318
|
-
|
|
319
|
-
### **Replication API**
|
|
320
|
-
|
|
321
|
-
```typescript
|
|
322
|
-
// Trigger manual replication
|
|
323
|
-
POST /lab/replicate/trigger
|
|
324
|
-
{
|
|
325
|
-
"dataset_id": "augenomics-wes-2024",
|
|
326
|
-
"priority": "high",
|
|
327
|
-
"force_full_sync": false
|
|
328
|
-
}
|
|
329
|
-
|
|
330
|
-
// Check replication status
|
|
331
|
-
GET /lab/replicate/status/:dataset_id
|
|
332
|
-
Response:
|
|
333
|
-
{
|
|
334
|
-
"dataset_id": "augenomics-wes-2024",
|
|
335
|
-
"status": "in_progress",
|
|
336
|
-
"files_total": 1500,
|
|
337
|
-
"files_synced": 1200,
|
|
338
|
-
"bytes_transferred": "450 GB",
|
|
339
|
-
"estimated_completion": "2025-10-24T14:30:00Z",
|
|
340
|
-
"replicas": [
|
|
341
|
-
{
|
|
342
|
-
"location": "master",
|
|
343
|
-
"url": "s3://vault.genobank.io/replicas/augenomics/",
|
|
344
|
-
"last_sync": "2025-10-24T13:00:00Z",
|
|
345
|
-
"status": "syncing"
|
|
346
|
-
}
|
|
347
|
-
]
|
|
348
|
-
}
|
|
349
|
-
```
|
|
350
|
-
|
|
351
|
-
---
|
|
352
|
-
|
|
353
|
-
## π¨ Failover & High Availability
|
|
354
|
-
|
|
355
|
-
### **Lab Node Failure Scenario**
|
|
356
|
-
|
|
357
|
-
```
|
|
358
|
-
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
359
|
-
β Timeline: Lab Node Goes Offline β
|
|
360
|
-
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€
|
|
361
|
-
β β
|
|
362
|
-
β T+0s: Lab node stops responding β
|
|
363
|
-
β T+30s: Master health check fails β
|
|
364
|
-
β T+60s: Master marks lab as "degraded" β
|
|
365
|
-
β T+90s: Second health check fails β
|
|
366
|
-
β T+120s: Master marks lab as "offline" β
|
|
367
|
-
β T+121s: Master activates failover: β
|
|
368
|
-
β - Redirect researcher requests to master β
|
|
369
|
-
β - Serve files from master replica β
|
|
370
|
-
β - Log failover event β
|
|
371
|
-
β T+300s: Send alert to lab admin β
|
|
372
|
-
β β
|
|
373
|
-
β Researcher experience: β
|
|
374
|
-
β - No downtime β
|
|
375
|
-
β - Transparent failover β
|
|
376
|
-
β - Slight latency increase (master may be farther) β
|
|
377
|
-
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
378
|
-
```
|
|
379
|
-
|
|
380
|
-
### **Automatic Failover Configuration**
|
|
381
|
-
|
|
382
|
-
```yaml
|
|
383
|
-
failover:
|
|
384
|
-
enabled: true
|
|
385
|
-
health_check:
|
|
386
|
-
interval: "30s"
|
|
387
|
-
timeout: "10s"
|
|
388
|
-
failure_threshold: 3 # 3 consecutive failures = offline
|
|
389
|
-
|
|
390
|
-
actions:
|
|
391
|
-
- type: "redirect"
|
|
392
|
-
target: "master"
|
|
393
|
-
priority: 1
|
|
394
|
-
|
|
395
|
-
- type: "notify"
|
|
396
|
-
channels: ["email", "slack"]
|
|
397
|
-
recipients: ["lab-admin@augenomics.org"]
|
|
398
|
-
priority: 2
|
|
399
|
-
|
|
400
|
-
- type: "serve_from_replica"
|
|
401
|
-
replica: "master"
|
|
402
|
-
priority: 1
|
|
403
|
-
|
|
404
|
-
recovery:
|
|
405
|
-
auto_restore: true
|
|
406
|
-
verification_checks: 5 # 5 successful health checks = back online
|
|
407
|
-
gradual_traffic_shift: true # Slowly shift traffic back to lab
|
|
408
|
-
```
|
|
409
|
-
|
|
410
|
-
---
|
|
411
|
-
|
|
412
|
-
## π Additional Critical Features
|
|
413
|
-
|
|
414
|
-
### **1. Node Discovery Protocol**
|
|
415
|
-
|
|
416
|
-
```yaml
|
|
417
|
-
discovery:
|
|
418
|
-
protocol: "dns-sd" # DNS Service Discovery
|
|
419
|
-
master_registry: "https://master.genobank.io/api/v1/nodes"
|
|
420
|
-
|
|
421
|
-
node_announcement:
|
|
422
|
-
interval: "5m"
|
|
423
|
-
payload:
|
|
424
|
-
- node_id
|
|
425
|
-
- capabilities
|
|
426
|
-
- available_datasets
|
|
427
|
-
- health_status
|
|
428
|
-
- geographic_location
|
|
429
|
-
- supported_protocols
|
|
430
|
-
|
|
431
|
-
client_discovery:
|
|
432
|
-
methods:
|
|
433
|
-
- "query_master" # Ask master for node list
|
|
434
|
-
- "dns_lookup" # DNS SRV records
|
|
435
|
-
- "multicast" # mDNS (local network)
|
|
436
|
-
```
|
|
437
|
-
|
|
438
|
-
**Example Client Usage**:
|
|
439
|
-
```bash
|
|
440
|
-
# Discover all nodes in network
|
|
441
|
-
biofs nodes discover
|
|
442
|
-
|
|
443
|
-
Output:
|
|
444
|
-
ββββββββββββββββββ¬βββββββββββββββββββββββββββ¬βββββββββββ¬βββββββββββββ
|
|
445
|
-
β Lab β URL β Datasets β Status β
|
|
446
|
-
ββββββββββββββββββΌβββββββββββββββββββββββββββΌβββββββββββΌβββββββββββββ€
|
|
447
|
-
β AUGenomics β https://node.aug.org β 1,500 β β
Online β
|
|
448
|
-
β UCSF Med β https://node.ucsf.edu β 3,200 β β
Online β
|
|
449
|
-
β Mayo Clinic β https://node.mayo.org β 5,000 β β οΈ Degradedβ
|
|
450
|
-
β GenoBank.io β https://master.genobank β 10,000 β β
Online β
|
|
451
|
-
ββββββββββββββββββ΄βββββββββββββββββββββββββββ΄βββββββββββ΄βββββββββββββ
|
|
452
|
-
|
|
453
|
-
# Connect to specific node
|
|
454
|
-
biofs config set-node https://node.aug.org
|
|
455
|
-
```
|
|
456
|
-
|
|
457
|
-
---
|
|
458
|
-
|
|
459
|
-
### **2. Unified Audit Trail**
|
|
460
|
-
|
|
461
|
-
```yaml
|
|
462
|
-
audit:
|
|
463
|
-
enabled: true
|
|
464
|
-
centralized_logging: true
|
|
465
|
-
master_aggregation: true
|
|
466
|
-
|
|
467
|
-
log_events:
|
|
468
|
-
- file_access
|
|
469
|
-
- license_verification
|
|
470
|
-
- quota_usage
|
|
471
|
-
- nft_minting
|
|
472
|
-
- api_calls
|
|
473
|
-
- failover_events
|
|
474
|
-
|
|
475
|
-
destinations:
|
|
476
|
-
- type: "local"
|
|
477
|
-
path: "/var/log/biofs-node/audit.jsonl"
|
|
478
|
-
|
|
479
|
-
- type: "master"
|
|
480
|
-
endpoint: "https://master.genobank.io/api/v1/audit"
|
|
481
|
-
batch_size: 1000
|
|
482
|
-
interval: "1m"
|
|
483
|
-
|
|
484
|
-
- type: "elasticsearch"
|
|
485
|
-
url: "https://logs.genobank.io"
|
|
486
|
-
index: "biofs-audit-{date}"
|
|
487
|
-
|
|
488
|
-
retention:
|
|
489
|
-
local: "90 days" # 3 months local
|
|
490
|
-
master: "7 years" # GDPR compliance
|
|
491
|
-
```
|
|
492
|
-
|
|
493
|
-
**Audit Log Format**:
|
|
494
|
-
```json
|
|
495
|
-
{
|
|
496
|
-
"timestamp": "2025-10-24T13:45:00Z",
|
|
497
|
-
"node_id": "augenomics",
|
|
498
|
-
"node_type": "lab",
|
|
499
|
-
"event_type": "file_access",
|
|
500
|
-
"researcher": "0xDrClaudia...",
|
|
501
|
-
"action": "download",
|
|
502
|
-
"resource": "biocid://0x.../vcf/genome-123.vcf",
|
|
503
|
-
"license_verified": true,
|
|
504
|
-
"license_token_id": 40447,
|
|
505
|
-
"consent_given": true,
|
|
506
|
-
"consent_timestamp": "2025-10-24T10:00:00Z",
|
|
507
|
-
"ip_address": "203.0.113.45",
|
|
508
|
-
"user_agent": "biofs-cli/1.6.2",
|
|
509
|
-
"bytes_transferred": 1073741824,
|
|
510
|
-
"duration_ms": 45000,
|
|
511
|
-
"status": "success",
|
|
512
|
-
"sponsored_by": "lab" // or "master" or "self"
|
|
513
|
-
}
|
|
514
|
-
```
|
|
515
|
-
|
|
516
|
-
---
|
|
517
|
-
|
|
518
|
-
### **3. Cost Accounting & Billing**
|
|
519
|
-
|
|
520
|
-
```yaml
|
|
521
|
-
accounting:
|
|
522
|
-
enabled: true
|
|
523
|
-
track_costs: true
|
|
524
|
-
|
|
525
|
-
cost_centers:
|
|
526
|
-
anthropic_api:
|
|
527
|
-
cost_per_1k_tokens:
|
|
528
|
-
input: 0.003
|
|
529
|
-
output: 0.015
|
|
530
|
-
|
|
531
|
-
story_protocol:
|
|
532
|
-
estimated_gas_per_mint: 0.002 ETH
|
|
533
|
-
eth_usd_rate_source: "coinbase"
|
|
534
|
-
|
|
535
|
-
storage:
|
|
536
|
-
cost_per_gb_month: 0.023
|
|
537
|
-
|
|
538
|
-
bandwidth:
|
|
539
|
-
cost_per_gb: 0.09
|
|
540
|
-
|
|
541
|
-
billing:
|
|
542
|
-
interval: "monthly"
|
|
543
|
-
invoices_to:
|
|
544
|
-
- lab_admin_email
|
|
545
|
-
payment_methods:
|
|
546
|
-
- "invoice"
|
|
547
|
-
- "crypto" # Pay in ETH/USDC
|
|
548
|
-
```
|
|
549
|
-
|
|
550
|
-
**Monthly Invoice Example**:
|
|
551
|
-
```
|
|
552
|
-
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
553
|
-
β GenoBank.io - BioFS Network Services Invoice β
|
|
554
|
-
β October 2025 β
|
|
555
|
-
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€
|
|
556
|
-
β β
|
|
557
|
-
β Lab: AUGenomics Genomics Core β
|
|
558
|
-
β Node ID: augenomics β
|
|
559
|
-
β Billing Period: Oct 1 - Oct 31, 2025 β
|
|
560
|
-
β β
|
|
561
|
-
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€
|
|
562
|
-
β Sponsored Services Used: β
|
|
563
|
-
β β
|
|
564
|
-
β Anthropic API (fallback to master): β
|
|
565
|
-
β - Input tokens: 2.5M @ $0.003/1k = $7.50 β
|
|
566
|
-
β - Output tokens: 500k @ $0.015/1k = $7.50 β
|
|
567
|
-
β Subtotal: $15.00 β
|
|
568
|
-
β β
|
|
569
|
-
β Story Protocol Gas (fallback to master): β
|
|
570
|
-
β - 25 NFT mints @ 0.002 ETH = 0.05 ETH β
|
|
571
|
-
β - ETH/USD rate: $2,500 β
|
|
572
|
-
β Subtotal: $125.00β
|
|
573
|
-
β β
|
|
574
|
-
β Data Replication: β
|
|
575
|
-
β - Storage: 500 GB @ $0.023/GB = $11.50 β
|
|
576
|
-
β - Bandwidth: 150 GB @ $0.09/GB = $13.50 β
|
|
577
|
-
β Subtotal: $25.00 β
|
|
578
|
-
β β
|
|
579
|
-
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€
|
|
580
|
-
β Total Due: $165.00 β
|
|
581
|
-
β Due Date: November 15, 2025 β
|
|
582
|
-
β β
|
|
583
|
-
β Payment Options: β
|
|
584
|
-
β - Bank transfer (USD) β
|
|
585
|
-
β - Crypto: 0.066 ETH or 165 USDC β
|
|
586
|
-
β - Send to: 0xGenoBank... β
|
|
587
|
-
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
588
|
-
```
|
|
589
|
-
|
|
590
|
-
---
|
|
591
|
-
|
|
592
|
-
### **4. Researcher Quota Management**
|
|
593
|
-
|
|
594
|
-
```yaml
|
|
595
|
-
quotas:
|
|
596
|
-
default_per_researcher:
|
|
597
|
-
anthropic_tokens_per_month: 100000 # 100k tokens
|
|
598
|
-
story_protocol_mints_per_month: 10
|
|
599
|
-
storage_gb: 50
|
|
600
|
-
bandwidth_gb_per_month: 500
|
|
601
|
-
|
|
602
|
-
quota_tiers:
|
|
603
|
-
free:
|
|
604
|
-
anthropic_tokens_per_month: 50000
|
|
605
|
-
story_protocol_mints_per_month: 5
|
|
606
|
-
storage_gb: 10
|
|
607
|
-
bandwidth_gb_per_month: 100
|
|
608
|
-
|
|
609
|
-
basic:
|
|
610
|
-
anthropic_tokens_per_month: 200000
|
|
611
|
-
story_protocol_mints_per_month: 20
|
|
612
|
-
storage_gb: 100
|
|
613
|
-
bandwidth_gb_per_month: 1000
|
|
614
|
-
|
|
615
|
-
premium:
|
|
616
|
-
anthropic_tokens_per_month: 1000000
|
|
617
|
-
story_protocol_mints_per_month: 100
|
|
618
|
-
storage_gb: 1000
|
|
619
|
-
bandwidth_gb_per_month: 10000
|
|
620
|
-
|
|
621
|
-
vip:
|
|
622
|
-
anthropic_tokens_per_month: unlimited
|
|
623
|
-
story_protocol_mints_per_month: unlimited
|
|
624
|
-
storage_gb: unlimited
|
|
625
|
-
bandwidth_gb_per_month: unlimited
|
|
626
|
-
|
|
627
|
-
enforcement:
|
|
628
|
-
soft_limit: 0.8 # Warn at 80%
|
|
629
|
-
hard_limit: 1.0 # Block at 100%
|
|
630
|
-
grace_period: "48h" # Allow 48h over limit before blocking
|
|
631
|
-
|
|
632
|
-
notifications:
|
|
633
|
-
warn_at: [0.5, 0.8, 0.9] # 50%, 80%, 90%
|
|
634
|
-
notify_methods: ["email", "cli"]
|
|
635
|
-
```
|
|
636
|
-
|
|
637
|
-
**CLI Quota Check**:
|
|
638
|
-
```bash
|
|
639
|
-
biofs quota check
|
|
640
|
-
|
|
641
|
-
Output:
|
|
642
|
-
βββββββββββββββββββββββ¬βββββββββββββ¬ββββββββββββ¬ββββββββββ
|
|
643
|
-
β Resource β Used β Limit β Status β
|
|
644
|
-
βββββββββββββββββββββββΌβββββββββββββΌββββββββββββΌββββββββββ€
|
|
645
|
-
β Anthropic Tokens β 75k β 100k β β
75% β
|
|
646
|
-
β Story NFT Mints β 8 β 10 β β οΈ 80% β
|
|
647
|
-
β Storage β 35 GB β 50 GB β β
70% β
|
|
648
|
-
β Bandwidth (month) β 450 GB β 500 GB β β οΈ 90% β
|
|
649
|
-
βββββββββββββββββββββββ΄βββββββββββββ΄ββββββββββββ΄ββββββββββ
|
|
650
|
-
|
|
651
|
-
π‘ Tip: Upgrade to 'basic' tier for 2x quota
|
|
652
|
-
```
|
|
653
|
-
|
|
654
|
-
---
|
|
655
|
-
|
|
656
|
-
### **5. Cross-Node License Verification**
|
|
657
|
-
|
|
658
|
-
**Problem**: Dr. Claudia has license token from AUGenomics, but wants to access file hosted on UCSF node.
|
|
659
|
-
|
|
660
|
-
**Solution**: License Token Propagation Protocol
|
|
661
|
-
|
|
662
|
-
```yaml
|
|
663
|
-
license_propagation:
|
|
664
|
-
enabled: true
|
|
665
|
-
protocol: "story-protocol-federation"
|
|
666
|
-
|
|
667
|
-
verification_flow:
|
|
668
|
-
- researcher_requests_file_from_node_b
|
|
669
|
-
- node_b_checks_local_license_cache
|
|
670
|
-
- if_not_found_query_master_registry
|
|
671
|
-
- master_verifies_token_on_story_protocol
|
|
672
|
-
- master_caches_verification_result
|
|
673
|
-
- node_b_caches_result_locally
|
|
674
|
-
- node_b_serves_file_if_authorized
|
|
675
|
-
|
|
676
|
-
cache:
|
|
677
|
-
ttl: "1h"
|
|
678
|
-
invalidate_on_revocation: true
|
|
679
|
-
refresh_interval: "5m"
|
|
680
|
-
```
|
|
681
|
-
|
|
682
|
-
**Flow Diagram**:
|
|
683
|
-
```
|
|
684
|
-
Dr. Claudia AUGenomics Master Node UCSF Node
|
|
685
|
-
β β β β
|
|
686
|
-
ββββ Grant License βββββββ>β β β
|
|
687
|
-
β<ββββ Token 40447 βββββββββ β β
|
|
688
|
-
β β β β
|
|
689
|
-
ββββββββββββ Request UCSF File βββββββββββββββββββββββββββββββββββββββ>β
|
|
690
|
-
β β β β
|
|
691
|
-
β β β<β Verify Token? βββ
|
|
692
|
-
β β β β
|
|
693
|
-
β β<ββββ Query Token βββββββ β
|
|
694
|
-
β βββββ Token Valid ββββββ>β β
|
|
695
|
-
β β β β
|
|
696
|
-
β β ββββ Authorized ββββ>β
|
|
697
|
-
β<ββββββββββββββββββββββββ File Stream βββββββββββββββββββββββββββββββββ
|
|
698
|
-
```
|
|
699
|
-
|
|
700
|
-
---
|
|
701
|
-
|
|
702
|
-
### **6. Node Health Monitoring**
|
|
703
|
-
|
|
704
|
-
```yaml
|
|
705
|
-
monitoring:
|
|
706
|
-
health_checks:
|
|
707
|
-
interval: "30s"
|
|
708
|
-
timeout: "10s"
|
|
709
|
-
|
|
710
|
-
checks:
|
|
711
|
-
- type: "http_ping"
|
|
712
|
-
endpoint: "/health"
|
|
713
|
-
expected_status: 200
|
|
714
|
-
|
|
715
|
-
- type: "storage_available"
|
|
716
|
-
min_free_gb: 100
|
|
717
|
-
|
|
718
|
-
- type: "api_latency"
|
|
719
|
-
max_ms: 2000
|
|
720
|
-
|
|
721
|
-
- type: "replication_lag"
|
|
722
|
-
max_hours: 2
|
|
723
|
-
|
|
724
|
-
- type: "anthropic_api_available"
|
|
725
|
-
test_request: true
|
|
726
|
-
|
|
727
|
-
- type: "story_protocol_executor"
|
|
728
|
-
balance_check: true
|
|
729
|
-
min_balance_eth: 0.1
|
|
730
|
-
|
|
731
|
-
metrics:
|
|
732
|
-
prometheus_enabled: true
|
|
733
|
-
port: 9090
|
|
734
|
-
|
|
735
|
-
exported_metrics:
|
|
736
|
-
- node_status
|
|
737
|
-
- request_rate
|
|
738
|
-
- error_rate
|
|
739
|
-
- quota_usage
|
|
740
|
-
- storage_used
|
|
741
|
-
- bandwidth_used
|
|
742
|
-
- api_latency_p95
|
|
743
|
-
- replication_lag_seconds
|
|
744
|
-
- anthropic_tokens_used
|
|
745
|
-
- story_mints_count
|
|
746
|
-
|
|
747
|
-
alerts:
|
|
748
|
-
- name: "node_offline"
|
|
749
|
-
condition: "node_status == 0"
|
|
750
|
-
severity: "critical"
|
|
751
|
-
notify: ["email", "pagerduty"]
|
|
752
|
-
|
|
753
|
-
- name: "high_error_rate"
|
|
754
|
-
condition: "error_rate > 0.05" # 5%
|
|
755
|
-
severity: "warning"
|
|
756
|
-
notify: ["slack"]
|
|
757
|
-
|
|
758
|
-
- name: "quota_exceeded"
|
|
759
|
-
condition: "quota_usage > 0.9" # 90%
|
|
760
|
-
severity: "info"
|
|
761
|
-
notify: ["email"]
|
|
762
|
-
```
|
|
763
|
-
|
|
764
|
-
---
|
|
765
|
-
|
|
766
|
-
### **7. Node Registration & Onboarding**
|
|
767
|
-
|
|
768
|
-
```bash
|
|
769
|
-
# Lab admin registers new node with master
|
|
770
|
-
biofs-node register \
|
|
771
|
-
--name "AUGenomics Genomics Core" \
|
|
772
|
-
--wallet 0xAUGenomics... \
|
|
773
|
-
--bucket s3://augenomics-genomics \
|
|
774
|
-
--master https://master.genobank.io \
|
|
775
|
-
--sponsored-services anthropic,story
|
|
776
|
-
|
|
777
|
-
Output:
|
|
778
|
-
β
Node registered successfully
|
|
779
|
-
Node ID: augenomics
|
|
780
|
-
Registration Token: eyJ...
|
|
781
|
-
|
|
782
|
-
Next steps:
|
|
783
|
-
1. Configure node: biofs-node config edit
|
|
784
|
-
2. Start node: biofs-node start
|
|
785
|
-
3. Verify health: biofs-node health check
|
|
786
|
-
4. Add researchers: biofs-node researchers add 0xDrClaudia...
|
|
787
|
-
```
|
|
788
|
-
|
|
789
|
-
**Registration API**:
|
|
790
|
-
```typescript
|
|
791
|
-
POST /master/labs/register
|
|
792
|
-
{
|
|
793
|
-
"name": "AUGenomics Genomics Core",
|
|
794
|
-
"wallet": "0xAUGenomics...",
|
|
795
|
-
"admin_email": "admin@augenomics.org",
|
|
796
|
-
"storage": {
|
|
797
|
-
"bucket": "s3://augenomics-genomics",
|
|
798
|
-
"region": "us-east-1",
|
|
799
|
-
"size_gb": 5000
|
|
800
|
-
},
|
|
801
|
-
"sponsored_services": ["anthropic", "story"],
|
|
802
|
-
"replication_enabled": true,
|
|
803
|
-
"discovery_enabled": true
|
|
804
|
-
}
|
|
805
|
-
|
|
806
|
-
Response:
|
|
807
|
-
{
|
|
808
|
-
"node_id": "augenomics",
|
|
809
|
-
"registration_token": "eyJ...",
|
|
810
|
-
"master_url": "https://master.genobank.io",
|
|
811
|
-
"config_template": "https://master.genobank.io/config/augenomics.yaml",
|
|
812
|
-
"status": "pending_verification"
|
|
813
|
-
}
|
|
814
|
-
```
|
|
815
|
-
|
|
816
|
-
---
|
|
817
|
-
|
|
818
|
-
### **8. Researcher Roaming**
|
|
819
|
-
|
|
820
|
-
**Single Sign-On Across Nodes**:
|
|
821
|
-
```yaml
|
|
822
|
-
authentication:
|
|
823
|
-
sso_enabled: true
|
|
824
|
-
provider: "story-protocol" # Use Story Protocol as identity
|
|
825
|
-
|
|
826
|
-
workflow:
|
|
827
|
-
- researcher_signs_message_with_wallet
|
|
828
|
-
- master_verifies_signature
|
|
829
|
-
- master_issues_jwt_token
|
|
830
|
-
- token_valid_across_all_nodes
|
|
831
|
-
- nodes_verify_token_with_master
|
|
832
|
-
|
|
833
|
-
token:
|
|
834
|
-
issuer: "master.genobank.io"
|
|
835
|
-
algorithm: "RS256"
|
|
836
|
-
expiry: "24h"
|
|
837
|
-
|
|
838
|
-
claims:
|
|
839
|
-
- wallet_address
|
|
840
|
-
- story_licenses
|
|
841
|
-
- quota_tier
|
|
842
|
-
- affiliated_labs
|
|
843
|
-
```
|
|
844
|
-
|
|
845
|
-
**User Experience**:
|
|
846
|
-
```bash
|
|
847
|
-
# Login once
|
|
848
|
-
biofs login --wallet 0xDrClaudia...
|
|
849
|
-
β
Authenticated with GenoBank Network
|
|
850
|
-
|
|
851
|
-
# Access any node transparently
|
|
852
|
-
biofs download biocid://augenomics/genome1.vcf # AUGenomics node
|
|
853
|
-
biofs download biocid://ucsf/genome2.vcf # UCSF node
|
|
854
|
-
biofs download biocid://mayo/genome3.vcf # Mayo node
|
|
855
|
-
|
|
856
|
-
# All work with same login!
|
|
857
|
-
```
|
|
858
|
-
|
|
859
|
-
---
|
|
860
|
-
|
|
861
|
-
## ποΈ Configuration Examples
|
|
862
|
-
|
|
863
|
-
### **Master Node Configuration**
|
|
864
|
-
|
|
865
|
-
```yaml
|
|
866
|
-
# /etc/biofs/master-node.yaml
|
|
867
|
-
node:
|
|
868
|
-
type: master
|
|
869
|
-
name: "GenoBank.io Master Node"
|
|
870
|
-
wallet: "0xGenoBank..."
|
|
871
|
-
url: "https://master.genobank.io"
|
|
872
|
-
|
|
873
|
-
services:
|
|
874
|
-
anthropic:
|
|
875
|
-
enabled: true
|
|
876
|
-
api_key_env: "GENOBANK_ANTHROPIC_KEY"
|
|
877
|
-
fallback_for_labs: true
|
|
878
|
-
global_quota_per_month: 100000000 # 100M tokens for entire network
|
|
879
|
-
|
|
880
|
-
story_protocol:
|
|
881
|
-
enabled: true
|
|
882
|
-
executor_key_env: "GENOBANK_EXECUTOR_KEY"
|
|
883
|
-
lab_wallet: "0xGenoBank..."
|
|
884
|
-
fallback_for_labs: true
|
|
885
|
-
global_gas_budget_per_month: 10.0 ETH
|
|
886
|
-
|
|
887
|
-
storage:
|
|
888
|
-
primary: "s3://vault.genobank.io/master/"
|
|
889
|
-
replicas:
|
|
890
|
-
- location: "us-west-2"
|
|
891
|
-
bucket: "s3://vault-replica-west.genobank.io/"
|
|
892
|
-
- location: "eu-central-1"
|
|
893
|
-
bucket: "s3://vault-replica-eu.genobank.io/"
|
|
894
|
-
|
|
895
|
-
labs:
|
|
896
|
-
max_labs: 1000
|
|
897
|
-
auto_approve: false # Manual approval required
|
|
898
|
-
onboarding:
|
|
899
|
-
require_contract: true
|
|
900
|
-
require_billing_info: true
|
|
901
|
-
|
|
902
|
-
monitoring:
|
|
903
|
-
prometheus: true
|
|
904
|
-
grafana: true
|
|
905
|
-
alertmanager: true
|
|
906
|
-
|
|
907
|
-
database:
|
|
908
|
-
type: "postgresql"
|
|
909
|
-
url: "postgres://master.genobank.io/biofs"
|
|
910
|
-
replicas: 3
|
|
911
|
-
```
|
|
912
|
-
|
|
913
|
-
### **Lab Node Configuration**
|
|
914
|
-
|
|
915
|
-
```yaml
|
|
916
|
-
# /etc/biofs/augenomics-node.yaml
|
|
917
|
-
node:
|
|
918
|
-
type: lab
|
|
919
|
-
id: "augenomics"
|
|
920
|
-
name: "AUGenomics Genomics Core"
|
|
921
|
-
wallet: "0xAUGenomics..."
|
|
922
|
-
url: "https://node.augenomics.org"
|
|
923
|
-
|
|
924
|
-
master:
|
|
925
|
-
url: "https://master.genobank.io"
|
|
926
|
-
registration_token: "eyJ..."
|
|
927
|
-
|
|
928
|
-
storage:
|
|
929
|
-
bucket: "s3://augenomics-genomics"
|
|
930
|
-
region: "us-east-1"
|
|
931
|
-
|
|
932
|
-
replication:
|
|
933
|
-
enabled: true
|
|
934
|
-
to_master: true
|
|
935
|
-
schedule: "0 * * * *" # Every hour
|
|
936
|
-
|
|
937
|
-
services:
|
|
938
|
-
# Optional: Provide own Anthropic key
|
|
939
|
-
anthropic:
|
|
940
|
-
sponsored: true
|
|
941
|
-
api_key_env: "AUGENOMICS_ANTHROPIC_KEY" # Lab pays
|
|
942
|
-
quota_per_researcher_per_month: 500000
|
|
943
|
-
fallback_to_master: true # If quota exceeded, use master
|
|
944
|
-
|
|
945
|
-
# Optional: Provide own Story Protocol executor
|
|
946
|
-
story_protocol:
|
|
947
|
-
sponsored: true
|
|
948
|
-
executor_key_env: "AUGENOMICS_EXECUTOR_KEY" # Lab pays gas
|
|
949
|
-
lab_wallet: "0xAUGenomics..."
|
|
950
|
-
fallback_to_master: true # If gas quota exceeded, use master
|
|
951
|
-
|
|
952
|
-
researchers:
|
|
953
|
-
- wallet: "0xDrClaudia..."
|
|
954
|
-
name: "Dr. Claudia Gonzaga-Jauregui"
|
|
955
|
-
role: "principal_investigator"
|
|
956
|
-
quota_tier: "vip"
|
|
957
|
-
|
|
958
|
-
- wallet: "0xDrSmith..."
|
|
959
|
-
name: "Dr. John Smith"
|
|
960
|
-
role: "postdoc"
|
|
961
|
-
quota_tier: "basic"
|
|
962
|
-
|
|
963
|
-
api:
|
|
964
|
-
port: 8080
|
|
965
|
-
cors_origins:
|
|
966
|
-
- "https://lab.augenomics.org"
|
|
967
|
-
rate_limit: 100 # requests per minute per researcher
|
|
968
|
-
```
|
|
969
|
-
|
|
970
|
-
---
|
|
971
|
-
|
|
972
|
-
## π Implementation Phases
|
|
973
|
-
|
|
974
|
-
### **Phase 1: Core Node Infrastructure** (Week 1-2)
|
|
975
|
-
|
|
976
|
-
**Deliverables**:
|
|
977
|
-
- β
`biofs-node` package with master/lab modes
|
|
978
|
-
- β
Basic API for file serving
|
|
979
|
-
- β
Node registration with master
|
|
980
|
-
- β
Health monitoring
|
|
981
|
-
|
|
982
|
-
**Commands**:
|
|
983
|
-
```bash
|
|
984
|
-
npm install -g @genobank/biofs-node
|
|
985
|
-
|
|
986
|
-
# Master node
|
|
987
|
-
biofs-node init --type master --config master.yaml
|
|
988
|
-
biofs-node start
|
|
989
|
-
|
|
990
|
-
# Lab node
|
|
991
|
-
biofs-node init --type lab --config augenomics.yaml
|
|
992
|
-
biofs-node start
|
|
993
|
-
```
|
|
994
|
-
|
|
995
|
-
---
|
|
996
|
-
|
|
997
|
-
### **Phase 2: Sponsored Services** (Week 3)
|
|
998
|
-
|
|
999
|
-
**Deliverables**:
|
|
1000
|
-
- β
Anthropic API proxy with quota management
|
|
1001
|
-
- β
Story Protocol executor proxy
|
|
1002
|
-
- β
Fallback logic (lab β master)
|
|
1003
|
-
- β
Cost tracking
|
|
1004
|
-
|
|
1005
|
-
---
|
|
1006
|
-
|
|
1007
|
-
### **Phase 3: Data Replication** (Week 4)
|
|
1008
|
-
|
|
1009
|
-
**Deliverables**:
|
|
1010
|
-
- β
S3 sync to master
|
|
1011
|
-
- β
Incremental replication
|
|
1012
|
-
- β
Failover mechanism
|
|
1013
|
-
- β
Replica health checks
|
|
1014
|
-
|
|
1015
|
-
---
|
|
1016
|
-
|
|
1017
|
-
### **Phase 4: Advanced Features** (Week 5-6)
|
|
1018
|
-
|
|
1019
|
-
**Deliverables**:
|
|
1020
|
-
- β
Cross-node license verification
|
|
1021
|
-
- β
Researcher roaming (SSO)
|
|
1022
|
-
- β
Unified audit trail
|
|
1023
|
-
- β
Billing & accounting
|
|
1024
|
-
|
|
1025
|
-
---
|
|
1026
|
-
|
|
1027
|
-
## π― Feature Checklist
|
|
1028
|
-
|
|
1029
|
-
### **Must Have (MVP)**
|
|
1030
|
-
- [x] Master node / lab node separation
|
|
1031
|
-
- [x] Anthropic API sponsorship with fallback
|
|
1032
|
-
- [x] Story Protocol gas sponsorship with fallback
|
|
1033
|
-
- [x] S3 data replication to master
|
|
1034
|
-
- [x] Basic failover (master serves if lab offline)
|
|
1035
|
-
- [x] Node registration API
|
|
1036
|
-
- [x] Health monitoring
|
|
1037
|
-
- [x] Quota management
|
|
1038
|
-
|
|
1039
|
-
### **Should Have (V1)**
|
|
1040
|
-
- [ ] Cross-node license verification
|
|
1041
|
-
- [ ] Researcher roaming (SSO)
|
|
1042
|
-
- [ ] Unified audit trail
|
|
1043
|
-
- [ ] Cost accounting & billing
|
|
1044
|
-
- [ ] Node discovery protocol
|
|
1045
|
-
- [ ] Gradual failover with traffic shifting
|
|
1046
|
-
- [ ] Multi-region master replicas
|
|
1047
|
-
|
|
1048
|
-
### **Nice to Have (V2)**
|
|
1049
|
-
- [ ] Real-time node metrics dashboard
|
|
1050
|
-
- [ ] Automated node provisioning
|
|
1051
|
-
- [ ] Geographic routing (nearest node)
|
|
1052
|
-
- [ ] Peer-to-peer node federation
|
|
1053
|
-
- [ ] Blockchain-based node registry
|
|
1054
|
-
- [ ] Decentralized storage (IPFS backup)
|
|
1055
|
-
|
|
1056
|
-
---
|
|
1057
|
-
|
|
1058
|
-
## π Outstanding Questions
|
|
1059
|
-
|
|
1060
|
-
1. **Billing Model**: Should labs pay monthly subscription or per-usage?
|
|
1061
|
-
2. **Data Sovereignty**: Can labs opt-out of replication to master?
|
|
1062
|
-
3. **Researcher Quotas**: Who sets limits - lab admin or master admin?
|
|
1063
|
-
4. **Failover SLA**: What uptime guarantee do we promise?
|
|
1064
|
-
5. **Cross-Border Data**: How to handle GDPR/HIPAA for international nodes?
|
|
1065
|
-
6. **Node Certification**: Should labs be audited before joining network?
|
|
1066
|
-
7. **Dispute Resolution**: What if researcher and lab disagree on quota?
|
|
1067
|
-
8. **Emergency Shutdown**: Can master force-disable a misbehaving lab node?
|
|
1068
|
-
|
|
1069
|
-
---
|
|
1070
|
-
|
|
1071
|
-
**What do you think? Any features missing? Ready to implement Phase 1?**
|