openzoo 0.49.8 → 0.49.10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,132 @@
1
+ # modelroute — current state
2
+
3
+ _Snapshot: 2026-08-20. Read `HANDOFF.md` for how to integrate; this file is what is true, what is
4
+ guessed, and what is unfinished._
5
+
6
+ ---
7
+
8
+ ## Status at a glance
9
+
10
+ | part | state |
11
+ |---|---|
12
+ | Router runtime (`route()`) | **working**, 22 contract tests + module selftest green |
13
+ | Catalogue (414 gateway-callable models) | **working**, rebuilt from the gateway, 11 KB |
14
+ | Task classifier (10 classes) | **working**, 0.642 held-out / 0.772 5-fold, 40 KB |
15
+ | End-to-end CLI (`ask.py`) | **working** — routes, calls openzoo, records outcome |
16
+ | `P_success` measured on real models | **in progress** — hard-suite run ~20% done |
17
+ | Base-suite outcomes | **discarded** (saturated, low-n) — kept at `outcomes.base.json.bak` |
18
+ | Vision / creative / advice classes | **never measured** — no objective grader, prior only |
19
+
20
+ The router works today on priors. It works *better* the moment the hard-suite run lands and every
21
+ time you record a real outcome.
22
+
23
+ ---
24
+
25
+ ## What is measured vs. what is authored
26
+
27
+ This distinction is the whole point of the design. Do not blur it.
28
+
29
+ ### MEASURED (evidence)
30
+
31
+ - **Classifier accuracy.** 0.642 on a register-shifted held-out split, against a bag-of-words
32
+ baseline at 0.333 and majority at 0.100. Ablated: ridge head +0.12 over perceptron, hashed IDF
33
+ +0.09, anchor gazetteer +0.075. Caveat: anchors were written *after* inspecting held-out errors,
34
+ so 0.642 is optimistically biased. The 5-fold number (0.772) is clean.
35
+ - **Routing regret.** 5.0% of held-out requests route below the bar their true class demands, at a
36
+ median 1.12× the oracle route's cost. The top-2 hedge causes that: hedge off gives 13.3% under-bar
37
+ at 1.00× cost. Ability bought with money, as the objective asks.
38
+ - **Model success rates.** In progress. See below.
39
+
40
+ ### AUTHORED (policy, not evidence — argue with these)
41
+
42
+ - **`_BAR`** — the required `P_success` per (class, difficulty). The single most important knob.
43
+ - **`_OUT_TOKENS`** — expected completion length per class. Cost is linear in it.
44
+ - **`_CLASS_CATEGORIES`** — which OpenRouter leaderboards count as evidence for which task class.
45
+ `vision` uses `technology` as an explicit *proxy* (there is no vision leaderboard); `bulk` maps to
46
+ nothing on purpose, so its objective degenerates to "cheapest feasible", which is correct for it.
47
+ - **`P_TOP/P_BOT/P_UNKNOWN`** — how a leaderboard rank becomes a probability, and what an unranked
48
+ model is assumed to be worth (0.45, deliberately below every bar except bulk/chat).
49
+ - **`BIND_ABOVE_TOKENS` (60k), `BIND_SLICE_TOKENS` (8k)** — when to bind instead of buying context.
50
+ - **`difficulty()`** — a 3-signal heuristic (rigour cues, long input, low classifier margin). There
51
+ are no difficulty labels in the corpus, so a trained head here would be a guess in a lab coat.
52
+
53
+ ---
54
+
55
+ ## The measurement run
56
+
57
+ **Hard suite** (`suite_hard.py`): 64 tasks, every answer key **computed by the generator** and
58
+ verified before spending — a reference answer must pass the real grader and a wrong answer must fail
59
+ it. 5 classes: reasoning (24), agentic (12), longctx (10), bulk (10), code (8).
60
+
61
+ It discriminates, which the base suite did not:
62
+
63
+ | class | pass rate across models so far |
64
+ |---|---|
65
+ | agentic | 0.96 |
66
+ | longctx | 0.88 |
67
+ | code | 0.79 |
68
+ | reasoning | 0.67 |
69
+ | bulk | 0.54 |
70
+
71
+ Model spread so far runs 0.60 → 0.95 (vs. the base suite, where 30 of 124 models tied at a perfect
72
+ 1.00 and it could not rank anything above the floor).
73
+
74
+ **Run state:** ~1,200 of 6,336 calls, 20 of 99 models, ~$5 spent, ~4 calls/s, ETA well under an hour.
75
+ Restart with the same command and `--resume` — it skips completed calls and *retries* errored ones.
76
+
77
+ ### Why 99 models, not 414
78
+
79
+ 409 models is not 409 pieces of information. `gpt-5.6-luna/sol/terra` scored identically; so did the
80
+ `deepseek-v4-flash` and `gemini-3.x-flash` families. A fixed budget is models × tasks, and redundant
81
+ variants buy nothing while every per-class estimate stays at n≈4 — a 95% CI **0.5 wide**, wider than
82
+ the entire range the router cares about. `--per-provider 2` takes each provider's flagship (by
83
+ leaderboard placement, then capability) plus its cheapest option. Same money, 10× the depth.
84
+
85
+ ### Statistical power, plainly
86
+
87
+ | tasks per model | 95% CI width at p≈0.9 |
88
+ |---|---|
89
+ | 5 | 0.59 |
90
+ | 10 | 0.39 |
91
+ | 30 | 0.22 |
92
+ | 64 (hard suite) | ~0.18 overall, but only ~n=10–24 *per class* |
93
+
94
+ **Per-class estimates are still thin.** Overall model quality is now solidly measured; a
95
+ per-(class, model) number at n=10 still leans on the prior. If you need per-class confidence, add
96
+ tasks to that class in `suite_hard.py` — the generators make that cheap and key-safe.
97
+
98
+ ---
99
+
100
+ ## Known weaknesses (ranked by how much they should bother you)
101
+
102
+ 1. **Three classes are never measured.** `creative`, `advice` and `vision` have no objective grader
103
+ (`vision` also needs image fixtures). They run on the leaderboard prior and always will until
104
+ someone decides what "good" means for them. An LLM judge was rejected: it is a second opinion, not
105
+ a measurement, and it would poison the same table the benchmark fills with real results.
106
+ 2. **`code` is the worst classifier class** (0.25 on the register-shifted held-out split). Requests
107
+ like "the linter hates everything I write" share no vocabulary with the training split. The
108
+ anchor gazetteer helps; more real examples would help more.
109
+ 3. **The corpus is one person's idea of what requests look like** — 400 authored sentences. Your
110
+ actual traffic is the real distribution. Drop a JSONL at
111
+ `lecore_data/modelroute/eval_real.jsonl` (`{"text":…, "label":…}`) and `train_router.py` will
112
+ report against it automatically.
113
+ 4. **21% of gateway calls return 429.** It is a per-account limit, not a concurrency problem —
114
+ dropping from 48 to 16 workers made it *worse*. The shared throttle handles it; it costs
115
+ wall-clock, not money or correctness.
116
+ 5. **Real prompts are fragments.** In a live agent session most turns are "fix it" / "did this
117
+ work?", which carry no routable task alone. Pass the conversation as `context=`; the router will
118
+ otherwise hedge (correctly) and route as if the task were hard, which costs money.
119
+
120
+ ---
121
+
122
+ ## What I would build next, in order
123
+
124
+ 1. **Wire outcome recording into the openzoo call path.** Everything else exists. This is the step
125
+ that makes `P_success` yours instead of borrowed.
126
+ 2. **Grow `suite_hard.py` per class** until per-class n ≥ 30, using the generators (keys stay
127
+ correct by construction).
128
+ 3. **Decide what "good" means for creative/advice**, or accept them as prior-only forever and say so
129
+ in the UI.
130
+ 4. **Thompson sampling for exploration.** Right now the cheapest clearing model always wins, so the
131
+ alternatives never get observed and the table can only improve where you already route. A small
132
+ exploration budget would fix that; the Beta posteriors needed for it are already there.
@@ -0,0 +1,159 @@
1
+ # modelroute → openzoo: integration handoff
2
+
3
+ You are plugging a **task router** into the openzoo stack. Given a request, it picks the cheapest
4
+ model that will probably finish it, out of the whole gateway catalogue. Pure NumPy, 51 KB of
5
+ artifacts, no torch, no pretrained model, no network at decision time, ~2 ms per call.
6
+
7
+ ---
8
+
9
+ ## 1. The one thing to understand before you read code
10
+
11
+ The objective is **not** "which model is best". It is:
12
+
13
+ ```
14
+ argmin cost(m, task) subject to P_success(m | task) >= bar(task), m in feasible(task)
15
+ ```
16
+
17
+ If nothing clears the bar, `route()` returns the strongest option **and flags it** (`cleared_bar:
18
+ False`). Do not silently treat that as a normal answer — it means "this probably will not get done".
19
+
20
+ Consequences worth internalising:
21
+
22
+ - **Price is used in `cost()` and nowhere else.** It is never a capability proxy. If you "improve"
23
+ the scorer by letting expensive models look stronger, the objective partly cancels itself.
24
+ - **The classifier is not the product.** It picks the bar and which leaderboards to trust. The
25
+ 414-model catalogue is a lookup table, so a model added to the gateway tomorrow is routable
26
+ after a catalogue refresh with no retraining.
27
+ - **`P_success` is a Beta posterior**, prior = OpenRouter usage rank, data = your recorded outcomes.
28
+ It reports `evidence: "prior"` until you feed it results, then `measured(n=...)`.
29
+
30
+ ---
31
+
32
+ ## 2. Integration surface
33
+
34
+ ### The one call
35
+
36
+ ```python
37
+ from holographic.semantic_router.holographic_modelroute import route
38
+
39
+ r = route(
40
+ "summarise this contract and list the obligations",
41
+ allow_free=False, # exclude $0 tiers (rate limits / data policy)
42
+ bindable=True, # openzoo has a leCore bind path -> True
43
+ input_tokens=180_000, # pass it if you know it; otherwise estimated from text length
44
+ has_image=False, needs_tools=False, needs_json=False, # pass what you KNOW
45
+ context=prior_turns, # conversation so far, for fragment requests like "fix it"
46
+ )
47
+ r["model"] # -> "deepseek/deepseek-v4-flash" (a gateway model id)
48
+ r["p_success"] # -> 0.83
49
+ r["usd_per_task"] # -> 0.000161
50
+ r["bind_first"] # -> True if the input should be bound to leCore before asking
51
+ r["cleared_bar"] # -> False means "nothing was good enough; this is a fallback"
52
+ r["shortlist"] # -> ranked alternatives with cost + evidence, for a fallback chain
53
+ ```
54
+
55
+ Every return carries the same keys, including the no-feasible-model path. Loading is cheap but not
56
+ free — hold `Catalog()`, `TaskClassifier.load()` and `Outcomes()` as singletons and pass them in:
57
+
58
+ ```python
59
+ from holographic.semantic_router.holographic_modelroute import Catalog, TaskClassifier, Outcomes
60
+ CAT, CLF, OUT = Catalog(), TaskClassifier.load(), Outcomes()
61
+ r = route(text, catalog=CAT, classifier=CLF, outcomes=OUT)
62
+ ```
63
+
64
+ ### Closing the loop (this is the part that matters)
65
+
66
+ ```python
67
+ OUT.record(r["task_class"], r["model"], ok=True) # or False
68
+ ```
69
+
70
+ Without this the router can never beat its prior. With it, every real call sharpens the next
71
+ decision. `Outcomes` is a plain JSON file of `{"class|model": [successes, attempts]}` — trivially
72
+ mergeable across machines; sum the pairs.
73
+
74
+ ### Suggested openzoo shapes
75
+
76
+ 1. **A virtual model id.** `openzoo/auto` → proxy sees it, calls `route()` on the last user message
77
+ (plus prior turns as `context`), rewrites the upstream model id, records the outcome on
78
+ completion. Users get routing by typing one model name.
79
+ 2. **A sidecar endpoint.** `POST /route {text, constraints} -> {model, p, cost, shortlist}` for
80
+ anything that wants to decide for itself.
81
+ 3. **A fallback chain.** On a 429/5xx from the chosen model, walk `r["shortlist"]` — it is already
82
+ sorted cheapest-first among those clearing the bar.
83
+
84
+ **Bind-first:** when `r["bind_first"]` is true, the input is bigger than `BIND_ABOVE_TOKENS`
85
+ (60k). Bind it to leCore and ask against the retrieved slice; do **not** go shopping for a
86
+ million-token model. The gateway advertises `context_length: 128000000` because the bind path backs
87
+ it — that number is not a model window, and using it as a routing constraint makes every context
88
+ filter a lie. `max_model_len` is the real window and is what the catalogue stores.
89
+
90
+ ---
91
+
92
+ ## 3. Files
93
+
94
+ | path | role |
95
+ |---|---|
96
+ | `holographic/semantic_router/holographic_modelroute.py` | the runtime — encoder, classifier, catalogue, `route()` |
97
+ | `lecore_data/modelroute/catalog.npz` | 414 gateway-callable models: price, real window, capabilities, leaderboard ranks (11 KB) |
98
+ | `lecore_data/modelroute/router.npz` | trained classifier, int8 + IDF table (40 KB) |
99
+ | `lecore_data/modelroute/outcomes.json` | your measured success counts — **gitignored, machine-local** |
100
+ | `tools/modelroute/fetch_catalog.py` | rebuild the catalogue (gateway prices + OpenRouter capabilities/leaderboards) |
101
+ | `tools/modelroute/train_router.py` | train + measure the classifier against baselines |
102
+ | `tools/modelroute/bench_openzoo.py` | measure real models on real tasks → `outcomes.json` |
103
+ | `tools/modelroute/suite_hard.py` | the generated, key-verified probe suite |
104
+ | `tools/modelroute/ask.py` | end-to-end CLI: route → run on openzoo → record |
105
+ | `tools/modelroute/routing_regret.py` | evaluates routing in dollars and failures, not accuracy |
106
+ | `tests/test_modelroute.py` | 22 contract tests |
107
+
108
+ ### Rebuild / operate
109
+
110
+ ```bash
111
+ python3 tools/modelroute/fetch_catalog.py # refresh catalogue (do this weekly)
112
+ python3 tools/modelroute/train_router.py --ablate --export # retrain the classifier
113
+ python3 tools/modelroute/suite_hard.py --verify # prove every answer key
114
+ python3 tools/modelroute/bench_openzoo.py --suite hard --per-provider 2 --run --exec --resume
115
+ python3 tools/modelroute/bench_watch.py # live dashboard for a run
116
+ python3 -m pytest tests/test_modelroute.py
117
+ ```
118
+
119
+ The catalogue goes stale. Prices and models change; refresh it on a schedule and the router follows
120
+ automatically — nothing is retrained for a new model.
121
+
122
+ ---
123
+
124
+ ## 4. Landmines — every one of these shipped plausible wrong numbers, not an error
125
+
126
+ 1. **Negative prices.** OpenRouter meta-routers (`openrouter/auto`, `fusion`, …) price at `-1`
127
+ ("varies"); the gateway's 3× markup makes it `-3`. `isfinite()` accepts that, so they look
128
+ *cheaper than free* and win every cheapest-first route. Unknown must never read as free.
129
+ 2. **`max_tokens` starves reasoning models.** Thinking tokens bill against the same budget, so a
130
+ tight cap returns `{"city": "Tokyo` — truncated mid-answer. Always capture `finish_reason` and
131
+ never score a `length`-truncated reply as a wrong answer.
132
+ 3. **Grading brevity instead of correctness.** Any grader that requires short replies will mark
133
+ every reasoning model wrong for showing its work. Score the *final* answer.
134
+ 4. **Hand-written answer keys are wrong.** Two of mine were. `suite_hard.py` computes every key and
135
+ `--verify` proves a reference answer passes and a wrong one fails before a cent is spent.
136
+ 5. **Shared-backoff livelock.** A fleet-wide pause penalised per failed call means 24 workers file
137
+ 24 penalties for one rate-limit wave, pushing the pause ahead of real time — the process looks
138
+ alive and does nothing. Penalise once per pause window, cap it.
139
+ 6. **`x and y` returns the operand, not a bool.** An empty reply made a grader return `[]`, which
140
+ exploded three layers later in the tally.
141
+ 7. **macOS:** `RLIMIT_AS` is not settable (raises `ValueError`) and `setsid` does not exist. Use
142
+ `RLIMIT_CPU` in a `try/except` and `subprocess.Popen(..., start_new_session=True)`.
143
+ 8. **zsh does not word-split unquoted vars** — `cmd $flags` passes ONE argument. This silently
144
+ produced two wrong benchmark tables that looked completely reasonable.
145
+
146
+ **The design decision that saved all of this:** the benchmark ledger stores the *full reply* of every
147
+ call, so grading is replayable offline (`--regrade`) at zero cost. Bugs 2, 3, 4 and 6 were all found
148
+ and corrected after the money was spent, without spending it again. Keep the raw evidence.
149
+
150
+ ---
151
+
152
+ ## 5. What I would do first if I were picking this up
153
+
154
+ 1. Wire `OUT.record(...)` into wherever openzoo completes a call. Everything else is already built;
155
+ this is the step that turns a borrowed prior into your own measurement.
156
+ 2. Put the catalogue refresh on a cron.
157
+ 3. Read `CURRENT_STATE.md` for what is measured, what is authored, and what is still weak — several
158
+ numbers in this system are policy, not evidence, and they are all in one place so you can argue
159
+ with them.
@@ -0,0 +1 @@
1
+ {"stamp":"2026-08-20T10:58:45Z","ids":["aion-labs/aion-2.0","aion-labs/aion-3.0","aion-labs/aion-3.0-mini","aion-labs/aion-rp-llama-3.1-8b","allenai/olmo-3-32b-think","amazon/nova-2-lite-v1","amazon/nova-lite-v1","amazon/nova-micro-v1","amazon/nova-premier-v1","amazon/nova-pro-v1","anthracite-org/magnum-v4-72b","anthropic/claude-3-haiku","anthropic/claude-fable-5","anthropic/claude-fable-5:batch","anthropic/claude-haiku-4.5","anthropic/claude-haiku-4.5:batch","anthropic/claude-opus-4","anthropic/claude-opus-4.1","anthropic/claude-opus-4.1:batch","anthropic/claude-opus-4.5","anthropic/claude-opus-4.5:batch","anthropic/claude-opus-4.6","anthropic/claude-opus-4.6:batch","anthropic/claude-opus-4.7","anthropic/claude-opus-4.7-fast","anthropic/claude-opus-4.7:batch","anthropic/claude-opus-4.8","anthropic/claude-opus-4.8-fast","anthropic/claude-opus-4.8:batch","anthropic/claude-opus-5","anthropic/claude-opus-5-fast","anthropic/claude-opus-5:batch","anthropic/claude-sonnet-4","anthropic/claude-sonnet-4.5","anthropic/claude-sonnet-4.5:batch","anthropic/claude-sonnet-4.6","anthropic/claude-sonnet-4.6:batch","anthropic/claude-sonnet-5","anthropic/claude-sonnet-5:batch","arcee-ai/trinity-large-thinking","arcee-ai/virtuoso-large","baidu/ernie-4.5-vl-424b-a47b","bytedance-seed/seed-1.6","bytedance-seed/seed-1.6-flash","bytedance-seed/seed-2-1-turbo","bytedance-seed/seed-2.0-code","bytedance-seed/seed-2.0-lite","bytedance-seed/seed-2.0-mini","bytedance/ui-tars-1.5-7b","cognitivecomputations/dolphin-mistral-24b-venice-edition","cohere/command-a","cohere/command-r-08-2024","cohere/command-r-plus-08-2024","cohere/command-r7b-12-2024","cohere/north-mini-code:free","deepcogito/cogito-v2.1-671b","deepseek/deepseek-chat","deepseek/deepseek-chat-v3-0324","deepseek/deepseek-chat-v3.1","deepseek/deepseek-r1","deepseek/deepseek-r1-0528","deepseek/deepseek-r1-distill-llama-70b","deepseek/deepseek-v3.1-terminus","deepseek/deepseek-v3.2","deepseek/deepseek-v3.2-exp","deepseek/deepseek-v4-flash","deepseek/deepseek-v4-flash-0731","deepseek/deepseek-v4-pro","deepseek/deepseek-v4-pro-0813","dots-studio/dots-3-note-preview:free","google/gemini-2.5-flash","google/gemini-2.5-flash-image","google/gemini-2.5-flash-lite","google/gemini-2.5-flash-lite:batch","google/gemini-2.5-flash:batch","google/gemini-2.5-pro","google/gemini-2.5-pro-preview","google/gemini-2.5-pro-preview-05-06","google/gemini-2.5-pro:batch","google/gemini-3-flash-preview","google/gemini-3-flash-preview:batch","google/gemini-3-pro-image","google/gemini-3-pro-image-preview","google/gemini-3.1-flash-image","google/gemini-3.1-flash-image-preview","google/gemini-3.1-flash-lite","google/gemini-3.1-flash-lite-image","google/gemini-3.1-flash-lite-preview","google/gemini-3.1-flash-lite:batch","google/gemini-3.1-pro-preview","google/gemini-3.1-pro-preview-customtools","google/gemini-3.1-pro-preview:batch","google/gemini-3.5-flash","google/gemini-3.5-flash-lite","google/gemini-3.5-flash-lite:batch","google/gemini-3.5-flash:batch","google/gemini-3.6-flash","google/gemini-3.6-flash:batch","google/gemini-3.7-flash","google/gemini-3.7-flash:batch","google/gemma-2-27b-it","google/gemma-3-12b-it","google/gemma-3-27b-it","google/gemma-3-4b-it","google/gemma-3n-e4b-it","google/gemma-4-26b-a4b-it","google/gemma-4-26b-a4b-it:free","google/gemma-4-31b-it","google/gemma-4-31b-it:free","google/lyria-3-clip-preview","google/lyria-3-pro-preview","gryphe/mythomax-l2-13b","ibm-granite/granite-4.0-h-micro","ibm-granite/granite-4.1-8b","inception/mercury-2","inclusionai/ling-2.6-1t","inclusionai/ling-2.6-flash","inclusionai/ling-3.0-flash","inclusionai/ring-2.6-1t","kwaipilot/kat-coder-air-v2.5","kwaipilot/kat-coder-pro-v2","kwaipilot/kat-coder-pro-v2.5","liquid/lfm-2.5-2.6b:free","meituan/longcat-2.0","meta-llama/llama-3.1-70b-instruct","meta-llama/llama-3.1-8b-instruct","meta-llama/llama-3.2-1b-instruct","meta-llama/llama-3.2-3b-instruct","meta-llama/llama-3.3-70b-instruct","meta-llama/llama-4-maverick","meta-llama/llama-4-scout","meta-llama/llama-guard-4-12b","meta/muse-glimmer-30b","meta/muse-spark-1.1","meta/muse-spark-1.2","microsoft/phi-4","microsoft/wizardlm-2-8x22b","minimax/minimax-01","minimax/minimax-m1","minimax/minimax-m2","minimax/minimax-m2-her","minimax/minimax-m2.1","minimax/minimax-m2.5","minimax/minimax-m2.7","minimax/minimax-m3","minimax/minimax-m3:batch","mistralai/codestral-2508","mistralai/ministral-14b-2512","mistralai/ministral-3b-2512","mistralai/ministral-8b-2512","mistralai/mistral-large","mistralai/mistral-large-2407","mistralai/mistral-large-2512","mistralai/mistral-medium-3","mistralai/mistral-medium-3-5","mistralai/mistral-medium-3.1","mistralai/mistral-nemo","mistralai/mistral-saba","mistralai/mistral-small-24b-instruct-2501","mistralai/mistral-small-2603","mistralai/mistral-small-3.1-24b-instruct","mistralai/mistral-small-3.2-24b-instruct","mistralai/mixtral-8x22b-instruct","mistralai/voxtral-small-24b-2507","moonshotai/kimi-k2","moonshotai/kimi-k2-0905","moonshotai/kimi-k2-thinking","moonshotai/kimi-k2.5","moonshotai/kimi-k2.6","moonshotai/kimi-k2.7-code","moonshotai/kimi-k2.7-code:batch","moonshotai/kimi-k3","morph/morph-v3-fast","morph/morph-v3-large","nex-agi/nex-n2-mini","nex-agi/nex-n2-pro","nousresearch/hermes-3-llama-3.1-405b","nousresearch/hermes-3-llama-3.1-70b","nousresearch/hermes-4-405b","nousresearch/hermes-4-70b","nvidia/nemotron-3-nano-30b-a3b","nvidia/nemotron-3-nano-30b-a3b:free","nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free","nvidia/nemotron-3-super-120b-a12b","nvidia/nemotron-3-super-120b-a12b:free","nvidia/nemotron-3-ultra-550b-a55b","nvidia/nemotron-3-ultra-550b-a55b:batch","nvidia/nemotron-3-ultra-550b-a55b:free","nvidia/nemotron-3.5-content-safety:free","nvidia/nemotron-3.5-lightning","nvidia/nemotron-3.5-lightning:free","nvidia/nemotron-nano-12b-v2-vl:free","nvidia/nemotron-nano-9b-v2:free","openai/gpt-3.5-turbo","openai/gpt-3.5-turbo-0613","openai/gpt-3.5-turbo-16k","openai/gpt-3.5-turbo-instruct","openai/gpt-3.5-turbo:batch","openai/gpt-4","openai/gpt-4-turbo","openai/gpt-4-turbo-preview","openai/gpt-4-turbo:batch","openai/gpt-4.1","openai/gpt-4.1-mini","openai/gpt-4.1-mini:batch","openai/gpt-4.1-nano","openai/gpt-4.1-nano:batch","openai/gpt-4.1:batch","openai/gpt-4o","openai/gpt-4o-2024-05-13","openai/gpt-4o-2024-08-06","openai/gpt-4o-2024-11-20","openai/gpt-4o-mini","openai/gpt-4o-mini-2024-07-18","openai/gpt-4o-mini:batch","openai/gpt-4o:batch","openai/gpt-5","openai/gpt-5-codex:batch","openai/gpt-5-image","openai/gpt-5-image-mini","openai/gpt-5-mini","openai/gpt-5-mini:batch","openai/gpt-5-nano","openai/gpt-5-nano:batch","openai/gpt-5-pro","openai/gpt-5-pro:batch","openai/gpt-5.1","openai/gpt-5.1-codex","openai/gpt-5.1-codex-max","openai/gpt-5.1-codex-mini","openai/gpt-5.1:batch","openai/gpt-5.2","openai/gpt-5.2-chat","openai/gpt-5.2-codex","openai/gpt-5.2-pro","openai/gpt-5.2-pro:batch","openai/gpt-5.2:batch","openai/gpt-5.3-codex","openai/gpt-5.4","openai/gpt-5.4-image-2","openai/gpt-5.4-mini","openai/gpt-5.4-mini:batch","openai/gpt-5.4-nano","openai/gpt-5.4-nano:batch","openai/gpt-5.4-pro","openai/gpt-5.4-pro:batch","openai/gpt-5.4:batch","openai/gpt-5.5","openai/gpt-5.5-pro","openai/gpt-5.5-pro:batch","openai/gpt-5.5:batch","openai/gpt-5.6-luna","openai/gpt-5.6-luna-pro","openai/gpt-5.6-luna-pro:batch","openai/gpt-5.6-luna:batch","openai/gpt-5.6-sol","openai/gpt-5.6-sol-pro","openai/gpt-5.6-sol-pro:batch","openai/gpt-5.6-sol:batch","openai/gpt-5.6-terra","openai/gpt-5.6-terra-pro","openai/gpt-5.6-terra-pro:batch","openai/gpt-5.6-terra:batch","openai/gpt-5:batch","openai/gpt-audio","openai/gpt-audio-mini","openai/gpt-chat-latest","openai/gpt-oss-120b","openai/gpt-oss-20b","openai/gpt-oss-20b:free","openai/gpt-oss-safeguard-20b","openai/o1","openai/o1-pro","openai/o1-pro:batch","openai/o1:batch","openai/o3","openai/o3-mini","openai/o3-mini-high","openai/o3-mini-high:batch","openai/o3-mini:batch","openai/o3-pro","openai/o3-pro:batch","openai/o3:batch","openai/o4-mini","openai/o4-mini-high","openai/o4-mini-high:batch","openai/o4-mini:batch","openrouter/auto","openrouter/auto-beta","openrouter/bodybuilder","openrouter/free","openrouter/fusion","openrouter/pareto-code","perceptron/perceptron-mk1","perplexity/sonar","perplexity/sonar-deep-research","perplexity/sonar-pro","perplexity/sonar-pro-search","perplexity/sonar-reasoning-pro","poolside/laguna-s-2.1","poolside/laguna-s-2.1:free","poolside/laguna-xs-2.1","poolside/laguna-xs-2.1:free","qwen/qwen-2.5-72b-instruct","qwen/qwen-2.5-7b-instruct","qwen/qwen-2.5-coder-32b-instruct","qwen/qwen-plus","qwen/qwen-plus-2025-07-28","qwen/qwen-plus-2025-07-28:thinking","qwen/qwen2.5-vl-72b-instruct","qwen/qwen3-14b","qwen/qwen3-235b-a22b","qwen/qwen3-235b-a22b-2507","qwen/qwen3-235b-a22b-thinking-2507","qwen/qwen3-30b-a3b","qwen/qwen3-30b-a3b-instruct-2507","qwen/qwen3-30b-a3b-thinking-2507","qwen/qwen3-32b","qwen/qwen3-8b","qwen/qwen3-coder","qwen/qwen3-coder-30b-a3b-instruct","qwen/qwen3-coder-flash","qwen/qwen3-coder-next","qwen/qwen3-coder-plus","qwen/qwen3-max","qwen/qwen3-max-thinking","qwen/qwen3-next-80b-a3b-instruct","qwen/qwen3-next-80b-a3b-thinking","qwen/qwen3-vl-235b-a22b-instruct","qwen/qwen3-vl-235b-a22b-thinking","qwen/qwen3-vl-30b-a3b-instruct","qwen/qwen3-vl-30b-a3b-thinking","qwen/qwen3-vl-32b-instruct","qwen/qwen3-vl-8b-instruct","qwen/qwen3-vl-8b-thinking","qwen/qwen3.5-122b-a10b","qwen/qwen3.5-27b","qwen/qwen3.5-35b-a3b","qwen/qwen3.5-397b-a17b","qwen/qwen3.5-9b","qwen/qwen3.5-flash-02-23","qwen/qwen3.5-plus-02-15","qwen/qwen3.5-plus-20260420","qwen/qwen3.6-27b","qwen/qwen3.6-35b-a3b","qwen/qwen3.6-flash","qwen/qwen3.6-max-preview","qwen/qwen3.6-plus","qwen/qwen3.7-flash","qwen/qwen3.7-max","qwen/qwen3.7-plus","qwen/qwen3.8-2.4t-a95b","qwen/qwen3.8-27b","qwen/qwen3.8-max","rekaai/reka-edge","rekaai/reka-flash-3","relace/relace-apply-3","relace/relace-search","sakana/fugu-ultra","sakana/sakana-namazu","sao10k/l3-lunaris-8b","sao10k/l3.1-euryale-70b","sao10k/l3.3-euryale-70b","stepfun/step-3.5-flash","stepfun/step-3.7-flash","tencent/hunyuan-a13b-instruct","tencent/hy3","tencent/hy3-preview","thedrummer/cydonia-24b-v4.1","thedrummer/rocinante-12b","thedrummer/skyfall-36b-v2","thedrummer/unslopnemo-12b","thinkingmachines/inkling","thinkingmachines/inkling-small","thinkingmachines/inkling:batch","undi95/remm-slerp-l2-13b","upstage/solar-pro-3","upstage/solar-pro4","writer/palmyra-x5","x-ai/grok-4.20","x-ai/grok-4.20-multi-agent","x-ai/grok-4.3","x-ai/grok-4.5","x-ai/grok-4.6","x-ai/grok-build-0.1","xiaomi/mimo-v2.5","xiaomi/mimo-v2.5-pro","z-ai/glm-4.5","z-ai/glm-4.5-air","z-ai/glm-4.5v","z-ai/glm-4.6","z-ai/glm-4.6v","z-ai/glm-4.7","z-ai/glm-4.7-flash","z-ai/glm-5","z-ai/glm-5-turbo","z-ai/glm-5.1","z-ai/glm-5.2","z-ai/glm-5.2:batch","z-ai/glm-5.2:free","z-ai/glm-5.3","z-ai/glm-5v-turbo","~anthropic/claude-fable-latest","~anthropic/claude-haiku-latest","~anthropic/claude-opus-latest","~anthropic/claude-sonnet-latest","~deepseek/deepseek-v4-flash-latest","~google/gemini-flash-latest","~google/gemini-pro-latest","~moonshotai/kimi-latest","~openai/gpt-latest","~openai/gpt-mini-latest","~x-ai/grok-latest","~z-ai/glm-latest"],"ctx":[131072,131072,131072,32768,65536,1000000,300000,128000,1000000,300000,32768,200000,1000000,1000000,200000,200000,200000,200000,200000,200000,200000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,262144,131072,123000,262144,262144,262144,262144,262144,262144,128000,128000,256000,128000,128000,128000,256000,128000,163840,163840,163840,64000,163840,8192,163840,163840,163840,1048576,1310720,1048576,1048576,512000,1048576,32768,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,0,65536,131072,65536,1048576,65536,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,1048576,8192,131072,262144,131072,32768,262144,262144,262144,262144,1048576,1048576,8192,131000,131072,128000,262144,262144,262144,262144,256000,262144,256000,128000,1048756,131072,131072,60000,131072,131072,1048576,1310720,1048576,131072,1048576,1048576,16384,65535,1000192,1000000,204800,65536,204800,204800,204800,1048576,524288,256000,262144,131072,262144,128000,131072,262144,131072,262144,131072,131072,32768,32768,262144,128000,256000,65536,32000,131072,262144,262144,262144,262144,262144,262144,1048576,81920,262144,262144,262144,131072,131072,131072,131072,262144,256000,256000,1000000,262144,512288,512288,1000000,128000,1000000,1000000,128000,128000,16385,4095,16385,4095,16385,8191,128000,128000,128000,1047576,1047576,1047576,1047576,1047576,1047576,128000,128000,128000,128000,128000,128000,128000,128000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,400000,128000,400000,400000,400000,400000,400000,1050000,272000,400000,400000,400000,400000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,1050000,400000,128000,128000,400000,131072,131072,131072,131072,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,200000,2000000,2000000,128000,200000,1000000,2000000,32768,127072,128000,200000,200000,128000,1048576,262144,262144,262144,32768,32768,32768,1000000,1000000,1000000,128000,131072,131072,262144,262144,131072,262144,81920,131072,131072,262144,262144,1000000,262144,1000000,262144,262144,262144,262144,262144,131072,262144,262144,131072,262144,131072,262144,262144,262144,262144,262144,1000000,1000000,1000000,262144,262144,1000000,262144,1000000,1000000,1000000,1000000,1048576,1000000,1000000,16384,65536,256000,256000,1000000,262144,8192,131072,131072,262144,262144,131072,262144,262144,131072,65536,32768,1024000,1048576,524288,524288,6144,131072,524288,1040000,2000000,2000000,1000000,500000,500000,256000,1050000,1050000,131072,131072,65536,204800,131072,204800,202752,204800,202752,204800,1048576,512000,256000,1048576,202752,1000000,200000,1000000,1000000,1310720,1048576,1048576,1048576,1050000,400000,500000,1048576],"price_in":[2.4000000953674316,9.0,2.0999999046325684,2.4000000953674316,0.44999998807907104,0.8999999761581421,0.18000000715255737,0.10499999672174454,7.5,2.4000000953674316,9.0,0.75,30.0,15.0,3.0,1.5,45.0,45.0,22.5,15.0,7.5,15.0,7.5,15.0,90.0,7.5,15.0,30.0,7.5,15.0,30.0,7.5,9.0,9.0,4.5,9.0,4.5,6.0,3.0,0.6600000262260437,2.25,1.2599999904632568,0.75,0.22499999403953552,1.5,1.5,0.75,0.30000001192092896,0.30000001192092896,0.6000000238418579,7.5,0.44999998807907104,7.5,0.11249999701976776,0.0,3.75,0.7721999883651733,0.75,0.75,2.0999999046325684,1.5,2.4000000953674316,0.8100000023841858,0.8069999814033508,0.8100000023841858,0.2658179998397827,0.41999998688697815,4.800000190734863,3.563999891281128,0.0,0.8999999761581421,0.8999999761581421,0.30000001192092896,0.15000000596046448,0.44999998807907104,3.75,3.75,3.75,1.875,1.5,0.75,NaN,6.0,1.5,1.5,0.75,0.75,0.75,0.375,6.0,6.0,3.0,4.5,0.8999999761581421,0.44999998807907104,2.25,2.25,1.125,1.125,0.5625,1.9500000476837158,0.15000000596046448,0.23999999463558197,0.15000000596046448,0.18000000715255737,0.20999999344348907,0.0,0.27000001072883606,0.0,0.0,0.0,0.18000000715255737,0.050999999046325684,0.15000000596046448,0.75,0.22499999403953552,0.029999999329447746,0.06300000101327896,0.22499999403953552,0.44999998807907104,0.8999999761581421,2.2200000286102295,0.0,0.8999999761581421,1.2000000476837158,0.15000000596046448,0.08100000023841858,0.15000000596046448,0.30000001192092896,0.6000000238418579,0.30000001192092896,0.5400000214576721,1.0499999523162842,3.75,3.75,0.20999999344348907,1.8600000143051147,0.6000000238418579,1.649999976158142,0.7649999856948853,0.8999999761581421,0.8999999761581421,0.675000011920929,0.8999999761581421,0.8999999761581421,0.8999999761581421,0.8999999761581421,0.6000000238418579,0.30000001192092896,0.44999998807907104,6.0,6.0,1.5,1.2000000476837158,4.5,1.2000000476837158,0.05700000002980232,0.6000000238418579,0.15000000596046448,0.44999998807907104,1.0529999732971191,0.28125,6.0,0.30000001192092896,1.7100000381469727,1.7999999523162842,1.7999999523162842,1.350000023841858,2.8499999046325684,2.130000114440918,2.8499999046325684,9.0,2.4000000953674316,2.700000047683716,0.07500000298023224,0.75,3.0,2.0999999046325684,3.0,0.38999998569488525,0.15000000596046448,0.0,0.0,0.2549999952316284,0.0,1.7999999523162842,1.7999999523162842,0.0,0.0,0.23999999463558197,0.0,0.0,0.0,1.5,3.0,9.0,4.5,0.75,90.0,30.0,30.0,15.0,6.0,1.2000000476837158,0.6000000238418579,0.30000001192092896,0.15000000596046448,3.0,7.5,15.0,7.5,7.5,0.44999998807907104,0.44999998807907104,0.22499999403953552,3.75,3.75,1.875,30.0,7.5,0.75,0.375,0.15000000596046448,0.07500000298023224,45.0,22.5,3.75,3.75,3.75,0.75,1.875,5.25,5.25,5.25,63.0,31.5,2.625,5.25,7.5,24.0,2.25,1.125,0.6000000238418579,0.30000001192092896,90.0,45.0,3.75,15.0,90.0,45.0,7.5,0.6000000238418579,0.6000000238418579,0.30000001192092896,0.30000001192092896,7.5,7.5,3.75,3.75,6.0,6.0,3.0,3.0,1.875,7.5,1.7999999523162842,15.0,0.09000000357627869,0.09000000357627869,0.0,0.22499999403953552,45.0,450.0,225.0,22.5,6.0,3.299999952316284,3.299999952316284,1.649999976158142,1.649999976158142,60.0,30.0,3.0,3.299999952316284,3.299999952316284,1.649999976158142,1.649999976158142,NaN,NaN,NaN,0.0,NaN,NaN,0.44999998807907104,3.0,6.0,9.0,9.0,6.0,0.27000001072883606,0.0,0.18000000715255737,0.0,1.0800000429153442,0.30000001192092896,1.9800000190734863,0.7799999713897705,0.7799999713897705,0.7799999713897705,2.4000000953674316,0.36000001430511475,1.3650000095367432,0.27000001072883606,0.6899999976158142,0.38999998569488525,0.14444999396800995,0.6000000238418579,0.23999999463558197,0.35100001096725464,0.8999999761581421,0.20999999344348907,0.5849999785423279,0.36000001430511475,1.9500000476837158,2.3399999141693115,2.3399999141693115,0.27000001072883606,0.44999998807907104,0.6299999952316284,1.2000000476837158,0.38999998569488525,0.6000000238418579,0.31200000643730164,0.35100001096725464,0.5400000214576721,0.7799999713897705,0.5849999785423279,0.75,1.1699999570846558,0.30000001192092896,0.19499999284744263,0.7799999713897705,0.8999999761581421,1.7999999523162842,0.41999998688697815,0.5625,3.0810000896453857,0.9750000238418579,0.09000000357627869,4.425000190734863,0.9599999785423279,6.0,1.350000023841858,6.0,0.30000001192092896,0.30000001192092896,2.549999952316284,3.0,15.0,2.8499999046325684,0.11999999731779099,2.549999952316284,1.9500000476837158,0.30000001192092896,0.6000000238418579,0.41999998688697815,0.3959999978542328,0.5400000214576721,0.8999999761581421,0.75,1.649999976158142,1.2000000476837158,2.8499999046325684,1.350000023841858,3.0,1.350000023841858,0.44999998807907104,0.09000000357627869,1.7999999523162842,3.75,3.75,3.75,6.0,6.0,3.0,0.41999998688697815,1.3049999475479126,1.7999999523162842,0.38999998569488525,1.7999999523162842,1.5,0.8999999761581421,1.2000000476837158,0.18000000715255737,1.7999999523162842,3.5999999046325684,2.8980000019073486,2.8980000019073486,4.199999809265137,0.0,4.199999809265137,3.5999999046325684,30.0,3.0,15.0,6.0,0.19499999284744263,1.125,6.0,7.800000190734863,7.5,2.25,6.0,4.199999809265137],"price_out":[4.800000190734863,18.0,4.199999809265137,4.800000190734863,1.5,7.5,0.7200000286102295,0.41999998688697815,37.5,9.600000381469727,15.0,3.75,150.0,75.0,15.0,7.5,225.0,225.0,112.5,75.0,37.5,75.0,37.5,75.0,450.0,37.5,75.0,150.0,37.5,75.0,150.0,37.5,45.0,45.0,22.5,45.0,22.5,30.0,15.0,2.549999952316284,3.5999999046325684,3.75,6.0,0.8999999761581421,7.5,9.0,6.0,1.2000000476837158,0.6000000238418579,2.700000047683716,30.0,1.7999999523162842,30.0,0.44999998807907104,0.0,3.75,3.0861001014709473,3.0,2.8499999046325684,7.5,6.449999809265137,2.4000000953674316,3.0,1.2000000476837158,1.2300000190734863,0.5316359996795654,0.8399999737739563,9.600000381469727,10.692000389099121,0.0,7.5,7.5,1.2000000476837158,0.6000000238418579,3.75,30.0,30.0,30.0,15.0,9.0,4.5,NaN,36.0,9.0,9.0,4.5,4.5,4.5,2.25,36.0,36.0,18.0,27.0,7.5,3.75,13.5,11.25,5.625,5.625,2.8125,1.9500000476837158,0.44999998807907104,1.350000023841858,0.30000001192092896,0.36000001430511475,1.0199999809265137,0.0,1.0199999809265137,0.0,0.0,0.0,0.18000000715255737,0.335999995470047,0.30000001192092896,2.25,1.875,0.09000000357627869,0.1889999955892563,1.875,1.7999999523162842,3.5999999046325684,8.880000114440918,0.0,3.5999999046325684,1.2000000476837158,0.23999999463558197,0.6029999852180481,0.9900000095367432,0.9599999785423279,2.4000000953674316,0.8999999761581421,0.5400000214576721,4.5,12.75,12.75,0.41999998688697815,1.8600000143051147,3.299999952316284,6.599999904632568,3.059999942779541,3.5999999046325684,3.5999999046325684,2.700000047683716,3.5999999046325684,3.5999999046325684,3.5999999046325684,2.700000047683716,0.6000000238418579,0.30000001192092896,0.44999998807907104,18.0,18.0,4.5,6.0,22.5,6.0,0.09000000357627869,1.7999999523162842,0.23999999463558197,1.7999999523162842,1.6649999618530273,0.75,18.0,0.8999999761581421,6.900000095367432,7.5,7.5,6.75,12.0,10.5,12.0,45.0,3.5999999046325684,5.699999809265137,0.30000001192092896,3.0,3.0,2.0999999046325684,9.0,1.2000000476837158,0.6000000238418579,0.0,0.0,1.2000000476837158,0.0,10.800000190734863,10.800000190734863,0.0,0.0,0.6000000238418579,0.0,0.0,0.0,4.5,6.0,12.0,6.0,2.25,180.0,90.0,90.0,45.0,24.0,4.800000190734863,2.4000000953674316,1.2000000476837158,0.6000000238418579,12.0,30.0,45.0,30.0,30.0,1.7999999523162842,1.7999999523162842,0.8999999761581421,15.0,30.0,15.0,30.0,6.0,6.0,3.0,1.2000000476837158,0.6000000238418579,360.0,180.0,30.0,30.0,30.0,6.0,15.0,42.0,42.0,42.0,504.0,252.0,21.0,42.0,45.0,45.0,13.5,6.75,3.75,1.875,540.0,270.0,22.5,90.0,540.0,270.0,45.0,3.5999999046325684,3.5999999046325684,1.7999999523162842,1.7999999523162842,45.0,45.0,22.5,22.5,36.0,36.0,18.0,18.0,15.0,30.0,7.199999809265137,90.0,0.5099999904632568,0.38999998569488525,0.0,0.8999999761581421,180.0,1800.0,900.0,90.0,24.0,13.199999809265137,13.199999809265137,6.599999904632568,6.599999904632568,240.0,120.0,12.0,13.199999809265137,13.199999809265137,6.599999904632568,6.599999904632568,NaN,NaN,NaN,0.0,NaN,NaN,4.5,3.0,24.0,45.0,45.0,24.0,0.5400000214576721,0.0,0.36000001430511475,0.0,1.2000000476837158,0.6000000238418579,3.0,2.3399999141693115,2.3399999141693115,2.3399999141693115,3.0,0.7200000286102295,5.460000038146973,1.649999976158142,6.900000095367432,1.559999942779541,0.5791500210762024,7.199999809265137,0.8399999737739563,1.3650000095367432,3.0,0.8399999737739563,2.924999952316284,2.4000000953674316,9.75,11.699999809265137,11.699999809265137,3.299999952316284,3.5999999046325684,5.699999809265137,12.0,1.559999942779541,7.199999809265137,1.2480000257492065,1.3650000095367432,6.300000190734863,6.239999771118164,4.679999828338623,3.75,7.019999980926514,0.44999998807907104,0.7799999713897705,4.679999828338623,5.400000095367432,10.800000190734863,3.0,3.375,18.486000061035156,5.849999904632568,0.38999998569488525,13.274999618530273,3.8399999141693115,18.0,9.600000381469727,18.0,0.30000001192092896,0.6000000238418579,3.75,9.0,90.0,12.0,0.15000000596046448,2.549999952316284,2.25,0.8999999761581421,3.450000047683716,1.7100000381469727,1.5839999914169312,1.7999999523162842,1.5,1.5,2.4000000953674316,1.2000000476837158,12.149999618530273,3.5999999046325684,12.149999618530273,1.9500000476837158,1.7999999523162842,0.36000001430511475,18.0,7.5,7.5,7.5,18.0,18.0,6.0,0.8399999737739563,2.609999895095825,6.599999904632568,2.549999952316284,5.400000095367432,6.0,2.700000047683716,5.25,1.2000000476837158,5.760000228881836,12.0,9.107999801635742,9.107999801635742,13.199999809265137,0.0,13.199999809265137,12.0,150.0,15.0,75.0,30.0,0.41999998688697815,5.625,36.0,39.0,45.0,13.5,18.0,13.199999809265137],"modality":[1,1,1,1,1,11,3,1,3,3,1,3,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,1,1,3,3,3,3,3,3,3,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,3,15,3,15,15,15,15,15,15,15,15,15,3,3,3,3,15,3,15,15,15,15,15,15,15,15,15,15,15,15,15,1,3,3,3,1,3,3,3,3,3,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,3,3,3,3,15,15,1,1,3,1,1,1,1,1,1,3,3,9,3,3,3,9,9,11,11,11,11,1,9,1,3,3,3,9,13,1,1,1,3,3,3,3,3,1,1,3,3,1,1,1,1,1,1,7,1,1,1,1,1,3,1,1,3,1,1,1,1,1,1,1,3,1,3,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,3,11,11,11,11,11,11,11,11,11,3,3,3,11,11,11,3,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,11,5,5,11,1,1,1,1,11,11,11,11,11,9,9,9,9,11,11,11,11,11,11,11,15,15,1,3,1,1,3,3,1,3,3,3,1,1,1,1,1,1,1,1,1,1,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,1,3,3,1,3,1,3,3,3,1,1,1,3,11,1,1,1,1,3,1,1,1,1,1,1,1,7,7,7,1,1,1,1,11,11,11,11,11,11,7,1,1,1,3,1,3,1,1,1,1,1,1,1,1,1,3,11,11,11,11,1,15,15,3,11,11,11,1],"tools":[true,true,true,false,false,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,false,false,false,true,true,false,true,false,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,false,false,false,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,false,false,true,true,true,true,false,false,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,true,false,true,true,true,false,false,false,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,false,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,false,false,false,false,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,false,false,false,false,false,false,false,false,true,true,true,true,true,true,false,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,true,false,true,false,true,true,false,true,true,false,false,false,true,true,true,true,false,true,true,false,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true],"jsonmode":[true,true,true,false,true,false,false,false,false,false,true,false,true,true,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,false,true,true,true,true,true,true,true,true,true,true,false,false,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,false,true,true,true,true,true,true,true,false,true,true,false,true,true,true,true,true,false,false,true,true,true,true,false,false,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,false,false,true,false,false,false,true,false,false,false,false,false,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,false,true,true,true,false,true,true,true,true,true,true,false,true,true,true,false,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true],"reasoning":[true,true,true,false,true,true,false,false,false,false,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,false,false,false,false,false,false,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,true,true,true,true,false,false,false,false,false,true,false,false,true,true,false,false,false,true,true,false,false,false,false,false,false,false,false,true,true,true,false,false,false,true,true,false,true,true,true,true,true,false,false,false,false,false,false,false,false,true,false,false,false,false,true,false,false,false,false,false,false,true,true,true,true,true,true,false,false,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,false,false,true,false,true,false,true,true,true,true,true,true,false,false,false,false,true,true,false,true,true,false,true,true,false,true,true,true,false,false,false,false,true,true,true,false,true,false,true,false,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,true,true,false,false,false,true,true,true,true,true,false,false,false,false,true,true,true,false,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true],"moderated":[false,false,false,false,false,true,true,true,true,true,false,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,false,false,true,true,false,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,true,true,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,false,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,false,true,true,false,false,false,false,true,true,false,false],"created":[1771881306,1783443095,1783443096,1738696718,1763758276,1764696672,1733437363,1733437237,1761950332,1733436303,1729555200,1710288000,1781007515,1781007515,1760547638,1760547638,1747931245,1754411591,1754411591,1764010580,1764010580,1770219050,1770219050,1776351100,1778613011,1776351100,1779905091,1779913703,1779905091,1784912544,1784912546,1784912544,1747930371,1759161676,1759161676,1771342990,1771342990,1782843083,1782843083,1775058318,1746478885,1751300903,1766504997,1766505011,1786552176,1786550701,1773157231,1772131107,1753205056,1752094966,1741894342,1724976000,1724976000,1734158152,1781723748,1763071233,1735241320,1742824755,1755779628,1737381095,1748455170,1737663169,1758548275,1764594642,1759150481,1777000666,1785478908,1777000679,1786549364,1786680361,1750172488,1759870431,1753200276,1753200276,1750172488,1750169544,1749137257,1746578513,1750169544,1765987078,1765987078,1781754054,1763653797,1781754065,1772119558,1778168828,1782837225,1772512673,1778168828,1771509627,1772045923,1771509627,1779193800,1784646726,1784646726,1779193800,1784646733,1784646733,1786640581,1786640581,1720828800,1741902625,1741756359,1741905510,1747776824,1775227989,1775227989,1775148486,1775148486,1774907255,1774907286,1688256000,1760927695,1777577071,1772636275,1776948238,1776795886,1784818580,1778247440,1783714590,1774649310,1783714589,1786470519,1784554658,1721692800,1721692800,1727222400,1727222400,1733506137,1743881822,1743881519,1745975193,1786302394,1784215741,1785959287,1736489872,1713225600,1736915462,1750200414,1761252093,1769177239,1766454997,1770908502,1773836697,1780245374,1780245374,1754079630,1764681735,1764681560,1764681654,1708905600,1731978415,1764624472,1746627341,1777570439,1755095639,1721347200,1739803239,1738255409,1773695685,1742238937,1750443016,1713312000,1761835144,1752263252,1757021147,1762440622,1769487076,1776699402,1781266361,1781266361,1784215858,1751910002,1751910858,1782312964,1780937140,1723766400,1723939200,1756235463,1756236182,1765731275,1765731275,1777393095,1773245239,1773245239,1780551208,1780551208,1780551208,1780581864,1786452751,1786452751,1761675565,1757106807,1685232000,1706140800,1693180800,1695859200,1685232000,1685232000,1712620800,1706140800,1712620800,1744651385,1744651381,1744651381,1744651369,1744651369,1744651385,1715558400,1715558400,1722902400,1732127594,1721260800,1721260800,1721260800,1715558400,1754587413,1758643403,1760447986,1760624583,1754587407,1754587407,1754587402,1754587402,1759776663,1759776663,1763060305,1763060298,1764878934,1763057820,1763060305,1765389775,1765389783,1768409315,1765389780,1765389780,1765389775,1771959164,1772734352,1776797528,1773748178,1773748178,1773748187,1773748187,1772734366,1772734366,1772734352,1777051893,1777051896,1777051896,1777051893,1783590864,1783590867,1783590867,1783590864,1783590850,1783590854,1783590854,1783590850,1783590857,1783590861,1783590861,1783590857,1754587413,1768862569,1768859419,1778000212,1754414231,1754414229,1754414229,1761752836,1734459999,1742423211,1742423211,1734459999,1744823457,1738351721,1739372611,1739372611,1738351721,1749598352,1749598352,1744823457,1744820942,1744824212,1744824212,1744820942,1699401600,1784311165,1764903653,1769917427,1781371647,1776747900,1778597029,1738013808,1741311246,1741312423,1761854366,1741313308,1784652683,1784652683,1783002429,1783002429,1726704000,1729036800,1731368400,1738409840,1757347599,1757347599,1738410311,1745876478,1745875757,1753119555,1753449557,1745878604,1753806965,1756399192,1745875945,1745876632,1753230546,1753972379,1758115536,1770164101,1758662707,1758662808,1770671901,1757612213,1757612284,1758668687,1758668690,1759794476,1759794479,1761231332,1760463308,1760463746,1772053789,1772053810,1772053822,1771223018,1773152396,1772053776,1771229416,1777261368,1777255064,1777260255,1777261362,1777260242,1775133557,1785190561,1779376861,1780491783,1786551702,1786722910,1785731612,1774026965,1741812813,1758891572,1765213560,1782276303,1786410129,1723507200,1724803200,1734535928,1769728337,1779985069,1751987664,1783344048,1776878150,1758931878,1727654400,1741636566,1731103448,1784325956,1785443117,1784325956,1689984000,1769481200,1786371636,1769003823,1774979019,1774979158,1777591821,1783523154,1786548957,1779298123,1776874269,1776874273,1753471347,1753471258,1754922288,1759235576,1765207462,1766378014,1768833913,1770829182,1773583573,1775578025,1781631930,1781631930,1781631930,1787086655,1775061458,1781029944,1777318492,1776795361,1777318368,1785606009,1777318398,1777318451,1777318428,1777318334,1777318471,1783519360,1787151053],"ranks":[[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,10,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,19,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[17,9,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,17,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[11,10,12,0,0,0,14,0,0,0,13,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,18,0,18,0,0,13,8,10,0,9,20],[0,0,0,0,0,0,0,0,0,0,0,0],[18,13,17,0,0,0,6,19,18,0,19,17],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,3,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[9,6,4,2,1,4,2,2,2,1,1,1],[2,2,1,1,2,2,1,1,1,2,2,2],[7,7,8,7,16,15,9,0,8,4,17,11],[12,19,14,0,0,0,0,0,0,12,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,13,14,17,15,12,11,18,12,15],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,5,8,8,10,9,15,6,6,7],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,19,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,16,16,16,11,3,4,7,12,10,7,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,14,6,0,18,6,19,0,18,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,13,0,0,14,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,12,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,18,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[6,1,0,0,0,0,0,0,0,0,0,18],[0,0,0,0,0,0,0,0,0,0,0,0],[13,12,10,12,13,11,16,17,16,14,8,12],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,6],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,8,10,19,0,14,17,9,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,15,9,16,0,0,6,7,14,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,20,0,0,0],[0,0,0,0,4,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[8,8,11,0,0,18,11,0,0,0,0,10],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,17,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,12,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[10,15,13,10,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[15,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,12,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,17,0,0,11,0,0,16,14],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,17,0,5,0,13,0,0,0,13],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,19,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,18,20,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,7,0,0,0,0,0,0,19],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[4,3,3,3,3,1,5,4,4,13,5,5],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[16,20,15,20,0,9,20,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[20,0,20,19,0,0,0,20,0,0,15,4],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,11,0,6,0,3,0,15,3,3],[0,0,0,0,0,0,0,18,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,5,0,0,0,0,0,0,8],[0,0,0,0,0,0,19,0,0,0,0,0],[0,0,0,0,0,0,0,16,7,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,17,9,0,0,0,0,0,13,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[5,4,2,4,0,14,8,15,9,20,4,9],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,14,7,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[19,0,0,0,0,10,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[1,11,5,9,15,0,7,10,3,5,20,0],[14,0,0,0,0,0,0,0,0,8,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,16,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[3,5,6,6,20,7,3,5,5,11,11,16],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0],[0,0,0,0,0,0,0,0,0,0,0,0]],"categories":["programming","technology","science","academia","translation","legal","finance","health","trivia","roleplay","marketing","marketing/seo"],"bind_ctx":[128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,0,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000,128000000]}