opencode-skills-antigravity 1.0.39 → 1.0.41

package/bundled-skills/hugging-face-papers/SKILL.md

@@ -0,0 +1,241 @@
+---
+source: "https://github.com/huggingface/skills/tree/main/skills/huggingface-papers"
+name: hugging-face-papers
+description: Read and analyze Hugging Face paper pages or arXiv papers with markdown and papers API metadata.
+risk: unknown
+---
+
+# Hugging Face Paper Pages
+
+Hugging Face Paper pages (hf.co/papers) is a platform built on top of arXiv (arxiv.org), specifically for research papers in the field of artificial intelligence (AI) and computer science. Hugging Face users can submit their paper at hf.co/papers/submit, which features it on the Daily Papers feed (hf.co/papers). Each day, users can upvote papers and comment on papers. Each paper page allows authors to:
+- claim their paper (by clicking their name on the `authors` field). This makes the paper page appear on their Hugging Face profile.
+- link the associated model checkpoints, datasets and Spaces by including the HF paper or arXiv URL in the model card, dataset card or README of the Space
+- link the Github repository and/or project page URLs
+- link the HF organization. This also makes the paper page appear on the Hugging Face organization page.
+
+Whenever someone mentions a HF paper or arXiv abstract/PDF URL in a model card, dataset card or README of a Space repository, the paper will be automatically indexed. Note that not all papers indexed on Hugging Face are also submitted to daily papers. The latter is more a manner of promoting a research paper. Papers can only be submitted to daily papers up until 14 days after their publication date on arXiv.
+
+The Hugging Face team has built an easy-to-use API to interact with paper pages. Content of the papers can be fetched as markdown, or structured metadata can be returned such as author names, linked models/datasets/spaces, linked Github repo and project page.
+
+## When to Use
+
+- User shares a Hugging Face paper page URL (e.g. `https://huggingface.co/papers/2602.08025`)
+- User shares a Hugging Face markdown paper page URL (e.g. `https://huggingface.co/papers/2602.08025.md`)
+- User shares an arXiv URL (e.g. `https://arxiv.org/abs/2602.08025` or  `https://arxiv.org/pdf/2602.08025`)
+- User mentions a arXiv ID (e.g. `2602.08025`)
+- User asks you to summarize, explain, or analyze an AI research paper
+
+## Parsing the paper ID
+
+It's recommended to parse the paper ID (arXiv ID) from whatever the user provides:
+
+| Input | Paper ID |
+| --- | --- |
+| `https://huggingface.co/papers/2602.08025` | `2602.08025` |
+| `https://huggingface.co/papers/2602.08025.md` | `2602.08025` |
+| `https://arxiv.org/abs/2602.08025` | `2602.08025` |
+| `https://arxiv.org/pdf/2602.08025` | `2602.08025` |
+| `2602.08025v1` | `2602.08025v1` |
+| `2602.08025` | `2602.08025` |
+
+This allows you to provide the paper ID into any of the hub API endpoints mentioned below.
+
+### Fetch the paper page as markdown
+
+The content of a paper can be fetched as markdown like so:
+
+```bash
+curl -s "https://huggingface.co/papers/{PAPER_ID}.md"
+```
+
+This should return the Hugging Face paper page as markdown. This relies on the HTML version of the paper at https://arxiv.org/html/{PAPER_ID}.
+
+There are 2 exceptions:
+- Not all arXiv papers have an HTML version. If the HTML version of the paper does not exist, then the content falls back to the HTML of the Hugging Face paper page.
+- If it results in a 404, it means the paper is not yet indexed on hf.co/papers. See [Error handling](#error-handling) for info.
+
+Alternatively, you can request markdown from the normal paper page URL, like so:
+
+```bash
+curl -s -H "Accept: text/markdown" "https://huggingface.co/papers/{PAPER_ID}"
+```
+
+### Paper Pages API Endpoints
+
+All endpoints use the base URL `https://huggingface.co`.
+
+#### Get structured metadata
+
+Fetch the paper metadata as JSON using the Hugging Face REST API:
+
+```bash
+curl -s "https://huggingface.co/api/papers/{PAPER_ID}"
+```
+
+This returns structured metadata that can include:
+
+- authors (names and Hugging Face usernames, in case they have claimed the paper)
+- media URLs (uploaded when submitting the paper to Daily Papers)
+- summary (abstract) and AI-generated summary
+- project page and GitHub repository
+- organization and engagement metadata (number of upvotes)
+
+To find models linked to the paper, use:
+
+```bash
+curl https://huggingface.co/api/models?filter=arxiv:{PAPER_ID}
+```
+
+To find datasets linked to the paper, use:
+
+```bash
+curl https://huggingface.co/api/datasets?filter=arxiv:{PAPER_ID}
+```
+
+To find spaces linked to the paper, use:
+
+```bash
+curl https://huggingface.co/api/spaces?filter=arxiv:{PAPER_ID}
+```
+
+#### Claim paper authorship
+
+Claim authorship of a paper for a Hugging Face user:
+
+```bash
+curl "https://huggingface.co/api/settings/papers/claim" \
+  --request POST \
+  --header "Content-Type: application/json" \
+  --header "Authorization: Bearer $HF_TOKEN" \
+  --data '{
+    "paperId": "{PAPER_ID}",
+    "claimAuthorId": "{AUTHOR_ENTRY_ID}",
+    "targetUserId": "{USER_ID}"
+  }'
+```
+
+- Endpoint: `POST /api/settings/papers/claim`
+- Body:
+  - `paperId` (string, required): arXiv paper identifier being claimed
+  - `claimAuthorId` (string): author entry on the paper being claimed, 24-char hex ID
+  - `targetUserId` (string): HF user who should receive the claim, 24-char hex ID
+- Response: paper authorship claim result, including the claimed paper ID
+
+#### Get daily papers
+
+Fetch the Daily Papers feed:
+
+```bash
+curl -s -H "Authorization: Bearer $HF_TOKEN" \
+  "https://huggingface.co/api/daily_papers?p=0&limit=20&date=2017-07-21&sort=publishedAt"
+```
+
+- Endpoint: `GET /api/daily_papers`
+- Query parameters:
+  - `p` (integer): page number
+  - `limit` (integer): number of results, between 1 and 100
+  - `date` (string): RFC 3339 full-date, for example `2017-07-21`
+  - `week` (string): ISO week, for example `2024-W03`
+  - `month` (string): month value, for example `2024-01`
+  - `submitter` (string): filter by submitter
+  - `sort` (enum): `publishedAt` or `trending`
+- Response: list of daily papers
+
+#### List papers
+
+List arXiv papers sorted by published date:
+
+```bash
+curl -s -H "Authorization: Bearer $HF_TOKEN" \
+  "https://huggingface.co/api/papers?cursor={CURSOR}&limit=20"
+```
+
+- Endpoint: `GET /api/papers`
+- Query parameters:
+  - `cursor` (string): pagination cursor
+  - `limit` (integer): number of results, between 1 and 100
+- Response: list of papers
+
+#### Search papers
+
+Perform hybrid semantic and full-text search on papers:
+
+```bash
+curl -s -H "Authorization: Bearer $HF_TOKEN" \
+  "https://huggingface.co/api/papers/search?q=vision+language&limit=20"
+```
+
+This searches over the paper title, authors, and content.
+
+- Endpoint: `GET /api/papers/search`
+- Query parameters:
+  - `q` (string): search query, max length 250
+  - `limit` (integer): number of results, between 1 and 120
+- Response: matching papers
+
+#### Index a paper
+
+Insert a paper from arXiv by ID. If the paper is already indexed, only its authors can re-index it:
+
+```bash
+curl "https://huggingface.co/api/papers/index" \
+  --request POST \
+  --header "Content-Type: application/json" \
+  --header "Authorization: Bearer $HF_TOKEN" \
+  --data '{
+    "arxivId": "{ARXIV_ID}"
+  }'
+```
+
+- Endpoint: `POST /api/papers/index`
+- Body:
+  - `arxivId` (string, required): arXiv ID to index, for example `2301.00001`
+- Pattern: `^\d{4}\.\d{4,5}$`
+- Response: empty JSON object on success
+
+#### Update paper links
+
+Update the project page, GitHub repository, or submitting organization for a paper. The requester must be the paper author, the Daily Papers submitter, or a papers admin:
+
+```bash
+curl "https://huggingface.co/api/papers/{PAPER_OBJECT_ID}/links" \
+  --request POST \
+  --header "Content-Type: application/json" \
+  --header "Authorization: Bearer $HF_TOKEN" \
+  --data '{
+    "projectPage": "https://example.com",
+    "githubRepo": "https://github.com/org/repo",
+    "organizationId": "{ORGANIZATION_ID}"
+  }'
+```
+
+- Endpoint: `POST /api/papers/{paperId}/links`
+- Path parameters:
+  - `paperId` (string, required): Hugging Face paper object ID
+- Body:
+  - `githubRepo` (string, nullable): GitHub repository URL
+  - `organizationId` (string, nullable): organization ID, 24-char hex ID
+  - `projectPage` (string, nullable): project page URL
+- Response: empty JSON object on success
+
+## Error Handling
+
+- **404 on `https://huggingface.co/papers/{PAPER_ID}` or `md` endpoint**: the paper is not indexed on Hugging Face paper pages yet.
+- **404 on `/api/papers/{PAPER_ID}`**: the paper may not be indexed on Hugging Face paper pages yet.
+- **Paper ID not found**: verify the extracted arXiv ID, including any version suffix
+
+### Fallbacks
+
+If the Hugging Face paper page does not contain enough detail for the user's question:
+
+- Check the regular paper page at `https://huggingface.co/papers/{PAPER_ID}`
+- Fall back to the arXiv page or PDF for the original source:
+  - `https://arxiv.org/abs/{PAPER_ID}`
+  - `https://arxiv.org/pdf/{PAPER_ID}`
+
+## Notes
+
+- No authentication is required for public paper pages.
+- Write endpoints such as claim authorship, index paper, and update paper links require `Authorization: Bearer $HF_TOKEN`.
+- Prefer the `.md` endpoint for reliable machine-readable output.
+- Prefer `/api/papers/{PAPER_ID}` when you need structured JSON fields instead of page markdown.

package/bundled-skills/hugging-face-trackio/.claude-plugin/plugin.json

@@ -0,0 +1,19 @@
+{
+  "name": "trackio-cli",
+  "version": "1.0.0",
+  "description": "Query Trackio projects, runs, and metrics using the `trackio` CLI. Use when the user needs to list projects/runs/metrics, get summaries, or retrieve metric values from local Trackio databases. Supports both human-readable and JSON output formats. Covers project discovery, run inspection, metric querying, and system metrics. Designed for LLM agents and automation scripts.",
+  "author": {
+    "name": "Hugging Face"
+  },
+  "repository": "https://github.com/huggingface/skills",
+  "license": "Apache-2.0",
+  "keywords": [
+    "trackio",
+    "experiment-tracking",
+    "metrics",
+    "mlops",
+    "cli",
+    "monitoring"
+  ]
+}
+

package/bundled-skills/hugging-face-trackio/SKILL.md

@@ -0,0 +1,117 @@
+---
+source: "https://github.com/huggingface/skills/tree/main/skills/huggingface-trackio"
+name: hugging-face-trackio
+description: Track ML experiments with Trackio using Python logging, alerts, and CLI metric retrieval.
+risk: unknown
+---
+
+# Trackio - Experiment Tracking for ML Training
+
+Trackio is an experiment tracking library for logging and visualizing ML training metrics. It syncs to Hugging Face Spaces for real-time monitoring dashboards.
+
+## Three Interfaces
+
+| Task | Interface | Reference |
+|------|-----------|-----------|
+| **Logging metrics** during training | Python API | [references/logging_metrics.md](references/logging_metrics.md) |
+| **Firing alerts** for training diagnostics | Python API | [references/alerts.md](references/alerts.md) |
+| **Retrieving metrics & alerts** after/during training | CLI | [references/retrieving_metrics.md](references/retrieving_metrics.md) |
+
+## When to Use Each
+
+### Python API → Logging
+
+Use `import trackio` in your training scripts to log metrics:
+
+- Initialize tracking with `trackio.init()`
+- Log metrics with `trackio.log()` or use TRL's `report_to="trackio"`
+- Finalize with `trackio.finish()`
+
+**Key concept**: For remote/cloud training, pass `space_id` — metrics sync to a Space dashboard so they persist after the instance terminates.
+
+→ See [references/logging_metrics.md](references/logging_metrics.md) for setup, TRL integration, and configuration options.
+
+### Python API → Alerts
+
+Insert `trackio.alert()` calls in training code to flag important events — like inserting print statements for debugging, but structured and queryable:
+
+- `trackio.alert(title="...", level=trackio.AlertLevel.WARN)` — fire an alert
+- Three severity levels: `INFO`, `WARN`, `ERROR`
+- Alerts are printed to terminal, stored in the database, shown in the dashboard, and optionally sent to webhooks (Slack/Discord)
+
+**Key concept for LLM agents**: Alerts are the primary mechanism for autonomous experiment iteration. An agent should insert alerts into training code for diagnostic conditions (loss spikes, NaN gradients, low accuracy, training stalls). Since alerts are printed to the terminal, an agent that is watching the training script's output will see them automatically. For background or detached runs, the agent can poll via CLI instead.
+
+→ See [references/alerts.md](references/alerts.md) for the full alerts API, webhook setup, and autonomous agent workflows.
+
+### CLI → Retrieving
+
+Use the `trackio` command to query logged metrics and alerts:
+
+- `trackio list projects/runs/metrics` — discover what's available
+- `trackio get project/run/metric` — retrieve summaries and values
+- `trackio list alerts --project <name> --json` — retrieve alerts
+- `trackio show` — launch the dashboard
+- `trackio sync` — sync to HF Space
+
+**Key concept**: Add `--json` for programmatic output suitable for automation and LLM agents.
+
+→ See [references/retrieving_metrics.md](references/retrieving_metrics.md) for all commands, workflows, and JSON output formats.
+
+## Minimal Logging Setup
+
+```python
+import trackio
+
+trackio.init(project="my-project", space_id="username/trackio")
+trackio.log({"loss": 0.1, "accuracy": 0.9})
+trackio.log({"loss": 0.09, "accuracy": 0.91})
+trackio.finish()
+```
+
+### Minimal Retrieval
+
+```bash
+trackio list projects --json
+trackio get metric --project my-project --run my-run --metric loss --json
+```
+
+## Autonomous ML Experiment Workflow
+
+When running experiments autonomously as an LLM agent, the recommended workflow is:
+
+1. **Set up training with alerts** — insert `trackio.alert()` calls for diagnostic conditions
+2. **Launch training** — run the script in the background
+3. **Poll for alerts** — use `trackio list alerts --project <name> --json --since <timestamp>` to check for new alerts
+4. **Read metrics** — use `trackio get metric ...` to inspect specific values
+5. **Iterate** — based on alerts and metrics, stop the run, adjust hyperparameters, and launch a new run
+
+```python
+import trackio
+
+trackio.init(project="my-project", config={"lr": 1e-4})
+
+for step in range(num_steps):
+    loss = train_step()
+    trackio.log({"loss": loss, "step": step})
+
+    if step > 100 and loss > 5.0:
+        trackio.alert(
+            title="Loss divergence",
+            text=f"Loss {loss:.4f} still high after {step} steps",
+            level=trackio.AlertLevel.ERROR,
+        )
+    if step > 0 and abs(loss) < 1e-8:
+        trackio.alert(
+            title="Vanishing loss",
+            text="Loss near zero — possible gradient collapse",
+            level=trackio.AlertLevel.WARN,
+        )
+
+trackio.finish()
+```
+
+Then poll from a separate terminal/process:
+
+```bash
+trackio list alerts --project my-project --json --since "2025-01-01T00:00:00"
+```

package/bundled-skills/hugging-face-trackio/references/alerts.md

@@ -0,0 +1,196 @@
+# Trackio Alerts
+
+Alerts let you flag important training events directly from code. They are the primary mechanism for LLM agents to diagnose runs and iterate autonomously on ML experiments.
+
+Alerts are printed to the terminal, stored in the database, displayed in the dashboard, and optionally sent to webhooks (Slack/Discord).
+
+## Core API
+
+### trackio.alert()
+
+```python
+trackio.alert(
+    title="Loss divergence",                    # Short title (required)
+    text="Loss 5.2 still high after 200 steps", # Detailed description (optional)
+    level=trackio.AlertLevel.WARN,               # INFO, WARN, or ERROR (default: WARN)
+    webhook_url="https://hooks.slack.com/...",   # Per-alert webhook override (optional)
+)
+```
+
+### Alert Levels
+
+| Level | Usage |
+|-------|-------|
+| `trackio.AlertLevel.INFO` | Informational milestones (checkpoints saved, eval completed) |
+| `trackio.AlertLevel.WARN` | Potential issues (loss plateau, low accuracy, high gradient norm) |
+| `trackio.AlertLevel.ERROR` | Critical failures (NaN loss, divergence, OOM) |
+
+### Webhook Support
+
+Set a global webhook URL via `trackio.init()` or the `TRACKIO_WEBHOOK_URL` environment variable. Alerts are auto-formatted for Slack and Discord URLs.
+
+```python
+trackio.init(
+    project="my-project",
+    webhook_url="https://hooks.slack.com/services/...",
+    webhook_min_level=trackio.AlertLevel.WARN,  # Only send WARN+ to webhook
+)
+```
+
+Per-alert override:
+
+```python
+trackio.alert(
+    title="Critical failure",
+    level=trackio.AlertLevel.ERROR,
+    webhook_url="https://hooks.slack.com/services/...",  # Overrides global URL
+)
+```
+
+Environment variables:
+- `TRACKIO_WEBHOOK_URL` — global webhook URL
+- `TRACKIO_WEBHOOK_MIN_LEVEL` — minimum level for webhook delivery (`info`, `warn`, `error`)
+
+## Retrieving Alerts (CLI)
+
+```bash
+# List all alerts for a project
+trackio list alerts --project my-project --json
+
+# Filter by run or level
+trackio list alerts --project my-project --run my-run --level error --json
+
+# Poll for new alerts since a timestamp (efficient for agents)
+trackio list alerts --project my-project --json --since "2025-06-01T12:00:00"
+```
+
+### JSON Output Structure
+
+```json
+{
+  "project": "my-project",
+  "run": null,
+  "level": null,
+  "since": "2025-06-01T12:00:00",
+  "alerts": [
+    {
+      "run": "run-name",
+      "title": "Loss divergence",
+      "text": "Loss 5.2 still high after 200 steps",
+      "level": "warn",
+      "step": 200,
+      "timestamp": "2025-06-01T12:05:30"
+    }
+  ]
+}
+```
+
+## Autonomous Agent Workflow
+
+The recommended pattern for an LLM agent running ML experiments:
+
+### 1. Insert Alerts Into Training Code
+
+Add diagnostic `trackio.alert()` calls for conditions the agent should react to:
+
+```python
+import trackio
+
+trackio.init(project="hyperparam-sweep", config={"lr": lr, "batch_size": bs})
+
+for step in range(num_steps):
+    loss = train_step()
+    trackio.log({"loss": loss, "step": step})
+
+    if step > 200 and loss > 5.0:
+        trackio.alert(
+            title="Loss divergence",
+            text=f"Loss {loss:.4f} still above 5.0 after {step} steps — learning rate may be too high",
+            level=trackio.AlertLevel.ERROR,
+        )
+
+    if step > 500 and loss_delta < 0.001:
+        trackio.alert(
+            title="Training stall",
+            text=f"Loss barely changed over last 100 steps (delta={loss_delta:.6f})",
+            level=trackio.AlertLevel.WARN,
+        )
+
+    if math.isnan(loss):
+        trackio.alert(
+            title="NaN loss",
+            text="Loss became NaN — training is broken",
+            level=trackio.AlertLevel.ERROR,
+        )
+        break
+
+trackio.finish()
+```
+
+### 2. Monitor Alerts
+
+Alerts are automatically printed to the terminal when fired. If the agent is watching the training script's output (e.g. running in the foreground or tailing logs), it will see alerts immediately — no polling needed.
+
+For background or detached runs, poll for alerts via CLI:
+
+```bash
+# Poll for alerts (run periodically)
+trackio list alerts --project hyperparam-sweep --json --since "2025-06-01T00:00:00"
+```
+
+### 3. Inspect Metrics Around the Alert
+
+When an alert fires, use `trackio get snapshot` to see all metrics at that point:
+
+```bash
+# Alert fired at step 200 — get all metrics in a ±5 step window
+trackio get snapshot --project hyperparam-sweep --run run-1 --around 200 --window 5 --json
+
+# Or inspect a single metric around the alert's timestamp
+trackio get metric --project hyperparam-sweep --run run-1 --metric loss --around 200 --window 10 --json
+```
+
+### 4. React and Iterate
+
+Based on alerts:
+- **ERROR alerts** → stop the run, adjust hyperparameters, relaunch
+- **WARN alerts** → inspect metrics with `trackio get snapshot ...`, decide whether to intervene
+- **INFO alerts** → note progress, continue monitoring
+
+### 5. Compare Across Runs
+
+```bash
+# Check metrics from previous runs
+trackio get run --project hyperparam-sweep --run run-1 --json
+trackio get metric --project hyperparam-sweep --run run-1 --metric loss --json
+
+# Launch new run with adjusted config
+python train.py --lr 5e-5
+```
+
+## Using Alerts with Transformers / TRL
+
+When using `report_to="trackio"`, you don't control the training loop directly. Use a `TrainerCallback` to fire alerts:
+
+```python
+from transformers import TrainerCallback
+
+class AlertCallback(TrainerCallback):
+    def on_log(self, args, state, control, logs=None, **kwargs):
+        if "trackio" not in args.report_to:
+            return
+        if logs and "loss" in logs:
+            if logs["loss"] > 5.0 and state.global_step > 100:
+                trackio.alert(
+                    title="High loss",
+                    text=f"Loss {logs['loss']:.4f} at step {state.global_step}",
+                    level=trackio.AlertLevel.ERROR,
+                )
+
+trainer = SFTTrainer(
+    model=model,
+    args=SFTConfig(output_dir="./out", report_to="trackio"),
+    callbacks=[AlertCallback()],
+    ...
+)
+```