benchmark
Define the comparison metrics and extract baseline values from the current implementation. Record them as a structured JSON entry so downstream phases and…
Read and understand the current baseline implementation. Extract all relevant information about the existing approach without modifying anything, and record the analysis as a structured JSON entry.
$ npx -y skills add Upsonic/Upsonic --skill analyze_current --agent claude-codeHow it fires
How this skill gets triggered: by you, by Claude, or both.
/analyze_currentContext preview
The summary Claude sees to decide when to auto-load this skill.
Read and understand the current baseline implementation. Extract all relevant information about the existing approach without modifying anything, and record the analysis as a structured JSON entry.
Read and understand the current baseline implementation. Extract all relevant information about the existing approach without modifying anything, and record the analysis as a structured JSON entry.
Phase 1 — after experiment setup is complete and files are copied to the experiment folder.
| Parameter | Type | Description | |-----------|------|-------------| | experiment_path | path | `experiments/{research_name}/` |
1. **Read `{experiment_path}/current.ipynb`** and extract:
2. **Extract dependencies:**
3. **Read `{experiment_path}/current_data/`** (or, for code-based data, the download spec):
4. **Append a Phase 1 entry to `{experiment_path}/log.json`** under `phases`:
{
"name": "Phase 1: Analyze Current",
"completed_at": "2026-04-17T10:15:00Z",
"model": "XGBoost",
"preprocessing": [
"Drop rows with NaN",
"LabelEncoder on target",
"LabelEncoder on categorical features",
"StandardScaler on numerical features"
],
"training": {
"split": 0.2,
"seed": 42,
"stratified": true
},
"hyperparameters": {
"n_estimators": 200,
"max_depth": 6,
"learning_rate": 0.1
},
"metrics": {
"accuracy": 0.8726,
"f1": 0.7277,
"roc_auc": 0.9274
},
"target": "income",
"features_count": 14,
"data": {
"source": "ucimlrepo fetch_ucirepo(id=2)",
"format": "pandas.DataFrame",
"rows": 45222,
"cols": 14
},
"notes": "Data downloaded programmatically; both notebooks must use the same source."
}Do not overwrite earlier entries; append to the `phases` array.
Define the comparison metrics and extract baseline values from the current implementation. Record them as a structured JSON entry so downstream phases and…
Compare baseline and new implementation results. Produce the machine-readable final report `result.json`, update `experiments.json`, and append a row to…
Set up and manage the experiment folder structure. This is Phase 0 — it runs before any analysis begins. All bookkeeping files are JSON (never markdown).
Create a new Jupyter notebook implementing the method from the research paper, using the same data as the baseline. Record implementation details and measured…
Maintain a **machine-readable** progress file so dashboards, CLIs, and notebooks can poll the experiment's state at any time. The file is a JSON document —…