/create-maxcompute-data-source

name: create-maxcompute-data-source
description: |-
  创建 MaxCompute 类型数据源并验证连通性——将 MaxCompute 项目接入 Dataphin 作为数据源。
  支持 Basic 和 DEV-PROD 两种项目模式。

  触发场景：
  - 新接入 MaxCompute 数据仓库到 Dataphin
  - 为 Dataphin 项目配置 MaxCompute 数据源
  - 验证 MaxCompute 数据源连通性

  触发词：创建 MaxCompute 数据源、接入 MaxCompute、新建 MC 数据源、MaxCompute datasource、配置 MaxCompute。

  关键限制：Type 固定 MAX_COMPUTE；DEV-PROD 项目需分两步创建（先生产后开发）；19 位 ID 必须字符串传参。

创建 MaxCompute 数据源并验证连通性

1. Scenario Description

将 MaxCompute 项目接入 Dataphin 作为数据源，使下游数据开发任务可以读写该 MaxCompute 项目中的数据。

**Architecture**：`Dataphin Tenant → DataSource (MAX_COMPUTE) → MaxCompute Project`

支持两种项目模式：

• **Basic 项目**：仅创建生产环境数据源
• **DEV-PROD 项目**（开发-生产分离）：先创建生产环境数据源，再创建开发环境数据源并关联

2. Installation

aliyun plugin install --names aliyun-cli-dataphin-public

（详见 [`references/cli-installation-guide.md`](references/cli-installation-guide.md)）

3. Environment Variables

> 凭证与环境变量由父 skill `alibabacloud-dataphin-skills` 统一声明并预检（父 §3 + §4 Authentication + §8 Step 0，先于路由到本 skill 执行）；本 skill 不重复声明。

4. Authentication

> **Pre-check: Alibaba Cloud Credentials Required** > > **Security Rules:** > - **NEVER** read, echo, or print AK/SK values to terminal or logs > - **NEVER** ask the user to input AK/SK directly in the conversation or command line > - **NEVER** use `aliyun configure set` with literal credential values > - **ONLY** use `aliyun configure list` to check credential status > > ```bash > aliyun configure list > ``` > Check the output for a valid profile (AK, STS, or OAuth identity). > > **If no valid profile exists, STOP here.** > 1. Obtain credentials from [Alibaba Cloud Console](https://ram.console.aliyun.com/manage/ak) > 2. Configure credentials **outside of this session** (via `aliyun configure` in terminal or environment variables in shell profile) > 3. Return and re-run after `aliyun configure list` shows a valid profile

**Pre-check: Aliyun CLI >= 3.4.8 required** > Run `aliyun version` to verify >= 3.4.8. If not installed or version too low, > install/update from https://aliyuncli.alicdn.com (see `references/cli-installation-guide.md` for the OS-specific script), > or see `references/cli-installation-guide.md` for installation instructions.

**Pre-check: Aliyun CLI plugin update required** > [MUST] run `aliyun configure set --auto-plugin-install true` to enable automatic plugin installation. > [MUST] run `aliyun plugin update` to ensure that any existing plugins are always up-to-date.

5. RAM Policy

最小权限策略详见 [`../../ram-policies.md`](../../ram-policies.md)。

> **[MUST] Permission Failure Handling:** When any command or API call fails due to permission errors at any point during execution, follow this process: > 1. Read `../../ram-policies.md` to get the full list of permissions required by this SKILL > 2. Use `ram-permission-diagnose` skill to guide the user through requesting the necessary permissions > 3. Pause and wait until the user confirms that the required permissions have been granted

6. Parameter Confirmation

> **IMPORTANT: Parameter Confirmation** — Before executing any command or API call, > ALL user-customizable parameters (e.g., RegionId, instance names, CIDR blocks, > passwords, domain names, resource specifications, etc.) MUST be confirmed with the > user. Do NOT assume or use default values without explicit user approval.

| 参数 | 必填 | 描述 | 默认值 | |---|---|---|---| | `TENANT_ID` | 是 | 租户 ID（19 位 snowflake，**字符串传**） | — | | `DS_NAME` | 是 | 数据源名称（英文、数字、下划线，不超过 64 字符） | — | | `DS_DESCRIPTION` | 否 | 数据源描述 | 空 | | `PROJECT_MODE` | 是 | 项目模式：`BASIC` 或 `DEV_PROD` | — | | `MC_ENDPOINT` | 是 | MaxCompute Endpoint | — | | `MC_PROJECT` | 是 | MaxCompute 项目名称（生产环境） | — | | `MC_PROJECT_DEV` | DEV_PROD 时必填 | MaxCompute 项目名称（开发环境，可与生产相同） | 同 `MC_PROJECT` | | `MC_ACCESS_ID` | 是 | MaxCompute 访问 AccessKey ID | — | | `MC_ACCESS_KEY` | 是 | MaxCompute 访问 AccessKey Secret | — |

> **Endpoint 参考**：`http://service.<region>.maxcompute.aliyun.com/api`，常见 region 如 `cn-hangzhou`、`cn-shanghai`、`cn-beijing`。

7. Observability (MUST follow for every aliyun command)

**session-id 由父 skill `alibabacloud-dataphin-skills` 在套件入口加载时生成（32-char 小写 hex），本子 skill 加载时直接继承同一 session-id，不再重新生成。**

**Rule: Every `aliyun` CLI command that calls a cloud API MUST include the `--user-agent` flag.** Local utility commands (e.g. `configure`, `plugin`, `version`) do not support this flag and should be excluded.

--user-agent AlibabaCloud-Agent-Skills/create-maxcompute-data-source/{session-id}

Example (assuming session-id is `a1b2c3d4e5f6a7b8c9d0e1f2a3b4c5d6`):

aliyun dataphin-public list-data-source-with-config --op-tenant-id "1234567890123456789" \
  --list-query '{"TypeList":["MAX_COMPUTE"],"Page":1,"PageSize":20}' \
  --user-agent AlibabaCloud-Agent-Skills/create-maxcompute-data-source/a1b2c3d4e5f6a7b8c9d0e1f2a3b4c5d6

Do not skip, alter the format, or omit `--user-agent` on any `aliyun` API command invocation.

8. Core Workflow

TENANT_ID="<19位租户ID>"
SESSION_ID="<inherited from alibabacloud-dataphin-skills>"
UA="--user-agent AlibabaCloud-Agent-Skills/create-maxcompute-data-source/$SESSION_ID"

Step 1：连通性预检（可选但推荐）

创建前先验证 MaxCompute 配置是否连通：

aliyun dataphin-public check-data-source-connectivity \
  --op-tenant-id "$TENANT_ID" \
  --check-command '{
    "Type": "MAX_COMPUTE",
    "ConfigItemList": [
      {"Key": "maxcompute.endpoint", "Value": "<MC_ENDPOINT>"},
      {"Key": "maxcompute.project", "Value": "<MC_PROJECT>"},
      {"Key": "maxcompute.access.id", "Value": "<MC_ACCESS_ID>"},
      {"Key": "maxcompute.access.key", "Value": "<MC_ACCESS_KEY>"}
    ]
  }' $UA

期望返回 `"ConnectStatus": true`。若为 `false`，请检查 endpoint / project / AK 是否正确后重试。

Step 2：创建数据源

分支 A：Basic 项目（仅生产环境）

aliyun dataphin-public create-data-source \
  --op-tenant-id "$TENANT_ID" \
  --create-command '{
    "ProdDataSourceCreate": {
      "Name": "<DS_NAME>",
      "Type": "MAX_COMPUTE",
      "Description": "<DS_DESCRIPTION>",