/alibabacloud-bailian-videoanalysis

name: alibabacloud-bailian-videoanalysis
description: |
  Alibaba Cloud Bailian Video Analysis Skill. Use for intelligent video comprehension and analysis via the Bailian (QuanMiaoLightApp) API.
  **Required API Product**: QuanMiaoLightApp (version 2024-08-01)
  **Required API Actions**: SubmitVideoAnalysisTask, GetVideoAnalysisTask
  **DO NOT use**: videorecog, Mts, or any other product for video analysis
  Triggers: "analyze video", "understand video", "analyze the local video /temp/xxx.mp4", "analyze the local video https://xxx.com/temp/xxx.mp4", "what is this video about", "summarize this video", "split video into shots", "video comprehension", "extract video insights", "transcribe video", "extract video captions", "generate video title", "generate video outline", "video mindmap".

Bailian Video Analysis

This skill provides video analysis functionality based on Alibaba Cloud Bailian Video Analysis Light Application. It uses the Bailian (QuanMiaoLightApp) API for intelligent video comprehension, including shot analysis, ASR transcription, title generation, caption extraction, and mind mapping.

**Architecture:** `CLI (Credential Chain) + OSS (File Storage) + Bailian Workspace + Quanmiao Video Analysis Service + Python SDK Scripts`

---

Output Language Policy

**Detection Priority:** User input language → Environment language → **Default: Chinese (中文)**

**Apply to:** All user-facing messages, summaries, error explanations, and interactive prompts.

**Keep original language:** Code snippets, API responses, file paths, technical identifiers, HTTP status codes.

---

Installation

1. Python Dependencies

python -m pip install -r scripts/requirements.txt
# On some systems, use pyhon3 instead of python

2. Alibaba Cloud CLI

> **Pre-check: Aliyun CLI >= 3.3.1 required** > Run `aliyun version` to verify >= 3.3.1. If not installed or version too low, > see `references/cli-installation-guide.md` for installation instructions. > Then **[MUST]** run `aliyun configure set --auto-plugin-install true` to enable automatic plugin installation.

> **AI-Mode Configuration for aliyun CLI** > > When using the aliyun CLI in this skill, you MUST configure AI-Mode settings: > > ```bash > # Enable AI-Mode (required before using CLI commands) > aliyun configure ai-mode enable > > # Set User-Agent for tracking (required) > aliyun configure ai-mode set-user-agent AlibabaCloud-Agent-Skills/alibabacloud-bailian-videoanalysis > > # Update plugins to latest versions (recommended) > aliyun plugin update > ``` > > **Note:** After completing your tasks, you can disable AI-Mode: > ```bash > aliyun configure ai-mode disable > ```

3. Important Prerequisite: Activate Bailian and Video Analysis Service

**Before using this skill, you must first activate the Video Analysis service in the Alibaba Cloud Bailian console!**

1. Visit [Bailian Video_Analysis page](https://bailian.console.aliyun.com/cn-beijing#/app/app-market/quanmiao/video-comprehend) 2. Click the **"Paid activation"** button 3. Confirm activation and wait for the service to take effect (usually 1-2 minutes)

4. Important Prerequisite: Guide Users to Grant Permissions in Alibaba Cloud Access Control and Bailian

**Before using this skill, you must grant the following permissions to the previously configured AK, otherwise calls will fail and may cause 403 errors**

1) RAM Permission Grant

See [references/ram-policies.md](references/ram-policies.md) for the full list of required RAM permissions and authorization instructions.

> **[MUST] Permission Failure Handling:** When any command or API call fails due to permission errors at any point during execution, follow this process: > 1. Read `references/ram-policies.md` to get the full list of permissions required by this SKILL > 2. Use `ram-permission-diagnose` skill to guide the user through requesting the necessary permissions > 3. Pause and wait until the user confirms that the required permissions have been granted

2) Bailian Workspace Permission Grant

1. Visit [Alibaba Cloud Bailian Permission Management](https://bailian.console.aliyun.com/cn-beijing?tab=app#/authority) 2. If the RAM user corresponding to the AK does not exist, click **"Add User"** in the upper right corner of the page, select the corresponding RAM user and click confirm to add. 3. There is a 30s effective time after configuration, please wait patiently for a while.

---

Authentication

> **Pre-check: Alibaba Cloud Credentials Required** > > **Security Rules:** > - **NEVER** read, echo, or print AK/SK values (e.g., `echo $ALIBABA_CLOUD_ACCESS_KEY_ID` is FORBIDDEN) > - **NEVER** ask the user to input AK/SK directly in the conversation or command line > - **NEVER** use `aliyun configure set` with literal credential values > - **ONLY** use `aliyun configure list` to check credential status > > ```bash > aliyun configure list > ``` > Check the output for a valid profile (AK, STS, or OAuth identity). > > **If no valid profile exists, STOP here.** > 1. Obtain credentials from [Alibaba Cloud Console](https://ram.console.aliyun.com/manage/ak) > 2. Configure credentials **outside of this session** (via `aliyun configure` in terminal or environment variables in shell profile) > 3. Return and re-run after `aliyun configure list` shows a valid profile

---

Parameter Confirmation

> **IMPORTANT: Parameter Confirmation** — Before executing any command or API call, > confirm user-provided or customizable parameters (video source, OSS bucket, oss object key). > System-auto-resolved parameters (workspace_id, default OSS bucket) do NOT > require explicit confirmation unless the user wants to override them.

| Parameter | Type | Description | Default / Resolution | |------------------|---------------|-------------------------------------------|-------------------------------------------