data_connectors

300+ data connectors via LlamaHub.

openlair@openlair

GitHub

From plugin

dr-claw

1k8 skills8 agents

Install

$ npx -y skills add OpenLAIR/dr-claw --agent claude-code

How it fires

How this agent gets triggered: by you, by Claude, or both.

Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.
You can call itInvoke it directly when you want it.

Context preview

The summary Claude sees to decide when to auto-load this agent.

300+ data connectors via LlamaHub.

Agent definition

data_connectors.md

LlamaIndex Data Connectors Guide

300+ data connectors via LlamaHub.

Built-in loaders

SimpleDirectoryReader

from llama_index.core import SimpleDirectoryReader

# Load all files
documents = SimpleDirectoryReader("./data").load_data()

# Filter by extension
documents = SimpleDirectoryReader(
    "./data",
    required_exts=[".pdf", ".docx", ".txt"]
).load_data()

# Recursive
documents = SimpleDirectoryReader("./data", recursive=True).load_data()

Web pages

from llama_index.readers.web import SimpleWebPageReader, BeautifulSoupWebReader

# Simple loader
reader = SimpleWebPageReader()
documents = reader.load_data(["https://example.com"])

# Advanced (BeautifulSoup)
reader = BeautifulSoupWebReader()
documents = reader.load_data(urls=[
    "https://docs.python.org",
    "https://numpy.org"
])

PDF

from llama_index.readers.file import PDFReader

reader = PDFReader()
documents = reader.load_data("paper.pdf")

GitHub

from llama_index.readers.github import GithubRepositoryReader

reader = GithubRepositoryReader(
    owner="facebook",
    repo="react",
    filter_file_extensions=[".js", ".jsx"],
    verbose=True
)

documents = reader.load_data(branch="main")

LlamaHub connectors

Visit https://llamahub.ai for 300+ connectors:

Notion, Google Docs, Confluence
Slack, Discord, Twitter
PostgreSQL, MongoDB, MySQL
S3, GCS, Azure Blob
Stripe, Shopify, Salesforce

Install from LlamaHub

pip install llama-index-readers-notion

from llama_index.readers.notion import NotionPageReader

reader = NotionPageReader(integration_token="your-token")
documents = reader.load_data(page_ids=["page-id"])

Custom loader

from llama_index.core.readers.base import BaseReader
from llama_index.core import Document

class CustomReader(BaseReader):
    def load_data(self, file_path: str):
        # Your custom loading logic
        with open(file_path) as f:
            text = f.read()
        return [Document(text=text, metadata={"source": file_path})]

reader = CustomReader()
documents = reader.load_data("data.txt")