AgentWeb
MCP server that gives AI agents structured access to any webpage. Returns clean text, links, forms, and metadata instead of raw HTML.
Works with Claude Code, Cursor, Windsurf, and any MCP-compatible AI coding agent.
Install
macOS (zero dependencies):
curl -fsSL https://www.agentweb.us/install.sh | bash
If you have npx:
npx agentwebai setup
If you have bun:
bunx agentwebai setup
Manual install for Claude Code:
claude mcp add agentweb -s user -- npx -y agentwebai
After install, restart your AI tool. Then ask it to: "Read the page at https://example.com"
What it does
AgentWeb gives your AI agent a read_page tool. Instead of raw HTML, the agent gets:
- Clean text (no HTML noise)
- All links with absolute URLs
- Forms with field names, types, and required flags
- Page metadata (title, description, Open Graph)
Machine-readable docs
/llms.txt - Installation instructions for AI agents
/llms-full.txt - Complete tool reference
Pricing
Free: Any publicly available page, unlimited reads.
Pro (coming soon): Authenticated access + action execution.
npm: npmjs.com/package/agentwebai
Website: agentweb.us