Creating a GitHub source in Bulkgrid
The API reference provides the necessary endpoint and parameters to programmatically create or subscribe to a GitHub source, enabling automated data ingestion.
All sources
Bulkgrid
https://bulkgrid.comBulkgrid API Reference for AI Agents & MCP
The Bulkgrid API Reference provides AI agents with programmatic access to manage web crawling and data extraction. It details how to control sources, initiate crawl and deep crawl runs, manage collections, retrieve run results, and search indexed content. Use it for integration, operational tasks, data extraction, and research.
- Pages
- 62
- 242
- Tokens
- ~168.2K
- Updated
- Oct 18, 2026
- Monitoring
- Active
Works with
- ChatGPT
- Claude
- Cursor
- MCP clients
Solutions
What AI Agents Can Do With This Source
Use Bulkgrid API Reference to complete source-specific tasks, make informed decisions, and follow evidence-backed workflows.
Initiating a crawl run for a source
The documentation details the API endpoint and required parameters for creating a crawl run, allowing agents to trigger data collection processes.
Retrieving content from a Bulkgrid run result
The API reference provides the endpoint and usage instructions to programmatically fetch the textual content of a specific run result, enabling data extraction and analysis.
Searching for information within indexed content
The API documentation outlines the `search:query` endpoint and its parameters, allowing agents to programmatically search across all indexed content for relevant information.
Configuring API key permissions for integrations
The API key scopes documentation clearly lists the available permissions and their associated operations, guiding agents in configuring appropriate access for integrations.
Creating a data collection in Bulkgrid
The API reference provides the necessary endpoint and body structure to programmatically create a new collection, enabling organization and management of indexed data.
Coverage
What's Indexed from Bulkgrid
A quick look at the main areas Bulkgrid has indexed and keeps ready for AI search, MCP, extraction, and change detection.
Runs
/docs/api-reference/runs
10 pages
Manage the lifecycle of various data processing runs, such as creating crawl, deep crawl, extract, or website map runs, and also canceling, deleting, or retrying them.
Collections
/docs/api-reference/collections
7 pages
Programmatically create, retrieve, update, and delete collections, including managing their associated rules for data organization.
Results
/docs/api-reference/results
3 pages
Access and retrieve the outcomes of various runs, including listing all results, fetching the content, or obtaining screenshots from specific run executions.
Index
/docs/api-reference/index
1 pages
Enables searching through content that has been indexed by Bulkgrid, allowing users to query and retrieve relevant information.
Advantages
Why Use Bulkgrid for AI-Ready Sources
Bulkgrid turns important websites into fresh, queryable, AI-ready sources without making teams maintain the infrastructure.
Spend Fewer Tokens
Retrieve the right source context instead of sending large pages, pasted docs, or noisy search results into every prompt.
Improve Answer Accuracy
Ground responses in current, source-backed evidence to reduce hallucinations and avoid relying on stale model memory.
Use Fresh Source Data
Keep important websites automatically recrawled and updated so AI is not working from old content.
Query Instantly
Search already-indexed source content immediately instead of crawling pages at question time.
No Infrastructure Maintenance
Bulkgrid handles crawling, rendering, retries, storage, indexing, recrawls, and change detection.
Change Detection
See when pages are added, removed, updated, or fail so teams can react without checking manually.
Give Your Agents Up-to-Date Knowledge from Bulkgrid
Search and use knowledge from Bulkgrid in ChatGPT, Claude, Cursor, and any MCP-compatible client.