Turn websites and GitHub repositories into trusted knowledge for AI. Bulkgrid crawls, indexes, and refreshes content for search through MCP and APIs.
Bulkgrid handles the full source lifecycle—from turning raw content into structured knowledge to delivering the right information to applications and agents.
Index websites and public or private GitHub repositories into searchable content your AI can use.
Automatically check your sources for additions, updates, and removals, and refresh indexed content.
Retrieve relevant passages with references through MCP, the REST API, TypeScript and Python SDKs, or the CLI.
Turn webpages into structured data that matches your schema and is ready for downstream workflows.
Bulkgrid handles website crawling, GitHub syncing, content processing, indexing, and automatic refreshes. Your team can focus on building the AI experience.
Your team builds the AI product. Bulkgrid keeps the knowledge behind it usable.
Start with an indexed source, add a website, or connect a public or private GitHub repository. Choose the pages or repository paths your AI needs. Bulkgrid processes the content and preserves useful structure and metadata for retrieval.
Source indexing
Website or GitHub repository → Processed documents → Indexed passages
Content and references, ready for your AI.
Bulkgrid automatically checks your sources for changes and refreshes indexed content, so your AI can work with fresh knowledge. Review additions, updates, removals, and processing failures in your source history.
Example source refresh
Give applications and agents access to the sources you choose through MCP, the REST API, our SDKs, or the CLI. Retrieve ranked passages with references, and organize sources into collections for focused search.
Example search · selected sources
Illustrative content. Search returns passages and references for your AI to use.
Provide one or more URLs, describe the fields you need, and receive consistent structured output for enrichment, analysis, automation, and downstream applications.
Example extraction
shop.example.com/products/field-notes
A notebook for your next idea.
Give coding agents and AI assistants trusted context from websites and GitHub repositories, with automatic refreshes to keep indexed knowledge up to date.
Coding Agents
Bring framework documentation and private repository knowledge into your agent’s workflow. Bulkgrid retrieves relevant passages from the sources you choose, with references your team can verify.
Outcome
AI Assistants
Turn product documentation, help content, and private repository knowledge into searchable context for your AI assistants. Organize sources into collections and retrieve relevant passages with references users can verify.
Outcome
Fresh Knowledge
Bulkgrid automatically checks your sources for changes and refreshes indexed content, so your AI can work with fresh knowledge.
Outcome
Connect Bulkgrid to your applications and agents through TypeScript and Python SDKs, the CLI, REST API, or MCP.
import { BulkgridClient } from '@bulkgrid/sdk';
const client = new BulkgridClient({
apiKey: process.env.BULKGRID_API_KEY ?? '',
baseUrl: 'https://bulkgrid.com',
});
const results = await client.search({
query: 'How do I authenticate API requests?',
limit: 3,
});
console.log(results);
Install @bulkgrid/sdk and set BULKGRID_API_KEY in your server environment.
Build source management, retrieval, and structured extraction into your applications.
Give supported AI clients direct access to selected Bulkgrid sources and collections.
Manage sources and search indexed content from your terminal or scripts.
Integrate source management, retrieval, and extraction into your application with our TypeScript and Python SDKs.
Everything you need to know about sources, updates, retrieval, and extraction.
Start with an indexed source or add your own website or GitHub repository. Give your AI searchable knowledge with automatic refreshes and references you can verify.
Get Started