35 lines
885 B
Text
35 lines
885 B
Text
|
---
|
||
|
|
title: Indexing Large Documents
|
||
|
|
description: Efficiently access huge documents without loading everything at once.
|
||
|
|
---
|
||
|
|
|
||
|
|
import { Aside } from '@astrojs/starlight/components';
|
||
|
|
|
||
|
|
# Indexing Large Documents
|
||
|
|
|
||
|
|
> *"It's not that I'm lazy, it's that I just don't care about loading 500 pages at once."*
|
||
|
|
|
||
|
|
For documents over 25,000 tokens, the indexing system enables on-demand fetching through MCP resources.
|
||
|
|
|
||
|
|
<Aside type="caution" title="Coming Soon">
|
||
|
|
Detailed indexing tutorial in progress.
|
||
|
|
</Aside>
|
||
|
|
|
||
|
|
## Quick Example
|
||
|
|
|
||
|
|
```python
|
||
|
|
# Index once
|
||
|
|
result = await index_document("huge-novel.docx")
|
||
|
|
# Returns: {"doc_id": "abc123", "resources": {...}}
|
||
|
|
|
||
|
|
# Fetch chapters on demand
|
||
|
|
# chapter://abc123/1 → Chapter 1
|
||
|
|
# chapter://abc123/1.md → Chapter 1 as Markdown
|
||
|
|
```
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
<div style="text-align: center; margin-top: 2rem; font-style: italic; opacity: 0.7;">
|
||
|
|
*Full tutorial coming soon.*
|
||
|
|
</div>
|