feat(core): implement ProgressiveFileReader with background indexer

Browse Source

Add ProgressiveFileReader state machine (Sampling/Ready/Error) with scanned_newlines cache for O(1) line lookups. Implement spawn_indexer() for background mmap-based indexing with cancellation and progress reporting. Add VisualHeightIndex with prefix-sum + binary search for O(log N) visual height queries. Register all new io submodules and extend FileReader with reload(), save_cache(), and accessor methods.

Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>

...

This commit is contained in:

dailz

2026-04-14 09:07:09 +08:00

parent 210eecfa66

commit f9f451e0d6

3 changed files with 1449 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

1267

crates/core/src/io/progressive_reader.rs Normal file

File diff suppressed because it is too large Load Diff