---
name: "csv-tsv-streaming-large-parser"
description: "Process gigabyte-scale delimited CSV and TSV files with streaming Node.js pipelines."
metadata:
  author: "mafintosh"
  version: "1.0.0"
  runtime_compatibility:
    - "codex"
    - "claude-code"
    - "cursor"
    - "windsurf"
triggers:
  - "stream parse large csv nodejs"
  - "handle rfc4180 quotes csv"
  - "convert tsv to csv stream"
permissions:
  fs_read: true
  fs_write: "workspace"
  shell_exec: false
  net_access: false
---

# High-Throughput Streaming CSV/TSV Parser

Streams massive delimited datasets using csv-parser or fast-csv in Node.js: stream chunking, RFC 4180 quote escaping, delimiter autodetection, and row transformation with minimal memory usage.

## When to Invoke
Invoke this skill whenever you need to:
- stream parse large csv nodejs
- handle rfc4180 quotes csv
- convert tsv to csv stream

## Execution SOP & Rules
1. Pipe readable file streams into parser: fs.createReadStream(path).pipe(csv({ separator: ',' })).
2. Handle backpressure by pausing stream execution during asynchronous database inserts.
3. Normalize messy header keys using mapHeaders: ({ header }) => header.trim().toLowerCase().
4. Handle escaped double quotes, line breaks inside quotes, and byte-order-marks (BOM) cleanly.

## Verification Checklist
- Run local linting, syntax validation, and type-checks before reporting completion.
- Ensure all created or modified files adhere to workspace boundaries and avoid uncommitted secrets.
- Verify tests or build commands exit cleanly with return code 0.