Promise based streaming tokenizer
// readme
strtok3
A promise-based streaming tokenizer for Node.js and browsers.
The strtok3 module provides several methods for creating a tokenizer from various input sources.
Designed for:
- Seamless support in streaming environments.
- Efficiently decode binary data, strings, and numbers.
- Reading predefined or custom tokens.
- Offering tokenizers for reading from files, streams or Uint8Arrays.
Features
strtok3 can read from:
- Files, using a file path as input.
- Node.js streams.
- WHATWG ReadableStream objects containing
Uint8Arraychunks. - Buffer or Uint8Array.
- Blob or File objects.
- HTTP chunked transfer provided by…