A11 TypeScript API - v0.7.0
    Preparing search index...

    Function tokenizeFlow

    • Split source into coloured runs, covering every character exactly once.

      Total by construction -- anything unrecognised comes back as plain -- so a caller can concatenate the tokens' text and get the source back. A highlighter that drops characters silently corrupts the code it is drawn behind.

      Parameters

      • source: string

      Returns FlowToken[]