mdast-util-from-markdown

mdast utility to parse markdown

Downloads in past

Stats

StarsIssuesVersionUpdatedCreatedSize
mdast-util-from-markdown
11611.3.03 days ago2 years agoMinified + gzip package size for mdast-util-from-markdown in KB

Readme

mdast-util-from-markdown
!Buildbuild-badgebuild !Coveragecoverage-badgecoverage !Downloadsdownloads-badgedownloads !Sizesize-badgesize !Sponsorssponsors-badgecollective !Backersbackers-badgecollective !Chatchat-badgechat
mdast utility that turns markdown into a syntax tree.

Contents

*   [`fromMarkdown(value[, encoding][, options])`](#frommarkdownvalue-encoding-options)
*   [`CompileContext`](#compilecontext)
*   [`CompileData`](#compiledata)
*   [`Encoding`](#encoding)
*   [`Extension`](#extension)
*   [`Handle`](#handle)
*   [`OnEnterError`](#onentererror)
*   [`OnExitError`](#onexiterror)
*   [`Options`](#options)
*   [`Token`](#token)
*   [`Transform`](#transform)
*   [`Value`](#value)

What is this?

This package is a utility that takes markdown input and turns it into an mdast
syntax tree.
This utility uses micromarkmicromark, which turns markdown into tokens, and then turns those tokens into nodes. This package is used inside remark-parseremark-parse, which focusses on making it easier to transform content by abstracting these internals away.

When should I use this?

If you want to handle syntax trees manually, use this. When you just want to turn markdown into HTML, use micromarkmicromark instead. For an easier time processing content, use the remark ecosystem instead.
You can combine this package with other packages to add syntax extensions to markdown. Notable examples that deeply integrate with this package are mdast-util-gfm
mdast-util-gfm, mdast-util-mdxmdast-util-mdx, mdast-util-frontmattermdast-util-frontmatter, mdast-util-mathmdast-util-math, and mdast-util-directivemdast-util-directive.

Install

This package is ESM onlyesm. In Node.js (version 14.14+ and 16.0+), install with npm:
npm install mdast-util-from-markdown

In Deno with esm.shesmsh:
import {fromMarkdown} from 'https://esm.sh/mdast-util-from-markdown@1'

In browsers with esm.shesmsh:
<script type="module">
  import {fromMarkdown} from 'https://esm.sh/mdast-util-from-markdown@1?bundle'
</script>

Use

Say we have the following markdown file example.md:
## Hello, *World*!

…and our module example.js looks as follows:
import fs from 'node:fs/promises'
import {fromMarkdown} from 'mdast-util-from-markdown'

const doc = await fs.readFile('example.md')
const tree = fromMarkdown(doc)

console.log(tree)

…now running node example.js yields (positional info removed for brevity):
{
  type: 'root',
  children: [
    {
      type: 'heading',
      depth: 2,
      children: [
        {type: 'text', value: 'Hello, '},
        {type: 'emphasis', children: [{type: 'text', value: 'World'}]},
        {type: 'text', value: '!'}
      ]
    }
  ]
}

API

This package exports the identifier fromMarkdownapi-frommarkdown. There is no default export.
The export map supports the development conditiondevelopment. Run node --conditions development example.js to get instrumented dev code. Without this condition, production code is loaded.

fromMarkdown(value[, encoding][, options])

Turn markdown into a syntax tree.
Overloads
  • (value: Value, encoding: Encoding, options?: Options) => Root
  • (value: Value, options?: Options) => Root
Parameters
— markdown to parse
— [character encoding][character-encoding] for when `value` is
[`Buffer`][buffer]
— configuration
Returns
mdast tree (Rootroot).

CompileContext

mdast compiler context (TypeScript type).
Fields
— stack of nodes
  • tokenStack (Array<[Token, OnEnterError | undefined]>)
— stack of tokens
  • getData ((key: string) => unknown)
— get data from the key/value store (see [`CompileData`][api-compiledata])
  • setData ((key: string, value?: unknown) => void)
— set data into the key/value store (see [`CompileData`][api-compiledata])
  • buffer (() => void)
— capture some of the output data
  • resume (() => string)
— stop capturing and access the output data
  • enter ((node: Node, token: Token, onError?: OnEnterError) => Node)
— enter a token
  • exit ((token: Token, onError?: OnExitError) => Node)
— exit a token
  • sliceSerialize ((token: Token, expandTabs?: boolean) => string)
— get the string value of a token
  • config (Required<Extension>)
— configuration

CompileData

Interface of tracked data (TypeScript type).
Type
interface CompileData { /* see code */ }

When working on extensions that use more data, extend the corresponding interface to register their types:
declare module 'mdast-util-from-markdown' {
  interface CompileData {
    // Register a new field.
    mathFlowInside?: boolean | undefined
  }
}

Encoding

Encodings supported by the Bufferbuffer class (TypeScript type).

See micromark for more info.
Type
type Encoding = 'utf8' | /* … */

Extension

Change how markdown tokens from micromark are turned into mdast (TypeScript type).
Properties
  • canContainEols (Array<string>, optional)
— token types where line endings are used
— opening handles
— closing handles
— tree transforms

Handle

Handle a token (TypeScript type).
Parameters
— context
— current token
Returns
Nothing (void).

OnEnterError

Handle the case where the right token is open, but it is closed (by the left token) or because we reached the end of the document (TypeScript type).
Parameters
— context
— left token
— right token
Returns
Nothing (void).

OnExitError

Handle the case where the right token is open but it is closed by exiting the left token (TypeScript type).
Parameters
— context
— left token
— right token
Returns
Nothing (void).

Options

Configuration (TypeScript type).
Properties
— micromark extensions to change how markdown is parsed
optional)
— extensions for this utility to change how tokens are turned into a tree

Token

Token from micromark (TypeScript type).

See micromark for more info.
Type
type Token = { /* … */ }

Transform

Extra transform, to change the AST afterwards (TypeScript type).
Parameters
— tree to transform
Returns
New tree (Rootroot) or nothing (in which case the current tree is used).

Value

Contents of the file (TypeScript type).

See micromark for more info.
Type
type Value = string | Uint8Array

List of extensions

— directives
— frontmatter (YAML, TOML, more)
— GFM
— GFM autolink literals
— GFM footnotes
— GFM strikethrough
— GFM tables
— GFM task list items
— math
— MDX
— MDX expressions
— MDX JSX
— MDX ESM

Syntax

Markdown is parsed according to CommonMark. Extensions can add support for other syntax. If you’re interested in extending markdown, more information is available in micromark’s readmemicromark-extend.

Syntax tree

The syntax tree is mdast.

Types

This package is fully typed with TypeScript. It exports the additional types CompileContextapi-compilecontext, CompileDataapi-compiledata, Encodingapi-encoding, Extensionapi-extension, Handleapi-handle, OnEnterErrorapi-onentererror, OnExitErrorapi-onexiterror, Optionsapi-options, Tokenapi-token, Transformapi-transform, and Valueapi-value.

Compatibility

Projects maintained by the unified collective are compatible with all maintained versions of Node.js. As of now, that is Node.js 14.14+ and 16.0+. Our projects sometimes work with older versions, but this is not guaranteed.

Security

As markdown is sometimes used for HTML, and improper use of HTML can open you up to a cross-site scripting (XSS)xss attack, use of mdast-util-from-markdown can also be unsafe. When going to HTML, use this utility in combination with hast-util-sanitizehast-util-sanitize to make the tree safe.

Related

— serialize mdast as markdown
— parse markdown
— process markdown

Contribute

See contributing.mdcontributing in syntax-tree/.githubhealth for ways to get started. See support.mdsupport for ways to get help.
This project has a code of conductcoc. By interacting with this repository, organization, or community you agree to abide by its terms.

License

MITlicense © Titus Wormerauthor