acorn, esprima, estraverse, ast-types, and recast form a toolkit for parsing, analyzing, and modifying JavaScript code programmatically. acorn and esprima are parsers that turn source code into Abstract Syntax Trees (AST). estraverse walks these trees to find specific patterns. ast-types provides definitions and builders for AST nodes. recast combines these steps to transform code while preserving original formatting, making it ideal for codemods and refactoring tools.
When building tools like linters, bundlers, or codemods, you need to understand JavaScript code as data. The packages acorn, esprima, estraverse, ast-types, and recast each handle a specific part of this pipeline. Let's compare how they approach parsing, walking, and modifying code.
acorn is a minimalist, fast parser that focuses on speed and modularity.
// acorn: Fast parsing
import * as acorn from 'acorn';
const ast = acorn.parse('const x = 10;', {
ecmaVersion: 2022,
sourceType: 'module'
});
console.log(ast.body[0].kind); // "const"
esprima was the pioneering parser for JavaScript but is now considered legacy.
acorn.// esprima: Legacy parsing
import * as esprima from 'esprima';
const ast = esprima.parseScript('const x = 10;', {
loc: true,
range: true
});
console.log(ast.body[0].kind); // "const"
estraverse provides a dedicated way to walk the AST produced by parsers like acorn or esprima.
enter and leave callbacks to handle nodes.// estraverse: Walking the AST
import * as estraverse from 'estraverse';
import * as acorn from 'acorn';
const ast = acorn.parse('const x = 10;', { ecmaVersion: 2022 });
estraverse.traverse(ast, {
enter(node) {
if (node.type === 'Identifier') {
console.log('Found:', node.name);
}
}
});
ast-types defines the shapes of AST nodes and provides builders to create them.
recast to construct new code.// ast-types: Building nodes
import { namedTypes, builders } from 'ast-types';
const id = builders.identifier('myVariable');
// Validate the node
if (namedTypes.Identifier.check(id)) {
console.log('Valid identifier:', id.name);
}
recast is a high-level tool that combines parsing, traversal, and printing.
esprima or acorn under the hood but hides the complexity.// recast: Transform with formatting
import * as recast from 'recast';
import { builders } from 'ast-types';
const code = `const x = 10;`;
const ast = recast.parse(code);
// Modify the AST
ast.program.body[0].declarations[0].init = builders.literal(20);
// Print only changed parts, keep rest intact
const output = recast.print(ast).code;
console.log(output); // "const x = 20;"
The way these tools handle code input and output defines their use case.
acorn or esprima when you only need the AST for analysis (e.g., linting rules).estraverse when you need to decouple walking logic from your parser choice.ast-types when you are generating new code nodes programmatically.recast when you need to output valid JavaScript code that looks like the original.π‘ Tip: If you use
recast, you often don't need to importestraversedirectly becauserecasthas its own traversal methods that integrate with its printer.
Not all packages are maintained equally. This affects long-term project stability.
acorn is actively maintained and widely used in the ecosystem (e.g., Rollup, ESLint).esprima is in maintenance mode. It receives few updates and lacks support for the latest JS features without forks.recast is actively maintained and updated to support new syntax via its parser options.estraverse and ast-types are stable utilities that change infrequently because the ESTree spec is stable.// acorn: Extensible via plugins
import * as acorn from 'acorn';
import * as acornWalk from 'acorn-walk';
// acorn-walk is a modern alternative to estraverse for acorn ASTs
acornWalk.simple(ast, {
Identifier(node) {
console.log(node.name);
}
});
You need to find all unused variables in a file.
acorn + estraverse (or acorn-walk)// Linter analysis
const ast = acorn.parse(code, { ecmaVersion: 2022 });
estraverse.traverse(ast, {
enter(node) {
if (node.type === 'VariableDeclarator') {
// Check usage logic here
}
}
});
You need to rename a function across 1000 files without breaking formatting.
recast// Codemod transformation
const ast = recast.parse(code);
// ... modify ast ...
const newCode = recast.print(ast).code;
You are building a CLI that scaffolds new components.
ast-types + recastast-types ensures the generated nodes are valid; recast prints them nicely.// Scaffolding
const fn = builders.functionDeclaration(
builders.identifier('init'),
[],
builders.blockStatement([])
);
const output = recast.print({ type: 'Program', body: [fn] }).code;
You are fixing a bug in an older tool built 5 years ago.
esprimaesprima's specific output quirks.// Legacy support
const ast = esprima.parse(code, { loc: true });
// Do not migrate unless necessary
| Package | Primary Role | Output | Formatting Preserved? | Active Maintenance? |
|---|---|---|---|---|
acorn | Parser | AST | β | β |
esprima | Parser | AST | β | β οΈ (Legacy) |
estraverse | Traversal | Void/Modified AST | β | β |
ast-types | Types/Builders | Node Objects | N/A | β |
recast | Transformation | Code String | β | β |
Think about your end goal: Analysis or Modification.
acorn to parse and estraverse (or acorn-walk) to inspect. It is fast and lightweight.recast. It handles the hard parts of reprinting code so your diffs stay clean.ast-types to ensure you are building valid structures before printing them.Avoid esprima for new projects unless you have a specific constraint. The community has largely standardized on acorn for parsing and recast for transformation. These tools work together seamlessly β recast can even use acorn as its underlying parser if configured.
Choose acorn when you need a fast, lightweight, and modular parser for modern JavaScript. It is the standard choice for build tools and linters that require high performance and extensibility via plugins. It is best suited for scenarios where you need to generate an AST quickly without worrying about preserving the original code formatting.
Choose ast-types when you need to validate AST node structures or programmatically build new nodes. It provides a robust system of type definitions and builders that ensure your generated code conforms to the ESTree specification. This is essential when writing tools that construct code from scratch rather than just modifying existing trees.
Choose esprima primarily for legacy support or if you require strict ESTree compatibility for older JavaScript versions. It is less actively developed than acorn and is generally not recommended for new projects unless you are maintaining a toolchain that already depends on it. Consider acorn or espree for modern ECMAScript features.
Choose estraverse when you need to walk or traverse an AST produced by any ESTree-compatible parser. It offers a simple API for visiting nodes with enter and leave callbacks, allowing you to analyze or modify the tree structure. It is the go-to utility for separation of concerns between parsing and tree manipulation.
Choose recast when you need to transform code while keeping the original formatting, comments, and whitespace intact. It is the industry standard for codemods and automated refactoring tools where diff readability is critical. It handles the complex work of reprinting only the changed parts of the code, reducing noise in version control.
A tiny, fast JavaScript parser written in JavaScript.
Acorn is open source software released under an MIT license.
You are welcome to report bugs or create pull requests on github.
The easiest way to install acorn is from npm:
npm install acorn
Alternately, you can download the source and build acorn yourself:
git clone https://github.com/acornjs/acorn.git
cd acorn
npm install
ESM as well as CommonJS is supported for all 3: acorn, acorn-walk and acorn-loose.
ESM example for acorn:
import * as acorn from "acorn"
CommonJS example for acorn:
let acorn = require("acorn")
ESM is preferred, as it allows better editor auto-completions by offering TypeScript support. For this reason, following examples will use ESM imports.
parse(input, options) is the main interface to the library. The
input parameter is a string, options must be an object setting
some of the options listed below. The return value will be an abstract
syntax tree object as specified by the ESTree
spec.
import * as acorn from "acorn"
console.log(acorn.parse("1 + 1", {ecmaVersion: 2020}))
When encountering a syntax error, the parser will raise a
SyntaxError object with a meaningful message. The error object will
have a pos property that indicates the string offset at which the
error occurred, and a loc object that contains a {line, column}
object referring to that same position.
Options are provided by in a second argument, which should be an
object containing any of these fields (only ecmaVersion is
required):
ecmaVersion: Indicates the ECMAScript version to parse. Can be a
number, either in year (2022) or plain version number (6) form,
or "latest" (the latest the library supports). This influences
support for strict mode, the set of reserved words, and support for
new syntax features.
NOTE: Only 'stage 4' (finalized) ECMAScript features are being implemented by Acorn. Other proposed new features must be implemented through plugins.
sourceType: Indicate the mode the code should be parsed in. Can be
either "script", "module" or "commonjs". This influences global strict mode
and parsing of import and export declarations.
NOTE: If set to "module", then static import / export syntax
will be valid, even if ecmaVersion is less than 6. If set to "commonjs",
it is the same as "script" except that the top-level scope behaves like a function.
onInsertedSemicolon: If given a callback, that callback will be
called whenever a missing semicolon is inserted by the parser. The
callback will be given the character offset of the point where the
semicolon is inserted as argument, and if locations is on, also a
{line, column} object representing this position.
onTrailingComma: Like onInsertedSemicolon, but for trailing
commas.
allowReserved: If false, using a reserved word will generate
an error. Defaults to true for ecmaVersion 3, false for higher
versions. When given the value "never", reserved words and
keywords can also not be used as property names (as in Internet
Explorer's old parser).
allowReturnOutsideFunction: By default, a return statement at
the top level raises an error. Set this to true to accept such
code.
allowImportExportEverywhere: By default, import and export
declarations can only appear at a program's top level. Setting this
option to true allows them anywhere where a statement is allowed,
and also allows import.meta expressions to appear in scripts
(when sourceType is not "module").
allowAwaitOutsideFunction: If false, await expressions can
only appear inside async functions. Defaults to true in modules
for ecmaVersion 2022 and later, false for lower versions.
Setting this option to true allows to have top-level await
expressions. They are still not allowed in non-async functions,
though. Setting this option to true is not allowed when sourceType: "commonjs".
allowSuperOutsideMethod: By default, super outside a method
raises an error. Set this to true to accept such code.
allowHashBang: When this is enabled, if the code starts with the
characters #! (as in a shellscript), the first line will be
treated as a comment. Defaults to true when ecmaVersion >= 2023.
checkPrivateFields: By default, the parser will verify that private properties are only used in places where they are valid and have been declared. Set this to false to turn such checks off.
locations: When true, each node has a loc object attached
with start and end subobjects, each of which contains the
one-based line and zero-based column numbers in {line, column}
form. Default is false.
onToken: If a function is passed for this option, each found
token will be passed in same format as tokens returned from
tokenizer().getToken().
If array is passed, each found token is pushed to it.
Note that you are not allowed to call the parser from the callbackβthat will corrupt its internal state.
onComment: If a function is passed for this option, whenever a comment is encountered the function will be called with the following parameters:
block: true if the comment is a block comment, false if it
is a line comment.text: The content of the comment.start: Character offset of the start of the comment.end: Character offset of the end of the comment.When the locations options is on, the {line, column} locations
of the commentβs start and end are passed as two additional
parameters.
If array is passed for this option, each found comment is pushed to it as object in Esprima format:
{
"type": "Line" | "Block",
"value": "comment text",
"start": Number,
"end": Number,
// If `locations` option is on:
"loc": {
"start": {line: Number, column: Number}
"end": {line: Number, column: Number}
},
// If `ranges` option is on:
"range": [Number, Number]
}
Note that you are not allowed to call the parser from the callbackβthat will corrupt its internal state.
ranges: Nodes have their start and end characters offsets
recorded in start and end properties (directly on the node,
rather than the loc object, which holds line/column data. To also
add a
semi-standardized
range property holding a [start, end] array with the same
numbers, set the ranges option to true.
program: It is possible to parse multiple files into a single
AST by passing the tree produced by parsing the first file as the
program option in subsequent parses. This will add the toplevel
forms of the parsed file to the "Program" (top) node of an existing
parse tree.
sourceFile: When the locations option is true, you can pass
this option to add a source attribute in every nodeβs loc
object. Note that the contents of this option are not examined or
processed in any way; you are free to use whatever format you
choose.
directSourceFile: Like sourceFile, but a sourceFile property
will be added (regardless of the location option) directly to the
nodes, rather than the loc object.
preserveParens: If this option is true, parenthesized expressions
are represented by (non-standard) ParenthesizedExpression nodes
that have a single expression property containing the expression
inside parentheses.
parseExpressionAt(input, offset, options) will parse a single
expression in a string, and return its AST. It will not complain if
there is more of the string left after the expression.
tokenizer(input, options) returns an object with a getToken
method that can be called repeatedly to get the next token, a {start, end, type, value} object (with added loc property when the
locations option is enabled and range property when the ranges
option is enabled). When the token's type is tokTypes.eof, you
should stop calling the method, since it will keep returning that same
token forever.
Note that tokenizing JavaScript without parsing it is, in modern
versions of the language, not really possible due to the way syntax is
overloaded in ways that can only be disambiguated by the parse
context. This package applies a bunch of heuristics to try and do a
reasonable job, but you are advised to use parse with the onToken
option instead of this.
In ES6 environment, returned result can be used as any other protocol-compliant iterable:
for (let token of acorn.tokenizer(str)) {
// iterate over the tokens
}
// transform code to array of tokens:
var tokens = [...acorn.tokenizer(str)]
tokTypes holds an object mapping names to the token type objects
that end up in the type properties of tokens.
getLineInfo(input, offset) can be used to get a {line, column} object for a given program string and offset.
Parser classInstances of the Parser class contain all the state and logic
that drives a parse. It has static methods parse,
parseExpressionAt, and tokenizer that match the top-level
functions by the same name.
When extending the parser with plugins, you need to call these methods
on the extended version of the class. To extend a parser with plugins,
you can use its static extend method.
var acorn = require("acorn")
var jsx = require("acorn-jsx")
var JSXParser = acorn.Parser.extend(jsx())
JSXParser.parse("foo(<bar/>)", {ecmaVersion: 2020})
The extend method takes any number of plugin values, and returns a
new Parser class that includes the extra parser logic provided by
the plugins.
The bin/acorn utility can be used to parse a file from the command
line. It accepts as arguments its input file and the following
options:
--ecma3|--ecma5|--ecma6|--ecma7|--ecma8|--ecma9|--ecma10: Sets the ECMAScript version
to parse. Default is version 9.
--module: Sets the parsing mode to "module". Is set to "script" otherwise.
--locations: Attaches a "loc" object to each node with "start" and
"end" subobjects, each of which contains the one-based line and
zero-based column numbers in {line, column} form.
--allow-hash-bang: If the code starts with the characters #! (as
in a shellscript), the first line will be treated as a comment.
--allow-await-outside-function: Allows top-level await expressions.
See the allowAwaitOutsideFunction option for more information.
--compact: No whitespace is used in the AST output.
--silent: Do not output the AST, just return the exit status.
--help: Print the usage information and quit.
The utility spits out the syntax tree as JSON data.