xml2js vs cheerio vs htmlparser2 vs sax
HTML and XML Parsing Libraries
xml2jscheeriohtmlparser2saxSimilar Packages:

HTML and XML Parsing Libraries

HTML and XML parsing libraries are essential tools in web development for extracting and manipulating data from web pages and structured documents. These libraries provide developers with the ability to parse, traverse, and manipulate HTML and XML content efficiently. They are particularly useful for web scraping, data extraction, and transforming documents into usable formats. Each library has its unique strengths and use cases, making it crucial to choose the right one based on project requirements.

Npm Package Weekly Downloads Trend

3 Years

Github Stars Ranking

Stat Detail

Package
Downloads
Stars
Size
Issues
Publish
License
xml2js32,455,9844,9683.44 MB2493 years agoMIT
cheerio030,2531.01 MB462 months agoMIT
htmlparser204,813235 kB1217 days agoMIT
sax01,15261 kB9621 days agoBlueOak-1.0.0

Feature Comparison: xml2js vs cheerio vs htmlparser2 vs sax

Parsing Methodology

  • xml2js:

    xml2js converts XML into JavaScript objects, allowing developers to work with XML data in a more natural way. It parses the entire XML document into an object structure, making it easy to access and manipulate data, but it may consume more memory compared to streaming parsers.

  • cheerio:

    Cheerio uses a jQuery-like syntax to manipulate the DOM, making it intuitive for developers familiar with jQuery. It loads HTML into memory and allows for easy traversal and manipulation, but it does not create a full DOM tree, which makes it faster for certain tasks.

  • htmlparser2:

    htmlparser2 operates as a low-level parser that can handle both HTML and XML. It provides a streaming interface, allowing developers to process data as it is parsed, which is beneficial for handling large documents or when immediate processing is required.

  • sax:

    SAX (Simple API for XML) is an event-driven, streaming parser that reads XML documents sequentially. It does not build a tree structure, making it memory efficient and suitable for large XML files. It emits events for each element, allowing for immediate processing of data as it is encountered.

Performance

  • xml2js:

    xml2js is less performant for large XML documents compared to streaming parsers because it loads the entire document into memory. However, it excels in scenarios where ease of use and quick access to data are more critical than raw performance.

  • cheerio:

    Cheerio is optimized for speed and is particularly efficient for parsing and manipulating small to medium-sized HTML documents. It is not as performant as lower-level parsers for large documents, but its ease of use often outweighs this drawback for many applications.

  • htmlparser2:

    htmlparser2 is designed for high performance and can handle large documents efficiently. Its streaming capabilities allow it to parse data in chunks, reducing memory overhead and improving performance for large-scale parsing tasks.

  • sax:

    SAX is highly efficient for large XML files due to its streaming nature. It processes data on-the-fly, which minimizes memory usage and allows for handling very large documents without significant performance degradation.

Error Handling

  • xml2js:

    xml2js offers some error handling capabilities, but it may not be as forgiving as htmlparser2. It can throw errors when encountering unexpected XML structures, requiring developers to ensure their XML is well-formed.

  • cheerio:

    Cheerio does not perform extensive error handling for malformed HTML, as it is designed to be forgiving and can work with imperfect markup. However, it may not provide detailed error messages, which can make debugging more challenging in complex scenarios.

  • htmlparser2:

    htmlparser2 is robust in handling malformed HTML and XML. It is designed to be forgiving, allowing developers to parse documents that do not conform to strict standards without crashing, making it suitable for web scraping.

  • sax:

    SAX provides minimal error handling, as it is focused on streaming and efficiency. Developers need to implement their own error handling logic to manage parsing errors, which can be a drawback in some use cases.

Use Cases

  • xml2js:

    xml2js is ideal for applications that frequently interact with XML data and require a straightforward way to convert XML into JavaScript objects. It is commonly used in scenarios where XML data needs to be integrated into JavaScript applications seamlessly.

  • cheerio:

    Cheerio is best suited for web scraping and server-side DOM manipulation tasks where developers want to leverage jQuery-like syntax. It is ideal for projects that require quick data extraction and manipulation from HTML documents.

  • htmlparser2:

    htmlparser2 is a versatile parser that can be used for both HTML and XML parsing. It is suitable for applications that need to handle a variety of document types, especially when performance is a concern.

  • sax:

    SAX is perfect for applications that need to process large XML files or streams of XML data in a memory-efficient manner. It is commonly used in scenarios where real-time processing of XML data is required, such as in data feeds or APIs.

Learning Curve

  • xml2js:

    xml2js is relatively easy to learn, especially for developers already familiar with JavaScript objects. Its straightforward API allows for quick integration and manipulation of XML data, making it accessible for most developers.

  • cheerio:

    Cheerio has a gentle learning curve, especially for developers familiar with jQuery. Its syntax and methods are intuitive, making it easy to pick up and use effectively for DOM manipulation tasks.

  • htmlparser2:

    htmlparser2 has a moderate learning curve due to its low-level API and streaming nature. Developers may need to familiarize themselves with event-driven programming to use it effectively, which can be a barrier for beginners.

  • sax:

    SAX has a steeper learning curve as it requires understanding event-driven programming and managing state across events. This can be challenging for developers who are not accustomed to this paradigm.

How to Choose: xml2js vs cheerio vs htmlparser2 vs sax

  • xml2js:

    Use xml2js when you need to convert XML data into JavaScript objects easily. It is particularly useful for applications that require seamless integration of XML data into JavaScript environments, allowing for straightforward manipulation and access to XML data.

  • cheerio:

    Choose Cheerio if you need a fast and flexible library for server-side jQuery-like manipulation of HTML documents. It is ideal for web scraping and allows you to use familiar jQuery syntax to traverse and manipulate the DOM.

  • htmlparser2:

    Select htmlparser2 when you require a fast, forgiving HTML and XML parser that can handle malformed markup. It is suitable for scenarios where performance is critical and you need to parse large documents efficiently without the overhead of a full DOM.

  • sax:

    Opt for sax if you need a streaming XML parser that is lightweight and efficient. It is perfect for processing large XML files in a memory-efficient manner, as it emits events as it parses the document, allowing for real-time processing without loading the entire document into memory.

README for xml2js

node-xml2js

Ever had the urge to parse XML? And wanted to access the data in some sane, easy way? Don't want to compile a C parser, for whatever reason? Then xml2js is what you're looking for!

Description

Simple XML to JavaScript object converter. It supports bi-directional conversion. Uses sax-js and xmlbuilder-js.

Note: If you're looking for a full DOM parser, you probably want JSDom.

Installation

Simplest way to install xml2js is to use npm, just npm install xml2js which will download xml2js and all dependencies.

xml2js is also available via Bower, just bower install xml2js which will download xml2js and all dependencies.

Usage

No extensive tutorials required because you are a smart developer! The task of parsing XML should be an easy one, so let's make it so! Here's some examples.

Shoot-and-forget usage

You want to parse XML as simple and easy as possible? It's dangerous to go alone, take this:

var parseString = require('xml2js').parseString;
var xml = "<root>Hello xml2js!</root>"
parseString(xml, function (err, result) {
    console.dir(result);
});

Can't get easier than this, right? This works starting with xml2js 0.2.3. With CoffeeScript it looks like this:

{parseString} = require 'xml2js'
xml = "<root>Hello xml2js!</root>"
parseString xml, (err, result) ->
    console.dir result

If you need some special options, fear not, xml2js supports a number of options (see below), you can specify these as second argument:

parseString(xml, {trim: true}, function (err, result) {
});

Simple as pie usage

That's right, if you have been using xml-simple or a home-grown wrapper, this was added in 0.1.11 just for you:

var fs = require('fs'),
    xml2js = require('xml2js');

var parser = new xml2js.Parser();
fs.readFile(__dirname + '/foo.xml', function(err, data) {
    parser.parseString(data, function (err, result) {
        console.dir(result);
        console.log('Done');
    });
});

Look ma, no event listeners!

You can also use xml2js from CoffeeScript, further reducing the clutter:

fs = require 'fs',
xml2js = require 'xml2js'

parser = new xml2js.Parser()
fs.readFile __dirname + '/foo.xml', (err, data) ->
  parser.parseString data, (err, result) ->
    console.dir result
    console.log 'Done.'

But what happens if you forget the new keyword to create a new Parser? In the middle of a nightly coding session, it might get lost, after all. Worry not, we got you covered! Starting with 0.2.8 you can also leave it out, in which case xml2js will helpfully add it for you, no bad surprises and inexplicable bugs!

Promise usage

var xml2js = require('xml2js');
var xml = '<foo></foo>';

// With parser
var parser = new xml2js.Parser(/* options */);
parser.parseStringPromise(xml).then(function (result) {
  console.dir(result);
  console.log('Done');
})
.catch(function (err) {
  // Failed
});

// Without parser
xml2js.parseStringPromise(xml /*, options */).then(function (result) {
  console.dir(result);
  console.log('Done');
})
.catch(function (err) {
  // Failed
});

Parsing multiple files

If you want to parse multiple files, you have multiple possibilities:

  • You can create one xml2js.Parser per file. That's the recommended one and is promised to always just work.
  • You can call reset() on your parser object.
  • You can hope everything goes well anyway. This behaviour is not guaranteed work always, if ever. Use option #1 if possible. Thanks!

So you wanna some JSON?

Just wrap the result object in a call to JSON.stringify like this JSON.stringify(result). You get a string containing the JSON representation of the parsed object that you can feed to JSON-hungry consumers.

Displaying results

You might wonder why, using console.dir or console.log the output at some level is only [Object]. Don't worry, this is not because xml2js got lazy. That's because Node uses util.inspect to convert the object into strings and that function stops after depth=2 which is a bit low for most XML.

To display the whole deal, you can use console.log(util.inspect(result, false, null)), which displays the whole result.

So much for that, but what if you use eyes for nice colored output and it truncates the output with ? Don't fear, there's also a solution for that, you just need to increase the maxLength limit by creating a custom inspector var inspect = require('eyes').inspector({maxLength: false}) and then you can easily inspect(result).

XML builder usage

Since 0.4.0, objects can be also be used to build XML:

var xml2js = require('xml2js');

var obj = {name: "Super", Surname: "Man", age: 23};

var builder = new xml2js.Builder();
var xml = builder.buildObject(obj);

will result in:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<root>
  <name>Super</name>
  <Surname>Man</Surname>
  <age>23</age>
</root>

At the moment, a one to one bi-directional conversion is guaranteed only for default configuration, except for attrkey, charkey and explicitArray options you can redefine to your taste. Writing CDATA is supported via setting the cdata option to true.

To specify attributes:

var xml2js = require('xml2js');

var obj = {root: {$: {id: "my id"}, _: "my inner text"}};

var builder = new xml2js.Builder();
var xml = builder.buildObject(obj);

will result in:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<root id="my id">my inner text</root>

Adding xmlns attributes

You can generate XML that declares XML namespace prefix / URI pairs with xmlns attributes.

Example declaring a default namespace on the root element:

let obj = { 
  Foo: {
    $: {
      "xmlns": "http://foo.com"
    }   
  }
};  

Result of buildObject(obj):

<Foo xmlns="http://foo.com"/>

Example declaring non-default namespaces on non-root elements:

let obj = {
  'foo:Foo': {
    $: {
      'xmlns:foo': 'http://foo.com'
    },
    'bar:Bar': {
      $: {
        'xmlns:bar': 'http://bar.com'
      }
    }
  }
}

Result of buildObject(obj):

<foo:Foo xmlns:foo="http://foo.com">
  <bar:Bar xmlns:bar="http://bar.com"/>
</foo:Foo>

Processing attribute, tag names and values

Since 0.4.1 you can optionally provide the parser with attribute name and tag name processors as well as element value processors (Since 0.4.14, you can also optionally provide the parser with attribute value processors):


function nameToUpperCase(name){
    return name.toUpperCase();
}

//transform all attribute and tag names and values to uppercase
parseString(xml, {
  tagNameProcessors: [nameToUpperCase],
  attrNameProcessors: [nameToUpperCase],
  valueProcessors: [nameToUpperCase],
  attrValueProcessors: [nameToUpperCase]},
  function (err, result) {
    // processed data
});

The tagNameProcessors and attrNameProcessors options accept an Array of functions with the following signature:

function (name){
  //do something with `name`
  return name
}

The attrValueProcessors and valueProcessors options accept an Array of functions with the following signature:

function (value, name) {
  //`name` will be the node name or attribute name
  //do something with `value`, (optionally) dependent on the node/attr name
  return value
}

Some processors are provided out-of-the-box and can be found in lib/processors.js:

  • normalize: transforms the name to lowercase. (Automatically used when options.normalize is set to true)

  • firstCharLowerCase: transforms the first character to lower case. E.g. 'MyTagName' becomes 'myTagName'

  • stripPrefix: strips the xml namespace prefix. E.g <foo:Bar/> will become 'Bar'. (N.B.: the xmlns prefix is NOT stripped.)

  • parseNumbers: parses integer-like strings as integers and float-like strings as floats E.g. "0" becomes 0 and "15.56" becomes 15.56

  • parseBooleans: parses boolean-like strings to booleans E.g. "true" becomes true and "False" becomes false

Options

Apart from the default settings, there are a number of options that can be specified for the parser. Options are specified by new Parser({optionName: value}). Possible options are:

  • attrkey (default: $): Prefix that is used to access the attributes. Version 0.1 default was @.
  • charkey (default: _): Prefix that is used to access the character content. Version 0.1 default was #.
  • explicitCharkey (default: false) Determines whether or not to use a charkey prefix for elements with no attributes.
  • trim (default: false): Trim the whitespace at the beginning and end of text nodes.
  • normalizeTags (default: false): Normalize all tag names to lowercase.
  • normalize (default: false): Trim whitespaces inside text nodes.
  • explicitRoot (default: true): Set this if you want to get the root node in the resulting object.
  • emptyTag (default: ''): what will the value of empty nodes be. In case you want to use an empty object as a default value, it is better to provide a factory function () => ({}) instead. Without this function a plain object would become a shared reference across all occurrences with unwanted behavior.
  • explicitArray (default: true): Always put child nodes in an array if true; otherwise an array is created only if there is more than one.
  • ignoreAttrs (default: false): Ignore all XML attributes and only create text nodes.
  • mergeAttrs (default: false): Merge attributes and child elements as properties of the parent, instead of keying attributes off a child attribute object. This option is ignored if ignoreAttrs is true.
  • validator (default null): You can specify a callable that validates the resulting structure somehow, however you want. See unit tests for an example.
  • xmlns (default false): Give each element a field usually called '$ns' (the first character is the same as attrkey) that contains its local name and namespace URI.
  • explicitChildren (default false): Put child elements to separate property. Doesn't work with mergeAttrs = true. If element has no children then "children" won't be created. Added in 0.2.5.
  • childkey (default $$): Prefix that is used to access child elements if explicitChildren is set to true. Added in 0.2.5.
  • preserveChildrenOrder (default false): Modifies the behavior of explicitChildren so that the value of the "children" property becomes an ordered array. When this is true, every node will also get a #name field whose value will correspond to the XML nodeName, so that you may iterate the "children" array and still be able to determine node names. The named (and potentially unordered) properties are also retained in this configuration at the same level as the ordered "children" array. Added in 0.4.9.
  • charsAsChildren (default false): Determines whether chars should be considered children if explicitChildren is on. Added in 0.2.5.
  • includeWhiteChars (default false): Determines whether whitespace-only text nodes should be included. Added in 0.4.17.
  • async (default false): Should the callbacks be async? This might be an incompatible change if your code depends on sync execution of callbacks. Future versions of xml2js might change this default, so the recommendation is to not depend on sync execution anyway. Added in 0.2.6.
  • strict (default true): Set sax-js to strict or non-strict parsing mode. Defaults to true which is highly recommended, since parsing HTML which is not well-formed XML might yield just about anything. Added in 0.2.7.
  • attrNameProcessors (default: null): Allows the addition of attribute name processing functions. Accepts an Array of functions with following signature:
    function (name){
        //do something with `name`
        return name
    }
    
    Added in 0.4.14
  • attrValueProcessors (default: null): Allows the addition of attribute value processing functions. Accepts an Array of functions with following signature:
    function (value, name){
      //do something with `name`
      return name
    }
    
    Added in 0.4.1
  • tagNameProcessors (default: null): Allows the addition of tag name processing functions. Accepts an Array of functions with following signature:
    function (name){
      //do something with `name`
      return name
    }
    
    Added in 0.4.1
  • valueProcessors (default: null): Allows the addition of element value processing functions. Accepts an Array of functions with following signature:
    function (value, name){
      //do something with `name`
      return name
    }
    
    Added in 0.4.6

Options for the Builder class

These options are specified by new Builder({optionName: value}). Possible options are:

  • attrkey (default: $): Prefix that is used to access the attributes. Version 0.1 default was @.
  • charkey (default: _): Prefix that is used to access the character content. Version 0.1 default was #.
  • rootName (default root or the root key name): root element name to be used in case explicitRoot is false or to override the root element name.
  • renderOpts (default { 'pretty': true, 'indent': ' ', 'newline': '\n' }): Rendering options for xmlbuilder-js.
    • pretty: prettify generated XML
    • indent: whitespace for indentation (only when pretty)
    • newline: newline char (only when pretty)
  • xmldec (default { 'version': '1.0', 'encoding': 'UTF-8', 'standalone': true }: XML declaration attributes.
    • xmldec.version A version number string, e.g. 1.0
    • xmldec.encoding Encoding declaration, e.g. UTF-8
    • xmldec.standalone standalone document declaration: true or false
  • doctype (default null): optional DTD. Eg. {'ext': 'hello.dtd'}
  • headless (default: false): omit the XML header. Added in 0.4.3.
  • allowSurrogateChars (default: false): allows using characters from the Unicode surrogate blocks.
  • cdata (default: false): wrap text nodes in <![CDATA[ ... ]]> instead of escaping when necessary. Does not add <![CDATA[ ... ]]> if it is not required. Added in 0.4.5.

renderOpts, xmldec,doctype and headless pass through to xmlbuilder-js.

Updating to new version

Version 0.2 changed the default parsing settings, but version 0.1.14 introduced the default settings for version 0.2, so these settings can be tried before the migration.

var xml2js = require('xml2js');
var parser = new xml2js.Parser(xml2js.defaults["0.2"]);

To get the 0.1 defaults in version 0.2 you can just use xml2js.defaults["0.1"] in the same place. This provides you with enough time to migrate to the saner way of parsing in xml2js 0.2. We try to make the migration as simple and gentle as possible, but some breakage cannot be avoided.

So, what exactly did change and why? In 0.2 we changed some defaults to parse the XML in a more universal and sane way. So we disabled normalize and trim so xml2js does not cut out any text content. You can reenable this at will of course. A more important change is that we return the root tag in the resulting JavaScript structure via the explicitRoot setting, so you need to access the first element. This is useful for anybody who wants to know what the root node is and preserves more information. The last major change was to enable explicitArray, so everytime it is possible that one might embed more than one sub-tag into a tag, xml2js >= 0.2 returns an array even if the array just includes one element. This is useful when dealing with APIs that return variable amounts of subtags.

Running tests, development

Build Status Coverage Status Dependency Status

The development requirements are handled by npm, you just need to install them. We also have a number of unit tests, they can be run using npm test directly from the project root. This runs zap to discover all the tests and execute them.

If you like to contribute, keep in mind that xml2js is written in CoffeeScript, so don't develop on the JavaScript files that are checked into the repository for convenience reasons. Also, please write some unit test to check your behaviour and if it is some user-facing thing, add some documentation to this README, so people will know it exists. Thanks in advance!

Getting support

Please, if you have a problem with the library, first make sure you read this README. If you read this far, thanks, you're good. Then, please make sure your problem really is with xml2js. It is? Okay, then I'll look at it. Send me a mail and we can talk. Please don't open issues, as I don't think that is the proper forum for support problems. Some problems might as well really be bugs in xml2js, if so I'll let you know to open an issue instead :)

But if you know you really found a bug, feel free to open an issue instead.