Home | Javadocs | Web-Scraping Tutorial | JSON Querying Tutorial | FAQ | Download

Jaunt Java Web Scraping & JSON Querying

Introduction
Sep 17, 2018
Jaunt 1.4.6 release

Test drive Jaunt today and leave feedback in the forum to help shape the next release!
Jaunt is a Java library for web-scraping, web-automation and JSON querying. The library features a fast, ultra-light, headless (ie, no GUI) browser. The browser provides web-scraping functionality (tables, form-fillout), access to the DOM and to HTTP Requests/Responses, but does not perform Javascript execution. Jaunt enables your Java programs to:
  • fill out and submit web forms
  • peform web-scraping and JSON data extraction
  • interface with REST APIs or web-apps (JSON, HTML, XHTML, or XML).
Code example: Google scraper - search for 'butterflies'
UserAgent userAgent = new UserAgent();         //create new userAgent (headless browser)
userAgent.visit("http://google.com");          //visit google
userAgent.doc.apply("butterflies");            //apply form input (starting at first editable field)
userAgent.doc.submit("Google Search");         //click submit button labelled "Google Search"
    
Elements links = userAgent.doc.findEvery("<h3>").findEvery("<a>");  //find search result links
for(Element link : links) System.out.println(link.getAt("href"));   //print results
Features:
Jaunt is free [see product comparison]. Features include:
  • Parsing dirty HTML, XHTML, XML, JSON
  • Support for HTTP, HTTPS & basic auth.
  • Form fill-out via field labels/names/sequence.
  • Generating form data permutations.
  • File downloading/uploading.
  • Saving complete web page (images, js, css, etc).
  • Table data extraction.
  • Fluent DOM navigation & search (search chaining).
  • Regex-enabled querying in DOM & JSON.
  • HTTP header/cookie manipulation.
  • HTTP/HTTPS proxy support.
  • Customizable caching & content handlers.
  • Web pagination discovery.
  • 100% Java (no dependencies)

Home | Javadocs | Web-Scraping Tutorial | JSON Querying Tutorial | FAQ | Download