Home | Javadocs | Web-Scraping Tutorial | JSON Querying Tutorial | FAQ | Download

Jaunt Java Web Scraping & JSON Querying

Introduction
January 23, 2016
Jaunt 1.1.3 release

Test drive Jaunt today and leave feedback in the forum to help shape the next release!
Jaunt is a new, free, Java library for web-scraping & web-automation, including JSON querying. The library provides an ultra-light headless browser (ie, no GUI). By using Jaunt your Java programs can easily perform browser-level, document-level, and DOM-level operations. Jaunt is the ideal tool when Javascript support is not required, for tasks including:
  • filling out and submitting web forms
  • creating web-bots or web-scraping programs.
  • writing http-clients for REST APIs or web-apps (JSON, HTML, XHTML, or XML).
Code example: Google scraper - search for 'butterflies'
UserAgent userAgent = new UserAgent();         //create new userAgent (headless browser)
userAgent.visit("http://google.com");          //visit google
userAgent.doc.apply("butterflies");            //apply form input (starting at first editable field)
userAgent.doc.submit("Google Search");         //click submit button labelled "Google Search"
    
Elements links = userAgent.doc.findEvery("<h3 class=r>").findEvery("<a>");  //find search result links
for(Element link : links) System.out.println(link.getAt("href"));           //print results
Features:
Jaunt is free [see product comparison]. Features include:
  • Parsing dirty HTML, XHTML, XML, JSON
  • Support for HTTP, HTTPS & basic auth.
  • Form fill-out via field labels/names/sequence.
  • Generating form data permutations.
  • File downloading/uploading.
  • Saving complete web page (images, js, css, etc).
  • Table data extraction.
  • Fluent DOM navigation & search (search chaining).
  • Regex-enabled querying in DOM & JSON.
  • HTTP header/cookie manipulation.
  • HTTP/HTTPS proxy support.
  • Customizable caching & content handlers.
  • Web pagination discovery.
  • 100% Java (no dependencies)

Home | Javadocs | Web-Scraping Tutorial | JSON Querying Tutorial | FAQ | Download