google/robotstxt: Google’s robots.txt parser and matcher

A C++ 11 library for each major platform usefull to provide standard (slightly modified … production code used by Googlebot, Google’s crawler).

Simple to use: function named ParseRobotsTxt takes robots.txt content and a class derived from RobotsParseHandler (used as interface with several pure virtual method to implement).

google/robotstxt: The repository contains Google’s robots.txt parser and matcher as a C++ library (compliant to C++11).


C++ REST SDK (Casablanca) 1.0.0 is now available

First release version of Casablanca is available here partially compatible with Ubuntu (what about Mac?).

One very important point will be it’s ability to:

  • correctly stream content (I mean really stream with controled memory footprint),
  • availability of flexible request/response management.

For exemple, if it’s possible to easilly respond with stream gzipped MultipartFormDataContent made of stream parts or to managed chunked requests.