httparsed 1.1.0

httparsed

Push parser of HTTP/1.x requests and responses. Other internet message like protocols (ie RTSP) are supported too.

Inspired by picohttpparser.

Features

• doesn't allocate anything on it's own (nothrow @nogc)
• works with betterC
• uses compile time introspection to pass parsed message parts to callbacks
• doesn't store any internal state
• handles incomplete messages and can continue parsing from previous buffer index
• no dependencies
• uses SSE4.2 with LDC2 compiler and SSE4.2 enabled target CPU

Usage

// define our message content handler
struct Header
{
    const(char)[] name;
    const(char)[] value;
}

// Just store slices of parsed message header
struct Msg
{
    @safe pure nothrow @nogc:
    void onMethod(const(char)[] method) { this.method = method; }
    void onUri(const(char)[] uri) { this.uri = uri; }
    void onVersion(const(char)[] ver) { this.ver = ver; }
    void onHeader(const(char)[] name, const(char)[] value) {
        this.m_headers[m_headersLength].name = name;
        this.m_headers[m_headersLength++].value = value;
    }
    void onStatus(int status) { this.status = status; }
    void onStatusMsg(const(char)[] statusMsg) { this.statusMsg = statusMsg; }

    const(char)[] method;
    const(char)[] uri;
    const(char)[] ver;
    int status;
    const(char)[] statusMsg;

    private {
        Header[32] m_headers;
        size_t m_headersLength;
    }

    Header[] headers() return { return m_headers[0..m_headersLength]; }
}

// init parser
auto reqParser = initParser!Msg(); // or `MsgParser!MSG reqParser;`
auto resParser = initParser!Msg(); // or `MsgParser!MSG resParser;`

// parse request
string data = "GET /foo HTTP/1.1\r\nHost: 127.0.0.1:8090\r\n";
int res = reqParser.parseRequest(data);
assert(res == data.length); // returns parsed message header length when parsed sucessfully, 0 when there is no error, but message isn't complete yet, -errcode on error

// parse response
data = "HTTP/1.0 200 OK\r\n";
uint lastPos; // store last parsed position for next run
res = resParser.parseResponse(data, lastPos);
assert(res == 0); // no complete message header yet, but no error
data = "HTTP/1.0 200 OK\r\nContent-Type: text/plain\r\nContent-Length: 3\r\n\r\nfoo";
res = resParser.parseResponse(data, lastPos); // starts parsing from previous position
assert(res == data.length - 3); // whole message header parsed, body left to be handled based on actual header values

SSE4.2

To use SSE4.2 use this in your dub.sdl:

dflags "-mcpu=native" platform="ldc"

Performance

• Tested on: AMD Ryzen 7 3700X 8-Core Processor
• Best of 5 runs for each parser
• tested parsers:
• httparsed (noop) - this parser but with a provided message context with no callbacks - it just parses through requests, but doesn't use anything
• httparsed - this parser with a simple msg struct as in example above
• picohttpparser
• http_parser
• llhttp - replacement of http_parser
• vibe-d - stripped down version of HTTP request parser used in vibe-d
• arsd - stripped down HTTP request parser of arsd's cgi.d package