A field identifies a field in a struct, accessible from a structPointer. In this implementation, a field is identified by its byte offset from the sta

Error represents an error returned in a command reply.

A field identifies a field in a struct, accessible from a structPointer. In this implementation, a field is identified by the sequence of field indice

Map fields may have key types of non-float scalars, strings and enums. The easiest way to sort them in some deterministic order is to use fmt. If this

NOTE: These type_Foo functions would more idiomatically be methods, but Go does not allow methods on pointer types, and we must preserve some pointer

A word32 is the address of a "pointer to 32-bit value" field.

A word32Val is the address of a 32-bit value field.

word64 is like word32 but for 64-bit values.

word64Val is like word32Val but for 64-bit values.

Args is a helper for constructing command arguments from structured values.

AuthResponse represents the metadata returned from an AUTH command to nsqd

BackoffStrategy defines a strategy for calculating the duration of time a consumer should backoff for a given attempt

Created by i-xuchongpeng on 2016/8/11.

A Buffer is a buffer manager for marshaling and unmarshaling protocol buffers. It may be reused between invocations to reduce memory usage. It is no

BufferedWriter is an io.WriteCloser with behavior similar to writers returned by NewWriter but it buffers written data, maximizing block size (to impr

Protobuf type {@code proto.DocGzMeta} <p> <pre> 原始数据按照gz压缩文件格式存放在hdfs中 每128行原始数据合在一起称为一个 Document（文档） 一个hdfs文件按照2GB大小计算，大约可以容纳 10w 个压缩后的 Document 我们用

Protobuf type {@code proto.DocId}

Protobuf type {@code proto.DocIdList} <p> <pre> 一个分词可能会出现多个文档中，由于每个文档有多行原始数据组成 每个关联数据需要 docId、rawIndex 两个信息来描述 </pre>

Protobuf type {@code proto.FastPForCompressedDocIdList} <p> <pre> 压缩的docIdList, 使用FastPFOR算法压缩，两个数组解压后等长 </pre>

Protobuf type {@code proto.InvertedIndex} <p> <pre> Token-&gt;DocIds 倒排索引表结构。这个索引数据压缩后最终每天需要占用2TB空间。 hashid=hash64(token)%100亿，重复(冲突)不影响 直接在hdfs上进行分词，

Protobuf type {@code proto.FastPForCompressedInvertedIndex}

Protobuf type {@code proto.PdzCompressedInvertedIndex} <p> <pre> Pdz 压缩算法是针对Protobuf的 Repeated 字段的一种压缩算法，详细实现情况请见： pdz_compress.go </pre>

Protobuf type {@code proto.InvertedIndexGzMeta} <p> <pre> 存入NoSQL中，Key=int(hashid/N) </pre>

Command represents a command from a client to an NSQ daemon

压缩的docIdList, 使用FastPFOR算法压缩，两个数组解压后等长

Config contains the options for a storage client

Config is a struct of NSQ options The only valid way to create a Config is via NewConfig, using a struct literal will panic. After Config is passed i

ConfigFlag wraps a Config and implements the flag.Value interface

Conn represents a connection to a Redis server.

Conn represents a connection to nsqd Conn exposes a set of callbacks for the various events that occur on a connection

ConnDelegate is an interface of methods that are used as callbacks in Conn

ConnMux multiplexes one or more connections to a single underlying connection. The ConnMux connections do not support concurrency, commands that assoc

Consumer is a high-level type to consume from NSQ. A Consumer instance is supplied a Handler that will be executed concurrently via goroutines to han

ConsumerStats represents a snapshot of the state of a Consumer's connections and the messages it has seen

Descriptor represents a protocol buffer message.

DialOption specifies an option for dialing a Redis server.

DiscoveryFilter is an interface accepted by `SetBehaviorDelegate()` for filtering the nsqds returned from discovery via nsqlookupd

Protobuf type {@code proto.DocGzMeta} <p> <pre> 原始数据按照gz压缩文件格式存放在hdfs中 每128行原始数据合在一起称为一个 Document（文档） 一个hdfs文件按照2GB大小计算，大约可以容纳 10w 个压缩后的 Document 我们用

原始数据按照gz压缩文件格式存放在hdfs中 每128行原始数据合在一起称为一个 Document（文档） 一个hdfs文件按照2GB大小计算，大约可以容纳 10w 个压缩后的 Document 我们用 DocGzMeta 结构来描述文档相关的元数据信息

原始数据按照gz压缩文件格式存放在hdfs中 每128行原始数据合在一起称为一个 Document（文档） 一个hdfs文件按照2GB大小计算，大约可以容纳 10w 个压缩后的 Document 我们用 DocGzMeta 结构来描述文档相关的元数据信息

Protobuf type {@code proto.DocId}

Protobuf type {@code proto.DocIdList} <p> <pre> 一个分词可能会出现多个文档中，由于每个文档有多行原始数据组成 每个关联数据需要 docId、rawIndex 两个信息来描述 </pre>

一个分词可能会出现多个文档中，由于每个文档有多行原始数据组成 每个关联数据需要 docId、rawIndex 两个信息来描述

一个分词可能会出现多个文档中，由于每个文档有多行原始数据组成 每个关联数据需要 docId、rawIndex 两个信息来描述

Created by liwei on 9/26/16.

Created by liwei on 9/27/16.

EnumDescriptor describes an enum. If it's at top level, its parent will be nil. Otherwise it will be the descriptor of the message in which it is defi

ErrIdentify is returned from Conn as part of the IDENTIFY handshake

ErrProtocol is returned from Producer when encountering an NSQ protocol level error

ExponentialStrategy implements an exponential backoff strategy (default)

Extension represents an extension in a message.

ExtensionDesc represents an extension specification. Used in generated code from the protocol compiler.

ExtensionDescriptor describes an extension. If it's at top level, its parent will be nil. Otherwise it will be the descriptor of the message in which

ExtensionRange represents a range of message extensions for a protocol buffer. Used in code generated by the protocol compiler.

FailedMessageLogger is an interface that can be implemented by handlers that wish to receive a callback when a message is deemed "failed" (i.e. the nu

Protobuf type {@code proto.FastPForCompressedDocIdList} <p> <pre> 压缩的docIdList, 使用FastPFOR算法压缩，两个数组解压后等长 </pre>

压缩的docIdList, 使用FastPFOR算法压缩，两个数组解压后等长

Protobuf type {@code proto.FastPForCompressedInvertedIndex}

FileDescriptor describes an protocol buffer descriptor file (.proto). It includes slices of all the messages and enums defined within it. Those slices

Created by i-xuchongpeng on 2016/8/11.

Created by i-xuchongpeng on 2016/8/11.

FullJitterStrategy implements http://www.awsarchitectureblog.com/2015/03/backoff.html

Created by liwei on 6/8/16.

Generator is the type whose methods generate the output, stored in the associated response structure.

Created by liwei on 8/31/16.

Handler is the message processing interface for Consumer Implement this interface for handlers that return whether or not message processing complete

HandlerFunc is a convenience type to avoid having to declare a struct to implement the Handler interface, it can be used like this: consumer.AddHand