Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/AdRoll/baker
/ types & classes
Types & classes
221 in github.com/AdRoll/baker
⨍
Functions
846
◇
Types & classes
221
↓ 33 callers
TypeAlias
bitmap
a bitmap is a bit array where bits correspond to cells, 0 indicates a free cell and 1 t a busy one.
pkg/buffercache/bitmap.go:9
↓ 32 callers
TypeAlias
FieldIndex
FieldIndex is the index uniquely representing of a field in a Record.
record.go:4
↓ 5 callers
TypeAlias
errInvalidConfig
pkg/buffercache/cache.go:73
↓ 3 callers
TypeAlias
SizeBytes
size_bytes.go:10
↓ 3 callers
TypeAlias
errUnsupportedURLScheme
errUnsupportedURLScheme is the error indicating a path has an invalid or unsupported URL scheme for the S3Input.
input/inpututils/s3.go:125
↓ 2 callers
TypeAlias
location
A location represents the location of an entry in the cache. It can either point to an entry in the hot or in the cold cache. The MSB indicates wheth
pkg/buffercache/location.go:18
↓ 1 callers
TypeAlias
sqsFormatType
input/sqs.go:79
Struct
Base
Base is a nop implementation of baker.Output useful to be embedded in tests and to redeclare one or more methods.
output/outputtest/base.go:7
Struct
Base
Base is a nop implementation of baker.Upload useful to be embedded in tests and to redeclare one or more methods.
upload/uploadtest/base.go:7
Struct
Base
Base is a nop implementation of baker.Filter useful to be embedded in tests and to redeclare one or more methods.
filter/filtertest/base.go:7
Struct
Base
Base is a nop implementation of baker.Input useful to be embedded in tests and to redeclare one or more methods.
input/inputtest/base.go:7
Struct
BufferCache
A BufferCache is like a map[string][]byte that is optimized for appending new bytes to the cache values.
pkg/buffercache/cache.go:54
Struct
Cache
Cache is a concurrent size-limited cache. If the cache size reaches maxCacheEntries all existing entries are removed. maxCacheEntries should effectiv
filter/metadata/cache.go:14
TypeAlias
Cache
Cache is a per-record cache.
record.go:75
TypeAlias
Channel
A Channel input is a Baker input used for testing. It's a channel tests can use to send record blobs (baker.Data)
input/inputtest/channel.go:19
Struct
Clause
Will real sum types ever make it to go? Validness of the fields in this structure depend on clauseType
filter/clausefilter.go:121
Struct
ClauseFilter
filter/clausefilter.go:84
Struct
ClauseFilterConfig
ClauseFilterConfig describes the ClauseFilter filter config
filter/clausefilter.go:80
Struct
ClearFields
ClearFields filter clears (i.e set to the empty string) a set of fields.
filter/clear_fields.go:24
Struct
ClearFieldsConfig
ClearFieldsConfig holds config parameters of the ClearFields filter.
filter/clear_fields.go:19
Struct
Client
Client allows to instrument code and export the metrics to a dogstatds client.
metrics/datadog/client.go:32
Struct
ComponentParams
ComponentParams holds the common configuration parameters passed to components of all kinds.
desc.go:23
Struct
Components
Components holds the descriptions of all components one can use to build a topology.
desc.go:5
Struct
CompressedInput
CompressedInput is a base for creating input components that processes multiple gzip or zstd-compressed logs coming from arbitrary sources. This clas
input/inpututils/compressedstream.go:55
Struct
Concatenate
filter/concatenate.go:25
Struct
ConcatenateConfig
filter/concatenate.go:19
Struct
Conf
Conf holds required configurations that are passed to NewServer to configure the Server
output/websocket/server.go:23
Struct
Config
A Config specifies the configuration for a topology.
config.go:128
Struct
Config
Config is the configuration of the Datadog metrics client.
metrics/datadog/client.go:24
Struct
Config
Config configures a BufferCache.
pkg/buffercache/cache.go:17
Struct
ConfigCSV
ConfigCSV defines configuration for CSV records
config.go:95
Struct
ConfigFields
ConfigFields specifies names for records fields. In addition of being a list of names, the position of each name in the slice also indicates the Field
config.go:119
Struct
ConfigFilter
ConfigFilter specifies the configuration for a single filter component.
config.go:56
Struct
ConfigFilterChain
ConfigFilterChain specifies the configuration for the whole fitler chain.
config.go:47
Struct
ConfigGeneral
A ConfigGeneral specifies general configuration for the whole topology.
config.go:101
Struct
ConfigInput
The configuration for the topology is parsed from TOML format. Each of Input, Filter, Output have a separate section (table) in the file containing a
config.go:37
Struct
ConfigMetrics
ConfigMetrics holds metrics configuration.
config.go:107
Struct
ConfigOutput
ConfigOutput specifies the configuration for the output component.
config.go:65
Struct
ConfigUpload
ConfigUpload specifies the configuration for the upload component.
config.go:80
Struct
ConfigUser
A ConfigUser defines a user-specific configuration entry.
config.go:89
TypeAlias
ConfigValidation
ConfigValidation specifies regular expressions for field names, used to generate the Record validation function.
config.go:125
Struct
CountAndTag
filter/count_and_tag.go:36
Struct
CountAndTagConfig
filter/count_and_tag.go:30
Struct
Crypt
filter/crypt.go:47
Struct
CryptConfig
filter/crypt.go:33
Struct
Data
Data represents raw data consumed by a baker input, possibly containing multiple records before they're parsed.
api.go:5
Struct
Dedup
filter/dedup.go:41
Struct
DedupConfig
filter/dedup.go:30
Struct
DynamoDB
DynamoDB is a class to do optimized batched writes to a single DynamoDB table with a fixed schema (same number of columns for all records).
output/dyndb.go:199
Struct
DynamoDBConfig
output/dyndb.go:167
Struct
ErrorRequiredField
ErrorRequiredField describes the absence of a required field in a component configuration.
config.go:571
Struct
ExpandJSON
filter/expand_json.go:54
Struct
ExpandJSONConfig
filter/expand_json.go:40
Struct
ExpandList
filter/expand_list.go:55
Struct
ExpandListConfig
filter/expand_list.go:43
Struct
ExternalMatch
filter/external_match.go:45
Struct
ExternalMatchConfig
filter/external_match.go:32
Struct
FileWriter
output/filewriter.go:121
Struct
FileWriterConfig
output/filewriter.go:93
Interface
Filter
Filter represents a data filter; a filter is a function that processes records. A filter can discard, transform, forward and even create records.
api.go:86
Struct
FilterDesc
FilterDesc describes a Filter component to the topology.
desc.go:76
Struct
FilterParams
FilterParams holds the parameters passed to Filter constructor.
desc.go:38
Struct
FilterStats
FilterStats contains statistics about the filter components, ready for export to the metric client and to print debug info
api.go:33
Struct
FormatTime
filter/format_time.go:78
Struct
FormatTimeConfig
filter/format_time.go:62
Struct
Hash
filter/hash.go:40
Struct
HashConfig
filter/hash.go:33
TypeAlias
HelpFormat
HelpFormat represents the possible formats for baker help.
help.go:10
Interface
Input
Input is an interface representing an object that produces (fetches) datas for the filter.
api.go:58
Struct
InputDesc
InputDesc describes an Input component to the topology.
desc.go:68
Struct
InputParams
InputParams holds the parameters passed to Input constructor.
desc.go:33
Struct
InputStats
InputStats contains statistics about the input component, ready for export to the metric client and to print debug info.
api.go:25
Struct
KCL
KCL is a Baker input reading from Kinesis with the KCL (Kinesis Client Library).
input/kcl.go:85
Struct
KCLConfig
KCLConfig is the configuration for the KCL input.
input/kcl.go:40
Struct
Kinesis
input/kinesis.go:46
Struct
KinesisConfig
input/kinesis.go:28
Struct
LazyFilter
examples/filtering/filter.go:19
Struct
LazyFilterConfig
examples/filtering/filter.go:16
Struct
List
input/list.go:78
Struct
ListConfig
for tests
input/list.go:58
Struct
LogLine
LogLine represents a CSV text line using ASCII 30 as field separator. It implement Record.. In memory, it is kept in a format optimized for very fast
logline.go:32
Struct
LogLine
A LogLine input is a Baker input used for testing.
input/inputtest/logline.go:21
Struct
LogLineConfig
LogLineConfig holds the log lines to be fed to the Baker topology.
input/inputtest/logline.go:15
TypeAlias
Metadata
Metadata about the input data; each Input will directly populate this map as appropriate. Consumers (filters) will access via Get()
api.go:12
Struct
MetadataLastModified
filter/metadata_lastmodified.go:23
Struct
MetadataLastModifiedConfig
filter/metadata_lastmodified.go:19
Struct
MetadataUrl
filter/metadata_url.go:30
Struct
MetadataUrlConfig
filter/metadata_url.go:26
Struct
Metrics
Metrics holds a snapshot of the performance counters of a BufferCache instance.
pkg/buffercache/metrics.go:4
TypeAlias
MetricsBag
A MetricsBag is collection of metrics, those metrics are reported by every Baker components, through their Stats method. Stats() is called once per se
metrics.go:12
Interface
MetricsClient
A MetricsClient allows to instrument components code and communicate the metrics to the metrics backend that is configured in Baker. New metrics back
metrics_client.go:12
Struct
MetricsDesc
MetricsDesc describes a Metrics interface to the topology.
desc.go:101
Struct
MockMetrics
MockMetrics is a metrics client to be used in tests only, which stores single calls made to the set of methods implementing the baker.MetricsClient in
testutil/mock_metrics.go:24
Struct
Nop
output/nop.go:16
Struct
NopConfig
output/nop.go:18
Struct
NopMetrics
NopMetrics implements a metrics.Client that does nothing.
nop_metrics.go:8
Struct
NotNull
NotNull is a baker filter that discards records having null fields.
filter/notnull.go:24
Struct
NotNullConfig
NotNullConfig holds configuration parameters for the NotNull filter.
filter/notnull.go:19
Struct
OpLog
output/oplog.go:22
Struct
OpLogConfig
output/oplog.go:18
next →
1–100 of 221, ranked by callers