MCPcopy Create free account

hub / github.com/alibaba/MongoShake / functions

Functions933 in github.com/alibaba/MongoShake

↓ 2 callersFunctioncountChunks
countChunks count the number of chunks for specified sharded collection, support all db versions
tools/pre-split/pre_split.go:625
↓ 2 callersFunctioncountChunks
(dbName, collName, uuid)
tools/pre-split/dryRun_range.js:94
↓ 2 callersMethodcurrentQueue
()
collector/batcher.go:521
↓ 2 callersMethodensureNetwork
()
collector/ckpt/ckpt_operation.go:69
↓ 2 callersFunctionextractOriginalSpecs
extractOriginalSpecs extracts originalSpec from each index in a commitIndexBuild oplog. For indexes that have originalSpec, it uses the originalSpec a
executor/db_writer.go:408
↓ 2 callersFunctionfetchIndexes
* * fetch all indexes. * the cost is low so that no need to run in parallel. */
collector/coordinator/utils.go:198
↓ 2 callersMethodfilter
(log *oplog.PartialLog)
collector/batcher.go:122
↓ 2 callersMethodfilterNsByRules
filterNsByRules checks namespace against white/black list regex rules.
collector/filter/doc_filter.go:121
↓ 2 callersMethodfilterOplogGid
(batchedOplog [][]*oplog.GenericOplog)
collector/syncer.go:713
↓ 2 callersFunctiongenerateWMessage
return $nr oplog inside
tunnel/writer_test.go:17
↓ 2 callersFunctiongetDbVersion
()
tools/pre-split/dryRun_range.js:19
↓ 2 callersFunctiongetDbVersionArray
(client *mongo.Client)
tools/pre-split/pre_split.go:171
↓ 2 callersMethodgetLastOplog
* * return the last oplog, if the current batch is empty(first oplog in this batch is ddl), * just return the last oplog in the previous batch. * i
collector/batcher.go:118
↓ 2 callersFunctiongetNetAddr
()
quorum/quorum.go:203
↓ 2 callersFunctiongetOplogTimestamp
(conn *MongoCommunityConn, sortType int)
common/db_opertion.go:115
↓ 2 callersMethodgetOptions
()
common/sentinel.go:52
↓ 2 callersMethodgetQueryTimestamp
()
collector/reader/oplog_reader.go:100
↓ 2 callersFunctiongetShardKeyAndUuid
getShardKeyAndUuid return shard key, type(range/hashed) and uuid if exists
tools/pre-split/pre_split.go:252
↓ 2 callersFunctiongetShardKeyAndUuid
(dbName, collName)
tools/pre-split/dryRun_range.js:44
↓ 2 callersFunctiongetSourceDbUrl
priority use mongo_s_url
cmd/collector/sanitize.go:24
↓ 2 callersMethodhandleTransaction
(txnMeta oplog.TxnMeta, genericLog *oplog.GenericOplog)
collector/batcher.go:446
↓ 2 callersFunctionhaveMinMaxKey
haveMinMaxKey return true if bound have 'minKey' or 'maxKey'
tools/pre-split/pre_split.go:447
↓ 2 callersFunctioninitStartupHTTPApis
()
cmd/collector/collector.go:175
↓ 2 callersMethodinnerRun
()
collector/coordinator/extra_job.go:74
↓ 2 callersFunctionintersectionInOrder
(one bson.M, other bson.M)
executor/collision_matrix.go:288
↓ 2 callersFunctionisNumericBsonType
isNumericBsonType returns true if the BSON type is a numeric type. MongoDB treats int32, int64, double, and decimal128 as comparable in sort order, so
collector/docsyncer/doc_reader.go:202
↓ 2 callersMethodisTransaction
(partialLog *oplog.PartialLog)
collector/batcher.go:431
↓ 2 callersFunctionlsnLagSeconds
************************************************************/
common/metric.go:363
↓ 2 callersFunctionmapTestTxnByID
()
oplog/txn_test.go:74
↓ 2 callersMethodmarkCollectionFinished
(collectionMetric *CollectionMetric)
collector/docsyncer/doc_syncer.go:633
↓ 2 callersFunctionmarshalData
(input bson.M)
oplog/change_stream_event_test.go:68
↓ 2 callersFunctionmasterChanged
(status int)
quorum/quorum.go:41
↓ 2 callersFunctionmockEvent
mock change stream event
collector/syncer_test.go:46
↓ 2 callersMethodmoveToNextQueue
()
collector/batcher.go:516
↓ 2 callersFunctionparse
parse the address (topic@broker1,broker2,...)
tunnel/kafka/common.go:103
↓ 2 callersFunctionparseJsonValue
(input []byte)
tunnel/writer_test.go:37
↓ 2 callersFunctionpreSharingForRange
preSharingForRange does the pre-sharing work for range sharding
tools/pre-split/pre_split.go:465
↓ 2 callersMethodprobe
()
collector/worker.go:245
↓ 2 callersMethodpurge
Because state is currently kept in memory, purge merely drops the reference so the GC will eventually clean up. Eventually, this might clean up a fil
oplog/txn_buffer.go:53
↓ 2 callersMethodpurgeACK
()
collector/worker.go:262
↓ 2 callersFunctionremoveUncheck
(m)
tools/mongodb-schema.py:47
↓ 2 callersFunctionrun_full_sync
(conf_name, src_url, dst_url)
scripts/run_sys_test.py:96
↓ 2 callersFunctionrun_incr_sync
(conf_name, src_url, dst_url)
scripts/run_sys_test.py:164
↓ 2 callersFunctionsourceTimeFromGenericOplog
(log *oplog.GenericOplog)
collector/syncer.go:533
↓ 2 callersFunctiontestBufferOps
(t *testing.T, buffer *TxnBuffer, ops []ParsedLog, txnByID map[TxnID]*TestData)
oplog/txn_test.go:203
↓ 2 callersFunctiontransformPartialLog
(partialLog *oplog.PartialLog, nsTrans *transform.NamespaceTransform, transformRef bool)
executor/executor.go:281
↓ 2 callersFunctionusage
()
tools/mongodb-schema.py:132
↓ 2 callersFunctionusage
()
scripts/comparison_3x.py:218
↓ 2 callersFunctionusage
()
scripts/comparison.py:186
↓ 2 callersFunctionversionCompare
(v1, v2)
tools/pre-split/dryRun_range.js:27
↓ 2 callersFunctionwait
(duration time.Duration)
quorum/quorum.go:199
↓ 2 callersFunctionwaitClosed
(t *testing.T, ch <-chan struct{}, msg string)
cmd/collector/collector_test.go:134
↓ 1 callersMethodAddApply
(incr uint64)
common/metric.go:269
↓ 1 callersMethodAddCheckpoint
(number uint64)
common/metric.go:249
↓ 1 callersMethodAddConsume
(incr uint64)
common/metric.go:279
↓ 1 callersFunctionAddExtraJob
(name string, interval int, input ...interface{})
collector/coordinator/extra_job.go:29
↓ 1 callersMethodAddFailed
(incr uint64)
common/metric.go:274
↓ 1 callersMethodAddRetransmission
(number uint64)
common/metric.go:254
↓ 1 callersMethodAddTunnelTraffic
(number uint64)
common/metric.go:259
↓ 1 callersMethodApply
()
common/metric.go:227
↓ 1 callersMethodApproximateSize
()
tunnel/tunnel.go:107
↓ 1 callersMethodBind
Bind bind different worker
collector/syncer.go:189
↓ 1 callersFunctionCheckpoint
(ckptMap map[string]utils.TimestampNode)
collector/docsyncer/doc_syncer.go:301
↓ 1 callersMethodClear
(s uint64)
common/metric.go:389
↓ 1 callersMethodClose
()
collector/docsyncer/doc_reader.go:92
↓ 1 callersMethodCompress
(chunk []byte)
modules/compress.go:36
↓ 1 callersFunctionConvertV2Oplog
(prefixField string, obj bson.D)
oplog/oplog.go:372
↓ 1 callersMethodCounter
()
tools/mongo_id.go:32
↓ 1 callersMethodCrashf
(format string, args ...any)
pkg/log/logger.go:272
↓ 1 callersMethodCreate
create specific Tunnel with tunnel name and pass connection or usefully meta
tunnel/tunnel.go:184
↓ 1 callersMethodCurrentDate
()
common/community_client.go:254
↓ 1 callersMethodDecompress
(compressed []byte)
modules/compress.go:37
↓ 1 callersMethodDistributeOplogByMod
DistributeOplogByMod We need to ensure that oplog entry will be sent to the same job[$hash] if they have the same ObjectID. thus we can consume the op
oplog/hasher.go:53
↓ 1 callersMethodEnsureNetwork
EnsureNetwork establish the mongodb connection at first if current connection is not ready or disconnected
collector/reader/oplog_reader.go:209
↓ 1 callersFunctionExactlyMatch
(first, second interface{})
executor/collision_matrix.go:224
↓ 1 callersFunctionFetchAllDocumentBsonD
(client *mongo.Client, testDb string, testCollection string, opts *options.FindOptions)
unit_test_common/common.go:9
↓ 1 callersMethodFetchNewestTimestamp
ensure network
collector/reader/reader.go:16
↓ 1 callersMethodFilterNs
(namespace string)
collector/filter/doc_filter.go:55
↓ 1 callersMethodFilterNs
(namespace string)
collector/filter/doc_filter.go:69
↓ 1 callersFunctionGatherApplyOps
(input []*PartialLog)
oplog/oplog.go:249
↓ 1 callersFunctionGenerateCollExecutorId
()
collector/docsyncer/doc_executor.go:45
↓ 1 callersFunctionGenerateDocExecutorId
()
collector/docsyncer/doc_executor.go:139
↓ 1 callersFunctionGenerateExecutorId
()
executor/executor.go:205
↓ 1 callersMethodGetAcked
()
receiver/replayer.go:105
↓ 1 callersFunctionGetAllTimestamp
GetAllTimestamp get all newest timestamp
common/db_opertion.go:177
↓ 1 callersFunctionGetColShardType
input given namespace, return all keys and shard type(range or hashed)
sharding/sharding_operation.go:171
↓ 1 callersFunctionGetCompressorByName
(name string)
modules/compress.go:40
↓ 1 callersFunctionGetDBVersion
GetDBVersion return string of db version with format like "3.0.1"
common/db_opertion.go:50
↓ 1 callersFunctionGetKeyWithIndex
(log bson.D, wanted string)
oplog/oplog.go:135
↓ 1 callersFunctionGetKeyWithIndex
(log bson.D, wanted string)
common/parse.go:12
↓ 1 callersFunctionGetListCollectionQueryCondition
(conn *MongoCommunityConn)
common/db_opertion.go:291
↓ 1 callersFunctionGetMetricWithSize
(input interface{})
common/metric.go:427
↓ 1 callersFunctionGetNewestTimestampByConn
GetNewestTimestampByConn return newest oplog
common/db_opertion.go:127
↓ 1 callersMethodGetNext
()
common/change_stream.go:137
↓ 1 callersFunctionGetOldestTimestampByConn
GetOldestTimestampByConn return oldest oplog
common/db_opertion.go:133
↓ 1 callersFunctionGetOldestTimestampByUrl
(url string, fromMongoS bool, sslRootFile string)
common/db_opertion.go:154
↓ 1 callersMethodGetQueryTsFromDiskQueue
()
collector/persister.go:98
↓ 1 callersFunctionGetTxnOpTimeFromOplogEntry
GetTxnOpTimeFromOplogEntry returns an TxnOpTime struct from the relevant fields in an ParsedLog struct.
oplog/txn_optime.go:30
↓ 1 callersMethodHandle
** * Handle outstanding request message. and messages * are passed one by one. Any changes of message in * Handle() will be preserved and delive
collector/write_controller.go:41
↓ 1 callersMethodHandle
Handle is called on every oplog consumed
collector/syncer.go:43
← previousnext →301–400 of 933, ranked by callers