MCPcopy Create free account

hub / github.com/alibaba/MongoShake / functions

Functions933 in github.com/alibaba/MongoShake

⨍ Functions 933◇ Types & classes 171
↓ 3 callersMethodString
()
collector/reader/oplog_reader.go:76
↓ 3 callersMethodTime
()
tools/mongo_id.go:21
↓ 3 callersMethodTryNext
()
common/change_stream.go:144
↓ 3 callersMethodUpdateQueryTimestamp
set query timestamp when first start
collector/reader/reader.go:13
↓ 3 callersMethodcheckCheckpointUpdate
checkCheckpointUpdate wait for checkpoint reach newestTs which mean oplog is written to dest db when barrier is true, max time is about 3 second (Chec
collector/syncer.go:382
↓ 3 callersFunctioncheckConflict
()
cmd/collector/sanitize.go:411
↓ 3 callersMethodclose
(self)
scripts/comparison.py:41
↓ 3 callersMethoddecodeHeader
(buffer []byte)
tunnel/tcp_writer.go:99
↓ 3 callersMethoddispatchBatches
(batchGroup [][]*oplog.GenericOplog)
collector/batcher.go:149
↓ 3 callersMethoddoCommand
* * command operation * Generally speaking, we should use `applyOps` command in mongodb to insert these data, * but this way will make the oplog
executor/db_writer.go:46
↓ 3 callersMethodencode
()
tunnel/tcp_writer.go:86
↓ 3 callersMethodensureNetwork
()
tunnel/tcp_writer.go:133
↓ 3 callersFunctionexit_process
(code)
scripts/run_sys_test.py:200
↓ 3 callersFunctionfindValueByKey
(keyName string, document *bson.D)
oplog/txn_buffer.go:306
↓ 3 callersFunctionhandleNamespace
(srcC *mongo.Client, dstC *mongo.Client, dbName, collName string)
tools/pre-split/pre_split.go:668
↓ 3 callersMethodmarkCollectionProcessing
(collectionMetric *CollectionMetric)
collector/docsyncer/doc_syncer.go:620
↓ 3 callersFunctionmockDisTxnOplogs
(startTs int64, normalOplog bool, isCommit bool)
collector/batcher_test.go:373
↓ 3 callersFunctionmockDisTxnPartialOplogs
(startTs int64, normalOplog bool, isCommit bool)
collector/batcher_test.go:507
↓ 3 callersMethodnext
fetch oplog from reader.
collector/syncer.go:627
↓ 3 callersFunctionnormalizeFilterOpTypes
(opTypes []string)
cmd/collector/sanitize.go:332
↓ 3 callersFunctionpromotion
()
quorum/quorum.go:190
↓ 3 callersMethodrecordLastFetchStats
(logs []*oplog.GenericOplog, now time.Time)
collector/syncer.go:582
↓ 3 callersFunctionreplayUpdateViaApplyOps
replayUpdateViaApplyOps replays an update oplog directly via applyOps command, preserving the original $v:2 diff format. This is used for time-series
executor/db_writer.go:440
↓ 3 callersMethodsetReplStatusCode
(status uint64)
common/metric.go:348
↓ 3 callersFunctionsourceTimeFromTimestamp
********************************deserializer end**********************************/
collector/syncer.go:529
↓ 3 callersMethodstartDocumentReplication
()
collector/coordinator/full.go:61
↓ 3 callersMethodstartOplogReplication
(oplogStartPosition interface{}, fullSyncFinishPosition int64, startTsMap map[string]int64)
collector/coordinator/incr.go:15
↓ 3 callersFunctionstringHashValue
(s string)
oplog/hasher.go:146
↓ 3 callersFunctiontcpErrorAndRelease
(socket *TcpSocket, err string)
tunnel/tcp_writer.go:259
↓ 3 callersFunctiontransformTimeseriesNs
transformTimeseriesNs transforms a namespace that may belong to a time-series collection. For 'system.buckets.xxx', it uses the logical collection nam
executor/executor.go:390
↓ 3 callersFunctionversionGTE
(v1, v2)
tools/pre-split/dryRun_range.js:35
↓ 2 callersMethodAckRequired
** * Indicate weather this tunnel cares about ACK feedback value. * Like RPC_TUNNEL (ack required is true), it's asynchronous and * needs peer r
tunnel/tunnel.go:123
↓ 2 callersMethodAcquireReplicaSetName
()
common/community_client.go:198
↓ 2 callersMethodAddGet
(incr uint64)
common/metric.go:244
↓ 2 callersMethodAllAcked
(allAcked bool)
collector/worker.go:87
↓ 2 callersFunctionApplyOpsFilter
ApplyOpsFilter is synced from utils.ApplyOpsFilter
oplog/change_stream_event_test.go:99
↓ 2 callersMethodClearReplStatus
(status uint64)
common/metric.go:343
↓ 2 callersMethodClose
()
collector/docsyncer/doc_reader.go:433
↓ 2 callersMethodCrc32
()
tunnel/tunnel.go:53
↓ 2 callersFunctionEncodeMongoURI
EncodeMongoURI encodes MongoDB URIs, mainly performing URL encoding on the password part. expected to handle the following URI: 1) normal one: "mongod
common/community_client.go:283
↓ 2 callersMethodEnsureNetwork
()
collector/reader/event_reader.go:145
↓ 2 callersFunctionExtractTimestampForLog
(ts interface{})
common/mix.go:73
↓ 2 callersMethodFetchBucket
()
common/speed.go:37
↓ 2 callersFunctionFileName
(identifier string)
journal/journal.go:34
↓ 2 callersMethodFilterNs
(namespace string)
collector/filter/doc_filter.go:94
↓ 2 callersFunctionFindFiledPrefix
(input bson.D, prefix string)
oplog/oplog.go:231
↓ 2 callersMethodFromBytes
(buf []byte, order binary.ByteOrder)
tunnel/tunnel.go:75
↓ 2 callersFunctionGetBalancerStatusByUrl
get balancer status from config server
sharding/sharding_operation.go:31
↓ 2 callersFunctionGetChunkMapByUrl
(csUrl string)
sharding/sharding_operation.go:72
↓ 2 callersFunctionGetMongoClient
(uri string)
tools/pre-split/pre_split.go:116
↓ 2 callersMethodGetTxnStream
GetTxnStream returns a channel of Oplog entries in a transaction and a channel for errors. If the buffer has been stopped, the returned op channel wi
oplog/txn_buffer.go:169
↓ 2 callersMethodHasOplogNs
(queryCondition bson.M)
common/community_client.go:186
↓ 2 callersMethodInitDiskQueue
(dqName string)
collector/persister.go:81
↓ 2 callersFunctionInitialLoggerWithRotation
(logDir, logFile, level string, logFlush bool, verbose, maxSizeMB, maxAge int)
common/common.go:74
↓ 2 callersMethodIsData
IsData is true if the oplog entry contains transaction data
oplog/txn_meta.go:103
↓ 2 callersMethodIsGood
()
common/metric.go:397
↓ 2 callersMethodIsMultiOp
IsMultiOp is true if the oplog entry is part of a prepared and/or large transaction.
oplog/txn_meta.go:126
↓ 2 callersFunctionIsRunOnAdminCommand
(operation string)
oplog/cmd_oplog.go:55
↓ 2 callersFunctionLogEntryEncode
(logs []*GenericOplog)
oplog/oplog.go:61
↓ 2 callersFunctionNewCheckUniqueIndexExistsJob
(interval int, collections []string, urls []*utils.MongoSource)
collector/coordinator/extra_job.go:62
↓ 2 callersFunctionNewDBSyncer
( id int, fromMongoUrl string, fromReplset string, toMongoUrl string, nsTrans *transform.NamespaceTransfo
collector/docsyncer/doc_syncer.go:346
↓ 2 callersFunctionNewDocExecutor
(id int, colExecutor *CollectionExecutor, conn *utils.MongoCommunityConn, syncer *DBSyncer)
collector/docsyncer/doc_executor.go:143
↓ 2 callersFunctionNewEventReader
NewEventReader creates reader with mongodb url
collector/reader/event_reader.go:48
↓ 2 callersFunctionNewJournal
(name string)
journal/journal.go:38
↓ 2 callersFunctionNewOrphanFilter
(replset string, chunkMap sharding.DBChunkMap)
collector/filter/orphan_filter.go:31
↓ 2 callersFunctionNewPartialLog
(data bson.M)
oplog/oplog.go:86
↓ 2 callersFunctionNewPersister
(replset string, sync *OplogSyncer)
collector/persister.go:49
↓ 2 callersFunctionNewWhiteListObjectIdHasher
(whiteList []string)
oplog/hasher.go:87
↓ 2 callersMethodOldestOpTime
OldestOpTime returns the optime of the oldest buffered transaction, or an empty optime if no transactions are buffered. This will include committed tr
oplog/txn_buffer.go:224
↓ 2 callersMethodPanic
(args ...any)
pkg/log/logger.go:265
↓ 2 callersMethodRestAPI
()
collector/syncer.go:735
↓ 2 callersMethodSetLSNCheckpoint
(ckpt int64)
common/metric.go:296
↓ 2 callersMethodSetOplogGetDelay
(delay int64)
common/metric.go:328
↓ 2 callersMethodSetQueryTimestampOnEmpty
start fetcher
collector/reader/reader.go:12
↓ 2 callersMethodStart
()
tunnel/kafka/sync_writer.go:40
↓ 2 callersMethodString
()
collector/reader/event_reader.go:58
↓ 2 callersMethodSync
* * Receiver message and do the following steps: * 1. if we need re-transmit, this log will be discard * 2. validate the checksum * 3. decompress
receiver/replayer.go:54
↓ 2 callersFunctionTimestampGreaterThan
TimestampGreaterThan returns true if lhs comes after rhs, false otherwise.
oplog/txn_optime.go:10
↓ 2 callersFunctionTimestampLessThan
TimestampLessThan returns true if lhs comes before rhs, false otherwise.
oplog/txn_optime.go:15
↓ 2 callersFunctionTimestampToString
(ts int64)
common/mix.go:47
↓ 2 callersFunctionTransformDBRef
(logObject bson.D, db string, nsTrans *NamespaceTransform)
collector/transform/transform.go:74
↓ 2 callersMethodWriteRecord
(oplog *oplog.PartialLog)
journal/journal.go:48
↓ 2 callersFunction_get_mongodb_addr
(src_url)
scripts/run_sys_test.py:79
↓ 2 callersMethodaddSignature
(signature string)
executor/collision_matrix.go:60
↓ 2 callersFunctionassertNoStateForID
(t *testing.T, meta TxnMeta, buffer *TxnBuffer)
oplog/txn_test.go:288
↓ 2 callersFunctionbuildWriteSyncer
( target zapcore.WriteSyncer, logFlush bool, )
pkg/log/logger.go:107
↓ 2 callersFunctioncalculatePendingQueueConcurrency
********************************deserializer begin**********************************/ deserializer: pending_queue -> logs_queue how many pending queue
collector/syncer.go:428
↓ 2 callersMethodcheckIndexKeyTypeConsistency
checkIndexKeyTypeConsistency checks whether the min and max values of the parallel index key share the same BSON type. If they differ (excluding numer
collector/docsyncer/doc_reader.go:211
↓ 2 callersFunctionchunkGt
(x, y interface{})
collector/filter/orphan_filter.go:150
↓ 2 callersFunctionchunkLt
(x, y interface{})
collector/filter/orphan_filter.go:196
↓ 2 callersMethodclose
(self)
tools/mongodb-schema.py:43
↓ 2 callersMethodclose
()
collector/ckpt/ckpt_operation.go:114
↓ 2 callersMethodclose
(self)
scripts/comparison_3x.py:42
↓ 2 callersFunctioncombinePrefixField
(prefixField string, obj interface{})
oplog/oplog.go:444
↓ 2 callersMethodcompareCheckpointAndDbTs
* * compare current checkpoint and database timestamp * @return: * int64: the smallest newest timestamp of all mongod * bool: can run incr
collector/coordinator/utils.go:23
↓ 2 callersMethodconnect
(self)
tools/mongodb-schema.py:40
↓ 2 callersMethodconnect
(self)
scripts/comparison_3x.py:39
↓ 2 callersMethodconnect
(self)
scripts/comparison.py:38
↓ 2 callersMethodconvert
(segment []*PartialLogWithCallback)
executor/collision_matrix.go:32
↓ 2 callersFunctionconvertToRule
convert input namespace filter to regex string e.g., namespace-filter = []string{"db1", "db2.collection2"} return: ^(db1|db2.collection2)$|(db1\.|db2\
collector/filter/oplog_filter.go:233
← previousnext →201–300 of 933, ranked by callers