MCPcopy Index your code
hub / github.com/azkaban/azkaban

github.com/azkaban/azkaban @4.0.0

Chat with this repo
repository ↗ · DeepWiki ↗ · release 4.0.0 ↗ · + Follow
9,475 symbols 42,756 edges 1,023 files 1,917 documented · 20%
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

Azkaban

Build Statuscodecov.ioJoin the chat at https://gitter.im/azkaban-workflow-engine/LobbyDocumentation Status

Build

Azkaban builds use Gradle and requires Java 8 or higher.

The following set of commands run on *nix platforms like Linux, OS X.

# Build Azkaban
./gradlew build

# Clean the build
./gradlew clean

# Build and install distributions
./gradlew installDist

# Run tests
./gradlew test

# Build without running tests
./gradlew build -x test

Build a release

Pick a release from the release page. Find the tag corresponding to the release.

Check out the source code corresponding to that tag. e.g.

git checkout 3.30.1

Build

./gradlew clean build

Documentation

The current documentation will be deprecated soon at azkaban.github.io. The new Documentation site is under development. The source code for the documentation is inside docs directory.

For help, please visit the Azkaban Google Group.

Developer Guide

See the contribution guide.

Documentation development

If you want to contribute to the documentation or the release tool (inside the tools folder), please make sure python3 is installed in your environment. python virtual environment is recommended to run these scripts.

To download the python3 dependencies, run

pip3 install -r requirements.txt

After, enter the documentation folder docs and make the build by running

cd docs
make html

[July, 2018] We are actively improving our documentation. Everyone in the AZ community is welcome to submit a pull request to edit/fix the documentation.

Extension points exported contracts — how you extend this code

ThreadPoolExecutingListener (Interface)
Interface for listener to get notified before and after a task has been executed. @author hluu [7 implementers]
azkaban-common/src/main/java/azkaban/utils/ThreadPoolExecutingListener.java
Storage (Interface)
The Azkaban Storage interface would facilitate getting and putting objects into a storage mechanism of choice. By defaul [6 …
azkaban-spi/src/main/java/azkaban/spi/Storage.java
SQLTransaction (Interface)
This interface defines how a sequence of sql statements are organized and packed together. All transaction implementatio [7 …
azkaban-db/src/main/java/azkaban/db/SQLTransaction.java
ICrypto (Interface)
Encrypts plain text and decrypts ciphered text. [6 implementers]
az-crypto/src/main/java/azkaban/crypto/ICrypto.java
IPropertiesValidator (Interface)
Interface of Gobblin properties validator [9 implementers]
az-hadoop-jobtype-plugin/src/main/java/azkaban/jobtype/connectors/gobblin/helper/IPropertiesValidator.java
DependencyPluginConfig (Interface)
Defines the dependency plugin level configuration [14 implementers]
az-flow-trigger-dependency-plugin/src/main/java/azkaban/flowtrigger/DependencyPluginConfig.java
NodeProcessor (Interface)
(no doc) [15 implementers]
azkaban-exec-server/src/main/java/azkaban/dag/NodeProcessor.java
WebMetrics (Interface)
Defines all the metrics the Web server can emit. [4 implementers]
azkaban-web-server/src/main/java/azkaban/webapp/metrics/WebMetrics.java

Core symbols most depended-on inside this repo

put
called by 1477
azkaban-common/src/main/java/azkaban/utils/CaseInsensitiveConcurrentHashMap.java
get
called by 1455
azkaban-common/src/main/java/azkaban/user/FileWatcher.java
put
called by 688
az-core/src/main/java/azkaban/utils/Props.java
add
called by 681
azkaban-web-server/src/main/java/azkaban/webapp/servlet/Page.java
error
called by 560
azkaban-common/src/main/java/azkaban/jobExecutor/AbstractJob.java
append
called by 483
azkaban-common/src/main/java/azkaban/utils/CircularBuffer.java
add
called by 478
azkaban-common/src/main/java/azkaban/utils/SwapQueue.java
apply
called by 374
az-hadoop-jobtype-plugin/src/main/java/azkaban/jobtype/connectors/gobblin/GobblinHadoopJob.java

Shape

Method 7,431
Function 961
Class 943
Interface 87
Enum 53

Languages

Java90%
TypeScript10%
Python1%
C1%

Modules by API surface

azkaban-web-server/src/web/js/d3.v3.min.js372 symbols
azkaban-web-server/src/web/js/jquery/jquery-1.9.1.js80 symbols
azkaban-exec-server/src/main/java/azkaban/execapp/FlowRunner.java74 symbols
azkaban-common/src/main/java/azkaban/executor/ExecutableRamp.java68 symbols
azkaban-web-server/src/main/java/azkaban/webapp/servlet/ProjectManagerServlet.java67 symbols
azkaban-exec-server/src/main/java/azkaban/execapp/FlowRunnerManager.java66 symbols
azkaban-common/src/main/java/azkaban/executor/ExecutorManager.java65 symbols
azkaban-exec-server/src/main/java/azkaban/execapp/JobRunner.java62 symbols
azkaban-common/src/main/java/azkaban/executor/ExecutableNode.java61 symbols
azkaban-common/src/main/java/azkaban/flow/Flow.java59 symbols
azkaban-web-server/src/web/js/raphael.min.js58 symbols
azkaban-common/src/test/java/azkaban/executor/MockExecutorLoader.java56 symbols

Datastores touched

(mysql)Database · 1 repos

For agents

$ claude mcp add azkaban \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact