hub / github.com/FINRAOS/herd
github.com/FINRAOS/herd @v0.51.0
Chat with this repo
9,238 symbols
54,136 edges
1,237 files
3,603 documented · 39%
What it actually does AI analysis from the code graph — generated when you open this
loading…
README
Overview 
Herd is big data governance for the cloud. The herd unified data catalog helps separate compute from storage in the cloud. Herd job orchestration manages your ETL and analytics processes while tracking all data in the catalog. Here is a quick summary of features:
- Unified Data Catalog A centralized, auditable catalog for operational usage and data governance.
- Track Lineage Capture data ancestry for regulatory, forensic, and analytical purposes
- Manage Clusters Create and launch clusters; load data into clusters from catalog entries
- Orchestrate Jobs Orchestrate clusters and catalog services to automate processing jobs
Find out more about herd features on our GitHub project page
Quick Start
The best way to start learning about herd is through these links. The demo installation process is quick and easy - you can have herd up and running in AWS in 10-15 minutes and start registering data immediately afterwards.
Get Involved
We are actively seeking organizations and individuals that are interested in adopting herd and contributing to the development effort. Find out more in the contributions section of our GitHub project page. If you have any questions or discussion topics, post them on GitHub Issues or email us at herd@finra.org.
License
Herd is licensed under Apache License 2.0
Extension points exported contracts — how you extend this code
Command (Interface)A simple interface to implement the command pattern. [17 implementers]
herd-code/herd-core/src/main/java/org/finra/herd/core/Command.java
StoragePolicySelectorService (Interface)
The storage policy selector service. [18 implementers]
herd-code/herd-service/src/main/java/org/finra/herd/service/StoragePolicySelectorService.java
SqsOperations (Interface)
A service for AWS SQS operations. [5 implementers]
herd-code/herd-dao/src/main/java/org/finra/herd/dao/SqsOperations.java
ApplicationUserBuilder (Interface)
A builder that knows how to build an application user. [4 implementers]
herd-code/herd-app/src/main/java/org/finra/herd/app/security/ApplicationUserBuilder.java
HerdAWSCredentialsProvider (Interface)
Provides credentials for AWS services. [3 implementers]
herd-code/herd-model/src/main/java/org/finra/herd/model/dto/HerdAWSCredentialsProvider.java
XmlTypeInterfaceCase (Interface)
(no doc)
herd-build/herd-swaggergen-maven-plugin/src/test/java/org/finra/herd/swaggergen/test/exampleXmlGenerator/XmlTypeInterfaceCase.java
LoggingHelper (Interface)
A logging helper that provides methods to manipulate logging infrastructure beyond what is provided in SLF4J. The majori [2 …
herd-code/herd-core/src/test/java/org/finra/herd/core/helper/LoggingHelper.java
SearchableService (Interface)
Service interface to support search operations. [5 implementers]
herd-code/herd-service/src/main/java/org/finra/herd/service/SearchableService.java
Core symbols most depended-on inside this repo
addcalled by 2464
herd-code/herd-service/src/main/java/org/finra/herd/service/helper/NotificationMessageInMemoryQueue.java
format
called by 1079
herd-code/herd-dao/src/main/java/org/finra/herd/dao/helper/EmrVpcPricingStateFormatter.java
size
called by 733
herd-code/herd-service/src/main/java/org/finra/herd/service/helper/NotificationMessageInMemoryQueue.java
getNamespace
called by 631
herd-code/herd-service/src/main/java/org/finra/herd/service/NamespaceService.java
getProperty
called by 537
herd-code/herd-core/src/main/java/org/finra/herd/core/helper/ConfigurationHelper.java
getId
called by 537
herd-code/herd-model/src/main/java/org/finra/herd/model/jpa/TagEntity.java
toString
called by 425
herd-code/herd-model/src/main/java/org/finra/herd/model/dto/ApplicationUser.java
isEmpty
called by 356
herd-code/herd-service/src/main/java/org/finra/herd/service/helper/NotificationMessageInMemoryQueue.java
Shape
Languages
Java98%
TypeScript2%
Modules by API surface
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectFormatServiceTest.java136 symbols
herd-code/herd-dao/src/test/java/org/finra/herd/dao/S3DaoTest.java104 symbols
herd-code/herd-dao/src/test/java/org/finra/herd/dao/impl/MockResultSet.java103 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectDefinitionServiceTest.java72 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/EmrServiceTest.java71 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectDataServiceGenerateBusinessObjectDataDdlTest.java70 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/TagServiceTest.java60 symbols
herd-build/herd-docs/herd-docs-swagger/src/swagger-ui-master/lib/jquery-1.8.0.min.js60 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/JobServiceTest.java57 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectDataServiceCheckBusinessObjectDataAvailabilityTest.java57 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectDataAttributeServiceTest.java54 symbols
herd-code/herd-service/src/test/java/org/finra/herd/service/BusinessObjectDataServiceCreateBusinessObjectDataTest.java50 symbols