hub / github.com/Teradata/kylo
github.com/Teradata/kylo @v0.10.1
Chat with this repo
39,815 symbols
128,441 edges
3,859 files
8,452 documented · 21%
What it actually does AI analysis from the code graph — generated when you open this
loading…
README
Kylo is an enterprise-ready modern data lake management software platform for big data engines such as Teradata, Apache Spark, or Hadoop. Kylo enforces best practices around metadata management, governance, and security gathered from experience in over 150+ successful big data projects.
Visit http://kylo.io and unlock the power of Kylo today!
Quick Start
You can download a pre-configured sandbox and get started with Kylo in no time. To get started visit the Quick Start page.
Documentation
Please visit Kylo documentation to learn more.
Issues and Support
To raise issues with Kylo, please register and visit the Jira instance.
For support, questions can be asked on the Google Groups group.
Code Structure
The layout of code in the following subtrees follows particular reasoning described below:
| Subfolder | Description |
|---|---|
| commons | Utility or common functionality |
| core | API frameworks that can generally used by developers to extend the capabilities of Kylo |
| docs | Documentation that should be distributed as part of release |
| integrations | Pure integration projects with 3rd party software such as NiFi and Spark. |
| metadata | The metadata server is a top-level project for providing a metadata repository |
| plugins | Alternative and often optional implementations for operating with different distributions or technology branches |
| samples | Sample plugins, feeds, and templates, |
| security | Support for application security for both authentication and authorization |
| services | Provides REST endpoints and core server-side processing |
| ui | User Interface module for Kylo |
Extension points exported contracts — how you extend this code
AuthenticationService (Interface)Simple Auth to allow a plugin to provide auth via a username/password SimpleAuthenticationService is an example impl @s [10 …
security/security-auth-simple/src/main/java/com/thinkbiganalytics/auth/AuthenticationService.java
AlertResponse (Interface)
Instances of this object provide a means for a responder to change the state of an actionable alert. An instance is pass [6 …
core/alerts/alerts-api/src/main/java/com/thinkbiganalytics/alerts/api/AlertResponse.java
FileMetadataExtractor (Interface)
Extract metadata from a list of files [14 implementers]
core/file-metadata/file-metadata-api/src/main/java/com/thinkbiganalytics/kylo/metadata/file/FileMetadataExtractor.java
Search (Interface)
Provides access to a search engine for global search and updating indexes. [6 implementers]
core/search/search-api/src/main/java/com/thinkbiganalytics/search/api/Search.java
StandardizationPolicy (Interface)
Provides cleansing or data standardization returning a new value from the provided value Perform custom standardization [18 …
core/field-policy/field-policy-api/src/main/java/com/thinkbiganalytics/policy/standardization/StandardizationPolicy.java
ClusterServiceListener (Interface)
Listen for Cluster Events [6 implementers]
core/cluster-manager/cluster-manager-api/src/main/java/com/thinkbiganalytics/cluster/ClusterServiceListener.java
ObligationAssessor (Interface)
An assessor responsible for generating assessments of the types of obligations that it accepts. [13 implementers]
core/sla/sla-api/src/main/java/com/thinkbiganalytics/metadata/sla/spi/ObligationAssessor.java
JdbcPredicate (Interface)
Represents a predicate (boolean-valued function) of one argument. This is a function interface whose functional meth [22 …
core/schema-discovery/schema-discovery-rdbms/src/main/java/com/thinkbiganalytics/schema/JdbcPredicate.java
Core symbols most depended-on inside this repo
splitcalled by 2496
integrations/spark/spark-ingest/spark-ingest-app/src/main/java/com/thinkbiganalytics/kylo/spark/ingest/SemicolonParameterSplitter.java
add
called by 2261
security/security-auth/src/main/java/com/thinkbiganalytics/auth/jaas/LoginConfigurationBuilder.java
call
called by 2235
core/kerberos/kerberos-core/src/main/java/com/thinkbiganalytics/kerberos/KerberosUtil.java
map
called by 1738
integrations/spark/spark-catalog/spark-catalog-spark-v2/src/main/java/com/thinkbiganalytics/kylo/catalog/spark/sources/JdbcDataSetProviderV2.java
stream
called by 1496
security/security-api/src/main/java/com/thinkbiganalytics/security/action/AllowableAction.java
indexOf
called by 1402
commons/commons-spark/commons-spark-repl/src/main/java/com/thinkbiganalytics/spark/util/ArrayUtils.java
put
called by 1263
integrations/nifi/nifi-nar-bundles/nifi-standard-services/nifi-core-service-api-v1.2/src/main/java/com/thinkbiganalytics/nifi/v2/core/savepoint/DistributedCacheListener.java
filter
called by 1081
ui/ui-app/src/main/resources/static/js/services/ListTableViewTypes.d.ts
Shape
Languages
Java66%
TypeScript34%
Modules by API surface
ui/ui-app/src/main/resources/static/bower_components/angular-material/angular-material.js844 symbols
ui/ui-app/src/main/resources/static/bower_components/d3/d3.js569 symbols
ui/ui-app/src/main/resources/static/bower_components/angular/angular.js555 symbols
ui/ui-app/src/main/resources/static/bower_components/codemirror/lib/codemirror.js429 symbols
ui/ui-app/src/main/resources/static/bower_components/d3/d3.min.js389 symbols
ui/ui-app/src/main/resources/static/bower_components/angular-ui-router/release/angular-ui-router.js298 symbols
ui/ui-app/src/main/resources/static/bower_components/moment/min/moment-with-locales.js288 symbols
ui/ui-app/src/main/resources/static/bower_components/moment/min/moment-with-locales.min.js286 symbols
ui/ui-app/src/main/resources/static/bower_components/angular/angular.min.js274 symbols
ui/ui-app/src/main/resources/static/bower_components/moment/min/moment.min.js231 symbols
ui/swagger-ui/src/main/resources/swagger-ui/lib/lodash.min.js184 symbols
ui/ui-app/src/main/resources/static/bower_components/angular-ui-router/release/angular-ui-router.min.js155 symbols
Datastores touched
(mysql)Database · 1 repos
kyloDatabase · 1 repos
hiveDatabase · 1 repos
metastoreDatabase · 1 repos
pipeline_dbDatabase · 1 repos
metadataDatabase · 1 repos
pipeline_dbDatabase · 1 repos
kyloDatabase · 1 repos