MCPcopy Create free account
hub / github.com/bottomless-archive-project/library-of-alexandria

github.com/bottomless-archive-project/library-of-alexandria @v2.0.0.M1

Chat with this repo
repository ↗ · DeepWiki ↗ · release v2.0.0.M1 ↗ · + Follow
1,180 symbols 3,726 edges 434 files ⚖ MIT 164 documented · 14% ● updated 4mo agov2.0.0 · 2024-07-05★ 13714 open issues

Browse by type

⨍ Functions 716◇ Types & classes 464
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

Library of Alexandria

LoA Logo

Library of Alexandria (LoA in short) is a project that aims to collect and archive documents from the internet.

In our modern age new text documents are born in a blink of an eye then (often just as quickly) disappear from the internet. We find it a noble task to save these documents for future generations.

This project aims to support this noble goal in a scalable way. We want to make the archival activity streamlined and easy to do even in a huge (Terabyte / Petabyte) scale. This way we hope that more and more people can start their own collection helping the archiving effort.

Documentation

We have an extensive documentation for the application suite! It is available in our documentation page!

Introduction video

We have an introduction video on YouTube to show the application in action. The example dataset shown in the video is 33 TB in size with 30 million documents.

Discord

We have an official Discord server to help people setting up the application and discussing possible/upcoming updates. Feel free to join.

Extension points exported contracts — how you extend this code

CompressorService (Interface)
A service that is responsible for compressing and decompressing binary data. [6 implementers]
loa-library/loa-compression-service/src/main/java/com/github/bottomlessarchive/loa/compression/service/compressor/CompressorService.java
VaultLocation (Interface)
A location on the storage media where a document's contents are stored. [4 implementers]
loa-library/loa-vault-service/src/main/java/com/github/bottomlessarchive/loa/vault/service/location/VaultLocation.java
InstancePropertyExtensionProvider (Interface)
(no doc) [14 implementers]
loa-library/loa-conductor-client-service/src/main/java/com/github/bottomlessarchive/loa/conductor/service/client/extension/InstancePropertyExtensionProvider.java
DocumentLocationIdFactory (Interface)
This factory creates semi-unique ids for document locations. [2 implementers]
loa-library/loa-document-location-service/src/main/java/com/github/bottomlessarchive/loa/location/service/id/factory/DocumentLocationIdFactory.java
DocumentLocationSource (Interface)
This class is streaming new DocumentLocations that should be checked for new documents. [2 implementers]
loa-library/loa-source-service/src/main/java/com/github/bottomlessarchive/loa/source/source/DocumentLocationSource.java
ChecksumProvider (Interface)
This interface is responsible for providing checksum values for documents in the stage location. @see <a href="https:// [2 …
loa-library/loa-checksum-service/src/main/java/com/github/bottomlessarchive/loa/checksum/service/ChecksumProvider.java

browse all types & interfaces →

Core symbols most depended-on inside this repo

browse all functions →

Shape

Method 715
Class 437
Enum 17
Interface 10
Function 1

Languages

Java89%
TypeScript11%

Modules by API surface

loa-application/loa-vault-application/src/test/java/com/github/bottomlessarchive/loa/vault/integration/VaultViewDefaultIntegrationTest.java28 symbols
loa-frontend/src/app/view/search/search.component.ts18 symbols
loa-application/loa-vault-application/src/test/java/com/github/bottomlessarchive/loa/vault/view/controller/VaultControllerTest.java16 symbols
loa-library/loa-document-repository/src/main/java/com/github/bottomlessarchive/loa/document/repository/DocumentRepository.java15 symbols
loa-library/loa-indexer-client-service/src/test/java/com/github/bottomlessarchive/loa/indexer/service/search/DocumentSearchClientTest.java11 symbols
loa-application/loa-staging-application/src/test/java/com/github/bottomlessarchive/loa/stage/integration/StageViewIntegrationTest.java11 symbols
loa-library/loa-io-service/src/test/java/com/github/bottomlessarchive/loa/url/service/downloader/DocumentLocationResultCalculatorTest.java10 symbols
loa-library/loa-document-service/src/main/java/com/github/bottomlessarchive/loa/document/service/entity/factory/DocumentEntityFactory.java10 symbols
loa-library/loa-conductor-client-service/src/main/java/com/github/bottomlessarchive/loa/conductor/service/client/ConductorClient.java10 symbols
loa-application/loa-web-application/src/main/java/com/github/bottomlessarchive/loa/web/view/dashboard/service/ApplicationStatisticsResponseFactory.java9 symbols
loa-application/loa-vault-application/src/test/java/com/github/bottomlessarchive/loa/vault/integration/VaultProcessingIntegrationTest.java9 symbols
loa-application/loa-downloader-application/src/test/java/com/github/bottomlessarchive/loa/downloader/integration/QueueSourceIntegrationTest.java9 symbols

For agents

$ claude mcp add library-of-alexandria \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

Ask about this repo answers extend the page