hub / github.com/NfNitLoop/pipeliner

github.com/NfNitLoop/pipeliner @v1.0.1

Chat with this repo

repository ↗ · DeepWiki ↗ · release v1.0.1 ↗ · + Follow

46 symbols 97 edges 7 files 21 documented · 46% ● updated 6y ago★ 322 open issues

Browse by type

⨍ Functions 35 ◇ Types & classes 11

What it actually does AI analysis from the code graph — generated when you open this

loading…

README

Pipeliner

Pipeliner is a Rust library to help you create multithreaded work pipelines. You can choose how many threads each step of the pipeline uses to tune performance for I/O- or CPU-bound workloads.

The API docs contain code examples.

Comparison with Rayon

Rayon is another Rust library for parallel computation. If you're doing purely CPU-bound work, you may want to try that out to see if it offers better performance.

Pipeliner, IMHO, offers a simpler interface. That simpler interface makes it easier to combine parts of a data pipeline that may be I/O-bound and CPU-bound. Usually in those cases, your bottleneck is I/O, not the speed of your parallel execution library, so having a nice API may be preferable.

Extension points exported contracts — how you extend this code

Sender (Interface)

A trait for the common functionality in mpsc::Sender mpsc::SyncSender crossbeam_channel::Sender [3 implementers]

src/panic_guard.rs

Pipeline (Interface)

Things which implement this can be used with the Pipeliner library. [1 implementers]

src/lib.rs

ResultTrait (Interface)

This lets me access a Result's Ok/Err types as associated types: [1 implementers]

src/unordered.rs

Core symbols most depended-on inside this repo

Shape

Method 21

Function 14

Class 8

Interface 3

Languages

Rust100%

Modules by API surface

src/unordered.rs11 symbols

src/tests.rs8 symbols

src/lib.rs8 symbols

src/ordered/mod.rs7 symbols

src/panic_guard.rs5 symbols

src/ordered/promise.rs5 symbols

benches/benchmarks.rs2 symbols

For agents

$ claude mcp add pipeliner \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

github.com/NfNitLoop/pipeliner @v1.0.1

Pipeliner

Links

Comparison with Rayon

Extension points exported contracts — how you extend this code

Core symbols most depended-on inside this repo

Shape

Languages

Modules by API surface

For agents

Ask about this repo answers extend the page