Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Jingyu6/speculative_prefill
/ types & classes
Types & classes
26 in github.com/Jingyu6/speculative_prefill
⨍
Functions
156
◇
Types & classes
26
↳
Endpoints
2
↓ 2 callers
Class
AugmentedSequenceData
speculative_prefill/vllm_patch/data/sequence.py:9
↓ 1 callers
Class
LookAheadSpecWorker
speculative_prefill/vllm_patch/worker/look_ahead_spec_worker.py:47
↓ 1 callers
Class
RagLlama
rag_baseline/rag_model.py:10
↓ 1 callers
Class
SpecPrefillWorker
speculative_prefill/vllm_patch/worker/spec_prefill_worker.py:81
Class
AugmentedModelInputForGPUBuilder
speculative_prefill/vllm_patch/data/input_builder.py:8
Class
ContractNLI
ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts https://arxiv.org/abs/1712.07040
eval/lm_eval_patch/scrolls/task.py:417
Class
GovReport
Efficient Attentions for Long Document Summarization https://arxiv.org/abs/2104.02112 Note: The average length of the reference summaries is
eval/lm_eval_patch/scrolls/task.py:435
Class
GovReportLlama16k
eval/lm_eval_patch/scrolls/task.py:490
Class
GovReportLlama32k
eval/lm_eval_patch/scrolls/task.py:514
Class
NarrativeQA
The NarrativeQA Reading Comprehension Challenge https://arxiv.org/abs/1712.07040
eval/lm_eval_patch/scrolls/task.py:384
Class
NarrativeQALlama16k
eval/lm_eval_patch/scrolls/task.py:484
Class
NarrativeQALlama32k
eval/lm_eval_patch/scrolls/task.py:508
Class
PatchedGPUExecutor
speculative_prefill/vllm_patch/executor/gpu_executor.py:12
Class
PatchedGPUExecutorAsync
speculative_prefill/vllm_patch/executor/gpu_executor.py:33
Class
QMSum
QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization https://arxiv.org/abs/2104.05938
eval/lm_eval_patch/scrolls/task.py:456
Class
Qasper
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers https://arxiv.org/abs/2105.03011
eval/lm_eval_patch/scrolls/task.py:299
Class
QasperLlama16K
eval/lm_eval_patch/scrolls/task.py:472
Class
QasperLlama32K
eval/lm_eval_patch/scrolls/task.py:496
Class
QuALITY
QuALITY: Question Answering with Long Input Texts, Yes! https://arxiv.org/abs/2112.08608
eval/lm_eval_patch/scrolls/task.py:356
Class
QuALITYLlama16k
eval/lm_eval_patch/scrolls/task.py:478
Class
QuALITYLlama32k
eval/lm_eval_patch/scrolls/task.py:502
Class
SpecConfig
speculative_prefill/vllm_patch/config.py:10
Class
SummScreenFD
SummScreen: A Dataset for Abstractive Screenplay Summarization https://arxiv.org/abs/2104.07091
eval/lm_eval_patch/scrolls/task.py:448
Class
_SCROLLSMultipleChoiceTask
eval/lm_eval_patch/scrolls/task.py:227
Class
_SCROLLSSummaryTask
eval/lm_eval_patch/scrolls/task.py:268
Class
_SCROLLSTask
eval/lm_eval_patch/scrolls/task.py:110