CAT

Computerized Adaptive Testing Package, including the following models and strategies.

• Item Response Theory (IRT)
• MaximumFisherInformation (MFI) strategy
• Kullback-Leibler Information (KLI) strategy
• Model-Agnostic Adaptive Testing (MAAT) strategy
• Bounded Ability Estimation Adaptive Testing (BECAT) strategy
• Bilevel Optimization-Based Computerized Adaptive Testing (BOBCAT) strategy

• Neural Computerized Adaptive Testing (NCAT) strategy

• Multidimensional Item Response Theory (MIRT)

• D-Optimality (D-opt) strategy
• Multivariate Kullback-Leibler Information (MKLI) strategy
• Model-Agnostic Adaptive Testing (MAAT) strategy
• Bilevel Optimization-Based Computerized Adaptive Testing (BOBCAT) strategy
• Neural Computerized Adaptive Testing (NCAT) strategy
• Neural Cognitive Diagnosis (NCD)
• Model-Agnostic Adaptive Testing (MAAT) strategy
• Bounded Ability Estimation Adaptive Testing (BECAT) strategy

BECAT strategy comes from paper A Bounded Ability Estimation for Computerized Adaptive Testing(https://nips.cc/virtual/2023/poster/70224)

Installation

Git and install by pip

pip install -e .

Quick Start

See the examples in scripts directory.

utils

Visualization

By default, we use tensorboard to help visualize the reward of each iteration, see demos in scripts and use

tensorboard --logdir /path/to/logs

to see the visualization result.