Examples#
Each subdirectory of examples/
is a self-contained training recipe. Recipes are
nvsubquadratic.lazy_config.LazyConfig trees describing the
network, datamodule, Lightning wrapper, and trainer; running them is
python -m experiments.run --config <path>.
The active experimental roadmap (priorities, owners, status) lives at
examples/overview_tracker.md.
Classification#
ImageNet#
examples/imagenet_classification/
ships seven CCNN configs (Hyena / Hyena-circular / attention, with and
without augmentation, plus tiny variants for laptop sanity checks).
Representative entry points: ccnn_7_512_hyena.py,
ccnn_7_512_attention.py.
TinyImageNet — ViT-5#
examples/vit5_imagenet/
is the ViT-5 baseline suite (v1–v5) with its own
TRACKER.md.
Spatial recall#
examples/spatial_recall_1d/,
spatial_recall_2d/,
spatial_recall_3d/,
and the newer
spatial_recall_v2/
are synthetic recall benchmarks measuring how well each mixer (Hyena,
attention, Mamba, CKConv) routes information across long-range
spatial/sequence positions. See
spatial_recall_v2/TRACKER.md
for the v2 task suite.
Benchmarks#
examples/vit_b_benchmark/
holds the throughput-comparison configs used to produce the numbers in
Benchmarks.
Scientific#
The Well#
examples/well/
covers The Well PDE benchmark — see its
README
for sub-datasets and baselines.