HardAssignments

A2 — CSA2 Mode-Frequency Sweep

Sparse Attention · KV Reuse

Hard

Prerequisites (this site)

Readings

Problem

Compare quality and cache usage as the frequency of Full/Reindex layers changes in a 6-layer CSA2 stack.

Input

Sweep the number of Full layers 1→6 and Reindex layers 0→2; hold parameters fixed.

Output

A quality-vs-cache Pareto curve and a recommendation for a 1M-token agent.

Requirements

Constraints

Hints

  1. Fix all variables except the one you are sweeping.
  2. Instrument cost (FLOPs/bytes/time) before tuning quality.
  3. Write the honest limitation before writing the conclusion.

Assignment for CS/AI 684.