Chapter 09 / Concept 33 of 48

Quantum reinforcement learning

Quantum circuits can parameterize policies or value functions in sequential decision-making.

Input / assumptions→ Quantum or learning model→ Measurement / inference→ Validation

Core idea

Quantum circuits can parameterize policies or value functions in sequential decision-making. The central design question is what information the representation retains, which operations are physically implementable, and how prediction quality and total resource cost are measured. In QML, a mathematical formulation must be paired with an explicit data-access model and a reproducible evaluation protocol.

$$\pi_\theta(a|s)=p_\theta(a\mid s)$$

Worked example

Use a small circuit to output action probabilities for a two-state bandit.

How to study or implement it

Start with a minimal analytic case that can be checked by hand. Build a noiseless simulation, inspect intermediate states or predictions, and then repeat with finite sampling. Compare against a suitable classical reference using the same dataset, preprocessing, and evaluation split. Record circuit depth, qubit count, optimization steps, and measurement budget.

Interpretation and limitations

Claims of exploration speedup depend on the oracle and environment-access model. When evaluating experimental claims, separate theoretical asymptotic statements from measured end-to-end performance. Include preprocessing, state preparation, parameter tuning and output extraction in the comparison.

Further exploration

See the chapter overview, interactive lab, guided learning path, and curated sources.

◈ QuantumVerse Hub