Entropix MoE Router

[cat-state]

top-k sampling -> entropix
top-k moe routing -> entropix routing ?

A top-k expert router is doing top-k sampling, but one could replace it with entropix.
potential remapping:

Im not sure if it would be better to have a "self-check" expert or whether to leave that to the sampling (assuming that you would run this with the entropix sampler).