Trained Ternary Quantization

https://arxiv.org/abs/1612.01064

https://github.com/czhu95/ternarynet

(1) maintain a constant factor $$t$$ for all layers$$\Delta_l = t \times \max (|\tilde{\omega} |)$$

(2) maintain a constant sparsity $$r$$ for all layers