Dual network with atomic learning rates

too lazy to read photos of hand written notes. my loss, I know.