add warmup duration in CosineAnnealingScheduler and LinearCyclicalScheduler for warmup each cycle
Read more...