ISchedule: a general purpose interface for getting values according to some schedule.
Cycle schedule Based on 1cycle schedule as proposed in https://arxiv.org/abs/1803.09820 Starts at initial learning rate, then linearly increases learning rate until max learning rate is reached, at that point the learning rate is decreased back to initial learning rate.
An exponential schedule, with 2 parameters: initial value, and gamma.
Inverse schedule, with 3 parameters: initial value, gamma and power.
MapSchedule is a schedule based on specific values in a
DynamicCustomOpsBuilder for conveniently constructing map schedules
Polynomial decay schedule, with 3 parameters: initial value, maxIter, power.
A "Wrapper" schedule that ramps up from
Sigmoid decay schedule, with 3 parameters: initial value, gamma and stepSize.
Step decay schedule, with 3 parameters: initial value, gamma and step.
Copyright © 2020. All rights reserved.