Delay Execution until Global Step Reaches to <code>wait_until_step</code>.

This hook delays execution until global step reaches to wait_until_step. It is used to gradually start workers in distributed settings. One example usage would be setting wait_until_step=int(K*log(task_id+1)) assuming that task_id=0 is the chief.

hook_global_step_waiter(wait_until_step)

Arguments

wait_until_step

An integer indicating that until which global step should we wait.

See also