title

The 1cycle policy - an experiment that investigate super-convergence phenomenon described in Leslie Smith's research - Part 1 (2018) - Deep Learning Course Forums

charset

utf-8

description

This is an interesting experiment conducted by a fellow under fast.ai’s International Fellowship 2018 that dig into Leslie Smith’s work that Leslie describes the super-convergence phenomenon in this paper, “A Disciplin…

generator

Discourse 2.9.0.beta1 - https://github.com/discourse/discourse version 3da6f6b717905bafb62d64d800965d62e2603ac6

theme-color

#ffffff

og:site_name

Deep Learning Course Forums

og:type

website

og:image

https://web.archive.org/web/20220507203124im_/https://forums.fast.ai/uploads/default/original/3X/b/3/b395de7a2ba00b82865031c97a8cadf3d80e71e5.png

og:url

https://web.archive.org/web/20220507203124/https://forums.fast.ai/t/the-1cycle-policy-an-experiment-that-investigate-super-convergence-phenomenon-described-in-leslie-smiths-research/14737

og:title

The 1cycle policy - an experiment that investigate super-convergence phenomenon described in Leslie Smith's research

twitter:card

summary

twitter:image

https://web.archive.org/web/20220507203124im_/https://forums.fast.ai/uploads/default/original/3X/b/3/b395de7a2ba00b82865031c97a8cadf3d80e71e5.png

twitter:url

https://web.archive.org/web/20220507203124im_/https://forums.fast.ai/t/the-1cycle-policy-an-experiment-that-investigate-super-convergence-phenomenon-described-in-leslie-smiths-research/14737

twitter:title

The 1cycle policy - an experiment that investigate super-convergence phenomenon described in Leslie Smith's research

twitter:description

This is an interesting experiment conducted by a fellow under fast.ai’s International Fellowship 2018 that dig into Leslie Smith’s work that Leslie describes the super-convergence phenomenon in this paper, “A Disciplined Approach to Neural Network Hyper-Parameters: Part 1 - Learning Rate, Batch Size, Momentum, and Weight Decay”. Results from the experiments: By training with high learning rates we can reach a model that gets 93% accuracy in 70 epochs which is less than 7k iterations (as opp...

position

1

name

Deep Learning Course Forums

url

https://web.archive.org/web/20220507203124/https://forums.fast.ai/uploads/default/original/2X/b/b9ae8035630922dd8a0f9c3f4c6a599a2c5c7fa4.png

dateModified

2018-04-10T13:30:09Z

headline

The 1cycle policy - an experiment that investigate super-convergence phenomenon described in Leslie Smith's research

alternate

https://web.archive.org/web/20220507203124/https://forums.fast.ai/t/the-1cycle-policy-an-experiment-that-investigate-super-convergence-phenomenon-described-in-leslie-smiths-research/14737.rss

apple-touch-icon

https://web.archive.org/web/20220507203124im_/https://forums.fast.ai/uploads/default/optimized/3X/b/3/b395de7a2ba00b82865031c97a8cadf3d80e71e5_2_180x180.png

canonical

https://web.archive.org/web/20220507203124/https://forums.fast.ai/t/the-1cycle-policy-an-experiment-that-investigate-super-convergence-phenomenon-described-in-leslie-smiths-research/14737

icon

https://web.archive.org/web/20220507203124im_/https://forums.fast.ai/uploads/default/optimized/3X/b/3/b395de7a2ba00b82865031c97a8cadf3d80e71e5_2_32x32.png

search

https://web.archive.org/web/20220507203124/https://forums.fast.ai/opensearch.xml