dc.contributor.author | Bengio, Yoshua | |
dc.contributor.author | Louradour, Jerˆome | |
dc.contributor.author | Collobert, Ronan | |
dc.contributor.author | Weston, Jason | |
dc.date.accessioned | 2016-10-20T12:20:52Z | |
dc.date.available | 2016-10-20T12:20:52Z | |
dc.date.issued | 2009-06-14 | |
dc.date.submitted | 2016-06-02T16:02:48.580Z | |
dc.identifier.citation | Bengio, Y, Louradour, J., Collobert, R and Weston, J. 2009. Curriculum Learning. 26th International Conference on Machine Learning (ICML 2009) Montreal, Canada, June 14-18, 2009 http://www.machinelearning.org/icml.html. | en_US |
dc.identifier.uri | http://qmro.qmul.ac.uk/xmlui/handle/123456789/15972 | |
dc.description.abstract | Humans and animals learn much better when
the examples are not randomly presented but
organized in a meaningful order which illustrates
gradually more concepts, and gradually
more complex ones. Here, we formalize
such training strategies in the context
of machine learning, and call them “curriculum
learning”. In the context of recent research
studying the difficulty of training in
the presence of non-convex training criteria
(for deep deterministic and stochastic neural
networks), we explore curriculum learning
in various set-ups. The experiments show
that significant improvements in generalization
can be achieved. We hypothesize that
curriculum learning has both an effect on the
speed of convergence of the training process
to a minimum and, in the case of non-convex
criteria, on the quality of the local minima
obtained: curriculum learning can be seen
as a particular form of continuation method
(a general strategy for global optimization of
non-convex functions). | en_US |
dc.description.sponsorship | The authors thank NSERC, CIFAR, and MITACS for support. | en_US |
dc.language.iso | en | en_US |
dc.publisher | International Machine Learning Society | en_US |
dc.subject | machine learning | en_US |
dc.title | Curriculum Learning | en_US |
dc.type | Presentation | en_US |
dc.rights.holder | Copyright 2009 by the author(s)/owner(s) | |
pubs.declined | 2016-06-02T16:02:48.380+0100 | |
pubs.publication-status | Submitted | |