DEEP LEARNING,SYSTEM,TIMELINE,JURGEN SCHMIDHUBER,YOU AGAIN,NOTE,TEXT,MASSIVE,OPEN,ONLINE,PEER REVIEW,MACHINE LEARNING,RESEARCHER,OBSESSED,PROPER,CREDIT,ASSIGNMENT,SNAPSHOT,TECHNICAL REPORT,ARXIV,UPDATES,COMPARE,COMPREHENSIVE,SURVEY,REFERENCES,HERE,ARTIFICIAL NEURAL NETWORKS,DEEP,LEARNERS,INTERNATIONAL,PATTERN RECOGNITION,COMPETITIONS,SECRET,TEST SET,EIGHT,OBJECT DETECTION,IMAGES,IMAGE SEGMENTATION,THE WORLDS FIRST,SUPERHUMAN,VISUAL,RESULTS,THE FIELD,RESEARCH,OLDER,DOWN,LAPA,PUBLISHED,GENERAL,LEARNING ALGORITHM,FEEDFORWARD,PERCEPTRONS,PAPER,ALREADY,NETWORK,LAYERS,TRAINED,THE GROUP,METHOD,DATA,HANDLING,POPULAR,MILLENNIUM,MY OWN,LEARNER,DATES,DEEPER,FATHER,ABLE,PERFORM,HUNDREDS,NONLINEAR,OPERATORS,NEURAL,UNSUPERVISED,TRAINING,STACK,RECURRENT NEURAL NETWORKS,BY NATURE,FIGURE,ABOVE,COMPUTERS,POWERFUL,NORMAL,ENCODE,ENTIRE,SEQUENCES,IDEA,RELEVANT,TODAY,FOR A WHILE,FASHION,PREDICT,INPUT,UNEXPECTED,ERRORS,INFORMATION,THE NEXT,HIGHER,THUS,TICKS,SELF ORGANISING,SCALE,GETS LOST,IT JUST,GETS,COMPRESSION,LESS AND LESS,REDUNDANT,SEQUENCE,ENCODINGS,DEEPER AND DEEPER,HIERARCHICAL TEMPORAL MEMORY,SPACE LIKE,CONTINUOUS,VARIANT,ANCIENT,EXPERIMENT,STEPS,VIRTUAL,LEVEL,CODE,COMPACT,PREVIOUSLY,CLASSIFICATION,SUPERVISED LEARNING,POSSIBLE,THERE IS A WAY,DISTILLING,TRICK,RETRAIN,IMITATE,THE HIDDEN,UNITS,HIGHER LEVEL,PREDICTIVE,OUTPUT,DEVELOP,CHANGING,MEMORIES,BRIDGE,LAGS,THE DEEP,PROBLEM,IDENTIFIED,FIRST STUDENT,PROFESSOR,SEPP HOCHREITER,EXPLODING,GRADIENTS,1990S,2000S,LSTM,EVENTUALLY,SIMILAR,FEATS,SYSTEM 1,MOREOVER,LEARN,PARTICULARLY,STACKS,CONNECTIONIST,FASTER,EVER,COMPETITION,THE WORK,PHD STUDENT,POSTDOC,ALEX GRAVES,RECURRENT,CONTEST,IN FACT,ICDAR,CONNECTED,HANDWRITING,LANGUAGES,GEOFFREY,HINTONS,LAB,TORONTO,BROKE,FAMOUS,TIMIT,SPEECH RECOGNITION,RECORD,THOUSANDS,OF MAN,SPENT,HELPED,SCORE,EVALUATION,AS OF,COMPANIES,GOOGLE,MICROSOFT,IBM,BAIDU,IMPROVE,MACHINE TRANSLATION,IMAGE,CAPTION,GENERATION,PARSING,TEXT TO SPEECH,SYNTHESIS,PHOTO,REAL,TALKING HEADS,PROSODY,DETECTION,VIDEO,TRANSLATION,APPLICATIONS,EXAMPLE,GOOGLE BLOG,GOOGLE VOICE,AVAILABLE,BILLION,SMARTPHONE,ENTREPRENEURS,THE ANCIENT,TERM,ACTUALLY,SUBSEQUENTLY,THE CONTEXT,DATING,HALF,LESS,REACHED,ERROR,RATE,MNIST,HANDWRITTEN,BENCHMARK,OUR TEAM,GOOD,BACKPROPAGATION,GPUS,PATTERN,DISTORTIONS,THREE TIMES,BACK THEN,WORLD RECORD,PREVIOUS,STANDARD NET,BACKPROP,CNN,PLAIN,EXCEPT,SACCADIC EYE MOVEMENT,TRANSLATIONS,BIOLOGICALLY,RATHER,ARCHITECTURE,INSPIRED,NEUROSCIENCE,RELATED,WORK,WIDE,MULTI,COLUMN,MAX POOLING,SHARING,WINNER TAKE ALL,COMMITTEES,SIMPLE,DEMOCRATIC,AVERAGING,SOPHISTICATED,ENSEMBLE METHODS,PROFIT,FAST,INTERNATIONAL COMPETITION,C,HUMAN,COMPETITIVE,ROUTINE,BASIS,STANFORD,APPLE INC,MAKER,HIRED,UELI,MEMBER,TEAM,CHINESE,ARCELORMITTAL,WORLDS,STEEL,PRODUCER,MATERIAL,DEFECT,TECHNIQUES,BIOMEDICAL IMAGING,CANCER,PROGNOSIS,PLAQUE,IN CT,HEART,LEADING,AUTOMOTIVE,DEEPMIND,WHOSE,PHDS,ONE OF THEM,CO FOUNDER,ALGORITHMS,ADAPTATIONS,ALGORITHM,EFFICIENT,BPTT,TRANSFER LEARNING,PARTICULAR,STATE OF THE ART,NETS,COMBINATIONS,CONCEPTS,NEOCOGNITRON,ALTERNATIVE,LOCAL,PLUS,TRICKS,CASE,SYSTEMS,DOMINATE,WINNING,SETTING,DEVELOPED,LAB 1,OR 2,BUILDING,1960S,ADVANTAGEOUS,COMBINE,THE BEST OF BOTH WORLDS,COMMENTS,GEOFFREY HINTON,KUNIHIKO FUKUSHIMA,YOSHUA BENGIO,SVEN,YANN LECUN,MIKE,MOZER,RANZATO,ANDREAS,PAUL WERBOS,SHUN,ICHI,AMARI,SEPPO LINNAINMAA,PETER NORVIG,YU CHI HO,JONATHAN,MASCI,STUART DREYFUS,GRAPHICS,FIBONACCI,WEB DESIGN,TIMELINE OF,HIGHLIGHTS,BELOW,NEUROBIOLOGICAL,INSPIRATION,SIMPLE CELLS,COMPLEX CELLS,HUBEL,VISUAL CORTEX,ARTIFICIAL NEURAL NETWORK,CERTAIN,MODERN,TRAINING SET,VECTORS,TARGET,REGRESSION ANALYSIS,THE HELP,VALIDATION SET,USED TO,WEED OUT,THE NUMBERS,LAYER,LEARNED,DEPENDENT,DECADE,FUNCTIONS,COMPLEX,MULTI STAGE,DIFFERENTIABLE,DISCUSSED,THE EARLY,GRADIENT DESCENT,PERFORMED,ITERATING,CHAIN RULE,DYNAMIC PROGRAMMING,STYLE,DERIVATION,ARBITRARY,SPARSE,APPARENTLY,ALSO KNOWN AS,REVERSE,MODE,AUTOMATIC DIFFERENTIATION,COSTS,FORWARD,ACTIVATION,EQUAL,DERIVATIVE,CALCULATION,FORTRAN,DISCUSSION,SECTION 5,PROCESSING,NATURAL,THE CENTRAL,CONVOLUTION,NEUROPHYSIOLOGICAL,INSIGHTS,THE ARCHITECTURE OF,GRADIENT,USES,UNSUPERVISED LEARNING,RULES,AUTOENCODER,HIERARCHIES,IDEAS,POST,SOMEWHAT,COMBINATION,ESSENTIAL,INGREDIENT,EXPERIMENTS,HARD,TRAIN,MY STUDENT,DISCOVERED,REASON,HIERARCHY,PRESENT,PAGE,ACCELERATE,THIS WAS,THE MODERN,SENSE,LONG SHORT TERM MEMORY,PROBLEMS,DEEP BELIEF NETWORKS,HINTON,FOCUSED,INTEREST,IN DEEP,KEYWORDS,RESTRICTED,BOLTZMANN,MACHINES,DIGIT,PERFORMING,SEGMENTATION,YIELDS,EXCELLENT,STANDARD,IMPLEMENTATION,THE FIRST HUMAN,21 TODAY,TWICE,BETTER THAN,HUMANS,ARTIFICIAL,COMPETITOR,SIX TIMES,THE BEST,THE CURRENT,GOLD STANDARD,IMAGE SCANNING,MERE,MITOSIS,IMAGENET,THE COMPUTER,VISION,COMMUNITY,PURE,INTERVIEW,PHONEME,ALMOST,HANDWRITING RECOGNITION,CLASSES,DESKTOP,MACHINE,GRAND CHALLENGE,HELP,PASCAL,THE WEB,PAGES,SWISS,AI LAB,IDSIA,THE UNIVERSITY OF TORONTO,LEARNING,THE PRINCIPLE,NEURAL COMPUTATION,HABILITATION THESIS,GOOGLE TRANSLATE,YOUR MOTHER,TONGUE,DIPLOMA THESIS,ADVISOR,GRADIENT FLOW,DIFFICULTY OF LEARNING,L