DeepLearn 2024
11th International School on Deep Learning
(and the Future of Artificial Intelligence)
Porto - Maia, Portugal · July 15-19, 2024
Registration
Downloads
  • Call DeepLearn 2024
  • Poster DeepLearn 2024
  • Lecture Materials
  • Home
  • Lecturers
  • Schedule
  • Sponsoring
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
  • Home
  • Lecturers
  • Schedule
  • Sponsoring
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
deeeplearn-speakers-ney

Hermann Ney

RWTH Aachen University / AppTek

[intermediate/advanced] Machine Learning and Deep Learning for Speech & Language Technology: A Probabilistic Perspective

Summary

Today data-driven methods like machine learning and artificial neural networks (ANN) are widely used for speech and language processing, e.g. for automatic speech recognition (ASR) and machine translation. We will re-visit the evolution of these methods over the last 50 years and will present a unifying view of their principles from a probabilistic perspective.

Specifically, we will address the following aspects of probabilistic modelling:

– What is the probabilistic interpretation of ANN outputs?
– What is the relation between the task performance (e.g. word error rate in ASR) and the decision rule for generating the output sequence (e.g. Bayes decision rule)?
– What are the relations between training criteria (like cross-entropy) and task performance?
– How do we model the dependencies between input and output sequences in sequence-to-sequence processing?
– What are synchronization mechanisms between input and output sequences (e.g. hidden Markov models, finite-state transducers, cross-attention)?
– What role does the language model play in the context of end-to-end models?

Syllabus

  • Part 1: Probabilistic foundations, Bayes decision theory, probabilistic interpretation of neural networks, training criteria.
  • Part 2: Sequence processing and specific ANN structures (hidden Markov models, finite-state transducers, cross-attention).
  • Part 3: Deep Learning and HLT tasks (speech recognition, language modelling, machine translation).

References

H. Bourlard, N. Morgan: Connectionist Speech Recognition – A Hybrid Approach, Kluwer Academic Publishers, 1994.

D. Yu, L. Deng: Automatic Speech Recognition: A Deep Learning Approach. Springer, 2014.

D. Jurafsky, J. H. Martin: Speech and Language Processing. 3rd edition draft, 2017, https://web.stanford.edu/~jurafsky/slp3/

Y. Goldberg: Neural Network Methods in Natural Language Processing. Morgan & Claypool Publishers, 2016.

K.P. Murphy: Probabilistic Machine Learning: An Introduction. MIT Press, 2022.

K.P. Murphy: Probabilistic Machine Learning: Advanced Topics. MIT Press, 2023.

Pre-requisites

Linear algebra, numerical mathematics, probability and statistics, elementary machine learning.

Short bio

Hermann Ney is director of science at AppTek, McLean, VA and senior professor of computer science at RWTH Aachen University, Germany. His main research interests lie in the area of machine learning, neural networks and applications to speech recognition, machine translation and other tasks in natural language processing.

He and his team contributed to a large number of European (e.g. TC-STAR, QUAERO, TRANSLECTURES, EU-BRIDGE) and American (e.g. GALE, BOLT, BABEL) large-scale joint projects. His work has resulted in more than 700 conference and journal papers with an h index of 113 and 64,000 citations (based on Google Scholar). More than 50 of his former PhD students work for IT companies like Amazon, Apple, Cerence, Ebay, Google and Nuance.

The results of his research contributed to various operational research prototypes and commercial systems. In 1993, Philips Dictation Systems Vienna introduced a large-vocabulary continuous-speech recognition product for medical applications. In 1997, Philips Dialogue Systems Aachen introduced a spoken dialogue system for traintable information via the telephone. In the German project VERBMOBIL, his team introduced the phrase-based approach to data-driven machine translation, which in 2008 was used by his former PhD students at Google as starting point for the service Google Translate. In the EU project TC-STAR, the first research prototype system for spoken language translation of real-life domains was built.

Awards: 2005 Technical Achievement Award of the IEEE Signal Processing Society; 2013 Award of Honour of the International Association for Machine Translation; 2019 IEEE James L. Flanagan Speech and Audio Processing Award; 2021 ISCA Medal for Scientific Achievements (ISCA = Int. Speech Communication Ass.).

Other Courses

deeeplearn-speakers-hanJiawei Han
Katia SycaraKatia Sycara
deeeplearn-speakers-beniniLuca Benini
Gustau Camps-VallsGustau Camps-Valls
Nitesh ChawlaNitesh Chawla
Daniel CremersDaniel Cremers
deeeplearn-speakers-cuiPeng Cui
deeeplearn-speakers-gleyzerSergei V. Gleyzer
deeeplearn-speakers-heYulan He
Frank HutterFrank Hutter
deeeplearn-speakers-karypisGeorge Karypis
Massimiliano PontilMassimiliano Pontil
Elisa RicciElisa Ricci
Wojciech SamekWojciech Samek
Xinghua Mindy ShiXinghua Mindy Shi
Michalis VazirgiannisMichalis Vazirgiannis
James ZouJames Zou

DeepLearn 2023 Summer

CO-ORGANIZERS

University of Maia

Institute for Research Development, Training and Advice – IRDTA, Brussels/London

Active links
    Past links
    • DeepLearn 2023 Summer
    • DeepLearn 2023 Spring
    • DeepLearn 2023 Winter
    • DeepLearn 2022 Autumn
    • DeepLearn 2022 Summer
    • DeepLearn 2022 Spring
    • DeepLearn 2021 Summer
    • DeepLearn 2019
    • DeepLearn 2018
    • DeepLearn 2017
    © IRDTA 2023. All Rights Reserved.
    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
    Cookie SettingsAccept All
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
    CookieDurationDescription
    cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
    cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    PHPSESSIDsessionThis cookie is native to PHP applications. The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website. The cookie is a session cookies and is deleted when all the browser windows are closed.
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    Functional
    Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
    Performance
    Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
    Analytics
    Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
    CookieDurationDescription
    _ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
    _gat_gtag_UA_74880351_91 minuteThis cookie is set by Google and is used to distinguish users.
    _gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
    Advertisement
    Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
    Others
    Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
    SAVE & ACCEPT
    Powered by CookieYes Logo