DeepLearn 2023 Winter
8th International School
on Deep Learning
Bournemouth, UK · January 16-20, 2023
Registration
Downloads
  • Call DeepLearn 2023 Winter
  • Poster DeepLearn 2023 Winter
  • Lecture Materials
  • Home
  • Schedule
  • Lecturers
  • News
  • Accommodation
  • Info
    • Travel from London to Bournemouth
    • Sponsoring
    • Code of conduct
    • Visa
    • Testimonials
  • Home
  • Schedule
  • Lecturers
  • News
  • Accommodation
  • Info
    • Travel from London to Bournemouth
    • Sponsoring
    • Code of conduct
    • Visa
    • Testimonials
deeplearn-speaker-kunal-tawar

Kunal Talwar

Apple

[introductory/intermediate] Foundations of Differentially Private Learning

Summary

Machine Learning models can memorize training data and have been shown to allow extraction of information found in individual training examples. Differential Privacy is a standard definition of privacy in statistical settings and can allow training of models that capture global trends while provably preventing learning information specific to one or a few training examples. Recent advances have shown that one can in many settings, one can learn with differential privacy with little or no impact on accuracy. This includes both theoretical results showing that provably one can learn convex models with little impact on accuracy for a large range of parameters, and practical results showing that one can train neural network models with accuracy close to non-private methods. Similarly, learning popular items from a discrete set can be done privately at a small cost to accuracy. This course will study the foundational techniques that allow for solving these problems.

Syllabus

  • Differential Privacy definition, properties
  • Basic Algorithms, Composition
  • Convex Optimization with Differential Privacy
  • Privacy Amplification, Moments Accountant, Differentially Private SGD
  • Frequency Estimation, Shuffling, Compression
  • Principal Component Analysis

References

Cynthia Dwork, Aaron Roth. The Algorithmic Foundations of Differential Privacy. https://www.cis.upenn.edu/~aaroth/privacybook.html

Pre-requisites

Basic understanding of probabilities and statistics, calculus, linear algebra, and machine learning.

Short bio

Kunal Talwar is a Research Scientist at Apple, leading a research group focusing on foundations of ML and Private Data Analysis. His research interests span various aspects of Computer Science including Differential Privacy, Machine Learning, Algorithms and Data Structures. He got his B.Tech. from IIT Delhi (2000) and his PhD from UC Berkeley (2004). Prior to joining Apple, he worked at Microsoft Research in Silicon Valley from 2005 to 2014, and at Google Brain from 2014 to 2019. He has made major contributions to Differential Privacy, Metric Embeddings and Discrepancy Theory. His work has been recognized by the Privacy Enhancing Technologies award in 2009 and the ICLR Best Paper award in 2017.

Other Courses

deeplearn-speaker-yi-maYi Ma
Daphna WeinshallDaphna Weinshall
Eric P. XingEric P. Xing
Matias Carrasco KindMatias Carrasco Kind
deeplearn-speaker-nitesh-chawlaNitesh Chawla
Sumit ChopraSumit Chopra
Luc De RaedtLuc De Raedt
Marco DuarteMarco Duarte
Joao GamaJoão Gama
Claus HornClaus Horn
Zhiting Hu & Eric P. XingZhiting Hu & Eric P. Xing
deeplearn-speaker-nathalie-japkowiczNathalie Japkowicz
deeplearn-speaker-gregor-kasieczkaGregor Kasieczka
Karen LivescuKaren Livescu
deeplearn-speaker-david-mcallersterDavid McAllester
deeplearn-speaker-dhabaleswar-k-pandaDhabaleswar K. Panda
Fabio RoliFabio Roli
Bracha ShapiraBracha Shapira
Tinne TuytelaarsTinne Tuytelaars
deeplearn-speaker-lyle-ungarLyle Ungar
speakers-bram-van-ginnekenBram van Ginneken
deeplearn-speaker-yudong-zhangYu-Dong Zhang

DeepLearn 2022 Winter

CO-ORGANIZERS

Bournemouth University
Department of Computing and Informatics

Universitat Rovira i Virgili, Tarragona

Institute for Research Development, Training and Advice – IRDTA, Brussels/London

Active links
  • DeepLearn 2023 Summer – 10th International Gran Canaria School on Deep Learning
  • BigDat 2023 Summer – 7th International School on Big Data
  • DeepLearn 2023 Spring – 9th International School on Deep Learning
Past links
  • DeepLearn 2022 Autumn
  • DeepLearn 2022 Summer
  • DeepLearn 2022 Spring
  • DeepLearn 2021 Summer
  • DeepLearn 2019
  • DeepLearn 2018
  • DeepLearn 2017
© IRDTA 2022. All Rights Reserved.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
Cookie SettingsAccept All
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
PHPSESSIDsessionThis cookie is native to PHP applications. The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website. The cookie is a session cookies and is deleted when all the browser windows are closed.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_gtag_UA_74880351_91 minuteThis cookie is set by Google and is used to distinguish users.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
Powered by CookieYes Logo