DeepLearn 2025
12th International School on Deep Learning
(with a special focus on Large Language Models, Foundation Models and Generative AI)
Porto - Maia, Portugal · July 21-25, 2025
Registration
Downloads
  • Call DeepLearn 2025
  • Poster DeepLearn 2025
  • Lecture Materials
  • Home
  • Lecturers
  • Schedule
  • Sponsors
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
  • Home
  • Lecturers
  • Schedule
  • Sponsors
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
Rex Ying

Rex Ying

Yale University

[intermediate/advanced] Multimodal Foundation Models for Graph-Structured Data: Framework and Scientific Applications

Summary

Foundation models have demonstrated remarkable capabilities across a diverse range of tasks and modalities such as natural language, images, time series, graphs and tabular data. They leverage abundant unsupervised data to map them into an embedding space (usually Euclidean), such that the embeddings can be easily used for a variety of generative and predictive downstream tasks with little demonstration or label. However, the complex structural properties of these data modalities often exhibit non-Euclidean characteristics including hierarchy, power-law distribution and clustering. In this course, we will demonstrate the underlying rationale for non-Euclidean representation learning. We will further introduce research breakthroughs in leveraging non-Euclidean geometry, such as hyperbolic geometry, as a powerful embedding technique to be integrated in powerful large language models, multimodal foundation models and graph foundation models.

Syllabus

  • Non-Euclidean Representation Learning
  • Hyperbolic Deep Learning Architectures
  • Non-Euclidean Training and Fine-tuning of Foundation Models
  • Tools, Benchmarks, and Applications

References

Nickel, Maximillian, and Douwe Kiela. “Poincaré embeddings for learning hierarchical representations.” Advances in Neural Information Processing Systems 30 (2017).

Gu, Albert, et al. “Learning mixed-curvature representations in product spaces.” International Conference on Learning Representations. 2018.

Chami, Ines, et al. “Hyperbolic graph convolutional neural networks.” Advances in Neural Information Processing Systems 32 (2019).

Desai, Karan, et al. “Hyperbolic image-text representations.” International Conference on Machine Learning. PMLR, 2023.

Yang, Menglin, et al. “Hypformer: Exploring efficient transformer fully in hyperbolic space.” Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024.

Yang, Menglin, et al. “Hyperbolic Fine-tuning for Large Language Models.” arXiv:2410.04010 (2024).

Pre-requisites

Deep learning and representation learning basics. Foundation models.

Short bio

Rex Ying is an assistant professor in the Department of Computer Science at Yale University. His research focus includes algorithms for foundation models, multimodal models, graph neural networks, geometric deep learning, and trustworthy deep learning. He is interested in the use of graphs and geometry to empower representation learning in expressiveness and trustworthiness in large-scale settings. Rex has built multi-modal foundation models in engineering, natural science, social science and financial domains. He won the best dissertation award at KDD 2022, and the Amazon Research Award in 2024. His research is in part supported by National Science Foundation, Gordon and Betty Moore Foundation, Snap Research and Amazon Research Award.

Other Courses

YoninaEldar2023Yonina Eldar
Manuela VelosoManuela Veloso
Pierre BaldiPierre Baldi
Sean BensonSean Benson
Xavier BressonXavier Bresson
Nello CristianiniNello Cristianini
Mark DerdzinskiMark Derdzinski
Samira Ebrahimi KahouSamira Ebrahimi Kahou
Elena GiusarmaElena Giusarma
Shih-Chieh HsuShih-Chieh Hsu
Xia (Ben) HuXia “Ben” Hu
Lu JiangLu Jiang
Jayashree Kalpathy-CramerJayashree Kalpathy-Cramer
Yingbin LiangYingbin Liang
Chen Change LoyChen Change Loy
Fenglong MaFenglong Ma & Cao (Danica) Xiao
Evan ShelhamerEvan Shelhamer
deeeplearn-speakers-wangAtlas Wang
Xiang WangXiang Wang

DeepLearn 2025

CO-ORGANIZERS

University of Maia

Institute for Research Development, Training and Advice – IRDTA, Brussels/London

Active links
  • CESArtIn 2026
Past links
  • DeepLearn 2024
  • DeepLearn 2023 Summer
  • DeepLearn 2023 Spring
  • DeepLearn 2023 Winter
  • DeepLearn 2022 Autumn
  • DeepLearn 2022 Summer
  • DeepLearn 2022 Spring
  • DeepLearn 2021 Summer
  • DeepLearn 2019
  • DeepLearn 2018
  • DeepLearn 2017
© IRDTA 2024. All Rights Reserved.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
Cookie SettingsAccept All
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
PHPSESSIDsessionThis cookie is native to PHP applications. The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website. The cookie is a session cookies and is deleted when all the browser windows are closed.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_gtag_UA_74880351_91 minuteThis cookie is set by Google and is used to distinguish users.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
Powered by CookieYes Logo