DeepLearn 2025
12th International School on Deep Learning
(with a special focus on Large Language Models, Foundation Models and Generative AI)
Porto - Maia, Portugal · July 21-25, 2025
Registration
Downloads
  • Call DeepLearn 2025
  • Poster DeepLearn 2025
  • Lecture Materials
  • Home
  • Lecturers
  • Schedule
  • Sponsors
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
  • Home
  • Lecturers
  • Schedule
  • Sponsors
  • News
  • Info
    • Travel
    • Accommodation
    • UMaia / UP students and staff
    • Visa
    • Code of conduct
    • Testimonials
Xiang Wang

Xiang Wang

University of Science and Technology of China

[advanced] Large Language Models for User Behavior Modeling: Cross-Modal Interpretation, Preference Optimization, and Agentic Simulation

Summary

This lecture examines the pivotal role of large language models (LLMs) in advancing user behavior modeling, with a specific focus on personalized recommendation systems. It highlights how LLMs enhance the understanding of user intent, optimize behavioral preferences, and simulate intricate user interactions, with three foundational pillars:

  1. Cross-Modal Interpretation: This section explores how LLMs process diverse behavioral modalities (e.g., clicks, purchases, and views) alongside textual data, enabling a unified understanding of user behaviors across multiple input formats.
  2. Preference Alignment: It introduces state-of-the-art approaches such as reinforcement learning with human feedback (RLHF) and direct preference optimization (DPO), framing user behaviors as preference data to refine and personalize recommendations effectively.
  3. Agentic Simulation: The lecture further discusses decomposing complex user modeling tasks into manageable subtasks, each addressed by specialized LLMs operating collaboratively within a network of agentic experts.

The lecture provides both theoretical insights and practical applications, bridging the gap between LLMs research and real-world recommender systems.

Syllabus

  • Background: role of LLMs in recommendation systems.
  • Introduction: key pillars (cross-modal interpretation, preference optimization, agentic simulation).
  • Cross-Modal Interpretation: concepts, paradigms, and core ideas of fine-tuning.
  • Preference Alignment: concepts, methodologies, and recent progress of preference optimization.
  • Agentic Simulation: concepts, frameworks, and latest advancements of agents.
  • Key takeaways and future trends

References

LLaRA: Large Language-Recommendation Assistant. In SIGIR 2024.

On generative agents in recommendation. In SIGIR 2024.

On Softmax Direct Preference Optimization for Recommendation. In NeurIPS 2024.

Customizing Language Models with Instance-wise LoRA for Sequential Recommendation. In NeurIPS 2024.

beta-DPO: Direct Preference Optimization with Dynamic beta. In NeurIPS 2024.

Language Representations Can Be What Recommenders Need: Findings and Potentials.

Pre-requisites

Machine learning basics.

Short bio

Xiang Wang is a professor at the University of Science and Technology of China (USTC). He obtained his Ph.D. from the National University of Singapore in 2019. His research focuses on multi-modal large language models, user modeling, and data mining. He has authored over 100 publications in top-tier artificial intelligence conferences, including more than 10 papers recognized as highly influential and 3 papers selected as Best Paper Finalists. He has served as an Area Chair for leading conferences such as NeurIPS and ICML. Dr. Wang’s achievements include the SIGIR Early Career Award and recognition as one of MIT Technology Review’s Innovators Under 35 (TR35) in China.

Other Courses

YoninaEldar2023Yonina Eldar
Manuela VelosoManuela Veloso
Pierre BaldiPierre Baldi
Sean BensonSean Benson
Xavier BressonXavier Bresson
Nello CristianiniNello Cristianini
Mark DerdzinskiMark Derdzinski
Samira Ebrahimi KahouSamira Ebrahimi Kahou
Elena GiusarmaElena Giusarma
Shih-Chieh HsuShih-Chieh Hsu
Xia (Ben) HuXia “Ben” Hu
Lu JiangLu Jiang
Jayashree Kalpathy-CramerJayashree Kalpathy-Cramer
Yingbin LiangYingbin Liang
Chen Change LoyChen Change Loy
Fenglong MaFenglong Ma & Cao (Danica) Xiao
Evan ShelhamerEvan Shelhamer
deeeplearn-speakers-wangAtlas Wang
Rex YingRex Ying

DeepLearn 2025

CO-ORGANIZERS

University of Maia

Institute for Research Development, Training and Advice – IRDTA, Brussels/London

Active links
  • CESArtIn 2026
Past links
  • DeepLearn 2024
  • DeepLearn 2023 Summer
  • DeepLearn 2023 Spring
  • DeepLearn 2023 Winter
  • DeepLearn 2022 Autumn
  • DeepLearn 2022 Summer
  • DeepLearn 2022 Spring
  • DeepLearn 2021 Summer
  • DeepLearn 2019
  • DeepLearn 2018
  • DeepLearn 2017
© IRDTA 2024. All Rights Reserved.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
Cookie SettingsAccept All
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
PHPSESSIDsessionThis cookie is native to PHP applications. The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website. The cookie is a session cookies and is deleted when all the browser windows are closed.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_gtag_UA_74880351_91 minuteThis cookie is set by Google and is used to distinguish users.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
Powered by CookieYes Logo