DeepLearn 2022 Spring
5th International School
on Deep Learning
Guimarães, Portugal · April 18-22, 2022
Registration
Downloads
  • Call DeepLearn 2022 Spring
  • Poster DeepLearn 2022 Spring
  • Lecture Materials
  • Home
  • Schedule
  • Lecturers
  • Travel
  • Accommodation
  • Info
    • Sponsors
    • Code of conduct
    • Visa
    • News
  • Home
  • Schedule
  • Lecturers
  • Travel
  • Accommodation
  • Info
    • Sponsors
    • Code of conduct
    • Visa
    • News
Altan Cakir

Altan Çakır

Istanbul Technical University

[introductory] Introduction to Deep Learning with Apache Spark

Summary

Apache Spark, open-source cluster-computing framework providing a fast and general engine for large-scale processing, has been one of the exciting technologies in recent years for the big data development. The main idea behind this technology is to provide a memory abstraction, which allows us to efficiently share data across the different stages of a map-reduce job or provide in-memory data sharing. Our lecture starts with a brief introduction to Spark and its Hadoop related ecosystem, and then shows some common techniques – classification, collaborative filtering, and anomaly detection, among others, to fields scientific applications, social media analysis, web-analytics and finance. If you have an entry-level understanding of machine learning and statistics, and program in Python or Scala, you will find these subjects useful for working on your own big data challenges.

Syllabus

  • Introduction to Data Analysis with Apache Spark
  • Spark Programming Model with RDD objects and DataFrames
  • Running Spark Applications on Hadoop / Cloud-based Cluster Systems
  • Spark SQL
  • Spark Streaming
  • Machine Learning with Spark MLlib/ML
  • Advanced Analytics Applications with Spark
  • Anaysis of real world applications

References

https://spark.apache.org, Unified Analytics Engine for Big Data

Advanced Analytics with Spark: Patterns For Learning From Data at Scale, A. Teller, M. Pumperla, M. Malohlava

Mastering Machine Learning with Apache Spark 2.x, S. Amirgodshi, M. Rajendran, B. Hall, S. Mei

Pre-requisites

Python, Machine Learning, Distributed Computing.

Short bio

Altan Cakir has a M.Sc. degree in physics from Izmir Institute of Technology in 2006 and then went straight to graduate school at the Karlsruhe Institute of Technology, Germany. During his Ph.D., he was responsible for a scientific research based on new physics searches in the CMS detector at the Large Hadron Collider (LHC) at European Nuclear Research Laboratory (CERN). Thereafter he was granted as a post-doctoral research fellow at Deutsches Elektronen-Synchotron (DESY), a national nuclear research center in Hamburg, Germany, where he spent 5 years, and then recently got his present full professor position at Istanbul Technical University (ITU), Istanbul, Turkey. Currently, Altan Cakir is a group leader of ITU-CMS group at CERN leading a data analysis group at the CMS detector. Furthermore, he was a visiting faculty at Fermi National Accelerator Laboratory (Fermilab), Illinois, USA in 2017. His group’s expertise is focused around machine learning techniques in large scale data analysis. However, their research is very much interdisciplinary, with expertise in the group ranging from science and big data synthesis to economy, industrial applications and operations research. Today, he is consulting various companies worldwide, and sharing his expertise in big data application areas, strategies, skills and competencies based on the real-world scenarios.

Altan Cakir was involved in a large number of high-profile research projects at CERN, DESY and Fermilab in the last fifteen years. He enjoys being able to integrate his research and teaching key concepts of science and big data technologies. It’s rewarding to be part of the development of the next generation of scientists, engineers and help his students move on to careers all over the world, in academia, industry and government.

The following lectures on big data are periodically given by Assoc. Prof. Dr. Altan Cakir in Big Data and Business Analytics Program (http://bigdatamaster.itu.edu.tr) at Istanbul Technical University: Big Data Technologies and Applications, Machine Learning with Big Data. All in all, Altan Cakir is executive member of ITU AI Center (ai.itu.edu.tr) and one of the lecturers of Cambridge Big Data Program in BigDat2019, University of Cambridge, United Kingdom.

Other Courses

Eneko AgirreEneko Agirre
Rylan ConwayRylan Conway
deeplearn-speakers-gaoJianfeng Gao
deeplearn-speakers-hanBohyung Han
deeplearn-speakers-karamLina J. Karam
Kyle KeaneKyle Keane
deeplearn-speakers-xiaoming-liuXiaoming Liu
Jennifer NgadiubaJennifer Ngadiuba
Lucila Ohno-MachadoLucila Ohno-Machado
deeplearn-speakers-rajBhiksha Raj
Bart ter Haar RomenijBart ter Haar Romeny
deeplearn-speakers-royKaushik Roy
deeplearn-speakers-saadWalid Saad
Yvan SaeysYvan Saeys
deeplearn-speakers-schultzMartin Schultz
deeplearn-speakers-smith-milesKate Smith-Miles
Mihai SurdeanuMihai Surdeanu
deeplearn-speakers-vallecorsaSofia Vallecorsa
deeplearn-speakers-vazirgiannisMichalis Vazirgiannis
Guowei WeiGuowei Wei
deeplearn-speakers-xiaowei-xuXiaowei Xu
deeplearn-speakers-zhaoGuoying Zhao
Zhongming ZhaoZhongming Zhao

DeepLearn 2022 Spring

CO-ORGANIZERS

Algoritmi Center, University of Minho, Guimarães

School of Engineering, University of Minho

Intelligent Systems Associate Laboratory, University of Minho

Rovira i Virgili University

Municipality of Guimarães

Institute for Research Development, Training and Advice – IRDTA, Brussels/London

Active links
  • DeepLearn 2022 Autumn – 7th International School on Deep Learning
  • DeepLearn 2022 Summer – 6th International School on Deep Learning
  • TPNC 2020 & 2021 – 9th-10th International Conference on the Theory and Practice of Natural Computing
  • SLSP 2020 & 2021 – 8th-9th International Conference on Statistical Language and Speech Processing
  • AlCoB 2020 & 2021 – 7th-8th International Conference on Algorithms for Computational Biology
  • LATA 2020 & 2021 – 14th-15th International Conference on Language and Automata Theory and Applications
Past links
  • DeepLearn 2021 Summer
  • DeepLearn 2019
  • DeepLearn 2018
  • DeepLearn 2017
© IRDTA 2021. All Rights Reserved.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
Cookie SettingsAccept All
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
PHPSESSIDsessionThis cookie is native to PHP applications. The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website. The cookie is a session cookies and is deleted when all the browser windows are closed.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_gtag_UA_74880351_91 minuteThis cookie is set by Google and is used to distinguish users.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
Powered by CookieYes Logo