machine learning

Hayssam Dahrouj

Senior Research Scientist at KAUST (King Abdullah University of Science and Technology)

Karen Sanchez

Postdoctoral Research Fellow
Karen Sanchez is a Postdoctoral Researcher in the IVUL lab at KAUST, specializing in deep learning, machine learning, and artificial intelligence (AI) for healthcare applications. Her research focuses on video understanding, domain adaptation, generative AI, and methods for preserving patient privacy.

Hani A. Al Majed

M.S. Student
Electrical and Computer Engineering Master's student at KAUST under the supervision of Professor Bernard Ghanem, with expertise in machine learning workflow automation, physics-informed neural operators, and AI for Science, particularly in chemistry applications. Passionate about leveraging AI to solve complex scientific problems.

Ahmad Sait

M.S. Student, Computer Science
Ahmad Sait is a Master's student in the Computer Science program at KAUST. Before joining KAUST, Ahmad obtained his Bachelor's degree in Computer Science from King Abdulaziz University, Saudi Arabia. Ahmad is also a KAUST Academy graduate from the AI track, having been under the supervision of Prof. Naeemullah Khan. The Academy provided him with seven opportunities to assist in teaching students enrolled in subsequent cohorts.

Saleh AlJazzar

Research Fellow at King Abdullah University of Science and Technology (KAUST) .

Muhammad Esmat

Visiting student at, King Abdullah University of Science and Technology (KAUST).

Yasser Jaber

Visiting Student Researcher ,Machine Learning Engineer at KAUST (King Abdullah University of Science and Technology).
Syed Abidullah Fareed

Syed Abidullah Fareed

Visiting Student (former), Information Science Lab

Ahsan Mehmood

Intern (former), Information Science Lab
Visiting student at King Abdullah University of Science and Technology (KAUST).

Abdulkarem Badiea Alshaibani

Visiting Student at the Information Science Lab at the King Abdullah University of Science and Technology (KAUST).

On the resolution of a theoretical question related to the nature of local training in federated learning

-

B1 L3 R3119

In this talk, I will explain the problem, its solution, and some subsequent work generalizing, extending and improving the ProxSkip method in various ways. We study distributed optimization methods based on the local training (LT) paradigm - achieving improved communication efficiency by performing richer local gradient-based training on the clients before parameter averaging - which is of key importance in federated learning. Looking back at the progress of the field in the last decade, we identify 5 generations of LT methods: 1) heuristic, 2) homogeneous, 3) sublinear, 4) linear, and 5) accelerated. The 5th generation, initiated by the ProxSkip method of Mishchenko et al (2022) and its analysis, is characterized by the first theoretical confirmation that LT is a communication acceleration mechanism.

Models, Methods, Applications: HPC in Medicine, Science, Engineering, and AI

-

B3 L5 R5209

Abstract The accurate numerical prediction of complex processes in medicine, science, and engineering requires a well balanced interplay of mathematical models, numerical methods, and scientific software. In this talk, we discuss along different examples from engineering, earth-sciences, and medicine the various challenges in building predictive models. Our focus will be on the algorithmic aspects, i.e. on the numerical methods, -may it be finite elements or neural networks in the context of massive parallelism. We will present in particular parallel preconditioners for non-linear problems

Course: A Mathematical Introduction to Deep Learning

1 min read ·
I will give an elementary introduction of basic deep learning models and training algorithms from a mathematical viewpoint. In particular, I will relate some basic deep learning models with finite element and multigrid methods. I will also touch on some advanced topics to demonstrate the potential of new mathematical insight and analysis for improving the efficiency of deep learning technologies and, in particular, for their application to numerical solution of partial differential equations. Course Schedule View the full course schedule here.

Juncai He

I am currently a research scientist in Computer, Electrical and Mathematical Science and Engineering Division (CEMSE) at King Abdullah University of Science and Technology (KAUST). I received a B.S. degree in Mathematics and Applied Mathematics from Sichuan University in 2014. In the Summer of 2019, I received my Ph.D. degree in Computational Mathematics under the supervision of Prof. Jinchao Xu and Prof. Jun Hu at Peking University in Beijing, China. From 2019 to 2020, I worked as a Postdoctoral Scholar supervised by Prof. Jinchao Xu in The Center for Computational Mathematics and Application