My research focuses on Langevin-based sampling algorithms for complex probability distributions
on both unconstrained and constrained domains, with applications in Bayesian statistics and machine learning.
I combine theoretical convergence analysis with numerical experiments to understand and evaluate their performance.
I study how Langevin dynamics can be designed and analysed to efficiently sample from complex distributions. My current work falls under the first two themes below; the third is a direction I want to develop.
Current research
Langevin dynamics and nonreversible sampling
When does adding a nonreversible drift make a Langevin sampler converge faster, and how can the gain be measured?
Overdamped Langevin dynamics is the starting point for many sampling algorithms. Adding a skew-symmetric drift leaves the target distribution unchanged but changes how the process moves through it. I study when this helps, using large deviations and nonasymptotic convergence bounds.
Langevin dynamics with a skew-symmetric matrix J. The target distribution π ∝ e−U is invariant for every such J.
Current research
Constrained Sampling with Penalized Nonreversible Langevin Algorithms
How can we combine penalization and nonreversible Langevin dynamics to efficiently sample from probability distributions supported on constrained sets?
Many models in statistics and machine learning restrict parameters to compact convex sets. We develop Langevin sampling algorithms that combine squared-distance penalties with nonreversible dynamics.
Our research establishes convergence and accuracy guarantees for full-gradient and stochastic-gradient methods, accounting for both numerical discretization and the approximation introduced by penalization.
We also investigate when nonreversibility can accelerate convergence, combining theoretical analysis with numerical experiments on constrained sampling problems.
Future direction
Sampling Theory for Generative Modeling
How can we generate samples more accurately and at lower computational cost?
Building on my research in Langevin dynamics, I plan to investigate how numerical discretization and the choice of sampling dynamics affect convergence and approximation error in diffusion-based generative models.
I aim to combine theoretical analysis with numerical experiments to develop sampling algorithms that achieve a desired accuracy with less computation.
Interactive demo
How a nonreversible drift can speed up sampling
Both panels sample the same stretched Gaussian distribution, starting from the same point and using the same random noise. The right panel adds the drift −J∇U, which leaves the target unchanged but makes the points circulate around it, so they settle much sooner. Drag the slider to change the strength of the drift.
Standard Langevin J = 0
Nonreversible Langevin J ≠ 0
Distance to the target log scale
t = 0.0
The target is a Gaussian whose long axis is four times its short axis; the grey ellipses mark 1, 2 and 3 standard deviations, and the dark line follows the average position of the points. Both samplers take Euler–Maruyama steps of size h = 0.005 with 500 points, and on the right J = δ01−10. The chart shows the exact Kullback–Leibler divergence between the distribution of the points and the target. For Gaussian targets, the best choice of J raises the convergence rate from that of the slowest direction to the average over all directions (Hwang, Hwang-Ma and Sheu, 1993; Lelièvre, Nier and Pavliotis, 2013).
Publications
Papers and preprints, newest first. Each entry is marked Published, Accepted, Preprint or In preparation. A full list is on Google Scholar.
Papers and preprints
2026Preprint
Accelerating Non-Smooth and Heavy-Tailed Sampling
Pervez Ali, Xiaoyu Wang, Yingli Wang and Lingjiong Zhu
arXiv:2610.11139
Nonreversible anchored Langevin dynamics for target densities that may be non-differentiable: NALD on the whole Euclidean space, where the target may also be heavy-tailed, and NRALD on bounded domains with normal reflection. A circulation drift built from a possibly state-dependent, divergence-free skew-symmetric matrix field and a stream potential preserves the target without using derivatives of its density. Nonasymptotic convergence bounds, a large deviations analysis and asymptotic variance reduction show that both can converge faster than their reversible counterparts, and numerical experiments demonstrate their efficiency.
@misc{ali2026accelerating,
title = {Accelerating Non-Smooth and Heavy-Tailed Sampling},
author = {Ali, Pervez and Wang, Xiaoyu and Wang, Yingli and Zhu, Lingjiong},
year = {2026},
eprint = {2610.11139},
archivePrefix = {arXiv}
}
2026Preprint
Penalized Nonreversible Langevin for Constrained Sampling
Pervez Ali, Weihao Dong and Xiaoyu Wang
arXiv:2609.25381
Sampling on a compact convex set by combining a squared-distance penalty with a skew-symmetric perturbation of Langevin dynamics. The preprint gives nonasymptotic bounds relative to the penalized target: in total variation with full gradients, including nonconvex potentials, and in 2-Wasserstein distance with stochastic gradients. For a quadratic model, tuning the perturbation improves the sufficient number of iterations from linear to logarithmic in the curvature ratio.
@misc{ali2026penalized,
title = {Penalized Nonreversible {L}angevin for Constrained Sampling},
author = {Ali, Pervez and Dong, Weihao and Wang, Xiaoyu},
year = {2026},
eprint = {2609.25381},
archivePrefix = {arXiv}
}
2025Preprint
Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis
Nian Yao, Pervez Ali, Xihua Tao and Lingjiong Zhu
arXiv:2503.19066
Large deviation principles with explicit rate functions for mirror, high-order and Hessian-free high-resolution Langevin dynamics. Comparing rate functions shows when these dynamics, and underdamped Langevin, accelerate overdamped Langevin. Experiments cover Bayesian linear and logistic regression, including real data.
@misc{yao2025accelerating,
title = {Accelerating {L}angevin {M}onte {C}arlo Sampling: A Large Deviations Analysis},
author = {Yao, Nian and Ali, Pervez and Tao, Xihua and Zhu, Lingjiong},
year = {2025},
eprint = {2503.19066},
archivePrefix = {arXiv}
}
2021Published
On Modelling and Pricing Weather Derivatives Driven by Nonlinear Brownian Motion
Javed Hussain and Pervez Ali
International Journal of Analysis and Applications 19(1), 29–46
Estimates for risk-neutral prices of temperature-based weather derivatives when temperature follows a G-stochastic differential equation driven by G-Brownian motion.
I am a Fulbright Scholar and a PhD candidate in the Department of Mathematics at Florida State University, where I am advised by Dr. Lingjiong Zhu. I develop and analyze sampling algorithms based on Langevin dynamics. My work spans reversible and nonreversible dynamics, as well as unconstrained and constrained sampling.
I am also a Lecturer in Mathematics at Sukkur IBA University in Pakistan, where I taught from 2017 to 2022 and completed my MS in Mathematics. I have been on study leave from Sukkur IBA since July 2022. At Florida State, I have served as vice president of the SIAM Student Chapter.
Outside of research, I play tennis, pickleball, and cricket, and never pass up a chance to try a new sport.
Travel grant to attend the Hausdorff School, University of Bonn2023
Fulbright Scholarship for PhD study in the United States2022
Departmental Merit Scholarship, Sukkur IBA University2019
Prime Minister’s Scholarship for MS study (fully funded)2018
Student of the Year in Mathematics, University of Sindh (awarded a laptop)2015
Teaching
I have taught undergraduate mathematics since 2017: first as a lecturer in Pakistan, and since 2022 as an instructor and teaching assistant at Florida State University.
Florida State University, USA
Graduate Teaching Assistant and Instructor · Aug 2022 – present
Courses at Florida State University
Course
Role
Terms
Calculus I
Instructor
Spring 2025, Summer 2025
Calculus II
Instructor
Fall 2025, Spring 2026
Calculus III
Instructor
Summer 2026, Fall 2026
Calculus, Trigonometry, College Algebra
Teaching assistant
2024
Sukkur IBA University, Pakistan
Lecturer in Mathematics · Aug 2017 – Jul 2022
On study leave since July 2022
Courses at Sukkur IBA University
Course
Role
Terms
Linear Algebra, Scientific Computing, Probability, Statistics, Inferential Statistics
Lecturer
Aug 2017 – Jul 2022
Also taught Calculus, Ordinary Differential Equations, Business Mathematics, Business Statistics and Actuarial Mathematics.
CV
My CV lists my education, publications, talks, teaching and awards.