Pervez Ali

PhD Candidate in Mathematics

Florida State University

My research focuses on Langevin-based sampling algorithms for complex probability distributions on both unconstrained and constrained domains, with applications in Bayesian statistics and machine learning. I combine theoretical convergence analysis with numerical experiments to understand and evaluate their performance.

Seeking postdoctoral opportunities starting Summer 2027.

Research

I study how Langevin dynamics can be designed and analysed to efficiently sample from complex distributions. My current work falls under the first two themes below; the third is a direction I want to develop.

  • Current research

    Langevin dynamics and nonreversible sampling

    When does adding a nonreversible drift make a Langevin sampler converge faster, and how can the gain be measured?

    Overdamped Langevin dynamics is the starting point for many sampling algorithms. Adding a skew-symmetric drift leaves the target distribution unchanged but changes how the process moves through it. I study when this helps, using large deviations and nonasymptotic convergence bounds.

    d X sub t equals minus, open bracket I plus J close bracket, times the gradient of U at X sub t, d t, plus the square root of 2, d W sub t.
    Langevin dynamics with a skew-symmetric matrix J. The target distribution π ∝ e−U is invariant for every such J.
  • Current research

    Constrained Sampling with Penalized Nonreversible Langevin Algorithms

    How can we combine penalization and nonreversible Langevin dynamics to efficiently sample from probability distributions supported on constrained sets?

    Many models in statistics and machine learning restrict parameters to compact convex sets. We develop Langevin sampling algorithms that combine squared-distance penalties with nonreversible dynamics. Our research establishes convergence and accuracy guarantees for full-gradient and stochastic-gradient methods, accounting for both numerical discretization and the approximation introduced by penalization. We also investigate when nonreversibility can accelerate convergence, combining theoretical analysis with numerical experiments on constrained sampling problems.

  • Future direction

    Sampling Theory for Generative Modeling

    How can we generate samples more accurately and at lower computational cost?

    Building on my research in Langevin dynamics, I plan to investigate how numerical discretization and the choice of sampling dynamics affect convergence and approximation error in diffusion-based generative models. I aim to combine theoretical analysis with numerical experiments to develop sampling algorithms that achieve a desired accuracy with less computation.

Interactive demo

How a nonreversible drift can speed up sampling

Both panels sample the same stretched Gaussian distribution, starting from the same point and using the same random noise. The right panel adds the drift −J∇U, which leaves the target unchanged but makes the points circulate around it, so they settle much sooner. Drag the slider to change the strength of the drift.

The target is a Gaussian whose long axis is four times its short axis; the grey ellipses mark 1, 2 and 3 standard deviations, and the dark line follows the average position of the points. Both samplers take Euler–Maruyama steps of size h = 0.005 with 500 points, and on the right J = δ01−10. The chart shows the exact Kullback–Leibler divergence between the distribution of the points and the target. For Gaussian targets, the best choice of J raises the convergence rate from that of the slowest direction to the average over all directions (Hwang, Hwang-Ma and Sheu, 1993; Lelièvre, Nier and Pavliotis, 2013).

Publications

Papers and preprints, newest first. Each entry is marked Published, Accepted, Preprint or In preparation. A full list is on Google Scholar.

Papers and preprints

  • 2026 Preprint

    Accelerating Non-Smooth and Heavy-Tailed Sampling

    Pervez Ali, Xiaoyu Wang, Yingli Wang and Lingjiong Zhu

    arXiv:2610.11139

    Nonreversible anchored Langevin dynamics for target densities that may be non-differentiable: NALD on the whole Euclidean space, where the target may also be heavy-tailed, and NRALD on bounded domains with normal reflection. A circulation drift built from a possibly state-dependent, divergence-free skew-symmetric matrix field and a stream potential preserves the target without using derivatives of its density. Nonasymptotic convergence bounds, a large deviations analysis and asymptotic variance reduction show that both can converge faster than their reversible counterparts, and numerical experiments demonstrate their efficiency.

    BibTeX
    @misc{ali2026accelerating,
      title         = {Accelerating Non-Smooth and Heavy-Tailed Sampling},
      author        = {Ali, Pervez and Wang, Xiaoyu and Wang, Yingli and Zhu, Lingjiong},
      year          = {2026},
      eprint        = {2610.11139},
      archivePrefix = {arXiv}
    }
  • 2026 Preprint

    Penalized Nonreversible Langevin for Constrained Sampling

    Pervez Ali, Weihao Dong and Xiaoyu Wang

    arXiv:2609.25381

    Sampling on a compact convex set by combining a squared-distance penalty with a skew-symmetric perturbation of Langevin dynamics. The preprint gives nonasymptotic bounds relative to the penalized target: in total variation with full gradients, including nonconvex potentials, and in 2-Wasserstein distance with stochastic gradients. For a quadratic model, tuning the perturbation improves the sufficient number of iterations from linear to logarithmic in the curvature ratio.

    BibTeX
    @misc{ali2026penalized,
      title         = {Penalized Nonreversible {L}angevin for Constrained Sampling},
      author        = {Ali, Pervez and Dong, Weihao and Wang, Xiaoyu},
      year          = {2026},
      eprint        = {2609.25381},
      archivePrefix = {arXiv}
    }
  • 2025 Preprint

    Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis

    Nian Yao, Pervez Ali, Xihua Tao and Lingjiong Zhu

    arXiv:2503.19066

    Large deviation principles with explicit rate functions for mirror, high-order and Hessian-free high-resolution Langevin dynamics. Comparing rate functions shows when these dynamics, and underdamped Langevin, accelerate overdamped Langevin. Experiments cover Bayesian linear and logistic regression, including real data.

    BibTeX
    @misc{yao2025accelerating,
      title         = {Accelerating {L}angevin {M}onte {C}arlo Sampling: A Large Deviations Analysis},
      author        = {Yao, Nian and Ali, Pervez and Tao, Xihua and Zhu, Lingjiong},
      year          = {2025},
      eprint        = {2503.19066},
      archivePrefix = {arXiv}
    }
  • 2021 Published

    On Modelling and Pricing Weather Derivatives Driven by Nonlinear Brownian Motion

    Javed Hussain and Pervez Ali

    International Journal of Analysis and Applications 19(1), 29–46

    Estimates for risk-neutral prices of temperature-based weather derivatives when temperature follows a G-stochastic differential equation driven by G-Brownian motion.

    BibTeX
    @article{hussain2021weather,
      title   = {On Modelling and Pricing Weather Derivatives Driven by Nonlinear {B}rownian Motion},
      author  = {Hussain, Javed and Ali, Pervez},
      journal = {International Journal of Analysis and Applications},
      volume  = {19},
      number  = {1},
      pages   = {29--46},
      year    = {2021}
    }

Talks

  • 2026 May

    Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis

    International Conference on Computing, Mathematics and Engineering Technologies (iCoMET 2026), Sukkur IBA University, Pakistan

  • 2020 January

    On Modelling and Pricing Weather Derivatives Driven by Nonlinear Brownian Motion

    International Conference on Computing, Mathematics and Engineering Technologies (iCoMET 2020), Sukkur IBA University, Pakistan

About

I am a Fulbright Scholar and a PhD candidate in the Department of Mathematics at Florida State University, where I am advised by Dr. Lingjiong Zhu. I develop and analyze sampling algorithms based on Langevin dynamics. My work spans reversible and nonreversible dynamics, as well as unconstrained and constrained sampling.

I am also a Lecturer in Mathematics at Sukkur IBA University in Pakistan, where I taught from 2017 to 2022 and completed my MS in Mathematics. I have been on study leave from Sukkur IBA since July 2022. At Florida State, I have served as vice president of the SIAM Student Chapter.

Outside of research, I play tennis, pickleball, and cricket, and never pass up a chance to try a new sport.

Education

Honors and awards

  • Educator of the Year Award2023
  • Travel grant to attend the Hausdorff School, University of Bonn2023
  • Fulbright Scholarship for PhD study in the United States2022
  • Departmental Merit Scholarship, Sukkur IBA University2019
  • Prime Minister’s Scholarship for MS study (fully funded)2018
  • Student of the Year in Mathematics, University of Sindh (awarded a laptop)2015

Teaching

I have taught undergraduate mathematics since 2017: first as a lecturer in Pakistan, and since 2022 as an instructor and teaching assistant at Florida State University.

Florida State University, USA

Graduate Teaching Assistant and Instructor · Aug 2022 – present

Courses at Florida State University
CourseRoleTerms
Calculus IInstructorSpring 2025, Summer 2025
Calculus IIInstructorFall 2025, Spring 2026
Calculus IIIInstructorSummer 2026, Fall 2026
Calculus, Trigonometry, College AlgebraTeaching assistant2024

Sukkur IBA University, Pakistan

Lecturer in Mathematics · Aug 2017 – Jul 2022

On study leave since July 2022

Courses at Sukkur IBA University
CourseRoleTerms
Linear Algebra, Scientific Computing, Probability, Statistics, Inferential StatisticsLecturerAug 2017 – Jul 2022

Also taught Calculus, Ordinary Differential Equations, Business Mathematics, Business Statistics and Actuarial Mathematics.

CV

My CV lists my education, publications, talks, teaching and awards.

A current CV is available on request. Please email me.

Contact

Email is the best way to reach me.

Department of Mathematics
Florida State University
1017 Academic Way
Tallahassee, FL 32306, USA

Academic profiles