Fast quantile regression in reproducing kernel Hilbert space

Abstract

In literature, the idea of kernel machine was introduced to quantile regression, resulting kernel quantile regression (KQR) model, which is capable to fit nonlinear models with flexibility. However, the formulation of KQR leads to a quadratic programming which is computationally expensive to solve. This paper proposes a fast training algorithm for KQR based on majorization-minimization approach, in which an upper bound for the objective function is derived in each iteration which is easier to be minimized. The proposed approach is easy to implement, without requiring any special computing package other than basic linear algebra operations. Numerical studies on simulated and real-world datasets show that, compared to the original quadratic programming based KQR, the proposed approach can achieve essentially the same prediction accuracy with substantially higher time efficiency in training.

Department(s)

Mathematics

Document Type

Article

DOI

https://doi.org/10.1007/s42952-021-00154-0

Keywords

Kernel quantile regression, MM-algorithm, Quadratic programming

Publication Date

1-1-2021

Journal Title

Journal of the Korean Statistical Society

Link to Full Text

Share

COinS