betaFeedback

WorksMathematics

New hierarchical matrices for fast kernel matrix-vector products with Applications to Gaussian processes and kernel ridge regression

Abstract

This article presents two new multilevel hierarchical matrices to perform fast kernel matrix-vector products in dd dimensions (d>1)(d>1), namely Hhw′\mathcal{H}_{hw}^{\prime}, Hhw′′\mathcal{H}_{hw}^{\prime \prime}. We introduce a novel hybrid weak admissibility condition to construct these hierarchical matrices. More precisely, at coarser levels of the tree (i.e., larger blocks), we use a weak admissibility condition, wherein far-field and vertex-sharing clusters are considered admissible, while at the finer levels (i.e., smaller blocks), the adjacent clusters are treated as admissible. The admissible blocks at coarser levels of Hhw′\mathcal{H}_{hw}^{\prime} and Hhw′′\mathcal{H}_{hw}^{\prime \prime} are represented using semi-nested and fully nested bases, respectively. In both hierarchical matrices, the finer levels at which adjacent clusters are treated as admissible are constructed in a non-nested fashion. Thus, they can be viewed as a hybrid of H\mathcal{H} and H2\mathcal{H}^2 matrices. We use adaptive cross approximation (ACA) and nested cross approximation (NCA) to construct non-nested and nested bases, respectively. The fast matrix-vector products are performed using the proposed hierarchical matrix formats. To evaluate the performance and usefulness of the proposed hierarchical matrices, we conduct some numerical experiments. The numerical results show that they outperform their uniform admissibility counterparts in terms of storage and matrix-vector product cost, demonstrating the effectiveness of the proposed hybrid formats. We also show that the proposed formats are competitive with the standard (or strong) admissibility-based H2\mathcal{H}^2-matrices. Furthermore, we showcase some interesting applications of the proposed hierarchical matrices.

Paper details

vlnc:W_6g5fnhdk
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

Not recorded for this paper

View statement
Looking for related papers…