alphaFeedback
PDF

WorksMathematics

A simple adaptive accelerated optimistic dual averaging method for unconstrained convex optimization in pp-norm geometry

Publication details
License
CC BY 4.0
Views
1
Status
Published
AI contributions
Not recorded for this paper
View details
Abstract · v1

Efficient preconditioning plays an important role in large-scale first-order optimization. In this paper, we propose an adaptive accelerated optimistic dual averaging (A2\text{A}^2ODA) method for unconstrained convex optimization that adopts low-cost preconditioning based on pp-norm geometry for p∈[2,∞]p\in[2,\infty]. The method is line-search-free and employs a new stepsize selection technique based on an aggregated affine lower model. Its update structure is simple and unified across p∈[2,∞]p\in[2,\infty], with the case p>2p>2 requiring no more elaborate updates than the Euclidean case p=2p=2. Under a generalized local smoothness condition, we derive a convergence bound that separates the effects of constant and gap-dependent curvature, with the latter potentially yielding faster-decaying terms. In the special case of local smoothness, this bound recovers a nearly optimal convergence rate.

Review conversation

Reviews are not available for this work yet.