Inexact tensor methods and their application to stochastic convex optimization

Loading...
Thumbnail Image
Date
2021
Volume
2818
Issue
Journal
Series Titel
Book Title
Publisher
Berlin : Weierstraß-Institut für Angewandte Analysis und Stochastik
Abstract

We propose a general non-accelerated tensor method under inexact information on higher- order derivatives, analyze its convergence rate, and provide sufficient conditions for this method to have similar complexity as the exact tensor method. As a corollary, we propose the first stochastic tensor method for convex optimization and obtain sufficient mini-batch sizes for each derivative.

Description
Keywords
High-order methods, tensor methods, convex optimization, inexact derivatives, stochastic optimization
Citation
Agafonov, A., Kamzolov, D., Dvurechensky, P., & Gasnikov, A. (2021). Inexact tensor methods and their application to stochastic convex optimization (Vol. 2818). Berlin : Weierstraß-Institut für Angewandte Analysis und Stochastik. https://doi.org//10.20347/WIAS.PREPRINT.2818
Collections
License
This document may be downloaded, read, stored and printed for your own use within the limits of § 53 UrhG but it may not be distributed via the internet or passed on to external parties.
Dieses Dokument darf im Rahmen von § 53 UrhG zum eigenen Gebrauch kostenfrei heruntergeladen, gelesen, gespeichert und ausgedruckt, aber nicht im Internet bereitgestellt oder an Außenstehende weitergegeben werden.