Distributed Optimization: Convergence Conditions from a Dynamical System Perspective

Guodong Shi 1 Alexandre Proutière 1, 2 Karl Henrik Johansson 1
2 DYOGENE - Dynamics of Geometric Networks
DI-ENS - Département d'informatique de l'École normale supérieure, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : This paper explores the fundamental properties of distributed minimization of a sum of functions with each function only known to one node, and a pre-specified level of node knowledge and computational capacity. We define the optimization information each node receives from its objective function, the neighboring information each node receives from its neighbors, and the computational capacity each node can take advantage of in controlling its state. It is proven that there exist a neighboring information way and a control law that guarantee global optimal consensus if and only if the solution sets of the local objective functions admit a nonempty intersection set for fixed strongly connected graphs. Then we show that for any tolerated error, we can find a control law that guarantees global optimal consensus within this error for fixed, bidirectional, and connected graphs under mild conditions. For time-varying graphs, we show that optimal consensus can always be achieved as long as the graph is uniformly jointly strongly connected and the nonempty intersection condition holds. The results illustrate that nonempty intersection for the local optimal solution sets is a critical condition for successful distributed optimization for a large class of algorithms.
Complete list of metadatas

Contributor : Alexandre Proutiere <>
Submitted on : Tuesday, December 17, 2013 - 4:43:51 PM
Last modification on : Wednesday, January 30, 2019 - 11:07:41 AM

Links full text


  • HAL Id : hal-00920077, version 1
  • ARXIV : 1210.6685



Guodong Shi, Alexandre Proutière, Karl Henrik Johansson. Distributed Optimization: Convergence Conditions from a Dynamical System Perspective. Conference on Decision and Control, Dec 2013, Italy. pp.00. ⟨hal-00920077⟩



Record views