Open Access Research

A multi-block alternating direction method with parallel splitting for decentralized consensus optimization

Qing Ling1*, Min Tao2, Wotao Yin3 and Xiaoming Yuan4

Author Affiliations

1 Department of Automation, University of Science and Technology of China, Anhui, Hefei, China

2 , School of Science, Nanjing University of Posts and Telecommunications, Jiangsu, Nanjing, China

3 Department of Computational and Applied Mathematics, , Texas, Houston, USA

4 Department of Mathematics, HongKong Baptist University, Kowloon Tong, Hong Kong

For all author emails, please log on.

EURASIP Journal on Wireless Communications and Networking 2012, 2012:338  doi:10.1186/1687-1499-2012-338

Published: 12 November 2012

Abstract

Decentralized optimization has attracted much research interest for resource-limited networked multi-agent systems in recent years. Decentralized Tconsensus optimization, which is one of the decentralized optimization problems of great practical importance, minimizes an objective function that is the sum of the terms from individual agents over a set of variables on which all the agents should reach a consensus. This problem can be reformulated into an equivalent model with two blocks of variables, which can then be solved by the alternating direction method (ADM) with only communications between neighbor nodes. Motivated by a recently emerged class of so-called multi-block ADMs, this article demonstrates that it is more natural to reformulate a decentralized consensus optimization problem to one with multiple blocks of variables and solve it by a multi-block ADM. In particular, we focus on the multi-block ADM with parallel splitting, which has easy decentralized implementation. Convergence rate is analyzed in the setting of average consensus, and the relation between two-block and multi-block ADMs are studied. Numerical experiments demonstrate the effectiveness of the multi-block ADM with parallel splitting in terms of speed and communication cost and show that it has better network scalability.