Lately, in engineering it has been necessary to develop algorithms that handle “big data” optimization problems in a distributed manner. In this thesis, we present ADMM (Alternating Direction Method of Multipliers) algorithm, as the basic tool for solving these kinds of problems, and its application in machine learning and signal processing problems.