Moreau's decomposition theorem
From Wikimization
m (Protected "Moreau's decomposition theorem" [edit=autoconfirmed:move=autoconfirmed]) |
|||
Line 3: | Line 3: | ||
=== Projection mapping === | === Projection mapping === | ||
- | Let <math>(\ | + | Let <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> be a Hilbert space and <math>\mathcal C</math> a closed convex set in <math>\mathbb H.</math> The '''projection mapping''' <math>P_{\mathcal C}</math> onto <math>\mathcal C</math> is the mapping <math>P_{\mathcal C}:\mathbb H\to\mathbb H</math> defined by <math>P_{\mathcal C}(x)\in\mathcal C</math> and |
<center> | <center> | ||
Line 13: | Line 13: | ||
- | Let <math>(\ | + | Let <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> be a Hilbert space, <math>\mathcal C</math> a closed convex set in <math>\mathbb H,\,u\in\mathbb H</math> and <math>v\in\mathcal C.</math> Then, <math>v=P_{\mathcal C}(u)</math> if and only if <math>\langle u-v,w-v\rangle\leq0</math> for all <math>w\in\mathcal C.</math> |
=== Proof === | === Proof === | ||
Line 48: | Line 48: | ||
under the addition of vectors and multiplication of vectors by positive scalars (see more at [http://en.wikipedia.org/wiki/Convex_cone Convex cone, Wikipedia] or for finite dimension at [[Convex cones | Convex cones, Wikimization]]). | under the addition of vectors and multiplication of vectors by positive scalars (see more at [http://en.wikipedia.org/wiki/Convex_cone Convex cone, Wikipedia] or for finite dimension at [[Convex cones | Convex cones, Wikimization]]). | ||
- | '''Theorem (Moreau)''' Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\ | + | '''Theorem (Moreau)''' Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>\mathcal K^\circ</math> its '''polar cone'''; that is, the closed convex cone defined by <math>K^\circ=\{a\in\mathbb H\mid\langle a,b\rangle\leq0,\,\forall b\in\mathcal K\}</math> (for finite dimension see more at [http://en.wikipedia.org/wiki/Dual_cone_and_polar_cone Dual cone and polar cone]; see also [[Farkas%27_lemma#Extended_Farkas.27_lemma | Extended Farkas' lemma]]). For <math>x,y,z\in\mathbb H</math> the following statements are equivalent: |
<ol> | <ol> | ||
Line 116: | Line 116: | ||
=== Nonlinear complementarity problems === | === Nonlinear complementarity problems === | ||
- | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\ | + | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>f:\mathbb H\to\mathbb H.</math> Recall that the dual cone of <math>\mathcal K</math> is the closed convex cone <math>\mathcal K^*=-\mathcal K^\circ,</math> where <math>\mathcal K^\circ</math> is the [[Moreau's_decomposition_theorem#Moreau.27s_theorem |polar]] of <math>\mathcal K.</math> The '''nonlinear complementarity problem''' defined by <math>\mathcal K</math> and <math>f\,</math> is the problem |
<center> | <center> | ||
Line 131: | Line 131: | ||
=== Every nonlinear complementarity problem is equivalent to a fixed point problem === | === Every nonlinear complementarity problem is equivalent to a fixed point problem === | ||
- | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\ | + | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>f:\mathbb H\to\mathbb H.</math> Then, the nonlinear complementarity problem <math>NCP(f,\mathcal K)</math> is equivalent to the fixed point problem |
- | <math>Fix(P_{\mathcal K}\circ(I-f)),</math> where <math>I:\ | + | <math>Fix(P_{\mathcal K}\circ(I-f)),</math> where <math>I:\mathbb H\to\mathbb H</math> is the identity mapping defined by <math>I(x)=x.\,</math> |
=== Proof === | === Proof === | ||
- | For all <math>x\in\ | + | For all <math>x\in\mathbb H</math> denote <math>z=x-f(x)\,</math> and <math>y=-f(x).\,</math> Then, <math>z=x+y.\,</math> |
<br> | <br> | ||
<br> | <br> | ||
Line 157: | Line 157: | ||
==== Variational inequalities ==== | ==== Variational inequalities ==== | ||
- | Let <math>\mathcal C</math> be a closed convex set in the Hilbert space <math>(\ | + | Let <math>\mathcal C</math> be a closed convex set in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>f:\mathbb H\to\mathbb H.</math> The '''variational inequality''' defined by <math>\mathcal C</math> and <math>f\,</math> is the problem |
<center> | <center> | ||
Line 172: | Line 172: | ||
==== Every variational inequality is equivalent to a fixed point problem ==== | ==== Every variational inequality is equivalent to a fixed point problem ==== | ||
- | Let <math>\mathcal C</math> be a closed convex set in the Hilbert space <math>(\ | + | Let <math>\mathcal C</math> be a closed convex set in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>f:\mathbb H\to\mathbb H.</math> Then the variational inequality <math>VI(f,\mathcal C)</math> is equivalent to the fixed point problem <math>Fix(P_{\mathcal C}\circ(I-f)).</math> |
==== Proof ==== | ==== Proof ==== | ||
Line 192: | Line 192: | ||
==== Every variational inequality defined on a closed convex cone is equivalent to a complementarity problem ==== | ==== Every variational inequality defined on a closed convex cone is equivalent to a complementarity problem ==== | ||
- | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\ | + | Let <math>\mathcal K</math> be a closed convex cone in the Hilbert space <math>(\mathbb H,\langle\cdot,\cdot\rangle)</math> and <math>f:\mathbb H\to\mathbb H.</math> Then, the nonlinear complementarity problem <math>NCP(f,\mathcal K)</math> is equivalent to the variational inequality <math>VI(f,\mathcal K).</math> |
==== Proof ==== | ==== Proof ==== |
Revision as of 15:00, 13 July 2009
Contents
|
Projection on closed convex sets
Projection mapping
Let be a Hilbert space and a closed convex set in The projection mapping onto is the mapping defined by and
Characterization of the projection
Let be a Hilbert space, a closed convex set in and Then, if and only if for all
Proof
Suppose that Let and be arbitrary. By using the convexity of it follows that Then, by using the definition of the projection, we have
Hence,
By tending with to we get
Conversely, suppose that for all Then,
for all Hence, by using the definition of the projection, we get
Moreau's theorem
Moreau's theorem is a fundamental result characterizing projections onto closed convex cones in Hilbert spaces. Recall that a convex cone in a vector space is a set which is invariant under the addition of vectors and multiplication of vectors by positive scalars (see more at Convex cone, Wikipedia or for finite dimension at Convex cones, Wikimization).
Theorem (Moreau) Let be a closed convex cone in the Hilbert space and its polar cone; that is, the closed convex cone defined by (for finite dimension see more at Dual cone and polar cone; see also Extended Farkas' lemma). For the following statements are equivalent:
- and
- and
Proof of Moreau's theorem
- 12: For all we have
Then, by the characterization of the projection, it follows that Similarly, for all we have
- 21: By using the characterization of the projection, we have for all In particular, if then and if then Thus, Denote Then, It remained to show that First, we prove that For this we have to show that for
all By using the characterization of the projection, we have
for all Thus, We also have
for all because By using again the characterization of the projection, it follows that
References
- J. J. Moreau, Décomposition orthogonale d'un espace hilbertien selon deux cones mutuellement polaires, C. R. Acad. Sci., volume 255, pages 238–240, 1962.
An application to nonlinear complementarity problems
Fixed point problems
Let be a set and The fixed point problem defined by is the problem
Nonlinear complementarity problems
Let be a closed convex cone in the Hilbert space and Recall that the dual cone of is the closed convex cone where is the polar of The nonlinear complementarity problem defined by and is the problem
Every nonlinear complementarity problem is equivalent to a fixed point problem
Let be a closed convex cone in the Hilbert space and Then, the nonlinear complementarity problem is equivalent to the fixed point problem where is the identity mapping defined by
Proof
For all denote and Then,
Suppose that is a solution of Then, with and Hence, by using Moreau's theorem, we get Therefore, is a solution of
Conversely, suppose that is a solution of Then, and by using Moreau's theorem
Hence, . Thus, . Moreau's theorem also implies that In conclusion, and Therefore, is a solution of
An alternative proof without Moreau's theorem
Variational inequalities
Let be a closed convex set in the Hilbert space and The variational inequality defined by and is the problem
Every variational inequality is equivalent to a fixed point problem
Let be a closed convex set in the Hilbert space and Then the variational inequality is equivalent to the fixed point problem
Proof
is a solution of if and only if By using the characterization of the projection the latter equation is equivalent to
for all But this holds if and only if is a solution of
Remark
The next section shows that the equivalence of variational inequalities and fixed point problems is much stronger than the equivalence of nonlinear complementarity problems and fixed point problems, because each nonlinear complementarity problem is a variational inequality defined on a closed convex cone.
Every variational inequality defined on a closed convex cone is equivalent to a complementarity problem
Let be a closed convex cone in the Hilbert space and Then, the nonlinear complementarity problem is equivalent to the variational inequality
Proof
Suppose that is a solution of Then, and Hence,
for all Therefore, is a solution of
Conversely, suppose that is a solution of Then, and
for all Particularly, taking and , respectively, we get Thus, for all or equivalently In conclusion, and Therefore, is a solution of
Concluding the alternative proof
Since is a closed convex cone, the nonlinear complementarity problem is equivalent to the variational inequality which is equivalent to the fixed point problem