PEtit ComplémENt Sur la méthodE dE NEwtoN www.h

Transcription

PEtit ComplémENt Sur la méthodE dE NEwtoN www.h
!"!$#%&'
()()(+*-,/.102*436587:9);)<8=8>6?A@:BC>:DFECGA7HDF<8I)JK?FBL>F3M.F@6N65JAN@ABL>:DFE
OPRQTSUVHWXZYK[\YK]_^`X
aZbdc_cebgf8h:cibkjdhAlmnpoqcibgnsrutihAvMt4wxt_byjzce{|h6f~}A € €‚Kb„ƒ†…M‡8ˆ‰Šum‹ehAmLh6tRKbnprulŒqcehKKbkKbkŽbd+cehAf‘`’ bd“Kbdlmnpb”}6 •A€”Kb
jdbqcicib–tihAvMt4wxt_byjzce{|h6f–—4vMt4ce{™˜8bgn-’ {pfHci‹eh)v8jzce{|h6f%KbšnsrklŒqcehKKb–KbgŽb›+cihAfmLhAv8‹Rj›r:nsjqvnpbd‹npbšl{pf{plšvlœ/’ vfbšžhAf8jqci{phAf f Ÿ
bdc m‹iŒyt_b›fHcibg¡‹i{pod¢6bdlbdfHc t_byt£6vMr:np{™ceŒ›tRbqc¤tib›tKŒq¥rAvKcet›¦Rr:f8t jdbgjdhAlmnpŒdlbdfHc Ÿ f8hAv8tRfh6v8t!žh)j›r:np{ptihAfMtRtiv‹ ter‚m‹ehAm8‹i{pŒqceŒ
lkr:—4bdv‹ebT§f8hAv8tglhAfHci‹ehAfMt–£Hvb t_h6v8tKb©¨ ¡Mh6ffb›t+ª«H¬)mLh:ceo›tib›t Ÿ nprTlŒqci8h)b„jdhAf)¢Ab›‹i­6b®¢Ab›‹et–vf¯l{|f{plšv8l°Kb„npr
žh6f8jzce{|h6f Ÿ bdc£6v8bjdbqcicib¤jqh6f)¢Abd‹e­Ab›Ÿ f8jqb!b›t_c‹erAm{sKbA
±PR²'UV)³!´xYK[\Y
ŽhAv8t‹ib›m‹ib›fhAfMtZnpb›tfh:cµrFci{phAfMtKb nprtihAv8t_wxt_byjzci{phAfT}A € €Kbkƒ …L‡ˆ‰L¶)hA{|c
vf8bžhAf8jqci{phAfKbdv“‚žhA{stK{|·LŒdw
n
→ R ‘r”tiv{|cibjqhAfMt4ce‹iv{|cibgm8rA‹Rnsr
‹ebdfHce{prA¡n|btiv‹ Rn ¶)hAfT­A‹µrAK{pbdfHcbdf¸v8fTmLhA{pfHc x byt4cfh:ceŒ ∇f (x) bqc¤tihAf¸8b›ftet_:{pbdRf Hf
(x)
lŒdcihKKb¤Kb¤Žbd+cehAf„b›t_cr:nphA‹µt2Œq˜8f{pb m8rA‹
bqc x = x − Hf (x )−1∇f (x ) Ÿ
x0 ∈ R n
k+1
k
k
k
tihAvMt+‹iŒyt_b›‹i¢6b!£Hvbn|byt+lkrFci‹e{sjqb›t2bytiti{pbdffbytt_h6{|b›fHc+{pf)¢Ab›‹eti{|¡8n|bytd)‘bRci8ŒdhA‹eodlb tiv{|¢FrAf6cŒdcer:¡8n|{|c£6v’ vf~¨¡Mh6fª‚l{|f8{|l–vl
Kb f rFcici{p‹ibnsrgtiv{|cib¤Kb Žbd+cih6f
x?
¹Rº)»6¼)½¾K¿kÀÂÁ Ã`¼MÄ)Å6ÀH½ÆÀKÄKÇFÀ%ÈCÉKÊ)ËM½4Ê6Ìq͆ÈCÉ)À„ËÀ~ÎÀAÏÌz¼MÄ/Ð ¶)h6{™c vfb–žhAfMjzci{phAfсKb–jdnpr6titib 3 ¶)vmmLh6tihAf8tR£Hvb x?
byt4cv8ful{pf{plšvln|hKjdrAnKb f ¢6Œd‹e{™˜Lr:fHc2npb›tjqhAfMK{™ce{|h6f8ttivKÒ®tirAf6ceb›t+Kb f l{pf{|lkrAn|{|ciŒ¤jA’ byt4ciwŠ:wK{p‹eb C
bqc Hf (x? ) KŒd˜8f{pb mMhHt_{|ci{p¢Ab6
∇f (x? ) = 0
Ó n|h6‹et¤mMh6v‹ x t_vKÒ®ter:llbdfHc m‹eh)jµ8b®Kb x? Ÿ nsrt_v8{™ceb®Kb‚Žb›+cih6fÑbyt4c¤¡8{|b›f©Œq˜8f{pb Ÿ bdnpn|b®jdhAf)¢Ab›‹i­6b–¢6bd‹µt x? Ÿ bdcšjqbqcicib
jdhAf)¢Ab›‹i­6bdf8jdbby0t4c£Hv8r6K‹er:ci{s£Hvb Ÿ j:’ b›t_c_wxŠFwxK{p‹ib

kxk+1 − x? k 6 O kxk − x? k2
Ô½ÀKÉ)ÅAÀMÐ ‘rkŒdlhAf8t_ci‹µrFce{|h6f„‹ib›mMhHt_bb›tetibdfHci{pbdnpn|b›lbdfHc!tiv‹n-’ vKce{|np{stir:ci{phAf/’ vf%KŒd¢6bdnphAmmLbdlb›f6cbšÕr1¬)nphA‹mLhAv‹!r:¡LhAvKce{|‹
Šn-’ {|fŒ›­6rAn|{|ciŒ (∗) jd{™wxKbytitihAv8t Ÿ Šgm8r:‹ici{p‹Kb nsrA£Hvbdnpnpb!cehAvKcbyt4cŒ›Kv{|c›
‘`’ rAmmnp{pj›rFce{|h6f
Œdcer:fHcšjdhAfHci{pf)vb
byt4c {pfH¢6bd‹µt_{p¡npb–mLhAv8‹cihAvc x r:f8tv8fbk¡Mh6vnpbgh6v¢Ab›‹_ceb U
jdbdfHci‹eŒdbb›f x? ¦Œd˜8xf7→
{stitihAdet(Hf
f8trAn|h6‹e(x))
t+tiv‹ U n-’ rAmmnp{pj›rFci{phAfŸ Hf (x)
∇f (x) Ÿ
aZbdc_ceb¤r:mmnp{sjdrFce{|h6f”¢6Œd‹e{™˜MbbdvK“‚m8‹ih6m‹i{pŒqceŒ›t+{plmMh6‹_cµr:fHcibmLhAv‹fhAci‹ebŒqcivMKbk§
bqc x? = N(x? ) 
xk+1 = N(xk )
Ö rA‹KŒq˜8f8{™ce{|h6f„b N Ÿ fh6v8tr1¢Ah6f8tZvfb ‹ebdnsrFci{phAfubdfHce‹ib N(x) bdc x

Hf (x)(N(x) − x) + ∇f (x) = 0
× jq‹e{|¢6hAf8t+npb¤KŒd¢6bdnphAmmLbdlb›f6cKb Õ\r1¬)n|h6‹+b npr–žhAfMjzci{phAf
Kb jqnsrAtetib C1 bdfHci‹ebvf„mMh6{|fHc
x 7→ ∇f (x)
N : x 7−→ x − Hf (x)
h6Ù
−1
x∈
Ø bqc
x?
0 = ∇f (x? ) = ∇f (x) + Hf (x)(x? − x) + R(x, x? )
R(x, x? )
byt4cnpb‹ibyt4cebb¤Õr1¬)nphA‹rAtet_hKjd{|Œ6HÚ`f„tihAvMt4ce‹er1¬Hr:fHcZnpb›tKb›vK“”Œ›­6rAn|{|ciŒyt Ÿ h6f”h6¡Kci{pbdfHc
Hf (x)(N(x) − x? ) = R(x, x? )
 ’ h6Ù

kN(x) − x? k = k(Hf (x))−1 R(x, x? )k 6 k(Hf (x))−1 k kR(x, x? )k
‘b›t2žh6f8jzce{|h6f8t x 7→ (Hf (x))−1 bdc x 7→ D3f (x) ŒdcerAf6cjdhAfHci{pf)vb›t Ÿ bdnpn|bytt_h6fHc2¡LhA‹efŒdbyt+t_v‹+cehAvKcjdhAlm8r6jzcKb U 8Û\{|“)h6f8t
vfb¡LhAvnpbžbd‹elŒdb jqh6fHcibdfMr:fHc x? bdc{|f8jdn|vMt_b¤rAf8t U bqcf8h:cih6f8t
K
bqc C = max kD3 f (x)k Ÿ
C1 = max k(Ü f (x))−1 k
2
x∈K
x∈K
rA{|fMt_{£Hvb C = C C LÝ!fuhA¡ci{pbdfHcKhAfMj!nsrglkrF—4hA‹µrFce{|h6f
1 2

kN(x) − x? k 6 Ckx − x? k2
(∗)
aZbdc_cebR{pfŒ›­6r:np{|ciŒ­6rA‹erAf6ce{™c2cih6vKc/’ r:¡LhA‹µ”£Hvbnsrgtiv{|cib¤Kb Žbd+cih6f„b›t_c+¡8{|b›f„Œq˜8f{pb r:vu¢Ah6{pti{|fMr:­AbRKb ? 
Ö h6v‹¢Ah6{|‹jdb›jd{ Ÿ h6fumLbdvc!jµhA{sti{|‹vf„‹eŒdb›n α > 0 ¢AŒd‹e{|˜Mr:fHc Cα < 1 Ÿ bqcr6titibmLbqce{™cmLhAv8‹£Hvb nprg¡LhAvnpbžbd‹elŒdb B(x? ,xα)
bjdbdfHci‹eb ? bqc‹µr1¬Ah6f t_h6{™c{pf8jqnpv8tibRrAf8t )ÕhAvcib›tjdb›t2m‹eŒ›j›r:vKce{|h6f8tZtihAfHc+m‹e{ptib›t2mLhAv‹£HvbRnpršžhAf8jqci{phAf N bdf)¢Ah6{|b!npr
¡LhAv8n|b B(xx? , α) r:f8t+b›n|αnpbqwldlbA8Úf„bq·Cbqc Ÿ KfhAv8tr1¢6hAf8t

kN(x) − x? k 6 (Ckx − x? k)kx − x? k 6 Cαkx − x? k
jdb›jq{fhAv8t­6r:‹µr:fHce{™c£Hvbšti{
rAn|h6‹et
 Ó {|fMt_{ jqh6llgb
h6f
Ö v{pte£Hvb
?
?
= N(xk )mLŸ hAv‹
b›fсŒ›Kv{|c Cαm8r:<‹‹e1Œ›Ÿ jdv‹i‹ebdfMjqbš£Hvbt_{ x ∈ B(x?x, α)∈ B(x
rAn|h6‹et!, npα)rutiv{™cebkKN(x)
bgŽbd+∈ceB(x
hAfÑb›t_,cRα)¡{pbdf©KŒd˜8Ÿ f{pb–bdc x xk+1
?
k ∈ B(x , α)
cehAvKc k  Ö hAv‹nsr–˜8fKb nprgm‹ebdv8¢Ab Ÿ f80hAv8t+fh6v8t+mnsrdhAf8t+rAf8tjqbdc_cebti{|civ8r:ci{phAf
!" ‘`’ {pfŒd­Hr:np{™ceb (∗) mLbd‹elbqcr:nphA‹µt+Kb lhAfHci‹ebd‹£Hvb (x ) jqh6fH¢6bd‹e­Ab!¢Abd‹µt x? LÝ!f„rgbdf„bq·Cbqc
k k∈N
?
jdb¤£Hv{bdfHce‹erA{|fb
Ö rA‹‹iŒyjqv‹e‹ib›f8jqb Ÿ Ah f„hA¡Kce{|b›fHchAf8j
jdb¤£Hv{Kh6ffbR˜8f8rAn|b›lgb›fHc
aZh6llgb Cα < 1 Ÿ jdb›jd{/{|lmnp{p£Hvb¤£Hvb
kxk+1 − x k 6 Ckxk − x? k2
Ÿ
Ckxk+1 − x? k 6 (Ckxk − x? k)2
Ckxk − x? k 6 (Ckx0 − x? k)2
k
kxk − x? k 6 (Cα)2 /C
kxk − x? k

k

Ÿ
cib›f8$# ci‹eo›t+¢){|cib&%2¢Abd‹µt 0 
'P)(Ñ^+*,*"WX`YK[]4S8WV
ŽhAv8tgfh6v8tjqh6f6cebdfHcih6f8tg{pjd{Kb£6v8bdns£6v8b›tg‹ib›lkr:‹µ£6v8b›tgt_v‹npb‚ceŒdh6‹io›lbT}6 Ó m‹eo›tjqbyt‹ib›lrA‹e£Hvbyt-#¥bqc®r:m‹eo›tr1¢6hA{p‹
¡Lb›rAv8jqh6vm„m8r:‹enpŒRKbytr1¢Fr:fHcerA­AbytZKb nsrglŒqci8h)b¤Kb¤Žb›+cihAf % Ÿ fh6v8tr:npnphAf8t+r:vMtiti{/m8r:‹enpbd‹+vf„mMb›vKb¤t_bytKŒq¥rAvKcet›
.\À)¿‚ÊA½xÈCÉ)À0/ 1T͙Ä8͙¿”Í 2qÊHÌzÍ ¼MĚÅ22»6ÈLÉÊHÌzÍ ¼MÄCÐ43 r:mmLbdnphAf8t £Hvb2nprRlŒqcehKKbKb+Žbd+cehAfgmMh6v‹ l{|f{pl{ptibd‹ jqhA‹e‹eb›timMh6f8
Šunsr‚lŒdcihKKbkKbkŽb›+cih6f¸mLhAv‹ ‹eŒ›tihAv8‹ib¤n-’ b›£Hv8rFce{|h6f g(x) = 0 r1¢6b›j g = ∇f 5 ¢6hA{p‹!npb›t £Hvb›np£Hvbyt!lhAcetf Š”jdbm‹ih6mMhHt
Š%n ’ bq“Kbdlmnpb¸}6 •A€Kb%ƒ†…M‡8ˆ‰ aZbyt”¨Kb›vK“kªÂlgŒdcihKKbytšKbuŽb›+cihAf~jdhAf8ti{st4cebdfHc–Kh6f8jkbdf©¥rA{™cr:vÂldlb®m8‹ihKjqbytitiv8t›76xn
byt4cgr:{pf8t_{ZfhA‹elkr:n`b®mMh6v¢Ah6{|‹¤ci‹µrAKv{p‹eb®jqbkceŒdh6‹io›lgbkbdc–jqbdc_ceb‚m‹ebdv¢6bkmMh6v‹¤nsrlŒqcehKKb‚KbuŽbd+cehAfÂmLhAv‹š‹iŒyt_h6v8K‹eb
#¥r1¢6b›j g : Rn → Rn %z
g(x) = 0
.\À)¿‚ÊA½xÈCÉ)À8 üMÄKÅAÀ:9HÍ Ìµ»šÇ:Ê)Ç6ºK»AÀMÐ 6xnb›t_c{|fHceŒd‹eb›tetirAf6cKb+fhAcib›‹£6v8b Ÿ tihAv8t npb›t )¬)mLh:ci8o›tib›tKvgci8ŒdhA‹eodlb Ÿ nprRžh6f8jzce{|h6f
b›t_c`jqh6fH¢6bq“Kb bdc l›lgbš¨`ce‹ioytjqhAf)¢6bq“Kb ª/6Ý!fŒdlhAfHci‹eb2bdfbq·Cbqcr:vgnpbdllb<;!nsr αwxjqh6fH¢6bq“K{|ciŒ+Kb f tiv‹ U £Hv{KbdfHci‹µr&= fb
fterjqh6fH¢6bq“K{|ciŒA Ÿ
.\À)¿‚ÊA½xÈCÉ)À?> üLÄ)ÅAÀ)½ÆÀKÄKÇFÀ«ÈCÉKÊ)ËM½4Ê6Ìq͆ÈCÉ)ÀMÐ ‘r¸m8‹ib›v¢Ab„Kv~ceŒdh6‹io›lb”Œdcer:¡8n|{|c®£6v8b”nsrÑ¢H{|cibytitib„KbujdhAf)¢Ab›‹i­6bdf8jdb
r6t_¬)lmKceh:ci{s£Hvb Kb (x ) b›t_c£6vMrAK‹µrFce{p£Hvbg§8ti{ x byt4cm‹ehKjµb Kb x? rAn|h6‹et2nsrt_v{|cib¤jdhAf)¢Ab›‹i­6bbdchAf„r
k k∈N
0

kxk+1 − x? k 6 Ckxk − x? k2
‘bkci8ŒdhA‹eodlb­6rA‹erAfHci{|c hAf8jk/’ vfb‚m8r:‹ic¤npr„mLbd‹ici{pfb›f8jqb®Kb‚npr„lŒqcehKKb‚Kb®Žbd+cehAf Ÿ bqcš/’ r:vKce‹ibkmMr:‹icšt_h6fÑbdÒ®jdrAjd{™ceŒA
‘r‚jdhAf)¢Ab›‹i­6bdf8jdb£Hv8r6K‹µrFci{s£Hvb¤byt4cb›f%bq·Cbqc­6rA­Ab¤Kbg£Hv8r:np{™ceŒ‚§CKo›t!£Hvbšnpb›t!{™ceŒd‹eŒ›t!t_b›‹ih6f6cm8‹ihKjµbytKb–npr”t_h6n|vKce{|h6f ? {pn
¢6hAfHctd’ bdfu‹erAmm‹ehKjµbd‹`ci‹eo›t2¢){™cebAMaZbRmŒdf8hAlodlb t_bR¢Ah6{™c+¡{pbdfubdf”vfb K{plgb›f8ti{|h6fT§)npbRf8hAlš¡8‹ibRKb jµ{™·C‹eb›t+t_{p­Af8{™˜Mj›xrFceŸ {™¥t
hAv¡npb¤Šjµ8rA£Hvb{|ciŒ›‹er:ci{phAf Ÿ mv8{pte£Hvb t_{ |x − x? | 6 10−p Ÿ r:nphA‹µt |x − x?| 6 10−2p 
k
k+1
.\À)¿‚ÊA½xÈCÉ)ÀA@ B»CÊÉ)Ì!2¸Ë8ÀED†Ê ¿®»AÌdºK¼CËÀ¯ËÀ ÎÀ6ÏÌz¼MÄ/Ð Ö hA{pfHcih6f8tkKv Kh6{|­Ac®n|byt®KŒq¥rAvKcet‚lkrF—4bdv8‹etF#¥bqc‚m8rA‹_žh6{pt
‹eŒ›{|¡8{™cehA{p‹ibytG%2Kb nsrglgŒdcihKKb¤b¤Žbd+cehAf
‘`’ {pfKžh6‹ilkrFce{|h6f–tiv‹npbt_byjqhAfMšh6‹eK‹eb+Kb f’ b›t_cm8rAt\cehAvF—4h6v‹µtK{ptimLhAf{p¡npb2b›fm‹er:ci{s£HvbAFÚfbd·Lbdc nsrRmn|v8m8r:‹icKvgcibdlm8t
npb›t\žh6f8jzce{|h6f8tŠRl{|f{pl{ptibd‹f8b+tihAfHcm8r6tfjqhAf8fHv8b›t bq“Kmnp{sjq{|cibdlb›f6c Ÿ lkr:{stt_{plmn|b›lbdfHc¢){prRvfr:np­Ah6Ÿ‹i{|cilb+jdrAnpjdvnprAfHc f (x)Ÿ
bdc (x) mLhAv‹2vf x Kh6ffŒ6Ka!’ b›t_cZnpb!j›rAtZbdf®m8rA‹_ce{pjdvnp{|b›‹2£Hv8rAf8knpb›t`žhAf8jqci{phAf8t2t_h6fHc`{ptetivb›t2Kb!j›r:nsjqvnstZbdf‚rAlgh6fHcH#žmMr:‹
bd“Kbd∇f
lmnpbgrAm‹ioytnsr‚‹eŒ›tihAnpvKce{|h6f¸/’ vfbgŒ›£Hv8rFce{|h6fTK{|·CŒd‹ebdfHci{pbdnpn|b&%z/¦Rr:f8tjqbyt!j›rAt l›lbgti{ npr”‹iŒ›­Avnsr:‹e{|ciŒšKbgnsr®žh6f8jzce{|h6f
mLbdvcIqce‹ib ­Hr:‹µr:fHci{pb!mMr:‹rA{|npn|b›v‹µt Ÿ h6fuf8b¤mMb›vKcm8r6tr:m8mn|{s£Hvbd‹nsrlŒqcehKKbšKb¤Ÿ Žbd+cih6f%jdrA‹+cihAvcib¤n-’ {pfKžh6‹ilkrFce{|h6f”f’ byt4c
mMrAtK{st_mLhAf8{|¡npbA
J dlbb›f‚t_v8mmMhHtirAfHc+qce‹ib8r:f8tZvfbRt_{|civ8r:ci{phAf®h6ÙkhAf®mLbdvc+j›r:nsjqvnpbd‹npb8b›tet_{pbdf nsr¤lŒqcehKKb!KbRŽb›+cihAf”KhA{|cZm8rA‹_žh6{pt
dci‹eb+m‹ihHtijd‹i{|cib+mLhAv‹ZKb›t‹µr:{stihAf8t f)vlŒd‹e{s£6v8b›t›FÚfkbq·Cbqc Ÿ jµ8r6£6v8b2{|ciŒ›‹er:ci{phAfgfŒ›jdb›teŸ t_{|cibb‹iŒyt_h6v8K‹ebZv8f®t_¬Kt_ciodlb+np{|fŒyr:{p‹ib
mLhAv8‹ZjdrAnpjdvnpbd‹`nsr¤K{p‹eb›jzce{|h6f‚Kbb›tejqbdfHcebAK¶){Mnsr lkrFce‹i{sjqb!b›teti{|b›ffbbyt4c2lrAnMjdhAf8K{|ci{phAf8fŒdb!hAv Ÿ l›lbm{p‹ib Ÿ ti{Lbdnpn|bf’ byt4c
mMrAt+{pfH¢6bd‹µt_{p¡npb# jqb¤£Hv{/mLbdvKccihAvcŠg¥rA{™crA‹i‹e{p¢Abd‹2nphA{pfuKb x? % Ÿ nsrkK{|‹eb›jqci{phAf„Kb Žb›+cihAf„f’ b›t_cm8r6t+mMb›‹_ce{|fb›fHcibA
‘rlŒqci8h)bšK{p¢Abd‹e­Ab tihAv¢6bdfHc+žhA‹icib›lgb›fHc ti{ f’ b›t_cm8rAt¡{|b›f%jµhA{sti{ Ú`fbq·Cbqc ldlbšti{npb¤l{|f{plšv8lbyt4cv8fu¡LhAf
l{pf{plšvl Ÿ hAfufbmLbdvKcm8r6t+­6rA‹erAf6ce{|‹+/’ qce‹iŸ bxr:0fMt+n|b¡8r6titi{|f„/’ rFcici‹µrAjzce{|h6f‚h6ٔnsr¤žh6Ÿ f8jzce{|h6f”byt4c¡{pbdfjdhAf)¢Abd“)b66Ú`fK˜8f Ÿ {pn
tibmMb›vKccih6vKcŠ–¥r:{|c£Hvb n|byt+{™ceŒd‹eŒ›ttihA{pbdfHcrFcici{p‹iŒyt+m8r:‹vf„lkrF“K{plšvln|hKjdrAn pp
Ó {|fMt_{ ti{nsrkm‹e{|fMjq{pm8r:npbš£Hv8r:np{|ciŒ¤Kb–nprlŒqcehKKb–bšŽb›+cihAfbyt4c!¡{|b›f¸jqh6ff)vb #¥£Hv8rAf8„bdnpnpbšjqh6fH¢6bd‹e­Ab bdnpn|bšjdhAf)¢Ab›‹i­6b
¢){|cib&% Ÿ t_byt®Ÿ KŒq¥rAvKcet‚n|bTt_h6f6c‚rAv8tet_{-2a!’ b›t_c¤—4v8t_cibdlb›f6c”mMh6v‹‚‹eŒdmLhAf8‹ib%ŠÂjdb›t®­6‹i{pbq¥t‚£6v8b%K{™·CŒd‹ebdfHceb›t‚rAlŸ Œdnp{|h6‹er:ci{phAf8tkKb
nsr~lŒdcihKKb©KbTŽbd+cehAf h6f6cuŒqceŒTKŒ›¢AbdnphAm8mMŒ›b›t #žfhAcer:llbdfHcun|byt‚lŒqcehKKb›tuKbюbd+cehAf ci‹ehAf8£HvŒ%bdcunpb›t”lŒqcehKKb›t
b‚£Hv8rAti{™wxŽb›+cih6f %z Ó {|­6v{pn|nphAf8t¤n|byt n|byjzcebdv‹µtšjdhAv‹µr:­6bdvK“%¢6bd‹µtn|b®np{p¢H‹eb®Kb®‹eŒqžŒ›‹ib›f8jqbktiv‹šjdb›t¤£Hvbyt4ce{|h6f8tk§2¨Žvlbd‹e{pj›r:n
Ý!mci{plg{ ›r:ci{phAfkªuKb  Û2 2hAff8rAf8t Ÿ  a! R{|np¡Lbd‹ic Ÿ a!8‘bdlkr:‹eŒ›jµMr:nCbqc!a!M¶KrA­6r6t4ce{ :¡8rAn Ÿ Œ›{™ceŒ¤jµb¤¶)m‹e{pf­Ab›‹›
P
WX!]CW
!Ý v8¢H‹ehAfMtZv8fb m8r:‹ebdfHceo›tib!mLhAv8‹lgbdc_ce‹ib b›f„r1¢FrAf6c+vf„‹eŒ›tivn™cµrFc£Hv{fh6v8ttibd‹µršvKce{|npb¤rAf8tnsrgtiv{|cib6
‘’ bdfMt_b›lš¡npb
Kb›tlr:ci‹e{pjdb›tbq˜8f{pb›tmMhHt_{|ci{p¢AbytKb cµr:{pn|npb n žhA‹elgb v8fhAv¢6bd‹ic
HÀ)¿u¿®À
++ À2zÌÉ8ļLÉ)ÅAÀ)½Ì1Ð
b n ’ b›tim8rAjdb Kb›St+nlkrFce‹i{sjqbytt_¬)lŒqce‹i{s£Hvb›t›KÚfu¥r:{|c Ÿ mMh6Svn‹vfb lkrFce‹i{sjqb A ∈ S Ÿ h6f„r
n
m
e
‹
K
h
µ
j

b
K

b
t
n
∃ β > 0, ∀ B
A, ∀ h ∈ R ,
h B h > βkhk2
Ô½ÀKÉ)ÅAÀMÐ 3 r:mmLbdnphAfMt2cihAvc/’ rA¡Mh6‹eu£HvbmMh6v‹vf8bRlkr:ci‹e{pjdbti¬)lŒqci‹e{s£6v8b S Ÿ hAf„rgn ’ Œ›£Hv{p¢Fr:npbdf8jdb
Œq˜8f{pbmMhHt_{|ci{p¢Ab ⇐⇒ ∃ α > 0, αkxk2 6 hx, Sxi 
S
aZbyjq{8t›’ hA¡Kce{|b›f6cb›f–{pf)¢AhK£Hv8r:fHcn-’ Œy£6v8{|¢Fr:npbdfMjqbKb›tfhA‹elb›t bdfK{plbdf8ti{|h6fg˜8f{pb §:vfblkrFce‹i{sjqbti¬)lgŒdci‹e{p£HvbKŒd˜8f{pbmMhHt_{|ci{p¢Ab
{pf8Kv8{™cv8fb fhA‹elbRtiv‹ Rn hAٔcih6vKcibytn|byt+fhA‹elb›ttihAfHcŒ›£Hv{p¢Fr:npbdfHcibytd8Ý!f„mMb›vKcr:vMtiti{r1¢Ah6{|‹2vf„‹iŒyt_v8n™cµrFcmnpv8tm‹eŒ›jd{pt+b›f
vci{pn|{stirAfHcRK{p‹ibyjzcebdlbdfHc!npb¤ceŒdh6‹io›lbšKb¤‹eŒ›KvMjzci{phAf¸bdf%¡8r6t_bšhA‹icih6fhA‹elŒdbk§8b›f%Œ›jd‹i{p¢Fr:fHc hx, Sxi bqc!b›f%KŒ›jdhAlmLh6ter:fHc x
8r:f8tv8fb¡8rAtibhA‹icih6fhA‹elŒdbKb ¢Abyjzcib›v‹µtZm8‹ih6m‹ibyt+Kb S Ÿ h6f”lhAfHce‹ib £Hvbn|b lb›{|npn|b›v‹ α mLh6tet_{p¡npbb›t_c λ (S) 
¦!Œdlh6f6ce‹ih6f8tŠ®m‹iŒyt_b›fHcn|b–n|b›llgbgbdfnpv{|w-l›lgb6¶)hA{pbdfHc S v8fbšlkrFce‹i{sjqbgr:fMt S bdc T vfb–lkrFci‹emin
{sjqbšti¬)lgŒdci‹e{p£Hvb
b fhA‹elbR{pfKžŒ›‹i{pbdv‹eb Š α/2 #¥mMh6v‹nsr–f8hA‹elgb tiv¡LhA‹µKhAff8Œdb % 5 r:nphA‹µt+¶ RÕ b›t_cr:v8teti{nr:f8t S Ÿ mv{ste£6v’ h6f”mLbdvKc!Œ›jq‹e{p‹ib
n
++
++
++
++
hx, (S + T)xi > αkxk2 + hx, Txi > kxk2 − kxkkTxk > αkxk2 − kTkkxk2 > α/2kxk2
b›f„vKci{pn|{ster:fHcRa2r:v8jµ)¬Hw4¶Kjµ)2rA‹ bdcnprKŒd˜8f{|ci{phAfKbnsrfhA‹elbRtiv¡LhA‹µKhAff8ŒdbA
.\À)¿‚ÊA½xÈCÉ)
À ZÅAÀHÇ D†ÊTÇA¼MÄ)Å6À9H͆Ìe»„ÀK
Ä D™É 2FÐ Žh6v8t!hAffh6f8tr:v%mMrAtetirA­Ab¤vf8brAvKci‹eb #¥‹erAm{sKb %m‹ebdv¢6b–KvTn|b›lglb
m8‹iŒyjqŒ›bdfHcvKci{pn|{ster:fHcn|bytKbdv“”‹eŒ›tivn™cµrFcµtt_v{p¢Fr:fHcet§
‘`’ rAmmnp{pj›rFce{|h6f%}A ;gKbgƒ …L‡ˆ‰/ŒdlhAfHci‹eb£6v8bRnsršžhAf8jqci{phAf
£Hv{ Ššv8fblr:ci‹e{pjdbRti¬)lŒqci‹e{s£6v8b Ÿ rAtet_hKjd{|bRtir
m8n|v8t+­6‹erAf8Kb¢Fr:npbdv‹m8‹ih6m‹ibRb›t_cvfbžh6f8jzce{|h6f„jdhAf)¢Abd“KbA A 7→ λmax(A) Ÿ
‘r®‹ebdlkr:‹µ£Hvb‚}6 ‚Kb„ƒ†…M‡8ˆ+‰bq“Kmnp{s£6v8b–b›fTm8rA‹_ce{pjdvnp{|b›‹R£Hv’ vfbgžhAfMjzci{phAfÑjqh6fH¢6bq“Kbšbyt4c jqh6fHci{pfHv8bgŠ”n ’ {pf6ceŒd‹e{|b›v‹ Kbt_h6f
hAlkr:{pfb Kb KŒq˜Mf{™ce{|h6f
Ú`f%rAtet_b›lš¡nsr:fHcjqb›tbdvK“u‹iŒyt_vn|cer:cet Ÿ hAf„lhAfHci‹ebR¥rAjq{pnpbdlbdfHc£Hvb n ’ r:m8mn|{sjdr:ci{phAf
λmin : A 7−→ λmin (A) = −λmax (−A)
byt4cv8fbžhAf8jqci{phAf„jqh6f8jdr1¢6bRjdhAfHci{pf)vb t_v‹n-’ b›tim8rAjdbb›t+lkrFce‹i{sjqbytt_¬)lŒqce‹i{s£Hvb›t›MÝ!f”b›fKŒ›Kv8{™cK{p‹eb›jzcebdlbdfHc£Hvb
Sn++ = λmin −1 (R+∗ )
byt4cgvf~h6v¢Ab›‹_cšKbujqbdc–b›tim8r6jqb bqcghAfÂhA¡ci{pbdfHc–b›fÂm‹i{plb”£Hvb‚jA’ byt4cgvf«jdhAf)¢Abd“)b # jqh6lglb®b›f8tibdlš¡8n|buKb®f{p¢Abyr:v~/’ vfb
žh6f8jzce{|h6fjqhAfMjdr1¢Ab!w`jz bq“Kb›lgm8n|Ÿ b}A !kKbƒ†…M‡8ˆ‰ %z
Û8bd‹elhAf8tnsr©m8r:‹ebdfHceo›tib”bdc‚Œqcµr:¡np{stitihAf8tgnsr©m‹ehAm‹e{|ŒdciŒKb%jdhAf)¢Abd“){|ciŒ„Kb t_h6v8tnpb›t)¬)mMhAcioyt_byt®Kv¯ciŒ›hA‹eodlb©}A
3 r:mmLbdnphAf8tgcehAvKc®/’ r:¡LhA‹µ #¥¢Ah6{|‹nsrTjdhAv‹icibu‹ib›lkr:‹µ£6v8b¸}A" #!©Kb©ƒ†…M‡ˆ‰
%£Hv’ vffb”žhAfMjzci{phAf f byt4ckK{|cib αwjdhAf)¢Abd“)b”mMh6v‹
ti{/bdnpn|b¤t›’ byjq‹e{™cjdhAllbRnsrt_h6llgb
α>0
r1¢Ab›j g jdhAf)¢Abd“)b6
f (x) = g(x) + α kxk2
aZbyjq{LmMb›vKc2t›’ {|fHcib›‹im8‹iŒdcibd‹ZjqhAllbvf”rF—4hAvcZ/’ bdf8jdhA‹ebmnpv8t`KbRjqh6fH¢6bq“K{|ciŒ #žnpbcebd‹elb
%`Š npr žhAf8jqci{phAf®jqh6f)¢Abq“Kb §6h6f
2
h6¡Kci{pbdfHc`Kh6f8j2vfb2žhAfMjzci{phAf f ¨ce‹ioytªgjqhAf)¢6bq“KbA1Úfm8rA‹_ce{pjdvn|{pbd‹ Ÿ vfb+žh6f8jzce{|h6f αwjdhAαkf)¢A·bdk“)b2b›t_ct4ce‹i{sjzcebdlbdfHc`jdhAf)¢Abd“)gbH#¥j›r:‹
byt4ct_ci‹e{sjzcib›lbdfHcjqhAf)¢6bq“Kb %q Ö r6titibd‹+m8rA‹2nsr wxjqh6f)¢Abq“K{|ciŒRb›t_c/’ rA{|npnpbdv‹µt+vfblkr:f{pod‹eb{|fHceŒd‹eb›tetirAf6ceb!Kb¤ŒdlhAfHci‹ebd‹
2
αk
nsrkt_·cik‹e{pjqcib jqh6fH¢6bq“K{|ciŒ/’ v8fbžhAf8jqci{phAf„mv{ste£6v8bRn-’ hAfαK{st_mLh6tib Kbnprkj›r:‹µrAjzceŒd‹e{pterFce{|h6f®t_v8{|¢Fr:fHcebA
HÀ)¿u¿®
À $
ÇA¼MÄ)Å6À9H͆Ìe»MÐ ¶)hA{|c vfb–žhAf8jqci{phAf©Kbdv“%žhA{stK{™·CŒd‹ebdfHce{prA¡n|btiv‹vfTh6v¢Ab›‹_c jqh6f)¢Abq“Kb U 5 rAn|h6‹et f byt4c
wαxjqhAf)¢6bq“KbRtiv‹ αU% t_{bqctibdvnpbdlbdfHcti{ f

t
∀ x ∈ U, ∀ h ∈ Rn ,
h Hf (x) h > αkhk2
Ô½ÀKÉ)ÅAÀMÐ 3 r:m8mMb›n|h6f8t+cih6vKc/’ r:¡LhA‹µ‚nsrkjdrA‹er6jzceŒd‹e{pterFce{|h6f‚Kb›tžhAf8jqci{phAf8tjdhAf)¢Abd“Kb›t2m8r:‹npbdv8‹b›teti{|b›fM¶)h6{™c f : U → R vfb
žh6f8jzce{|h6fKbdvK“”žhA{stK{|·LŒ›‹ib›f6ce{prA¡npb Ÿ r:nphA‹µt2hAf„r
jqhAf)¢6bq“KbRtiv‹ U ⇐⇒ ∀ x ∈ U, ∀ h ∈ Rn, th Hf (x) h > 0
f
aZbdc_ceb m‹ih6m‹e{|ŒdciŒfhAvMt+mMb›‹ilbqcb¤jqhAlmnpŒqcebd‹+npb›tŒy£6v8{|¢Fr:npbdfMjqb›ttiv{p¢Fr:fHcibytt_v‹ U
byt4c αwjdhAf)¢Abd“)b ⇐⇒ g = f − αk · k2 b›t_cjqh6f)¢Abq“Kb
f
mLhAv‹+cehAvKc h ∈ Rn
t
⇐⇒
h H g(x) h > 0
mLhAv‹+cehAvKc h ∈ Rn
t
⇐⇒
h Hf (x) − α Id h > 0
mMh6v‹+cih6vKc h ∈ Rn
t
⇐⇒
h Hf (x) h > α khk2
jdb¤£Hv{Kh6ffbn ’ Œ›£Hv{p¢Fr:npbdf8jdb t_h6v8r:{|ciŒ›bA
HÀ)¿u¿®À
Ã`¼MÄ)Å6À9H͆Ìe»”Ç:Ê)Ç6º)»6À /CÐ ¶)hA{|c vfbRžh6f8jzce{|h6f„bjdnpr6titib 2 r:vKcehAv‹/’ vf„mMh6{|fHc x? cibdnpnpb¤£6v8b Hf (x? ) byt4c
Œq˜8f{pb mLh6ti{™ce{|¢6b Ÿ r:nphA‹µt f byt4c αwjdhAf)¢Abd“)brAf8ft+vf„¢Ah6{pti{|fMr:­AbKb Kb x?  C
Ô½ÀKÉ)ÅAÀMÐ aZh6lglb f b›t_c C2 Ÿ nsržhAf8jqci{phAf x 7→ Hf (x) byt4cRjqhAfHce{|f)vb6CÝ!‹ Hf (x? ) ∈ S Ÿ KhAfMj­A‹Ajqb¤rAv„n|b›lglb Ÿ h6f
n
ŒdcerA¡n|{|c£Hvb
m‹eh)jµ8bb x? , ∀ h ∈ Rn, th Hf (x) h > αkhk2 
∃ α > 0, ∀ x
jdb¤£Hv{mLbd‹elgbdcKb¤jqh6f8jqnpv‹ebr1¢6b›j!n|bnpbdllb
++
!#"%$'&)(* +-,/.102"%$ &3546798:!;=<%>)?A@:BDCFEHGJILK MONQPSRHTUP1VSILKUWSX?Y[Z[\]&)^S_S_S`#?

Documents pareils