Conference PaperPDF Available

iCLEF 2003 at Maryland: Translation Selection and Document Selection

Authors:

Abstract and Figures

Maryland performed two sets of experiments for the 2003 Cross-Language Evaluation Forum’s interactive track, one focused on interactive selection of appropriate translations for query terms, the second focused on interactive selection of relevant documents. Translation selection was supported using possible synonyms discovered through back translation and two techniques for generating KeyWord In Context (KWIC) examples of usage. The results indicate that searchers typically achieved a similar search effectiveness using fewer query iterations when interactive translation selection was available. For document selection, a complete extract of the first 40 words of each news story was compared to a compressed extract generated using an automated parse-and-trim approach that approximates one way in which people can produce headlines. The results indicate that compressed “headlines” result in faster assessment, but with a 20% relative reduction in the F α= 0.8 search effectiveness measure.
No caption available
… 
Content may be subject to copyright.
  
!
"#$%%&')(+*,%*.-/%&'0012&3-.4657*89:(+*,%*.-/%&'
;=<?>@>@ACBD,<?EFEHG IDJLKMAC>@NPO.B?GRQLSR>TUS@<RG@D8<LSRNLVWJLXZY\[^]JLE`_aGcbdAWegfRJLE`_hcegfji/JLElk`mLG IgI
QLAWJn>oK?AWJn>RN'YpJn>@NoG@D8JqjAW_raJtsuAWe
vxwMy{zu|}zu~?zu=W==?wM`$M~?zuFnzu~M?|gy
/wM|Fuy|zxU?%wjRc$HgH8a%ucj9H%Z?
¡n¢£H£a¤¥¡n¦§n¨©tª¡a¤{«%¬©¤¢H¦£¡a¤x®n¦%©tªL«§a¤x¡¯M°n¦«t¨t±H²%³¬¯c¨¦t±t´^µ¶¬%¯L¡Uµ¥·H¡H¬U¤¸´H±¹®L¦£Hº°t³»»H©Uµ±H¢g¯
¼½a¾g¿gÀÁjÂ¿HÃ
?%wjÄcFWug¸zxÅyFzuyd`ÆLc`u|gwtzuy,WzuÇ?PHÈ
Éuyy{Ê¥Ëow?H~j%HÌU~jzu|HwÎÍMu~?Ï y|wtzu`l%`zu|Pzll@$Hw?3Ctg~Mygw
|wtzu`lFzu|HÐy```zu|HwÑ'%M?u?u|%zu6zl%wMy%zu|Hw?yÒCÓn~?`zu`uygzuÇM
yg`Hwj3Wtg~?ywÒ|wtzu`lFzu|Hygg`zu|Hwuggwtz.Ltg~M`wnzuygÔRÕRlwMyÊ
zu|Hw8ygg`zu|HwÅyay~?Mczug8~My|w?/cHyy|Ö?"y{Lw?HwtLy×?|ygFu,zuÇLuH~MÇ
ÖMl8zlw?y%zu|Hw'wM8z¥Å$.zu`FÇ?wM|Ót~MgyW%H`wM`lzu|w?.Ød`nÙl8v¥w$Hwtzu`Ænz
Ú
ØZÙÛv{"ÜU`Æ?%Mgy$%^~?yuHÔLÕÇMugy~M}zuy|wjL|%zuÝzuÇjzyuFÇ?`uyz¥LM|%
%FÇ?|`,y||%ÝyuFÇ`Þ@g`zu|`wMgyy~?y|wM8C`ÅFÓn~?`|}zu`lzu|wMyÅÝÇ?gw
|wtzu`lFzu|H=zlw?y%zu|Hw'ygg`zu|HwÅ"%yÝ|Ö?HÔ?ÍM?tg~?gwtz$yggFzu|wo?
gM`zud`Ænzl%`zazuÇMZß?uy{zÅ%l?y%FÇ9wM`ÅÝyy{zuÅ"%y=gju
zu39`H?u`yy`ÆnzlFzgwM`lzu~?y|w?3w6%~?zu%zuM%uy`Êx%wjLÊàzu|
%M?uHlÇzuÇM%z$??uÆL|zugy$wMÝÅ"g|wÅÝÇM|lÇ'cgMw?unL~MgÇMgHLÊ
|wMgygÔ×ÕÇMugy~?}zuy8|wjL|%zuzuÇjz.gHLugyyâáxÇM?|wMgyãu`y~M}z|w+äy{zuF
%yygyygwtztÖM~LzÉÅÝ|}zuÇ,HåÑugzu|HuL~M`zu|w|wzuÇ?/æ^çLè@é`ê ëÝy%ulÇ`Þ@g`Ê
zu|gw?gyyÝy~LuHÔ
ì íMîïcð@ñdò8ó,ô^ï@õuñî
öZf@BNL<?JLVÉ<L÷dø=E`<?X`XuùTUJL>@NLSoJnNLBú>@÷à<LE`ûJnkFAC<L>übdBk`EFACB%qtJnV.ý{ø/Túub,þ8AWXkF<f@B%VCÿpXlBHJnEgegf@B%EgX
>R_'EFBV BqJL>Mk"_@<je%S@ûB%>Mk`X$BqLB%>9idf@B>k`f@B%ACEÝKMS@B%E

kFBEFûPX"JnE`BZegf@<?XFB%>÷àEF<?û J8VWJn>RNLSRJLNLB
_cA

×B%E`B%>Mk÷àEF<?û kFf@B9VCJL>@NLSoJnNLBA >Äidf@ACegfÐkFf@B_c<ceSRû9B>MkJLEFB'idEFA klk`B%>[

@<?E,k`f@B3ø=EF<MXFXlù
TUJn>RNLSRJLNLB

qtJnVCSRJtk`A <?>

@<?EFS@û

Xý¥ø/T

"þAC>MkFBE`J?ekFACqLB,kFEgJLe

6ýàAàø/T

"þGci/B8fRJq?B

^B%B>
B

cÿ@VC<LE`A >@NkFf@Bpû<?XlkegfRJLV VCB%>RNLAC>@N XFSRegf eJLXFB

Ñidf@B%>Ñk`f@BpXlBHJnEgegf@B%E

X

j>@<tidV BH_cNLBÐ<n÷
kFf@B6_c<ceSRû9B>MkVWJn>RNLSRJLNLB3AWXPXl<üVCA ûA kFB_ÎkFfoJtk9kFf@B

i=<?S@VW_

^BSR>RJ

@VCBÒkF<ü÷à<LE`ûS@VWJtk`B
K?SRB%E`A BHXZ<LEZEFBHe<?NL>@ACm%BEFBV BqtJn>Mk._c<ceS@ûB%>MkgXZA >kFfoJtk.VWJn>@N?SRJnN?BL[R]8S@EdegfRJnVCVCB%>@N?BAWX/kFfjSRX
kF<ÿREF<tqjAW_cB8XFBJLE`egf@BE`XÝidAk`f3kFEgJn>oXlVWJtk`A <?>kF<j<LVWXÝk`fRJtkdJnE`Bdk`S@>@B_3kF<'kFf@B,k`J?X

cXkFfRJnk=k`f@B

ûSRXlk9ÿ^B%EF÷à<LE`û _cS@E`A >@NüJn>AC>MkFBE`J?ekFACqLBXlBHJnEgegfpÿ@EF<ce%BX`X

egf@<j<?XFA >RN¸K?SRB%E

Äk`B%E`ûPX'JL>R_
EFBHe<LN?>@ACm%AC>@NdEFBV BqtJn>MkÉ_c<ceSRû9B>Mk`X[

R<LEUAàø/T
!
@Gi/BÝEgJn>kui/<,XlB%k`XÉ<n÷cB

cÿ^B%E`A ûB>?kgX%G
<L>@B÷à<ceSRXFAC>@NP<L>BJ?egfJ?Xlÿ^BekZ<L÷Ék`f@AWX.egfRJnVCVCB%>@N?BL[
"
V kFf@<?S@NLfÑKMS@B%E

Û÷à<?EFû'S@VCJnkFAC<L>â÷à<LEø/Túub ûA N?f?k+JLÿ@ÿ^BJnEP<?>âkFf@BÐXFS@EF÷¶JLe%BÒk`<

^B
XlACûA VWJnE'kF<üK?SRB%E

Ä÷à<?EFû'S@VWJtkFAC<L>ÛAC>Îû<?>@<LVCA >RNLSRJLV=JnÿRÿ@V AWe%JnkFAC<L>RXGÉkFf@BAk`B%EgJtk`A q?B3>RJtk`S@E`B
#
=~LzuÇMuy"wMgy"|wP%MÇj%Öc`zu|olL`j
$
|%zu|Hw?yZyÝyÇ?ÅÝw9`ÆLgg?z%yÝwMzug
##&%'%)(
ÕogFÇ?wMH|gyg
+*,-.
%
uH`wPË^%wj9autÅ"gtcn~M|}zu
/.0-
Lc$H~M8ÖM|Lj9
.
g
-
<n÷ZkFf@BÒA >Mk`B%EgJLek`A q?B+XFBJnEgegfpÿ@E`<je%BX`XE`BXFS@VkgXAC>ÎJ¸_cA
×B%E`B%>Re%BPkFfRJnk'AWX<L÷d÷àS@>R_@JLû9B>Mk`JnV
A ûÿ^<LEFk`Jn>oeBL[?YÑf@B%>ÒXlBHJnEgegf@A >RNidAk`f@A >3kFf@BXFJLû9B,VCJL>@NLSRJLNLB?GLXlBHJnEgegf@B%EgXÝXFB%B

k`<egf@<j<?XFB
kFB%E`ûPXÉkFfRJnk"JLSckFfR<LEgXÉJ?ekFSoJnVCV
SRXFB_A >_c<ceS@ûB>?kgX%[töZfRJnk$AWX"eVCBJLEFV
>@<nkÿ^<?X`XlA
@VCB=idf@B>
SRXlAC>@NÐKMS@BE
ÐkFEgJn>RXFVWJtkFAC<L>ü÷à<?Eø/Túub
AC>RXuk`BJ?_aGÉXFBJLE`egf@BE`Xû'SRXlk'egf@<j<?XFB3KMS@B%E

¸k`B%E`ûX
kFfRJnkk`f@B

idA VCVkFEgJn>RXFVWJtkFB9AC>?k`<+k`B%E`ûPX,k`fRJtki/B%E`BSRXFB_
¸JnSck`f@<LEgX[oú>ø/TúubG
XlBHJnEgegf@B%EgXA >Mk`B%EgJLek=idAk`f+JkFEgJn>oXlVWJtk`A <?>X
cXuk`B%ûG?JL>R_>@<Lk8ý¶_cACE`Bek`V
@þÝidAk`f+_c<ceS@ûB>?kgX%[
YÄB
j>@<tiûSRegf6J

o<?Sck.f@<ti SoXlBE`XZAC>MkFB%EgJLek.idAk`f6_c<ceS@ûB%>MkgXdA >¸JL>ÒA kFBE`JnkFACqLBXFBJLE`egf
ÿ@EF<ce%BX`X%G
@Scki=B
j>@<ti e<?ûÿRJnEgJtk`A q?B%V
ÒVCAkFkFVCB9J

o<?Sckf@<ti kFf@B

6A >Mk`B%EgJLekidA kFf¸k`E`JL>RXlù
VCJnkFAC<L>ÎX
cXuk`B%ûPX÷à<?Ek`f@AWXÿ@SREFÿ^<?XFBL[öZfRJtk9i/J?Xk`f@B3÷à<ce%SRX9<n÷.<LSRE
EgXlk9XFBk'<L÷.Aäø/T
B

cÿoBEFACûB%>Mk`X/k`f@AWX
LBHJnEH[
D,<ceSRû9B>MkXFB%VCBek`A <?>6ûA N?f?kA >RAk`ACJLV V
6XlBB%û kF<
oB9J3û<LE`BXlkFEgJnACNLfMkl÷à<?EFiZJnEg_3kgJLX
f@B%E`BLGci/Bi/JL>?kZk`<3XlS@ÿRÿo<?ElkZkFfRBXlBHJnEgegf@B%E

X/_cBHeAWXlAC<L>RXdJ

o<?Sck.E`B%VCB%qtJn>Re%B8idA kFfk`f@B
^BXlk
ÿo<MXFXFA
RV B,kFEgJn>RXFVCJnkFAC<L>RX[?;/SckHGMJLN?JLA >GLkFf@BA kFB%EgJtk`A q?B.>RJnkFS@E`B.<n÷UkFf@BXlBHJnEgegfPÿ@EF<ce%BX`Xe<?û9ù
ÿ@V AWe%JnkFBHX.k`f@B9KMS@BHXuk`A <?>
÷à<?E8AC>MkFBE`J?ekFACqLB'XlBHJnEgegf@A >RNRGoJ?XFXFBX`XFû9B>Mk8Xlÿ^B%BH_¸e%JL>
^B'JLX8ACû'ù
ÿo<?ElkgJn>Mk/J?X=J?XFXFBX`XlûB>?k/JLe%e%S@EgJLe

?[LöZf@BEFBHJLXF<L>÷à<?Ek`f@ACX=AWX/XFACû9ÿRV B
VC<L>@N?B%E/JLX`XlBHXFXFûB%>Mk
kFACû9BHXi=<?S@VW_ûBJL>B%A kFfRB%E÷àB%i/B%E"_c<ce%S@ûB%>Mk`X$E`BJL_<LE$÷àB%i Ak`B%EgJtk`A <?>RXUÿ^B%EF÷à<LE`ûB_aG
^<nk`f
<n÷idf@ACegf6eJn>6JL_cq?B%EgXlBV
3J

^BHek.k`f@BB

×BekFACqLB>@BX`Xd<n÷"JPXFBJnEgegf+ÿREF<ceBHXFX[cYüBkFf@BEFB%÷à<LE`B
>@B%BH_kFEgJn>oXlVWJtk`A <?>RXak`fRJtke%Jn>
oBZJLX`XlBHXFXFB_EgJnÿRAC_cV
Jn>R_JLe%e%S@EgJtkFBV
?[öZfRJnk$iZJLXkFf@B=÷à<ceSRX
<n÷<LS@EdXFBe<?>R_XlB%k.<n÷Aäø/T
ÛB

jÿ^B%E`ACû9B>Mk`X/kFfRACX
?BJLE[
öZf@B'E`B%ûPJLA >R_@B%E<n÷=kFf@AWXÿRJnÿ^B%EAWX<LE`N?JL>@A mB_¸J?X8÷à<LVCV <ti.X[×YÄB
EgXlkAC>MkFE`<j_@SReB9kFfRB
_cBXFA N?>3<n÷<?S@EZK?SRB%E

'k`E`JL>RXFVCJnkFAC<L>PB

cÿ^B%E`A ûB>?kgX%GMÿ@E`BXFB%>Mk=<?S@EE`BXFS@V k`XGMJL>R_3_cEgJiXF<LûB
e<L>oeVCSRXlAC<L>oX%[^YÄB9k`f@B%>ü_c<+k`f@BPXFJLûB÷à<LE<?S@E_@<je%S@ûB%>MkXlBV BHekFAC<L>ÄB

cÿ^B%E`A ûB%>MkgX%[

$Aù
>RJnVCV
?G×i=Be<?>ReVCSR_cB'idAk`füXF<LûB9AC_cBHJLX,÷à<LE÷àSck`S@EFB9i/<LE

Òk`fRJtkfRJq?B
^B%B%>ÄA >oXlÿ@ACE`B_
kFf@BB

jÿ^B%E`ACû9B>Mk`XZE`B%ÿ^<LEFkFB_ÒAC>Òk`f@AWXdÿRJnÿ^B%EH[
Îó




Éï@õlñî
 !
ðRõ
#"$
Uî=ï

%
.V kFACûJnkFBV
?G@i=BJnE`BA >MkFBEFBHXuk`B_ÒA >VCBJnE`>@AC>@N9idf@Bk`f@B%E.JXFBJnEgegf@BE

X=J

@ACV A k
kF<AC>?k`B%EgJLeù
kFACqLB%V
B%ûÿ@VC<
J8ø/Túub X

cXlkFB%û
RJ?XlBH_<L>KMS@BE
k`E`JL>RXlVWJtk`A <?>e%JL>
oB=A ûÿ@E`<tqLBH_
ÿREF<Lù
qMAW_cAC>@N3N?EFBHJtkFBEZkFEgJn>RXFÿRJLEFB>Re

P÷à<?EdkFfRBKMS@B%E

3k`E`JL>RXlVWJtk`A <?>ÿ@EF<ce%BX`X%[o]8S@E,B

cÿoBEFACûB%>Mk`X
VCJ?Xuk
?BJLEZ÷à<LE,Aàø/T
 
'_@B%û<L>RXlkFEgJtk`B_ÒkFfRBSck`A VCAk
<n÷"SRXFB%EFùJLX`XlAWXuk`B_KMS@B%E

3k`E`JL>RXlù
VCJnkFAC<L>pA > Jn>pA >Mk`B%EgJLek`A q?BÒø/TúubX
jXlkFBû
'& (*)
{[UYÑA kFfÛSoXlBElùJLX`XlAWXlkFB_üKMS@B%E

¸k`E`JL>RXFVCJnkFAC<L>
÷àS@>Rek`A <?>GJ6ø/Túub X
cXuk`B%û ÿ@E`<tqjAC_@BXJn>ÄJ?_@_cA kFAC<L>RJLVA >MkFBE`J?ek`A <?>Ð<LÿRÿo<?Elk`S@>@A k
6idf@B%E`B
kFf@B+XFBJLE`egfRB%Ee%JL>ü<?ÿckFAC<L>oJnVCV
üXlBV BHek+ýà<?EE`B%û<tqLBþ.k`E`JL>RXFVCJnkFAC<L>RX<L÷/AC>R_cACqjAC_cSoJnV=KMS@BE
kFB%E`ûPX
oB%÷à<LE`BJn>R_
,+
t<LEdJt÷äk`B%EdqjACB%idAC>@N9kFf@BE`Bk`EFACB%q?B_+_@<je%S@ûB%>Mk`X[^]8S@EdB

cÿoBEFACûB%>MkdEFB%ù
XlS@V k`XZ_cBû<L>RXlkFEgJtk`BdkFfRJnk=k`f@BJqLB%EgJnN?BdXFe%<LE`BXÝ<L÷
.-0/214365 7
,<
!
ck`JLA >RB_P÷àE`<Lû XFBJLE`egf@BHX"<L>ÒJ
X

cXlkFB%û idAk`fSRXlBElùJLX`XFACXlkFBH_ÒKMS@BE
Pk`E`JL>RXFVCJnkFAC<L>Jnÿ@ÿ^BJLEFBH_

^BkFkFB%E,kFfRJL>kFfRJnk.<n÷"JPX

cXlù
kFB%û idA kFfR<LSckAkH[aO.<ti/B%qLBEGo_cS@B'kF<3k`f@BXlûPJnVCVXFJLû9ÿRV BXlACm%Býä÷à<?S@EXFBJLE`egfRB%EgX`þGRi/B'_cAW_
>@<nk/<

ckgJnAC>+XukgJtk`ACXlkFAWe%JLV^XFA N?>@A
e%JL>ReB?[?ú>+J?_@_cA kFAC<L>GMi/B
^B%VCA BqLB.k`fRJtk/kFfRBKMSRJLV A k
'<L÷kFfRB
XlBHJnEgegfÐJnVWXl<VCA BHX8AC>ÄkFf@Bidf@<?V B9ÿ@E`<je%BX`X<n÷k`f@BPXlBHJnEgegfG^E`JnkFf@BE,k`fRJn>ÄkFf@BPXFBJLE`egf¸<?Scklù
e<LûBJLV <?>@BL[RöZfRACX,û9<LkFACqtJtkFBH_SRXdk`<+_cBXFACNL>6Jn>Aàø/T
 !
9B

cÿ^B%E`A ûB%>Mk.k`<PB

cÿ@VC<LE`B
kFf@B÷à<?V VC<tidA >RNKMS@BHXuk`A <?>RX

8
[ZYÑfRJtk/Xuk`E`JnkFB%N?A BHX_c<XlBHJnEgegf@B%EgXJnÿ@ÿRV
'idf@B%>÷à<?EFû'S@VCJnkFAC>@NkFf@BA EA >@A kFAWJnV^KMS@B%E

LGnJL>R_
idf@B%>E`B÷à<?EFû'S@VCJnkFAC>@N8kFfRJnk"KMS@BE
9
ZYü<LSRVC_'kFfRB.JqJLA VWJ

RA VCAk
<L÷^J8kFEgJn>oXlVWJtk`A <?>9XFB%VCBeù
kFAC<L>÷àSR>Rek`A <?>VCBJL_XlBHJnEgegf@B%EgX×kF<JL_c<?ÿck$_@A

×B%E`B%>Mk$XlkFEgJtk`B%N?A BHX
:9
Zø/Jn>i/B<
!
RXFB%E`qLBJL>
EFBVCJnkFAC<L>RXFf@ACÿ

oB%kui=BB%>¸XFS
+
csuBek
j>@<tidVCB_cN?BLG@XFBJnEgegfB

cÿoBEFACB%>oeBLGo<LE.<LkFf@BE,XFA ûACVCJLE
÷¶JLekF<LEgXZ<L>ÒkFfRBegf@<LAWeB<n÷Xuk`E`JnkFBNLACBX/A >BHJLegfe<L>o_cAk`A <?>
,9
c[ZúuX.k`f@B%E`BJ+Xlk`Jtk`ACXlkFAWe%JLV V
6XlACNL>RA
eJn>Mk8_cA
×B%E`B%>Re%B'AC>ÄXFBJLE`egf6B

^BHekFACqLB>@BX`X9ý¶JLX8ûBJnù
XlSREFBH_
-0/214365 7
^Bkui/B%B> XFBJnEgegf@BHX+ÿ^B%EF÷à<LE`ûB_SoXlAC>@N JâX
cXuk`B%ûidA kFfSRXFB%EFù
JLX`XlAWXlkFB_9KMS@B%E

k`E`JL>RXFVCJnkFAC<L>Jn>R_9JX

cXlkFBû kFfoJtkÝVWJLe

cX$kFfRJnke%JLÿRJ

@ACVCAk
9
&
R<LE`ûPJnVCV
?G
i=BXF<LS@N?f?k,kF<EFBlsuBekkFfRB'>jS@VCVf
jÿ^<nk`f@BXFBX,kFfRJnk8k`f@B%E`BAWX>@<Ò_@A

×B%E`B%>Re%B
^Bkui/B%B>
kFf@B
!- / 1 35 7
÷à<LE/kFfRBûPJL>MSoJnV×Jn>R_ÒJnSck`<LûPJtk`ACee<?>R_cA kFAC<L>RXkFfRJnk.JnE`B8_cB
>@B_

oBV <ti[
 
YÄB9SRXFB_k`f@B

ÐJnE

MVWJn>o_6ú>MkFB%EgJLekFACqLBb.BkFE`ACB%qtJnV
"
_cqtJL>ReBH_üø=E`<?X`XuùTUJL>@NLSRJLNLB
Ý>RNLAC>@B
ý

6úub
"
ø/T
=þ$÷à<?EÝk`f@B,KMS@B%E

k`E`JL>RXFVCJnkFAC<L>B

cÿ^B%E`A ûB%>MkgXÝE`B%ÿ^<LEFkFB_9AC>kFf@AWXÝÿoJnÿ^B%EH[

6úubZù
"
ø/T

ÛAWX=JL>PA ûÿ@E`<tqLBH_9qLB%EgXFA <?>9<L÷akFf@Bø/TúubÑX
cXuk`B%û kFfRJnk=i/B.SRXFB_9÷à<?E=Aàø/T
 !
@[
6úub
"
ø/T

fRJLX,EFBHeB%>Mk`V
B%q?<LVCqLB_EgJnÿ@AW_cV
_@S@EFAC>@Nk`f@B'D
"
b

"
hcS@EFÿREFAWXlB'TUJn>RNLSRJLNLB
cB%EgeAWXlB?G

@S@k9Jtk'kFf@B+kFACûBÒ<L÷.<LS@E'Aäø/T
B

cÿ^B%E`A ûB%>MkgXkFfRB
RJ?XlAWe3JLE`egf@A kFBHek`S@EFB+<n÷
kFf@BX
jXlkFBû Jn>o_PkFfRBVWJ
L<?SckZ<n÷k`f@BSRXFB%EZA >Mk`B%EF÷¶JLeBi/B%E`BKMS@A kFBXFA ûACVCJLEk`<'k`fRJtkd<L÷É<LSRE
Aäø/T

8X
cXuk`B%û ý¶XFB%B
$ACNLS@E`B
8
þ[LöZf@B,X
cXuk`B%û XFS@ÿ@ÿ^<LEFk`X"kui=<e%<L>R_cA kFAC<L>oX%GLJL>

FJnS@ù
kF<LûPJnkFAWe

e%<L>R_@Ak`A <?>G?idA kFfÒJ_cBHXlACNL>+XFACû9ACVWJnEÝk`<k`fRJtkZ<n÷ÿ@E`BXFB%>MkYüB

XlBHJnEgegfPB%>@N?A >RBXG
Jn>R_3J
lûPJn>jSRJLV
!
e<L>o_cAk`A <?>GMA >Òidf@ACegf+kFf@BSRXFB%E/e%Jn>+ÿRJnEFkFAWeACÿRJtk`B,AC>3k`f@Be%<L>RXlkFE`SRekFAC<L>
<n÷"Jk`E`JL>RXFVCJnkFB_KMS@B%E

L[
6úub
"
ø/T

SRXFBX8kFf@B9ú>
"
8S@BE
k`B

jkE`Bk`EFACB%qtJLV$X
cXuk`B%û ýàq?B%EgXlAC<L>
@[
8
ÿ
8
þZ÷àE`<LûkFfRB
%
.>@ACqLBE`XFAk
Ò<n÷
#
¸J?XFX`JLegfjSRXFBkFk`XZk`<3A ûÿ@VCB%ûB>?k
$
ÝACE
?<LVWJ
+
XdXuk`EFSRekFS@E`B_6KMS@BE
+kFBHegf@>@AWK?SRB
ýàidf@AWegffRJLX

oBB%>XFf@<tid>kF<
oBÝE`B%VWJtk`A q?B%V
,E`<

@SoXukAC>kFfRBÝÿ@E`BXFB%>Re%B"<n÷cS@>@E`BXF<LVCqLBH_,k`E`JL>RXlù
VCJnkFAC<L>ÐJLû
@ACNLS@A k
!&
%
)
{[
R<LE.k`f@B'JLSckF<?ûPJtkFAWee%<L>R_@Ak`A <?>G
&
A E

L<?VCJ
XdûB%kFf@<c_6AWX8JLÿ@ÿ@VCA BH_
<tqLB%E/JnVCV
M>R<tid>PkFEgJn>RXFVWJtkFAC<L>oX
÷à<LE=kFf@BûPJn>jSRJLV^e%<L>R_cA kFAC<L>UG?<?>@V
3XFB%VCBekFBH_kFEgJn>RXFVWJtkFAC<L>oX
JnE`BSoXlBH_a[
"
RJ?e

L<

6kFEgJn>RXFVCJnkFAC<L>Xuk`E`JnkFBN

PAWXdSRXFB_idf@B%>k`f@BkFBEFû kF<
^BkFEgJn>oXlVWJtk`B_
ACX/>@<Lk
j>@<tid>
EgXlk=k`f@BkFB%E`û AWX/XlkFBûû9BH_aGcA ÷kFEgJn>RXFVWJtkFAC<L>ÒXuk`A VCV×÷¶JnACVCX=k`f@B%>J'XlkFBûû9BH_
qLB%EgXFA <?>P<n÷k`f@B,k`B%E`û V AWXlk/AWX=JLVCXF<SoXlBH_a[MöZfRACXZXFB%E`qLBXÝkF<9ûPJ
cA ûACm%B,kFf@Be<tq?B%EgJnNLBd<L÷kFfRB
@A VCAC>@NLSRJLV×kFBEFû V AWXuk
&
'
)
{[
hjA >oeBi/BJnE`BAC>MkFBEFBHXuk`B_A >k`f@BeJLXFBAC>6idf@AWegf6XlBHJnEgegf@B%EgX/fRJqLB>@<PSRXFB÷àSRV

j>@<tidV ù
B_cN?B9<L÷k`f@B3_c<ceS@ûB>?kVWJn>RNLSRJLNLBLG^i/B9û'SRXlkÿ@EF<tqjAW_cB'kFf@BPSRXFB%EidA kFfpXF<LûBB%qjAC_@B%>Re%B
J

^<LSckkFf@BûBJL>@AC>@NÒ<L÷=BHJLegf6k`E`JL>RXlVWJtk`A <?>¸AC>Ðk`f@BûJL>jSRJnV"e<?>R_cA kFAC<L>[U]8ÿck`A ûPJLV V
LG×i/B
i=<?S@VC_ VCA
LBkF<Îÿ@EF<tqjAW_cB¸KMS@B%E

Mù¥VWJn>RNLSRJLNLB_cB
>RAk`A <?>RX3<L÷BHJLegfÑ_c<ceSRû9B>Mk+VCJL>@NLSoJnNLB%ù
kFB%E`û[
"
V kFfR<LS@N?f_@ACekFAC<L>RJLEFACBX/k`fRJtk,e%<L>Mk`JLA >XlSoegf_@B
>@A kFAC<L>oX._c<B

cAWXukd÷à<?E.Xl<?û9BVWJn>@ù
NLSRJLNLBdÿRJLA EgX%GLkFf@B

PJnE`BdEFBVCJnkFACqLB%V
9E`JLEFBdAC>3ÿ@E`A >MkHG?Jn>o_PB

jkFE`B%ûBV
9E`JLEFBdAC>+JL>3JLe%e%BX`XlA
@VCB
B%VCBek`EF<?>@AWe÷à<?EFû[öZf@BEFB%÷à<LE`BLG^i=Bÿ@E`BXFB%>MkXlBHJnEgegf@B%EgX.idA kFfÛJLXûPJn>
6<L÷kFfRB'÷à<?V VC<tidAC>@N
kFf@E`B%BXF<LS@EgeBHXZ<n÷ÉBqjAC_cB>ReBJ?XZe%Jn>

^Be<?>RXuk`EFSoekFBH_3÷à<?EdBJ?egf+k`B%E`û

(*)  +-,./-01235467-/867&9:;<
@<?E'VWJn>@N?SRJnN?BXA >ÎkFf@BXFJLûB+idE`Ak`A >@NüX

cXlkFBûG
kFf@AWXZe%JL>+Xl<?ûBkFACûBX
^B8AC>c÷à<LE`ûPJtk`A q?BLGjXlAC>ReBXl<?ûB.kFEgJn>oXlVWJtk`A <?>RXÝûPJ
oBe<?NL>RJnkFBHX
<LEPVC<?JL> i/<LEg_@X'kFfRJnkPkFf@B¸XFBJLE`egfRB%Ee%Jn> E`Be%<LNL>RA mBL[
@<?EPB

@Jnûÿ@VCBLG"<?>@B¸hjÿRJn>RACXFf
kFEgJn>RXFVWJtkFAC<L><L÷
*

RJLV V
=
ACX
>
BHXukgJ
PeVCBJLEFV
3k`fRJtkACX.kFf@B
?
lÿRJLElk
@
XlB>RXFB<n÷
RJLV V/ý¶JLX
A >
A
lkF<PJtkFkFB%>o_J
RJLV V
=
?þ[
B
,CEDF4GC-,2H
öÉE`JL>RXlVWJtk`A <?>RX/JnE`Be%EF<MXFXlù¥VWJn>RNLSRJLNLB,X
j>@<L>
jûPX%GcXF<'E`<LS@>o_jùxk`EFACÿ
kFEgJn>RXFVWJtkFAC<L>eJn>E`B%q?BJnV?SRXFB÷àS@VjX

j>@<?>
MûPX[

R<LEUB

@Jnûÿ@VCBLGH<L>@B=ÿo<MXFXFA
RV B"k`E`JL>RXFVCJnkFAC<L>

Ã

ÕÇ?,9v

==ËoÌÐ~?y`|wnzuFä`.C| Ë^ÌUÍü%HÈLj%wn~j@gwjL|zu|woÔ
<n÷

RJL>
+
@
9A >MkF<3hjÿoJn>@AWXlfAWX
lE`A
oBE`JR[
9öZf@B÷à<LVCVC<tidA >@N'kFEgJn>oXlVWJtk`A <?>RXde%JL>
^B÷à<LSR>R_
ֈ<LE
H
FEFA
^B%EgJ
+
oJn>
+
×G=XFf@<?EFB?GÝXlBHJLXFf@<LE`BLG"E`A q?B%EgXlAW_cB?GÝJn>R_ iZJtk`B%EF÷àEF<?>?kH[ÝöZf@AWX3VCBJqLBHX
V A klk`V B'K?SRBXlkFAC<L>ÒkFfRJnk
lE`A
^B%EgJ
'_c<jBXd>@<LkdEFB%÷àB%EZkF<PJ
>oJn>Re%ACJLVXlB>RXlB<L÷

oJn>
+
×[

67

841,

/-67
@<?E.Aàø/T
 !!
cGci/B÷à<LSR>R_B

@Jnûÿ@VCBXd<L÷"SRXFJLNLBPýàidfRACegfi/B
e%JLV V

B

jYÄ<?E`_¸A >ø=<L>MkFB

jkG×<LE

YÑúFøZþ8A >üi/<LEg_jù{JLV ACNL>RB_6ÿRJLE`JLV VCB%VÉkFB

jk[aYÑf@ACV B
B

@Jnûÿ@VCBX/÷à<?S@>R_AC>kFf@AWXdiZJ
+JnE`BNLB%>RB%EgJnVCV
3e%<LE`EFBHek.Jn>R_Ò<n÷äk`B%>6AC>c÷à<LE`ûPJtk`A q?BLGjkFfRB
XlACm%B9Jn>R_ÐXFe%<Lÿ^B<n÷JqtJnACVWJ

@VCBÿRJLE`JLV VCB%VUkFB

jke<LVCVCBek`A <?>RX.ûPJ
>@<Lk

^B'XFS

3eACB%>Mk,k`<
>R_B

@Jnûÿ@VCBXU÷à<LE$Xl<?û9BkFBEFûPXÉA >kFf@AWX$i/J
?[%YüBk`f@B%E`B÷à<?EFBJ?_@_cBH_J,XFBe%<L>R_iZJ
<n÷
e<?>RXuk`EFSoekFAC>@N

YÑúFøâB

@Jnûÿ@VCBX/<L÷USRX`JnNLB,kFfRJnk/i/Be%JnVCV

YÑúFøù¥úubkF<9<LS@E/Aäø/T
!
9X

cXlkFB%û[
!
öZf@BXFBJnEgegf@BE`X=A >Aàø/T
 !!
V A
LBH_
"
YÑúFø
RJLXFB_Ò<L>ÿRJnEgJnVCVCB%V^kFB

Mk
&
^Bù
e%JnSoXlBA k3ÿ@EF<tqjAW_cB_Îû<LE`Be%<L>MkFB

jkAC>c÷à<?EFûPJtk`A <?>Îk`fRJn>âk`f@B6ÿo<MXFXFA
@V B6X
j>@<L>
jûPX9kFfRJnk
EFBHXlS@V kZ÷àEF<?û E`<LS@>R_cùxk`EFACÿ3k`E`JL>RXlVWJtk`A <?>[jYÄBk`f@B%E`B÷à<?EFBXF<LS@N?f?kZk`<9B

jkFB%>o_
"
YÑúFø kF<3JL_cù
_cAk`A <?>RJnV^e%J?XlBHX"SRXFA >@N'Jn>PJnÿ@ÿREF<MJLegf
RJLXFB_9<?>PEF<?S@>R_jù¥kFE`A ÿ9k`E`JL>RXlVWJtk`A <?>PJn>R_PJû<?>@<LVCA >@ù
NLSRJLV
Ý>RNLVCACXFfkFB

Mke<?V VCBekFAC<L>[oú{k8AWX,XlkFEgJnACNLfMkl÷à<?EFiZJnEg_3k`<3<

@k`JnAC>
RJLe

+kFEgJn>RXFVCJnkFAC<L>RX
5
<L>Re%B'i/B'foJqLB'J
@ACV AC>@N?SRJnVk`B%E`û V AWXukHGJn>R_ÐAkAWXûSRegfÄBJLXFACB%EkF<<

ckgJnAC>ÄJÒVCJLEFN?B'JL>R_
EFBÿ@EFBHXlB>Mk`Jtk`A q?B
Ý>@N?V AWXFfkFB

jke<LVCVCBek`A <?>6kFfoJn>¸A k8i/<LS@VW_
^Bk`<ÒJLX`XFB%û
RV BJÒe<LûÿRJLE`Jnù
@V BJnû<?S@>Mk<n÷,ÿoJnEgJnVCV BVÝkFB

jk'÷à<?E'BqLB%E

üVCJL>@NLSRJLNLB3ÿoJnACEkFfoJtkû9ACNLfMk
oB<n÷.AC>MkFB%E`BXlk[
YÑúFøù¥úub i=<?E
cXZJLX/ֈ<?V VC<ti.X

A q?B%>pJK?SRB%E

kFB%E`û

PJL>R_Ð<?>@B<n÷/AkgXkFEgJn>RXFVCJnkFAC<L>RX

?Gai/B9eJn>ü<

ckgJnAC>ÄJXlB%k<n÷
RJLe

3kFEgJn>RXFVCJnkFAC<L>RX
@<?EÉBHJLegf
RJ?e

kFEgJn>RXFVCJnkFAC<L>

lGtXlBHJnEgegfkFf@B/û<L>@<?V AC>@NLSoJnV
Ý>@N?V AWXlfk`B

jkÝe<?V VCBekFAC<L>
k`<P<

ckgJnAC>JXFBk.<L÷$XFB%>MkFB>ReBHXde<L>MkgJnAC>@A >RN

l[
6B%E`NLBJLV V×k`f@BXlB>MkFB%>oeBXZ<L÷$JLV V×k`f@B
RJLe

3kFEgJn>RXFVCJnkFAC<L>RX=k`<
RS@A VW_JXlB>?k`B%>Re%Bÿo<j<LV
"
÷äk`B%EEFBû<tqMAC>@N,XlkF<?ÿji=<?E`_@XG%XFB%VCBekÉE`B%ÿ@E`BXFB%>Mk`JnkFACqLBk`B%E`ûXÉ÷àE`<Lû kFf@BZXFB%>MkFB>ReB=ÿo<j<LV
ÒSRXFA >@N

ÐX`egf@Bû9B?[RO.BEFB

ÐAWX._cB
>@B_6J?XZkFf@B÷àEFBHK?SRB%>Re

+<n÷$kFfRBkFBEFû
Jnÿ@ÿ^BJLEFAC>@NüA >

Jn>R_

ACX'k`f@BA >jqLBE`XFAC<L><L÷_c<ceSRû9B>Mk'÷àE`BKMS@B>Re

?G"idf@ACegf ACX
_cB
>@B_ÄJLX8f@<ti ûPJn>
6XlB>MkFB%>oeBXe<?>Mk`JnAC>@AC>@N3k`f@B'kFB%E`û <LS@k8k`f@B%E`BAC>¸k`f@B'idfR<LVCB
kFB

Mke<?V VCBekFAC<L>
[×öZf@BXlBV BHek`A <?>ÐJnVCNL<?EFA kFf@û AWX.k`S@>@B_¸kF<XlBV BHek,k`B%E`ûPX.k`fRJtke<Lù
<ce%eSREXlfoJnE`ÿ@V
ÄA >ük`f@B+e<?>MkFB

jk<L÷/k`f@BXFB
RJ?e

¸kFEgJn>oXlVWJtk`A <?>RX%GÝý¶idf@AWegfÛA >Re%V So_cBLGÉ<n÷
e<?S@E`XFBLG^k`f@B3KMS@B%E

6kFBEFû

þG×kFfjSRXÿREFB%÷àB%E`EFAC>@NÒkFB%E`ûPXkFfRJnke<nù{<ce%e%S@EidAk`f

PkFfRJnk
JnE`BXuk`EF<?>@NLV
PEFBVCJnkFBH_3k`<9ûPJL>
3kFEgJn>RXFVCJnkFAC<L>RXZ<L÷

hjBJLE`egf¸kFf@B9û<L>@<?V AC>@NLSoJnV
'
Ý>@N?V AWXlfk`B

jke<?V VCBekFAC<L>6k`<+<

@k`JnAC>ÄJÒXlB%k<L÷=XFB%>MkFB>ReBHX
e<?>?kgJnAC>@AC>@N9kFf@BKMS@BE
Pk`B%E`û

%
,XFB.k`f@B8XFBk/<n÷e<?>?k`B

jk=i/<LEg_@Xk`<EgJn>
+
kFf@BXlB>MkFB%>oeBX/e<?>Mk`JnAC>@AC>@N

MGMJL>R_ÿ@AWe

S@ÿ
kFf@Bk`<Lÿ<L>RBJ?X/kFf@B
YÑúFøù{úub B

@Jnûÿ@VCB÷à<LE
?[
]8S@EA >@A kFAWJnVZk`BXlkFAC>@NüA >R_@ACeJtkFBH_k`fRJtkk`f@ACXPJLÿ@ÿ@E`<?J?egfÎe<?S@VC_ NLB>@B%EgJtk`B+E`BJ?Xl<?>RJ

@VCB
B

@Jnûÿ@VCBXÒ<n÷SRX`JnN?B¸ûSoegf<n÷k`f@BÐk`A ûB
<?S@EÒAàø/T
 !
pB

cÿ^B%E`A ûB%>MkgX+ÿ@E`<tqjAC_@B_
<LS@E
EgXuk<Lÿ@ÿ^<LEFkFSR>@Ak
âk`<kFE

ÑA kAC>k`f@Büe%<L>MkFB

jk<L÷Jn> B

jkFE`A >RXFAWeÎýäkgJLX
Mù{e%B%>MkFBEFBH_Rþ
B%qtJnVCSRJtk`A <?>[

1:;H2 9C&
YÄB÷à<LVCVC<ti=BH_PkFfRBXlk`JL>R_@JLE`_PÿREF<LkF<ce<?Vo÷à<?EZAäø/T
!
B

cÿoBEFACûB%>Mk`X[@hjBJLE`egfRB%EgXi/B%E`B
XlBHK?SRB%>MkFAWJnVCV
PN?A q?B%>3BA N?fMk=k`<Lÿ@AWe%Xý¶Xlk`JnkFBH_+AC>
>@NLVCACXFfoþG?÷à<?S@EZSRXFA >@N'kFfRBûPJL>MSoJnVae<?>R_cA ù
kFAC<L>G^Jn>R_Ò÷à<LSRE,SRXFA >RNkFf@BJLSckF<?ûPJtkFAWee<?>R_cA kFAC<L>[
&
ÝE`BXFB%>Mk`JnkFAC<L><LEg_cB%Ed÷à<?EdkF<?ÿ@AWe%X.JL>R_
X

cXlkFB%û i/J?XqtJnE`A BH_'X
cXuk`B%ûPJtk`ACeJnVCV
J?eE`<?X`XXlBHJnEgegf@B%EgXJLX"XFÿoBHeA
B_9AC>'k`f@Bdk`E`J?e

NLS@AW_cB%ù
V AC>@BX[
"
÷äk`B%EJL>'AC>@A kFAWJnVck`E`JLA >RA >@NXFBX`XlAC<L>GHk`f@B

'i=BEFB/NLACqLB>
8
,ûAC>MS@kFBX$÷à<?E"BJ?egf9XFBJLE`egf
kF<¸AW_cB%>Mk`A÷
üEFBV BqtJn>Mk'_c<ceSRû9B>Mk`XSoXlAC>@NkFfRB+EgJL_cAC<
@SckFkF<L>oXÿ@E`<tqjAC_cBH_Ä÷à<LEk`fRJtkÿRS@Elù
ÿo<MXlB8A >Ò<LS@E/SRXFB%E/A >MkFBEl÷¶J?eB?[MöZf@BXlBHJnEgegf@B%EgXÝi/B%E`B,J?X

?B_k`<B%ûÿ@foJLXFA mB,ÿ@E`Be%ACXFA <?>3<tqLBE
EFBHe%JnVCVý
kFBV VCA >RNk`f@B%û k`fRJtkZA kZiZJLX=û<LE`B,ACûÿo<?ElkgJn>Mk=k`fRJtk/kFfRB_c<ce%S@ûB%>Mk=k`fRJtkZk`f@B

XlBV BHekFBH_
oB.kFE`S@V
'EFBV BqtJn>Mk"kFfRJL>kFfRJnkÝkFfRB

>R_PBqLB%E

ÿ^<?X`XlA
@VCBdEFBV BqtJn>Mk_c<ceS@ûB>?kþ[
YÄB6JLX
LBH_BHJLegf XFBJLE`egfRB%E'kF<
VCVd<LSck
@E`A B%÷KMS@BHXuk`A <?>@>RJnACE`BX
oB%ֈ<LE`B+k`f@B
EgXuk3XFBJLE`egf
ýä÷à<LEP_cBû<LNLEgJnÿRf@ACe+_@JtkgJ?þG"Jn÷äkFB%EBHJLegfÎXFBJLE`egfG$Jn>R_ Jt÷äk`B%ESRXFA >@NÄBJ?egfÎX

cXlkFBû[
=JLegf
XlBHJnEgegf@B%ESRXFB_ÄkFfRB3XFJLû9BPX
cXuk`B%û JnkJ6_cA

×B%E`B%>Mkk`A ûBLGÉXl<i/BPi=BEFBPJ

RV B9kF<6<
!
RXFB%E`qLB
BJLegfÎA >R_@A qjAW_cSRJnVCV
ÎJn>R_ÎûPJ

LBÒB

jkFB>RXFA q?BÒ<
!
RXlBEFqtJnkFAC<L>RJLV>@<LkFBX[YÄB6JLVCXF<Äe%<L>R_cSoekFBH_
JÐXFB%ûAùXlkFE`SRek`S@EFBH_ÛAC>?k`B%E`qjA Bi:ýàAC>Îidf@AWegfÎi/B3kgJnACV <?EFBH_Û<LSRE9KMS@BHXuk`A <?>RX
oJLXFB_Û<?>Î<LSRE
<

RXFB%E`qtJtkFAC<L>oX`þ=Jt÷äk`B%E.JnVCVUXFBJLE`egf@BHX/i=BEFBe<?û9ÿRV B%kFB_[
YÄB+e%<L>R_@SRek`B_J¸XFûPJnVCVÿ@ACVC<nk9XlkFSo_
ÄidA kFf J¸XlAC>@N?V B+XFBJLE`egfRB%E3ýàSRû_

?þkF<¸B

cB%EFù
eAWXlB9<LS@E>@Bi X
cXuk`B%û Jn>o_ÐE`B
>RB'<?S@E_@JtkgJÒe%<LVCV BHekFAC<L>Äÿ@E`<je%B_cSREFBHX%[
ÝACNLfMkXlBHJnEgegf@B%EgX
ýàS@ûP_
+
8
ù{S@ûP_
+
'
Mþdk`f@B%>üÿoBEl÷à<?EFûBH_6kFfRB9B

cÿoBEFACûB%>MkSoXlAC>@NkFf@BBA N?f?kFù{XFS
+
csuBHek_cBXFA N?>
Xlÿ^Be%A
BH_¸AC>¸k`f@Bk`E`J?e

N?S@AW_cB%VCA >RBX[

YÄBXlS
@ûAkFkFB_ÄJnVCVB%ACNLfMk8E`S@>RX9ýàS@ûP_
+
8
ù{S@ûP_
+
'
÷à<LEdSRXFBA >Ò÷à<LE`ûA >RN9E`B%VCB%qtJL>ReBÿ^<M<?VCX[
C,/-: .
YÄB9egf@<?XFB
>@NLVCACXFf¸JLX.kFf@B9KMS@B%E

ÒVWJn>RNLSRJLNLBJn>o_ÐhjÿRJL>@ACXFf¸JLX.kFf@B9_c<ceScù
û9B>Mk/VWJn>@N?SRJnN?BL[MöZf@BhcÿRJn>@AWXFfÒ_c<ceSRû9B>MkZe%<LVCV BHekFAC<L>Òe<L>MkgJnAC>@B_

8

G

'
>@Bi.X=XlkF<?EFBHX
÷àEF<?û
'

,B%i.X
"
NLB>Re

?[@YÄBSRXlBH_kFf@B9hjÿRJn>RACXFfcù¥kF<nù
Ý>RNLVCACXFf+k`E`JL>RXFVCJnkFAC<L>RXZÿ@E`<tqjAC_@B_
k`f@BAàø/T

Ò<?EFNMJn>@ACm%BE`X^÷à<?E$e%<L>RXlkFE`SRekFAC<L><n÷R_@<je%S@ûB%>Mk$XFS@E`EF<?N?JnkFBXaJL>R_÷à<?EUqjA BidA >RN
kFf@B÷àS@V V_c<ceSRû9B>Mk,kFEgJn>oXlVWJtk`A <?>RX%[^öZf@Bk`E`JL>RXlVWJtk`A <?>RX.i/B%E`BeE`BJnkFBH_

SRXFA >RNh
cXlkFEgJn>
ÝE`<n÷àBX`XFA <?>RJnV
@[
@[
YÄB<

@k`JnAC>@BH_¸<LSREhcÿRJn>@AWXFfcù
>@NLVCAWXlf
@A VCAC>@NLSRJLV$kFB%E`û VCACXlkA >ü<LSREVWJ

U[aú{ke%<L>Mk`JLA >oX
(
RG

'
i=<?E`_RXJn>o_pi/J?X'e%<L>RXlkFE`SRek`B_ü÷àE`<Lû ûSRVk`A ÿ@VCBXl<?S@E`e%BX
&
)
{[$YÄBSRXFB_pk`f@B+ú>cù
"
8S@B%E

@S@ACVkFù¥AC> hcÿRJn>@AWXFf XlkFB%ûûB%E9k`<üXlkFBû
o<LkFf kFf@Be<?V VCBekFAC<L> JL>R_Ûk`f@B6hjÿRJn>RACXFf
kFEgJn>RXFVCJnkFAC<L>RX<L÷=k`f@B
Ý>RNLVCACXFfüKMS@BEFACBX[É]8S@E
YÑúFø\kFBHegf@>@AWKMS@BXPýxe%JnVCVCB_
FX`Jnûÿ@VCBSRXuù
JnNLBHX
AC>Pk`f@B
$
¸úub
"
ø/T

X
cXuk`B%û ÷à<LE=BJ?X

9S@>R_cBE`Xlk`JL>R_cAC>@N
9kFf@BXlBHJnEgegf@B%EgXgþ$EFBHK?SRA E`B
ÿRJnEgJnVCV BVhjÿoJn>@AWXlf
+
Ý>RNLVCACXFfÑkFB

jk`XJn>R_ J

@ACNÎû<L>R<LVCA >@N?SRJnV
Ý>RNLVCACXFf e<?V VCBekFAC<L>[/YüB
<

ckgJnAC>@B_ÄkFfRB
E`Xlk<L>@B÷àE`<Lû kFf@B
R<LE`B%ACNL>p;=E`<?J?_@e%J?Xukú>c÷à<?EFûPJtk`A <?>phcB%E`qMAWeB6ý
$;/úlh@þ
öZúuD

/hÒ_RJtk`JP_@ACX
×G@EFBV BHJLXFB
cGRJL>R_ÒkFf@BXFBe%<L>R_<?>@B÷àEF<?û kFfRBödD8ö/ù
(
3e<?V VCBekFAC<L>
Ý>@ù
NLVCACXFf>@Bi.XÿRJnEFkGidf@AWegf9i/J?X$e%<LVCV BHek`B_JL>R_'EFBV BHJLXFB_
TUA >@N?S@AWXuk`ACe/D8Jnk`Jø=<L>oXl<?Elk`A S@û
ýàfMklk`ÿ
+2+
ididi[ VC_Ren[ S@ÿoB>@>[ B_cS^þ[
67C/-:;
YÄBÒe<Lûÿ@S@kFB_ük`f@BP÷à<?V VC<tidA >RNûBHJLXFS@EFBHXA >Û<?E`_@B%EkF<6NMJnAC>pA >RXFACNLfMkA >Mk`<
XlBHJnEgegf

^B%fRJqjAC<LEdJn>R_XFBJLE`egfÒEFBHXlS@V k`X

-0/214365 7
LG×JLX8_cB
>@B_6AC>6k`f@Bk`E`J?e

ÒN?S@AC_@B%VCA >@BHXý¶idAk`f
FXF<LûBidfRJtk,E`B%VCB%qtJL>?k
P_c<ceScù
ûB%>Mk`XkFE`BJtk`B_J?Xa>@<nk$EFBV BqtJn>Mkgþ[YÄB=EFB%÷àB%Eak`<dkFfRACX$e<?>R_cA kFAC<L>JLX
FXlkFE`ACek
5
ZE`B%VCB%qtJn>Re%B
suSR_cN?û9B>Mk`X[RöZf@AWXdqtJnVCS@Bi/J?Xde<Lûÿ@S@kFB_Jtkdk`f@BB%>o_Ò<L÷ÉBHJLegfXlBHJnEgegfÒXFBX`XlAC<L>[
-0/214365 7
LG
)
@SckidA kFf
`Xl<?ûB%idfRJnkEFBV BqtJn>Mk
5
Ä_c<ceS@ûB%>MkgXk`EFBHJtkFBH_JLX'E`B%VCB%qtJn>Mk[$YüB
EFB%÷àB%EkF<k`f@ACXe%<L>R_@Ak`A <?>ÄJLX
9
FV <j<?XFB
C
+EFBV BqtJn>Re%B,suSR_@NLûB%>Mk`X[öZf@AWXqtJnVCS@B'iZJLXJLVCXF<
e<?û9ÿRSckFBH_+÷à<?EdBJ?egfXFBX`XlAC<L>U[
öZf@BkF<Lk`JLVa>MSRû
^B%E.<L÷$KMS@B%E

3A kFBE`JnkFAC<L>RX/÷à<?EdBJLegfXlBHJnEgegf[
öZf@B
-
2û9BHJLXFS@E`B6ACX3JL> <LSckge<LûB¸ûBHJLXFS@EFB
Ake%Jn>R>@<nkPk`B%VCV,SRX+idfRJtk+foJnÿ@ÿ^B%>@BH_
JnVC<L>@Nk`f@B.iZJ
L[nYüBdkFfRB%E`B÷à<LE`B.JnVWXF<SoXlBH_+ø/JnûkgJLXFACJhjkFSR_cAC<+ý¶ididi[ k`BegfRXFûAk`f[ e%<Lû3þ$k`<
EFBHe<LEg_Pk`f@BXFBJnEgegf@BE

X=J?ek`A qjA kFACBX._cSREFAC>@NBJ?egfXFBX`XlAC<L>U[


1/84EC
6@:;. )1: . )6@:;67. :;.
öZf@B%E`B6i=BEFB÷à<?S@E3÷àBûPJnVCBÐJn>R_ ÷à<?S@E+ûPJnVCB¸XFBJnEgegf@BE`X[
],kFf@BEFidAWXlB?GkFf@B.XFBJLE`egfRB%Eÿo<?ÿ@S@VWJtk`A <?>9iZJLX$E`B%VWJtk`A q?B%V
f@<Lû<?NLB%>RB%<LSoX%[nhjÿ^Be%A
eJnVCV
?Gn<LSRE
XlBHJnEgegf@B%EgXi/B%E`B

+8/-.6@C+
hjA

<n÷×k`f@B.B%ACNLfMk=XFBJLE`egfRB%EgXÉi/B%E`BdB%A kFfRB%EB>@E`<LVCV BH_'AC>+J
¸J?Xuk`B%EgX"ÿ@E`<LN?E`JLû
<LE'fRJL_JLV E`BJ?_
ÐBHJnE`>@B_ÛJnkVCBJLXlk9J¸ûJ?Xuk`B%EgX_cBNLE`B%B?[UöZf@B+E`B%ûPJLA >@AC>@N6kui/<¸i/B%E`B
<L>@BS@>R_@B%E`NLEgJL_cSRJnkFB,XlkFSo_cB%>Mk/kFfRJnkZiZJLX=>@BHJnE/NLEgJL_cSRJnkFAC<L>3JL>R_3<?>@B8ÿ^B%EgXF<L>3idA kFfJ
;ZJLegf@BV <?E`XZ_cBNLE`B%BL[
Çtzzu
 
zu`läÔ y|àÔ ~?wM@Ô `y

%| Ë^ÌUÍ

H%HHÈ

%~?|?g|wMgygÔ Çtzu
6@C/-:;
öZf@BJq?B%EgJnN?B,JnN?B8<tq?B%EdJnVCVaB%ACNLfMk.XlBHJnEgegf@B%EgX=i/J?X
!
@GjidA kFfkFf@B
?<LS@>RNLBXlkZ<n÷
8
Jn>o_3k`f@B<LVW_cBXlk.<n÷
0(
[

1:;8. +AC6@:;. ):;
ÉACqLBZ<L÷@kFf@BdBA N?fMkXFBJLE`egf@BE`XUf@B%VW__cB%N?EFBBXÉA >9VCA
@EgJnE

X`eA ù
B%>Re%BL[×öZf@B'XFBJLE`egfRB%EgXdEFBÿo<?Elk`B_6JL>¸JqLB%EgJnN?B<n÷J

^<LS@k
?BJnEgX.<L÷"<L>cù{V AC>@B9XlBHJnEgegfcù
A >RN6B

cÿoBEFACB%>oeBLGaidA kFfJûAC>@A û'S@û2<n÷
?BJLE`XJn>o_ÄûPJ

jACûSRû:<n÷
8

LBHJnEgX%[
"
V V
XlBHJnEgegf@B%EgX'EFBÿo<?Elk`B_ÛB

Mk`B%>RXFACqLBB

cÿoBEFACB%>oeBidAk`f YüB

XFBJnEgegfÎXFB%E`qjACe%BXGJL>R_ÎJLV V
EFBÿo<?Elk`B_JnkVCBJLXlk9XF<LûBÒB

cÿoBEFACB%>oeB+XFBJLE`egf@AC>@N¸e%<Lûÿ@Sck`B%E`A mB_ÛVCA
RE`JLE
pe%Jnk`JnVC<LNMX
ýàEgJn>@N?A >RN+÷àE`<Lû
FXF<LûB
C
+kF<
A
FJN?EFBHJtk_cBJLV
!
Mþ[UhjBqLB%>ü<n÷/kFfRBPB%ACNLfMkEFBÿo<?Elk`B_ÐkFfRJnk
kFf@B

ÒXFBJLE`egfJtk.VCBJLXlkd<L>Re%B<LE/kuidACe%BJ_@J
L[
-
1:;8. +

E )067. )-GC: 6 -46@,
hjBqLB%>ü<n÷/kFfRBPB%ACNLfMkXlBHJnEgegf@B%EgXEFB%ù
ÿo<?Elk`B_ >@B%q?B%E+foJqMAC>@NoG=<?EÒfRJqjAC>@NÎ<?>@V
XF<LûB?G=B

jÿ^B%E`ACB%>Re%BÐidA kFf Jn>
ûPJ?egf@A >RB
kFEgJn>RXFVWJtkFAC<L>Xl<L÷äkui/JLEFB,<LE/÷àEFBB8YüB

k`E`JL>RXlVWJtk`A <?>+XFB%E`qMAWeBHX%[jöZf@BE`B%ûPJnAC>@AC>@N'<?>@BEFB%ù
ÿo<?Elk`B_fRJqjAC>@NPû<LE`BkFfoJn>
<
FXF<LûBB

jÿ^B%E`ACB%>Re%B
C
PidA kFf6ûPJLegfRA >@BkFEgJn>RXFVCJnkFAC<L>6XF<n÷äklù
i/JLEFB<LE.XFB%E`qjACe%BX[
,

-:;

,/8 /-+-
F6@: C.
F672
.<?>@BZ<n÷^kFf@BdBA N?fMk"XFS
+
csuBHekgX"fRJL_'ÿ@E`B%qjAC<LSRXFV
ÿRJnEFkFAWeACÿRJnkFB_ÒAC>Jödb
&
ZøÑ<?EZ<LEdAàø/T

ÎXuk`SR_
L[
6@C

&
-4 )
6

&1:;
"
VCV@BA N?f?k"XFBJnEgegf@BE`XÉi=BEFB/>RJnkFACqLBZXlÿ^BJ

LB%EgX$<n÷
Ý>@N?V AWXlfU[
,

441+A<
F67- )
ÉACqLB<n÷UkFf@BB%ACNLfMkdXlBHJnEgegf@B%EgX"E`B%ÿ^<LEFkFB_+>@<9EFBHJL_cAC>@NX
jA VCVCX
A >¸hjÿoJn>@AWXlf6JnkdJLV V¥[
"
>R<nkFfRB%Edk`f@EFBBEFBÿo<?Elk`B_Òÿo<j<LEdE`BJ?_cAC>@N9X
jA VCVWXdA >6hjÿRJL>@AWXlf[
C/84E

,&:*:;14

767-.

/-+8&012
]8SRE"<
3eAWJnVcE`BXFS@V k`X"JnE`B
RJLXFB_'<L>'kFf@B
- /21435 7
qJLV SRBXdJqLBE`JLNLBH_P<tqLBEZJLV VXFBJLE`egfRB%EgXk`fRJtk.EgJn>BJ?egfÒe%<L>R_cA kFAC<L>U[@YÄBSoXlBidfRJnk.i=Be%JLV V




#



?GLA¥[ B?[ GnkFE`BJtk`A >RN
9
`Xl<?ûB%idfRJnkE`B%VCB%qtJL>?k
JLX
lACE`EFBV BqJL>Mk
5
8A >9kFfRB.e%JnVWeSRVCJnù
kFAC<L><n÷aÿ@E`Be%ACXFA <?>9JL>R_9EFBHe%JLV V¥[nYüBd÷à<LS@>o_k`fRJtkkFf@B.ûPJL>MSoJnV@Jn>o_PJnSck`<LûPJtk`ACeZe<?>R_cA kFAC<L>RX
JLegf@ACB%q?B_q?B%E

p>@BJLEFV
pkFf@B6X`JnûBqJLV SRBÒ÷à<?E9kFf@AWXûBJLXFS@E`BÒidfRB%> Jq?B%EgJnN?B_p<tqLBE9JLV V
B%ACNLfMk8k`<Lÿ@AWe%XPý
@[


3JL>R_
R[

8
(
RG^EFBHXlÿ^BekFACqLB%V
@þ[

@<?Ee<LûÿRJLEFAWXF<L>G^i=B9E`Be<?ûÿ@SckFBH_
kFf@BdX`JnûB=E`BXFS@V k`X$idA kFf



#



?GtAx[ BL[CGkFE`BJnkFAC>@N
9
FXF<LûB%idfRJnkÉE`B%VCB%qtJn>Mk
8J?X
FEFBV B%ù
qJL>Mk
5
A >9k`f@B.e%JLVCe%S@VCJnkFAC<L>[
"
N?JLA >Gk`f@B,_cA
×B%E`B%>Re%B/AC>PJqLBE`JLNLBqtJLV S@BHX$÷à<LE
-/21435 7
J?eE`<?X`X
JnVCV$BA N?fMk,kF<?ÿ@AWe%X
/
oB%kui=BB%>6k`f@B9kui=<e<?>R_cA kFAC<L>RX8ACXXFûPJnVCV/ý
@[

8
÷à<LEûPJn>jSRJLVxG
@[
'
÷à<LE.JnS@kF<LûPJnkFAWeþ[
"
e%e%<LEg_cAC>@Nk`<PYÑA VWe<
c<?>XFA N?>cù{E`JL>
+
kFBHXukHG@>@B%A kFfRB%E.<L÷UkFfRB_cA

×B%E`B%>oeBX
ACX.Xlk`JnkFAWXuk`ACeJnVCV
ÒXlACNL>@A
eJn>Mk[
T<j<

jAC>@N3Jtk.k`f@BE`BXFS@V k`X
&
ÒkF<?ÿ@ACe+ý¶XFB%B
$ACNLS@E`B
LþGo<?>@V
öU<?ÿ@AWe
B

cf@A
@A k`X8J3eVCBJLE
_cA

×B%E`B%>oeB
^Bkui/B%B>6kFfRB
- / 1 35 7
'qtJnVCS@BX.÷à<LE8kFf@B'ûJL>jSRJnVJn>R_ÐJnSck`<LûPJtk`ACee%<L>R_@Ak`A <?>RX%G
Jn>R_ü<L>RV
¸idA kFfXlkFE`AWekE`B%VCB%qtJn>Re%BsuSR_cNLûB>?kgX%[ÉöU<?ÿ@ACe
AWXJ

^<LS@kkFf@BPBHe<L>R<LûACe9ÿ^<LVCAù
eACBX=<n÷akFfRB
/
REFB>Regf3ÿ^<LVCAk`ACe%ACJL>
_@<LSRJLE`_;ZJnVCVCJ?_cS@EH[?ú{k/i/J?X>RB%A kFf@BEk`f@B,k`<Lÿ@AWedk`fRJtk/kFfRB
XlBHJnEgegf@B%EgX=÷àB%V k.i/J?XZû9<MXuk,_@A
3eSRVkHGR>@<?EZkFf@Bk`<Lÿ@AWekFfRJnkdkFf@B

3÷àBVk,iZJLXZBHJLXFA BHXukH[cYÄB_@<
>@<nk9ÿ@EFBHXlB>MkFV
üfoJqLB3Jn>ÎB

cÿ@VWJn>RJnkFAC<L>Û÷à<?EkFfRACX9B

×Bek[öZf@B+E`BJ?Xl<?>pkFfRJnkk`f@B%E`B+AWX>R<
_cA

×B%E`B%>oeB<L>üöU<?ÿ@ACe
(
ACXk`fRJtkJLV Vk`f@BPXlBHJnEgegf@B%EgX,_cAW_Ä>@<nk
>R_pJL>
6<
3eAWJnVEFBV BqtJn>Mk
_c<ceS@ûB%>MkÝAC>
o<LkFfPe<?>R_cA kFAC<L>RXGLJLVk`f@<LS@N?f9kFf@B

ûPJnE

LBH_'XFB%q?B%EgJnV¥[n]8>RBdÿo<MXFXFA
RV BdB

jÿRVCJnù
>RJtk`A <?>9AWX"k`fRJtkkFf@BEFB.JLEFBd<?>@V
<
3e%ACJLV@EFBV BqtJn>Mk_c<ceS@ûB>?kgX"AC>kFf@B.idfR<LVCB,e<?V VCBekFAC<L>
<n÷
8

G

'
_@<je%S@ûB%>Mk`X[
hjA ûACVCJLE,qtJnVCS@BHX,<L÷
-0/214365 7
'eJn>¸ûPJLX
<

aXlB%klkFAC>@N_cA

×B%E`B%>oeBX8AC>Ðÿ@E`Be%ACXFA <?>¸Jn>R_¸EFB%ù
e%JnVCV¥GMXF<i/B8JnVWXF<B

@JnûAC>@B_3ÿ@EFBHeAWXlAC<L>3JL>R_PE`BeJnVCVoXFB%ÿRJLE`JnkFB%V
L[
"
X
$A N?S@EFB
/
ACV VCSRXlkFEgJtk`BXG
ÿ@EFBHeAWXlAC<L>¸XFB%BûPX.k`<
oB9û<LE`BXFB%>RXFAk`A q?BkF<+kFf@B'ûPJn>jSRJnV
+
tJLSckF<?ûPJtkFAWe_cAWXlkFAC>Rek`A <?>6kFfRJL>
EFBHe%JnVCV¥GnidAk`fPkFfRB,ÿ@E`Be%ACXFA <?>9÷à<LE=öÉ<LÿRACe
Xuk`EF<?>@NLV
÷¶Jq?<LE`A >@Nk`f@B,ûPJn>jSRJLVRe<?>R_cA kFAC<L>3JL>R_
-0.1
-0.05
0
0.05
0.1
0.15
12345678
Topics
strict relevence
loose relevance

Ã

=Ö?yH~?zu/|Luggwtz|w9æ çLèRé`ê ë CuH zuÇ?/%wL~M@gwj?|}zu|HwRÔ
%
%uy=Öc/zuÇ?=Æ
ÆL|yaWHUzuÇM%wL~Mngwj?|}zu|HwRHÖc`ÅÐä%UzuÇ?Ý~LzuH%zu|`HwjL|}zu|woÔËotHy

¥~j?gwtzuy
zug%zá¥y`ÅÝÇjzu``H%wnzuãy"uggwtzÔ
kFf@B=ÿ@EFBHeAWXlAC<L>÷à<?EÉöÉ<Lÿ@AWe
#'
ý
%
XFf@AC>@N,KMS@<Lk`JLXgþaXlkFE`<L>@N?V
,÷¶JqL<?EFAC>@N/kFf@B/JnSck`<LûPJtk`ACee<L>@ù
_cAk`A <?>[M]8>9kFfRBd<nkFfRB%EÝfRJL>R_aGtE`BeJnVCVcACXÝXF<LûBidfRJtkÝXFB%>RXFAk`A q?BZkF<k`f@BdûPJn>jSRJnV
+
tJLSckF<?ûPJtkFAWe
_cACXlkFAC>RekFAC<L>÷à<?E$öÉ<LÿRACeX
8
ý¶öZf@B
"
ûBX$BHXlÿ@AC<L>oJnNLB=e%JLXFBHþUJn>R_
ý
BEFûPJL>
"
E`ûB_
R<LEgeBHX
<LSckFù¥<L÷äù{JLEFBHJ?þGoA >
o<LkFfÄeJLXFBX,÷¶JqL<?EFAC>@NkFfRB'ûPJn>jSRJLV$e%<L>R_@Ak`A <?>[×hcA >Re%B'i/Bi/<LSRVC_6>R<LEFù
ûJLV V
3B

jÿ^BekdEFBHe%JnVCVaJn>R_Òÿ@E`Be%ACXFA <?>3k`<9egfRJL>@NLBAC>Ò<?ÿ@ÿo<MXlA kFB_cACE`Bek`A <?>RXGjöÉ<LÿRACeX
JL>R_
'
Äý¶idf@ACegfpeVCBJLEFV
6VWJLe

kFfRACXB

^BHekgþJL>R_aG×kF<6XF<LûB_cB%N?EFBBLGaöU<?ÿ@AWe
cG_cBXFB%E`qLB÷àS@Elk`f@B%E
B

cÿ@VC<LEgJtkFAC<L>U[
]8>@BA >MkFBEFBHXuk`A >RNe%<LûÿRJLEFAWXl<?>Ði/BPe%Jn>p_cEgJi AWX
oB%kui=BB%>ÄkFf@AWX
?BJnE

X8E`BXFS@V k`XJL>R_
kFf@<MXlB=÷àEF<?û VWJLXlk
)
?BJnEH[
"
V kFf@<?S@NLf'kFf@BEFBZAWX$VCJL>@NLSRJLNLB/_cA

×B%E`B%>oeBýxhjÿoJn>@AWXlf9qcX
B%E`ûJL>oþG
kF<LÿRACeZ_cA
^BEFB>ReBý¶<L>@BZ<L÷RkFfRACX
?BJLE

XÉkF<LÿRACe/<L>RV
foJLX
EFBV BqtJn>Mk_@<je%S@ûB%>Mk`X,ý¶öÉ<Lÿ@AWe
(
MþG
Jn>@<LkFf@BEfRJLX
8
'
8
EFBV BqJL>Mk_c<ce%S@ûB%>Mk`X3ýxöU<?ÿ@AWe
'
MþlþGUJn>R_üXF<LûBPXlûPJnVCVÝX
jXlkFBû:_cA
^BElù
B%>Re%BXGtAk"AWXA >MkFBEFBHXuk`A >RN8k`<>@<nk`B=k`fRJtk"VWJLXlk
LBJLE

X$XlBHJnEgegf@B%EgXÉJ?egf@ACB%qLBH_
-/ 1 35 7


(
%%
÷à<LE8kFf@B'ûJL>jSRJnV$e<L>o_cAk`A <?>G×Jn>R_
R[
!
8
÷à<LE.k`f@B'JLSckF<?ûPJtkFAWee%<L>R_@Ak`A <?>[^öZfRBûPJn>jSRJLV
e<L>o_cAk`A <?>6kFfjSRXJLegfRA BqLB_6J
(
'

ACû9ÿREF<tq?B%ûB%>Mk,AC>
- / 14365 7
'<tqLB%E.kFf@B9JnSck`<LûPJtk`ACe'e<L>@ù
_cAk`A <?>A >VCJ?Xuk
?BJnE

X=B

cÿoBEFACûB%>MkG
@S@k.i=B<L>RV
+X`Ji J
8

ACû9ÿREF<tq?B%ûB%>Mk/kFf@AWX
LBHJnEH[
TUJLXlk
LBHJnEHGMXFBJLE`egf@BE`X=i/B%E`BJLV VC<ti=BH_

'ûA >jSck`BX/÷à<?EdBJLegf+kF<?ÿ@ACe
kFf@AWX
LBHJnE/kFfRB

3i/B%E`B
-0.6
-0.4
-0.2
0
0.2
0.4
0.6
12345678
Topics
precision
recall

Ã

=ÖMy~?zuÝ|?uggwtza|wLugg|y|HwwMug%?CuHÑzuÇ?%wn~jLgwj?|}zu|HwRy{zu|`z
¥~jLHggwtzÔ
%
%uya%ÖcUzuÇ?UÆd%ÆL|yoä%×zuÇM%wL~M`HwjL|}zu|woÖcgÅWH^zuÇ?$%~?zu%zu|
`HwjL|}zu|woÔ
JnVCV <ti/B_<?>@V
8
@[

B%E`fRJnÿoX"SRXFB%EFù{J?XFXFACXlkFBH_PKMS@B%E

9kFEgJn>RXFVCJnkFAC<L>3AWX=<n÷UN?EFBHJtkFBEqtJnVCS@BVCJnkFBE
A >ükFfRB+XlBHJnEgegfÐÿ@E`<ceBHXFXGJt÷äk`B%EXF<LûBP<n÷=kFf@B3û<?EFB<

jqjAC<LSRXiZJ
jX<L÷=÷à<?EFû'S@VWJtkFAC>@NkFfRB
K?SRB%E

3fRJqLBJnVCE`BJL_
+
oBB%>kFE`A BH_a[
/8: 9EC1:;6@, 67-6 4E
YüB<
!
ck`JLA >@BH_8kFf@B=>MSRû
^B%EU<L÷cAk`B%EgJtkFAC<L>oX×÷à<LEBHJLegfXFBJLE`egf
XlBHXFXFA <?>6kFfREF<?S@NLfÄV <?N
VCBPJn>RJLV
cXFACX[a]8>üJqLBE`JLNLBLG^XlBHJnEgegf@BX,A >ÄkFfRB9ûPJL>MSoJnVe<L>o_cAk`A <?>
B

cf@A
@Ak`B_÷àBi=BE,KMS@B%E

+A kFBE`JnkFAC<L>RXZk`fRJn>¸XFBJLE`egfRBX/A >k`f@BJLSckF<?ûJnkFAWee<?>R_cA kFAC<L>Ûý
R[


qjX
[
!
Lþ[TU<j<

jA >RNpJnkPA >R_@A qjAW_cSRJnVZk`<Lÿ@AWe%XGkF<?ÿ@AWe
(
ýxe<?û9ÿRSckFBE3Jn>@ACûPJtkFAC<L>^þfoJLX9kFfRB
VCJLEFN?BXlkJqLB%EgJnN?B=>jS@û
oBE<L÷Ak`B%EgJtkFAC<L>oX.ý
'
R[
þ$÷à<?E"kFf@BJnSck`<LûPJtk`ACe,e<L>o_cAk`A <?>Gn÷à<?V VC<ti/B_
3kF<LÿRACeX
8
ý
[
þ/Jn>R_
ý
[
?þGcidfRB%E`BJLX=k`<Lÿ@AWe
fRJLX/k`f@BVCJLEFN?BXlkZJq?B%EgJnN?B,>jS@û
^B%E
<n÷aAk`B%EgJtk`A <?>RX,ý

?þAC>PkFfRB,ûPJn>jSRJLVRe<?>R_cA kFAC<L>GL÷à<LVCV <ti/B_
'kF<LÿRACeX
(
R[
þ"JL>R_
'
(
o[
þ[
/-D
. 


CCH2
YüBÐJn>RJLV
jmB_ KMS@BXlkFAC<L>@>oJnACEFB6_@Jnk`JÛJn>o_ AC>MkFBEFqjACB%i EFB%ù
Xlÿ^<L>RXFBX8AC>ÄJn>ÐB

×<LEFk,kF<ÒS@>R_cBE`Xlk`JL>R_6f@<ti\ÿoJnEFkFAWeACÿRJn>Mk`X8B%ûÿ@VC<
LBH_kFf@BX
jXlkFBûPX8JL>R_
kF<
^BkFkFBEÒS@>o_cB%EgXukgJn>R_ÑkFf@BA EÒA ûÿ@E`BX`XlAC<L>oX+J

^<LS@k+kFfRBÄX
jXlkFBûPX%[/öZf@BÄXFBJLE`egf@BE`X3EFB%ù
0
1
2
3
4
5
6
7
8
9
12345678
Topics
auto
manual
Ã

=H`ldwL~?Öc`Ót~MF'|}zu`lzu|HwMygMÖtzuM|HÔ
ÿo<?Elk`B_ÄkFfRJnkkFfRB3ûPJn>jSRJnVÝJL>R_ÛJnS@kF<LûPJnkFAWePe<L>o_cAk`A <?>RXi/B%E`BBKMSRJnVCV
ÐBJ?X

¸kF<ÐXFBJLE`egf
idAk`fG
@Sck
^Be%JLSRXFBÝkFfRB/ûPJL>MSoJnVje<L>o_cAk`A <?>iZJLX$S@>R_@B%E$kFf@BA E"e%<L>MkFE`<LV¥G%k`f@B

foJL_J8û<LE`B
XFJnkFAWXu÷
jAC>@N<tqLB%EgJnVCV^B

cÿoBEFACB%>oeBS@>R_@B%EZkFfRACX.e%<L>R_@Ak`A <?>[
YÑf@B%>âk`JLV
jAC>@NÛJ

^<LSckk`f@B6EFBHJLXF<L>RX'÷à<?E3_cA
3e%S@Vk
>R_cAC>@NpE`B%VCB%qtJn>Mk3_c<ceS@ûB>?kgX%G
Jnû<L>@Nk`f@B8XFBJLE`egfRB%EgXSRXlAC>@NkFf@B.ûPJL>MSoJnVoe%<L>R_@Ak`A <?>G
-
FS@>c÷¶JLû9ACVCACJLE"kF<?ÿ@ACeX
Jn>R_

`K?SoJnV ù
Ak
3<L÷Uk`f@BkFEgJn>RXFVCJnkFAC<L>
i=BEFB8kFfRBû<MXukd<n÷äk`B%>ûB%>MkFAC<L>@BH_Äý
(
k`A ûBHXZBJLegf^þ[@öZf@BX`JnûB
NLB%>RB%EgJnVÿRJnklk`B%E`>6i/J?Xd<

RXFB%E`qLBH_+AC>6k`f@BE`BXFÿo<?>RXlBHXd<n÷ÝXFBJLE`egf@BE`XZSoXlAC>@NPk`f@B'JLSckF<?ûJnkFAWe
e<L>o_cAk`A <?>
@k`f@E`B%BûB>?k`A <?>RX.<L÷
*
uk`E`JL>RXlVWJtk`A <?>6K?SoJnVCAk
?G
9kui/<3ûB%>MkFAC<L>oX.<n÷
*
FS@>c÷¶JLû9ACVCACJLE
kF<LÿRACeX%G
Jn>R_+kui=<ûB%>Mk`A <?>RXZ<n÷
l>@<E`B%VCB%qtJn>Mk._c<ceSRû9B>Mk`XZE`BkFSREF>@BH_a[
@<LEKMS@BXlkFAC<L>oX,S@>RACKMS@B'kF<ÒkFf@B9ûPJn>jSRJLVe%<L>R_@Ak`A <?>G^JLV V<L÷ÝkFf@BXFBJnEgegf@BE`X,EFBÿo<?Elk`B_
kFfRJnkdkFf@B

+e<?S@VC_pýxXl<?û9BidfRJtkd<?E/q?B%E

@þ=e%<L>
_cB%>MkFV
+XFB%VCBek
+
E`B%û<tq?B.kFEgJn>oXlVWJtk`A <?>RX%GcJL>R_
JnVCVL<n÷ck`f@B%û÷àBVkÉkFfRJnkÉA kÉiZJLXÝýxXl<?û9BidfRJtkÉ<LEUq?B%E

@þ^SRXlB%÷àS@V?kF<,foJqLBkFfRB=J

RA VCAk
8kF<8û<j_@A÷
kFf@B/X

cXlkFB%û

X×kFEgJn>oXlVWJtk`A <?>XFB%VCBekFAC<L>RX[O,<ti=BqLBEGgk`f@B%E`BÝiZJLX>R<.eVCBJnEÉÿ@E`B÷àB%E`B%>oeBÝJnû<?>@N
kFf@BüJqJLA VWJ

RV B6AC>R_cAWe%JnkFAC<L>RXP<L÷kFf@BÐû9BHJn>@AC>@N<L÷BJLegf k`E`JL>RXFVCJnkFAC<L>[öZfREFBB¸XlBHJnEgegf@B%EgX
EFBÿo<?Elk`B_ÎkFfRJnkPkFf@B¸X
j>@<L>
VCACXlk3i/J?X9kFf@B6û<MXuk3SRXFB÷àSRV,eS@B?G"idf@ACV Bkui/<ÛXlBHJnEgegf@B%EgX
÷à<LS@>R_Òk`f@BB

@Jnûÿ@VCBXZ<L÷ÉSRX`JnN?BkF<
oBk`f@Bû<?Xlk.SRXFB÷àS@VýàkFf@E`B%Bi/B%E`B>@<nk,XFS@E`BHþ[
6<?Xlk=ÿRJLElk`ACe%A ÿoJn>Mk`X=EFBÿo<?Elk`B_3kFfRJnk=k`f@B

Pi/B%E`B,>@<Lk=÷¶JLûA VCACJLEZidAk`f3kFfRB8k`<Lÿ@AWe%XGMidAk`f
kF<LÿRACe
9fRJqjAC>@Nk`f@BNLE`BJnkFBHXukdE`B%ÿ^<LEFkFB_3÷¶JnûACV AWJnE`Ak
ÒJn>R_ÒkF<?ÿ@AWe
$'
9fRJqjAC>@N9kFf@BVCBJ?XukH[
6@:;. )C:;6@C
"
Vk`f@<LSRNLf9i=B/fRJqLB/>@<LkFAWeB_9eVCBJLE"_cA

×B%E`B%>oeBX
)
^Bkui/B%B>9XFBJLE`egf@BHX
ÿoBEl÷à<?EFûB_ S@>R_@B%EPk`f@B6ûPJn>jSRJnV.e%<L>R_@Ak`A <?> JL>R_ kFfRJL> SR>R_cB%E3kFf@B¸JLSckF<?ûJnkFAWe6e<?>R_cA ù
kFAC<L>G@i/BfRJqLB>@<Lk.>@<nk`ACe%B_Jn>
+e%V BHJnE._cA
^BEFB>ReBAC>6e<?>RXuk`EFSoekFAC>@N9kFfRBA >@A kFAWJnVÉK?SRB%E`A BHX
oB%kui=BB%>XFBJnEgegf@BHX<L>pk`f@B3kui/<¸e<?>R_cA kFAC<L>RX[ÉöZf@B+kFBEFûPX<L÷ZkFf@BÒA >@A kFAWJnV/KMS@B%E`A BHXi/B%E`B
û9<MXuk`V
'÷àE`<Lû kFf@B8ÿ@EF<tqjAW_cB_9k`<Lÿ@AWe.Xlk`JnkFB%ûB>?kHGLf@<ti/B%q?B%EHGLXF<LûB.B

jk`E`Jk`B%E`ûX=i/B%E`BdSRXlBH_
÷à<LEqtJnE`A <?SRX9EFBHJLXF<L>RX[
)
R<LEB

@JLû9ÿRV B?G
FXFÿ
@
Ði/J?X'SoXlBH_
JpXlBHJnEgegf@B%E'A >âk`f@BA >@A kFAWJnV
K?SRB%E

ÛA >RXlkFBHJL_ <n÷
9
lBXFÿ@AC<L>RJLNLB

@GJn>R_
lAC>MkFE`SRXlAC<L>â_cBk`BekFAC<L>
üiZJLX9SRXFB_
Jn>@<LkFf@BE
XlBHJnEgegf@B%E
^Be%JLSRXFB8k`f@BXFBJnEgegf@BE=fRJLÿ@ÿ^B%>@BH_+k`<
oBk`f@B_c<?ûJLA >B

cÿ^B%EFkd<L>kFfRJnkZkF<LÿRACeL[
O.<ti/B%qLBEGRkFf@BEFB9i/B%E`B9e%V BHJnE_cA

×B%E`B%>oeBXAC>üXFBJLE`egfRB%EgX

^XlS
+
oXlBHK?SRB%>Mk
/
^B%foJqMAC<LEgX.<?>
kFf@BPkui/<ÐX
cXuk`B%ûPX%[$hjBJLE`egf@BE`X_@AC_Û>R<nkfRJq?BûJL>
ÄB

Mk`E`J6egfR<LAWeBXA >pk`f@BÒJLSckF<?ûJnkFAWe
e<L>o_cAk`A <?> kFfRJL> A >JÛû<?>@<LVCA >RNLSRJLV.XlBHJnEgegf X
cXuk`B%û[öZf@BEFB%÷à<LE`BLG"k`f@B%ACEPkgJLek`ACeX3i/B%E`B
qLB%E

XlACûA VWJnE,kF<+û<?>@<LVCA >RNLSRJLVk`J?ek`ACeX%GoBL[ NR[CGoSRXFAC>@N3k`B%E`ûX.÷àEF<?ûEFBV BqJL>Mk8_c<ceS@ûB>?kgX%G
JL_@_cAC>@N<LE$EFBû<tqMAC>@Ndk`B%E`ûPX%GSRXFA >RNX
j>@<L>
jûPXU<?EÉf
jÿo<?>
MûPXGBk`eL[ú>?k`B%E`BXlkFAC>@NLV
LGkFfRB%E`B
i=BEFBde%J?XlBHXA >idf@AWegf9kFf@B.XFBJLE`egfRB%EgXÉÿRACe

?B_'S@ÿ3Xl<?ûB/SR>?k`E`JL>RXFVCJnkFB_
@Sck=<

jqjA <?SRXlV
ACû'ù
ÿo<?ElkgJn>MkÝkFBEFûPX÷àEF<?û k`f@B8_@<je%S@ûB%>Mk`XkF<û9<c_cA ÷
9kFf@BKMS@B%E

L[
@<LE/B

@JLû9ÿRV B?G?JXFBJLE`egf@BE
B

cÿRJn>o_cB_kFf@BdKMS@B%E

idA kFf

jA >RN8TB<L>
RGidf@ACegf'ACXÿREF<
!
RJ

@V
JhcÿRJn>@AWXFf
+
>@NLVCACXFfqtJnE`A ù
Jn>Mk<n÷ak`f@B,ÿRf@E`J?XlB
>
FTAC<L>
AC>@N
1
@GLJL>R_÷à<LSR>R_3XFB%qLBE`JLV@E`B%VCB%qtJn>Mk=_c<ce%S@ûB%>Mk`X

oBHe%JLSRXlB,<n÷
AkH[
hjBJLE`egf@BE`X

oBfRJqjA <?E`XqJLEFACB_üidAW_cB%V
üA >pk`f@B+e<?>MkFB

jk<L÷/k`f@B3ûPJn>jSRJLVe<?>R_cA kFAC<L>[
ú>JnVCV
8
XFBX`XlAC<L>RXJ?XFXF<ceAWJtk`B_üidAk`fükFf@B3ûPJL>MSoJnVe%<L>R_cA kFAC<L>UGakFf@BÒXlBHJnEgegf@B%EgXegf@Be

?B_
Jn>R_ÎEFBû9<tq?B_ÛSR>MiZJn>Mk`B_Ûk`E`JL>RXFVCJnkFAC<L>RX'idAk`fÎk`f@Bf@B%VCÿâ<n÷,<?S@E9kFf@E`B%B6eSRBX[$ú> XF<LûB
e%JLXFBXidfRB%E`BkFf@BÐXFBJLE`egfRB%EgX9_@AC_â>@<Lk+V A
LBk`f@B¸E`BkFSREF>@BH_âEFBHXlS@V k`XG"k`f@B

EFB%kFS@E`>@B_ k`<
egf@Be

ÛJn>o_
,+
<?E9egfRJL>@NLB+kFf@Bk`E`JL>RXlVWJtk`A <?>RXG

@Sckk`f@ACXfoJnÿ@ÿ^B%>@BH_VCBX`X'÷àEFBHK?SRB%>MkFV
pkFfRJL>
K?SRB%E

+egfRJn>RNLBX[cöZf@B%E`Bi=BEFBJnVWXF<9eJLXFBX/A >idf@AWegfXlBHJnEgegf@B%EgXE`Bk`S@E`>@B_+kF<PegfRJL>@NLBkFfRB
K?SRB%E`A BHXÝJt÷äk`B%EÝVC<j<

jA >RNJnk"kFf@B.kFEgJn>RXFVCJnkFAC<L>RX[tú>PÿRJLElk`ACe%S@VCJLEGt<?>@B.XFS
+
csuBek=XFBJnEgegf@BH_<L>RV
<L>Re%B÷à<LE.k`<Lÿ@AWe
(
Ðýxe<Lûÿ@S@kFB%E8Jn>@ACûPJtkFAC<L>^þd_cS@E`A >RNkFf@BB>MkFACEFB
8
tù{ûA >jSck`BXlBHXFXFA <?>G
@Sck
kFf@B9XlBHJnEgegf@B%E.AWX`XlS@BH_÷à<LS@E_cA
^BEFB>?kKMS@B%E`A BHX%Go<n÷Ýidf@AWegfkFfRB
EgXuk8kFf@E`B%Bi=BEFBegfoJn>@N?B_
RJLXFB_Û<?>Û<L>@V
pV <j<
!
MAC>@NÐJnkk`E`JL>RXlVWJtk`A <?>RX[
"
>@<LkFf@BE'AC>MkFBEFBHXuk`A >@NÐ<

RXFB%E`qtJtkFAC<L>ÛAWXkFfRJnk
kFEgJn>RXFVCJnkFAC<L>RX=ÿ@E`<tqjAC_cBJn>ÒB

jkFEgJ'EFBHXl<?S@E`e%B.÷à<?E/N?B%>@BE`JnkFAC>@NK?SRB%E

kFB%E`ûPX%[
R<LEZB

@Jnûÿ@VCBLG
Jt÷äkFBEN?Bklk`A >RN÷àEFSoXuk`E`JnkFB_idA kFfk`f@B8KMS@BE
kFBEFû
S@EF<?ÿoBHJn>
%
.>RA <?>
Jn>o_AkgXÝqtJnE`ACJL>Mk`XG
J'XFBJLE`egf@BE=_cBHeAW_cB_+kF<XFB%VCBekZ<L>RBhjÿoJn>@AWXlfÒkFEgJn>oXlVWJtk`A <?>P÷àEF<?û BJ?egf+i/<LEg_P<n÷k`f@BkFBEFû
ýàA¥[ B?[

lBS@EF<?ÿoB<

3÷à<LEB%SREF<?ÿoBHJn>ÄJL>R_
FXFA >R_@ACeJtkF<
1
P÷à<?ES@>@AC<L>oþJL>R_ÐÿRSckkFf@Bû _cACEFBHek`V
A >MkF<9k`f@BK?SRB%E

L[cöZf@AWXdXlS
+
@suBekdiZJLX/J

@VCBkF<9ûPJnE

kui=<9EFBV BqtJn>MkZ_@<je%S@ûB%>Mk`X
oJLXFB_3<?>
kFf@AWX.KMS@B%E

L[
YÑf@A VCBSRXFB%EFù{J?XFXFACXlkFBH_9kFEgJn>RXFVWJtkFAC<L>XlBV BHek`A <?>+fRJ?X=ÿREF<tq?B_PSRXFB÷àSRVxGjk`f@B%E`BJLEFBJ'>MSRû'ù
oBE"<n÷RVCA ûA k`JnkFAC<L>RX[tú>'ÿoJnEFkFAWeS@VWJnEHGHkFEgJn>RXFVCJnkFAC<L>XFB%VCBekFAC<L>9ACX$<?>@V
<L>@BZXuk`B%ÿ9A >'kFfRB/<tq?B%EFù
JnVCV=ø/Túub ÿ@EF<ce%BX`X%[×ú{kÿ@E`<tqMAW_cBHXJL>ÐB

Mk`E`JÒAC>?k`B%EgJLekFAC<L>ÄJL>Regf@<?E8k`fRJtkXFBJLE`egf@BE`X,÷à<LSR>R_
kF<
^B,f@BV ÿ@÷àS@Vx[jO.<ti/B%q?B%EHGtAkgXÝB

^BHek=AWXÝ>R<nk=J?XÝNLE`BJnkJLXÝKMS@BE
9E`B÷à<LE`ûSRVCJnkFAC<L>[nYüB.fRJq?B
÷à<LS@>R_¸ûJL>
+û<LE`Be%J?XlBHXd<n÷ÝKMS@BE
EFB%÷à<LE`ûS@VWJtk`A <?>+k`fRJn>¸kFEgJn>RXFVCJnkFAC<L>E`BùXlBV BHekFAC<L>U[@ú>
JL_@_cA kFAC<L>UGt<LS@E$SRXFB/<L÷oeSRBXÉkF<JLX`XFACXlkXFBJLE`egfRB%EgXVCA ûA kFB_kFfRB/SoXlB%÷àS@V >RBX`XÉ<L÷oSRXFB%EFùJLX`XlAWXuk`B_
kFEgJn>RXFVCJnkFAC<L>9XlBV BHekFAC<L>UGkF<Xl<?ûBZ_@B%NLE`B%B?G
oBHe%JnSoXlBZ<LSREe%S@BX"_@<>R<nkÝJnVCi/J
cX$ÿ@E`<tqjAC_cB=kFfRB

dB

cÿ@VWJn>RJnkFAC<L>RX[^]8S@E,NL<?JLViZJLXZk`<3NLACqLBk`f@E`B%B_cA
×B%E`B%>Mk8eSRBX.idfRACegf6ÿ@E`<tqjAC_@B


B

cÿ@VWJn>RJnkFAC<L>RX
idA kFfpk`f@B3f@<?ÿoB+kFfRJnkkFfRBÒe<?û
@AC>RJnkFAC<L>p<n÷dk`f@BXFBPkFfREFBB3i=<?S@VW_Ûe<tqLBE
JÒidAW_cBEgJn>@N?B'<L÷/XFAk`SRJtk`A <?>RX%[aú>üÿ@EgJLekFAWeBLGafR<ti=BqLB%EHGokFf@BPXFBJnEgegf@BE`X8i=BEFBXF<LûBk`A ûBX
e<L>@÷àSRXlBH_
9e%<L>MkFEgJL_@ACekF<LE

B

cÿ@VCJL>RJtk`A <?>RXÝJL>R_aGjJLXJEFBHXlS@V kG?kFfRB

'ֈEFBHK?SRB%>MkFV
P_cBe%AC_cBH_
kF<3XlkFAWe

PkF<<L>RBe%S@BJn>o_+ACNL>@<?EFBk`f@B<nk`f@B%EZkui/<R[
Ññdôaó
"
Éîï

.
Uô^ï@õuñî
 !
UðRõ
"$
Uî=ï

ú>J?_@_cA kFAC<L>ÒkF<9kFf@BJ

o<tq?B,AC>jqLBXlkFACN?JnkFAC<L>Ò<n÷Uk`f@BXlBHJnEgegf@B%E

X=J

@A VCA k
PkF<Pegf@<j<?XFBK?SRB%E`A BHX
SRXlAC>@Nü_cA

×B%E`B%>Mk9kFBHegf@>@AWK?SRBXGÉi/BJLVCXF<¸EgJn>ÎJL>B

cÿ^B%E`A ûB>?k9kF<ü_cBk`B%E`ûA >@BÒkFfRBÒSRXFB%E

X
J

@ACV A k
9kF<E`Be%<LN?>@A mB.E`B%VCB%qtJn>Mk=_c<ce%S@ûB%>Mk`X=SRXFA >@N'_cA

×B%E`B%>Mk=kFBegfR>@ACKMS@BHX%[Mú>3ÿRJLElk`ACe%S@VWJnEHG
i=Be<?ûÿRJnE`B_3kFf@BXFBJnEgegf@BE

XE`BXFS@V k`X/SRXFA >RN'kui/<_cA

×B%E`B%>Mk.JnÿRÿ@EF<MJLegf@BHXÝk`<ÿ@EFBHXlB>MkFAC>@N
_c<ceS@ûB%>Mk=XFS@E`EF<?N?JnkFBX

8
þ"Je%<Lûÿ@VCBkFB,B

jkFEgJLek<n÷×kFfRB
EgXuk
(
Pýäk`E`JL>RXlVWJtk`B_Rþ"i=<?E`_@XÝ<n÷
BJLegf>@Bi.X.XlkF<LE

Äý
LþdJPe%<Lûÿ@E`BX`XlBH_+B

jkFEgJLek.N?B%>@BE`JnkFBH_ÒSoXlAC>@N3Jn>6JLSckF<?ûJnkFBH_ÒÿoJnEgXlB%ù
Jn>R_jù¥kFE`ACû JLÿ@ÿ@E`<?J?egf kFfRJnkJLÿ@ÿ@E`<
jACûPJtk`BXP<?>@BÐiZJ
A >idfRACegf ÿoB<Lÿ@VCBÄeJn>ÿ@E`<c_cSRe%B
f@BJ?_cV AC>@BHX%[aöZf@AWXXlBHekFAC<L>ü_cBX`eE`A
oBHX.k`f@BÿRJnEgXlB%ù{JL>R_jù¥kFE`A ûJnÿRÿ@EF<MJLegf6k`<ÒfRBJL_@V AC>@B9NLB%>@ù
B%EgJtkFAC<L>Jn>o_+ÿ@E`BXFB%>MkgXZ<LS@EdE`BXFS@V k`X[

B
6@:;C356 -+ 3 (:;

67+84-

981: 67C,
O.BJ?_cVCA >@BZN?B%>@BE`JnkFAC<L>AWX"J,÷à<LE`û <n÷okFB

jkXFS@ûûPJnE`A mHJtkFAC<L>A >idf@AWegfk`f@BdXlSRû9ûPJLEFACmJnkFAC<L>
ACX,EFBHK?SRA E`B_+kF<
^BAC>c÷à<LE`ûPJtk`A q?BJn>R_B

jk`EFBû9BV
XlfR<LEFkGRJL>R_kF<PûACû9AWek`f@Be<?>R_cB>RXlBH_
VCJL>@NLSRJLNLB÷àBJnkFS@E`BX3<n÷>@B%i.XFÿRJnÿ^B%E+f@BJ?_cV AC>@BHX%[Ýú>@÷à<LE`ûJnkFACqLB¸XFS@ûûPJnE`A BHX3Jn>RXFi/B%EkFfRB
K?SRBXlkFAC<L>RX
>
lidfRJnk.fRJnÿ@ÿ^B%>RB_6AC>kFf@AWX_c<ceS@ûB%>Mk
9
C
3<LE
FidfRJtk,AWX,e%VCJLA ûBH_A >6k`f@AWX,_c<ceù
S@ûB%>Mk
9
?G
E`JnkFf@BE=k`fRJn>k`f@BKMS@BXlkFAC<L>
lidfRJnkdACXZk`f@AWX._c<ceS@ûB>?k,J

o<?Sck
9

]8S@Ef@BHJL_cVCA >RB+NLB>@B%EgJtk`A <?>ÛX

cXlkFB%ûG



jGe<L>oXuk`EFSRek`XfRBJL_@V AC>@BX9JnS@ù
kF<LûPJnkFAWe%JnVCV

¸XFB%VCBekFAC>@NÒfRA N?fcù{e%<L>MkFB>Mk8i/<LEg_@Xd÷àE`<Lûk`f@B
¸XFB%>Mk`B%>Re%B'<L÷ÝkFf@B_c<ceù
S@ûB%>Mk[
+ú{k_c<jBXkFf@AWX
pA kFBE`JnkFACqLB%V
üEFBû9<tqjAC>@N6NLEgJnûûPJtk`ACeJnV/e<L>oXuk`Ak`S@B%>Mk`X÷àE`<Lû J
ÿRJnEgXlBÒ<n÷.k`f@BV BHJL_XFB%>Mk`B%>Re%BÒS@>Mk`A V.JÄV B>@Nnk`fk`f@EFBHXlfR<LVW_ÛfRJLX
^B%B> ûBkH["öZf@BÒÿoJnEgXlBHX
JnE`Be%EFBHJtk`B_
3kFf@B;Z;
hjú
ö ÿoJnEgXlBE[
"
Xd_cBX`eE`A
^B_AC>
&
*)
kFf@B;Z;
\hjú
öÿRJnEgXlBE
@S@ACVC_@XZJLS@NLûB%>Mk`B_PÿRJLE`XFBdk`EFBBX/JLe%e%<LEg_cAC>@NkF<Jÿ@E`<ceBHXFX=XlACûA VWJnE=kF<kFfRJnkZ_cBHXFe%EFA
^B_PAC>
&
)
¥[MöZf@B,;Z;
hjú
ö ÿRJnEgXFB%E"fRJ?X
^B%B%>PSoXlBH_PXlSReeBHXFXl÷àS@VCV
'÷à<LEkFf@BdkgJLX
'<L÷aA >c÷à<?EFûPJnkFAC<L>
B

jkFEgJLekFAC<L>A >ÒkFf@Bhcú
$öX
jXlkFBû
&

)
{[
öZf@B.Jnÿ@ÿREF<MJLegfkgJ

?B%>
9O.BH_cNLB.öÉEFACûûB%EÝAWX"û<?XlkÝXlACûA VWJnE"k`<kFfRJnkÝ<n÷
&
)
¥GLidf@B%E`BdJ
XlAC>@NLVCBdXlB>MkFB%>oeBdAWXÝXlfR<LEFkFB%>RB_'SRXlAC>@NXlk`Jtk`ACXlkFAWe%JLVRe<?ûÿ@EFBHXFXFAC<L>[tO.<ti/B%q?B%EHGtO.B_@NLBdöUE`ACû'ù
û9BESRXFBXV AC>@N?S@ACXlkFAWe%JLV V
9û9<LkFACqtJtkFBH_f@B%SREFAWXuk`ACeX"÷à<?E=XFf@<LEFkFB>@A >RNkFf@B,XFB%>Mk`B%>Re%BL[?öZfRB%E`B.ACX
>@<PXukgJtkFAWXlkFAWe%JnVaû<c_cBVxGRXF<ÿ@E`A <?E=k`E`JLA >RA >@N<?>J9VWJnE`NLBe<?EFÿ@SoX=<L÷XlkF<?EFACBXZJL>R_+fRBJL_@V AC>@BX
ACXd>R<nkdEFBHKMS@A E`B_[
öZf@B+AC>@ÿ@Sckk`<ÄO.BH_cNLBöÉEFACûû9BE'AWX9JÄXlkF<?E
?[ÉöZf@B
EgXukPXlB>MkFB%>oeB+<L÷dkFf@B6XlkF<?E
üACX
ÿRJLX`XlBH_kFfREF<?S@NLfk`f@B;Z;
hcú
$öÿRJnEgXlBE[?öZf@B8ÿoJnEgXlB%ùxk`EFBBdEFBHXlS@V k/XFB%E`qLBHXJ?XÝAC>@ÿ@Sck/kF<9J
V AC>@NLSRACXlkFAWe%JLV V
û<nk`A qtJnkFB_û<c_cS@VCB.k`fRJtk/XlBV BHek`XXuk`<LE

i/<LEg_@XkF<÷à<?EFû f@BHJL_cVCA >RBX
oJLXFB_
<L>A >RXFACNLfMk`XZNMJnAC>@B_+÷àEF<?û <
!
RXlBEFqtJnkFAC<L>RX=<n÷fjS@ûPJn>cùe<?>RXuk`EFSoekFBH_+fRBJL_@V AC>@BX[
Ù`~?ugwtzu}3zlzuÇ?ßMuy{z.y`wnzu`wMgzu9ÖczuÇMygwtzugw?g"zuÇ??t`~Mgwtz

@ÖM~Lz
W~LzuÇM`d|wngy{zu|H%zu|HwÒ|yd`~?ugwtzu}P~MwM?`ÅgPW.y```zu|wM'zuÇ?y{z.??uHLu|%zu
ygwtzugwM`HÔ
"
kÝÿ@EFBHXlB>MkGnO.BH_cNLBdöÉEFACûûB%E"AWXÝJnÿ@ÿRV ACB_kF<k`f@Bdÿ@E`<

@VCB%û <L÷×e%EF<MXFXlù{VCJL>@NLSRJLNLBÝfRBJL_cù
V AC>@BNLB>@B%EgJtk`A <?>
kFEgJn>RXFVCJnkFAC>@Nk`f@B
EgXukdXlB>MkFB%>oeB<n÷$J9XlkF<LE

A >Mk`<
>@NLVCAWXlf+JL>R_3E`S@>cù
>@A >RNkFf@BO,B_cN?BöÉE`A ûûB%Edÿ@E`<ceBHXFX/<L>k`f@BEFBHXlSRVk`A >@N9k`E`JL>RXlVWJtk`A <?>[

9C ,

+8& (:;HH1: A


YÄBSRXFB_âO.BH_cNLB6öÉEFACûû9BEPJLX'kFf@B

RJ?XlAWX9<n÷8÷à<LE`û9AC>@Np_c<ceS@ûB>?k3XFS@E`EF<?N?Jtk`BX'A > kFfRB
ú>?k`B%EgJLekFACqLBkFEgJLe

Û÷à<?EPkFfRB
!
ø=EF<MXFXlùTUJn>RNLSRJLNLB
qtJnVCSRJtk`A <?>
R<LE`S@û[Ýú> kFf@AWX3B

ÿoBEFACûB%>MkÒkui/<âû9B%kFf@<c_@Xi/B%E`BÐSoXlBH_ÑkF<âÿ@E`<c_cSReB
Ý>RNLVCACXFf XFS@E`EF<?N?Jtk`BX÷à<?E¸hjÿRJn>RACXFf
_c<ceS@ûB%>MkgX%["hjS@E`EF<?N?JnkFB
"
ý

0(
!

?þe%<L>RXFAWXuk`B_p<n÷dk`f@B
E`Xlk
(
6i=<?E`_RX<n÷,J6ûPJ?egf@A >RB
kFEgJn>RXFVCJnkFAC<L><n÷×k`f@B8_c<ce%S@ûB%>Mk[chjS@E`EF<?N?JnkFBd; ý

FO8ö
?þiZJLX=Jf@BJ?_cV AC>@Be<L>oXuk`EFSRekFBH_
O.B_@NLB3öÉEFACûû9BE÷àE`<Lû k`f@BPûPJLegf@AC>@Bk`E`JL>RXlVWJtk`A <?>Ä<L÷=k`f@B
EgXlkXlB>?k`B%>Re%BL[

A N?fMkXFS
+
suBekgXi=BEFBXFf@<tid>ÐXFS@EFE`<LNMJtk`BX,÷à<LEkFf@BE`BXFS@V k`X<n÷úub XFBJnEgegf@BHX,<?>ÐB%ACNLfMkkF<?ÿ@AWe%X[×öZfRB
kFEgJn>RXFVCJnkFAC<L>RXZJL>R_XlBHJnEgegf+E`BXFS@VkgXZi=BEFBÿ@E`<tqjAC_cBH_

3Aàø/T

Ûk`<JLV VaÿoJnEFkFAWeACÿRJn>Mk`X[
JLegfpXFBJnEgegfüEFBHXlS@V ke<?>RXFACXlkFBH_Ä<L÷
6_c<ceS@ûB>?kgX%[
@<LEBJLegfük`<Lÿ@AWenGak`f@B+XFS
+
csuBHek`X
i=BEFBÐXFf@<tid>J _cBX`eE`A ÿ@kFAC<L>Ñ<n÷k`f@B¸k`<Lÿ@AWeÐJL>R_XFS@E`EF<?N?Jtk`BX9÷à<?E+k`f@B
_c<ceS@ûB>?kgX%[
öZf@BÒXFS
+
csuBHek`X'i/B%E`B+JLX
LBH_ükF<3suSo_cNLBÒidf@Bk`f@B%E'kFf@B_c<ceSRû9B>Mk'iZJLXfRA N?f@V
pE`B%VCB%qtJn>MkHG
Xl<?û9BidfRJtk'EFBV BqJL>Mk<LE>R<nk'E`B%VCB%qtJL>?kkF<6k`f@B3k`<Lÿ@AWe3Jn>o_Ûidf@Bk`f@B%EkFf@B

pi=BEFBPf@ACNLfRV
e<L>
_cB%>MkHG?XF<LûB%idfRJnke<?>
_cB>?kÝ<?EÝ>@<Lk=e<?>
_cB>?kÝAC>kFfRB%ACEE`B%VCB%qtJn>Re%BsuSR_cN?û9B>Mk[?öZfRB
<LEg_cB%E$<n÷@k`<Lÿ@AWe%XGJn>R_idf@Bk`f@B%E$kFfRB/XFS
+
csuBHek"XFJi

0(
!
,<LEO,ö÷à<LEJ,ÿRJLElk`ACe%S@VWJnEk`<Lÿ@AWe=i/J?X
qJLEFACB_J?e%e<?E`_@A >@Nk`<kFf@B8TUJtk`A >+h@K?SoJnE`Bdÿ@EF<tqjAW_cB_
Aàø/T

ÄJ?X"ÿRJLElkÝ<L÷^k`f@B,Xlk`JL>R_@JnEg_
B

cÿoBEFACûB%>Mk,_cBHXlACNL>[
]8S@E=N?<?JLVoiZJLXkF<XlfR<ti kFfRJnk/k`f@B8kui=<XlSREFE`<LNMJtkFBHX"fRJ?_+eVC<?XFBEFBHe%JnVCV×Jn>R_+ÿ@EFBHeAWXlAC<L>UG
@Sck/kFfRJnkZO8ö kF<j<

9k`f@BXFS
+
csuBHekgXVCBX`XÝk`A ûB8kF<'ÿoBEl÷à<?EFû kFfRB,kgJLX
^[chjS
+
@suBekgX/i=BEFB,J

@VCB
kF<6e<?û9ÿRV B%kFB
8 8
'%
suSR_@NLûB%>Mk`XAC>pJ3k`<nk`JLV<n÷
%

(
3ûA >jSck`BXidA kFf
(
@G×idf@ACV B9k`f@B

e<Lûÿ@VCBk`B_
8
' '
,suSR_cN?ûB%>Mk`X,A >

ûA >jSck`BX,idAk`f¸O,ö[oöZfoJtk,AWX%GRSRXlAC>@N
0(
!
PXFS
+
suBekgXûPJL_cB
(
R[
%
ÝsuSR_cN?û9B>Mk`Xÿ^B%E"ûA >jSck`BLGtidf@ACVCB/idA kFfPO8öÛkFfRB

ûPJL_@B
[
%
ÝsuSR_@NLûB%>Mk`X
ÿoBE=ûAC>MS@kFBL[cO,<ti=BqLB%EkFf@BE`BXFS@VkgX<L÷akFf@BB

cÿ^B%E`A ûB>?kdXFf@<ti=BH_9kFfRJnk/<tq?B%E
XFBJLE`egf@BHX
(
üfRJL_âJn> JqLBE`JLNLB3ÿ@E`Be%ACXFAC<L>Î<L÷
R[
%
%
@GJqLB%EgJnN?B3E`Be%JLV Vd<L÷
/
R[
%
ÄJn>R_âJqLBE`JLNLB
-0/214365 7
Ò<L÷
/
R[
(
cGUidf@ACVCBO8ö fRJ?_ÎJqLBE`JLNLB3ÿREFBHeAWXlAC<L><L÷
/
R[
(
1' '
RGÉJq?B%EgJnNLB+EFBHe%JnVCV/<n÷
@[
'

JL>R_JqLB%EgJnN?B
- / 14365 7
R[
;% '
R[
ú>?k`B%EFù{JL>@>@<Lk`Jtk`<LEJLNLE`B%Bû9B>Mk=_cAW_3>@<Lk/_cA
^BE=û'SRegf

^Bkui/B%B>PkFfRB,kui/<'X
cXuk`B%ûPX%[MYüB
SRXlBH_ ø=<LfRB%>
X

&
8
)
/kF<Äû9BHJLXFS@E`BPkFf@BÿRJLA E`idACXFB+AC>MkFBElùJn>@>R<nk`JnkF<?EJnN?EFBB%ûB%>Mk[

AWX
idf@B%>k`f@BJnN?EFBB%ûB%>Mk
&
^Bkui/B%B>¸Jn>@>@<Lk`JnkF<LEgXZAWXdidfRJtk8i=<?S@VC_

^BB

jÿ^BekFBH_

egfRJL>ReB?G
Jn>R_AWX
8
idf@B>kFf@BEFBAWX.ÿ^B%EF÷àBek8JnN?EFBB%ûB%>Mk[@D8S@Bk`<kFf@BB

cÿoBEFACûB%>Mk8_cBHXlACNL>UG@Ak8i/J?X
>@<nk/ÿo<MXFXFA
RV Bdk`<'eJnVWeS@VWJtk`B,X

cXlkFBû'ùXFÿoBHeA
edAC>?k`B%EFù{JL>@>@<Lk`Jtk`<LEJLNLE`B%Bû9B>Mk"÷à<LE/BJLegfPÿoJnACE
<n÷=JL>@>@<nkgJtk`<LEgX
^BeJnSRXFB9XF<LûB9ÿRJnACEgX8<L÷=Jn>R>@<nkgJtkF<?E`X8>@BqLB%ESRXFB_ÐkFf@BX`JnûB9XFS@E`EF<?N?JnkFB
÷à<LEsuSo_cNLAC>@Nk`f@BXFJLû9B8_c<ceS@ûB%>MkgX%[jöZf@B8Jq?B%EgJnN?B/<tq?B%EgJnVCV

ÒXFe%<LE`Bdi/J?X"÷à<LE=kFfR<?XFB,e%J?XlBHX
A >3idfRACegf3XFS
+
csuBHek`X=_cAW_3XlBBdkFfRB8X`JnûB,XFS@EFE`<LNMJtk`B=÷à<?EÝk`f@B,X`JnûB,_c<ceSRû9B>Mk=iZJLX
R[
*(
G
idf@A VCBk`f@BJqLBE`JLNLBÿRJnACEFidAWXFB

¸XFe%<LE`B8÷à<?E
0(
!
9iZJLX
&
R[

8
Jn>o_+k`f@BJq?B%EgJnNLB8ÿRJnACE`idACXFB
6XFe%<LE`B,÷à<?E.O,ö i/J?X
@[

(
R[
"
÷äkFBEkFf@BPXFS
+
csuBHek`Xe%<Lûÿ@VCBkFBH_3suSo_cNLAC>@NkFf@BP_c<ce%S@ûB%>Mk`X÷à<?EJ+kF<?ÿ@AWenG×kFfRB

¸i/B%E`B
JLX
LB_+kFfRB8÷à<?V VC<tidAC>@NPK?SRBXlkFAC<L>RX

8
[ZYÄBEFB
?<LS+÷¶JnûA VCAWJnEdidA kFfkFf@AWXZk`<Lÿ@AWe
oB%÷à<LE`BkFf@BXFBJLE`egf
,9
c[ZYüJ?X/AkZBJ?X

9kF<9NLSRBX`XidfRJnk=k`f@B_c<ceS@ûB>?kZiZJLX/J

^<LSck
RJLXFB_3<L>3k`f@BXlS@E`E`<LN?JnkFB
9
@[ZYüJ?XdA k.BJLX
kF<PûPJ

LBEFBV BqJL>ReB/suSR_@NLûB%>Mk`Xd÷à<LEZkFfRACXZk`<Lÿ@AWe
69
(
R[dD,<
?<LSfRJqLBe<?>
_cB>ReBAC>

L<LSREÉsuSo_cNLûB%>MkgXZ÷à<LEZk`f@ACXdkF<LÿRACe
9
öZf@B,XFS
+
csuBek`X=Jn>RXFi=BEFBH_9BJLegfPKMS@BHXuk`A <?>
XlBV BHek`A >@N'J>MSRû
^B%EÝ÷àE`<Lû
8
kF<
GLidfRB%E`B
8
û9BHJn>Mk
F>@<nkUJnkUJnVCV
!
RG
dûBJL>?k

`Xl<?ûB%idfRJnk
5
ZJn>R_
ûBHJn>Mk

lB

Mk`EFBûB%V
L[
döZf@B"EFBHXlÿ^<L>oXlBHX
JnE`BXFf@<tid>ÒA >6ö$J

@VCB
8
[
Á?½

`l%H

/~M`y{zu|w
gycHw?ygyÝÖn'tLy{zug
Í×H
/~?gy{zu|Hw
.
tÔ
* .
Ô
*
H
/~?gy{zu|Hw ÈnÔ
-0
tÔ
*.
/~?gy{zu|Hw9È ÈnÔ
0
ÈnÔ
,
/~?gy{zu|Hw' ÈnÔ
,
ÈnÔ
.
YÄB._c<>R<nkÝkgJ

LBZk`f@AWX"EFBHXlSRVkÝ>@BHeBHXFX`JnE`A V
k`<ûBJn>9k`fRJtkÝAC>c÷à<LE`ûPJtk`A q?Bdf@BJ?_cV AC>@BHXÝJnE`B
i=<?E`XFB'XFS@E`EF<?N?Jtk`BXZk`fRJn>ÄkFfRB
EgXlk8ֈ<?Elk
6i/<LEg_@X[oú{kACXVCA
?B%V
kFfRJnkkFf@B9f@BJ?_cVCA >@BHXSRXlBH_
A >6O,öi/B%E`B>@<nk.N?<M<c_B%>R<LS@N?fÒf@BHJL_cVCAC>@BXZk`<PûPJ

LBJe%<L>Re%V SRXFAC<L>6J

^<LSck.AC>c÷à<?EFûPJtk`A q?B
XlS@ûûPJnE`ACBX/A >N?B%>@BE`JLVx[
"
VWXl<oGjkFf@BJq?B%EgJnN?B.V B>@Nnk`fÒ<L÷Uk`f@Bf@BJ?_cV AC>@BHXZSRXlBH_+AC>6O,ö i/J?X
ûSRegfXlfR<LEFkFB%E$k`fRJn>'÷à<LEFk
i=<?E`_RX%GNLACqjA >RN
/
0(
!
8k`f@BdJL_cqtJn>MkgJnNLB/<n÷^A >oeVCSR_cAC>@Nû9<?EFB=kF<?ÿ@AWe
A >c÷à<?EFûPJnkFAC<L>[
Äñ=î,ô
4
jõuñî

"î,ò

.ó.ï@ó.ð


ñð

YÄB9÷à<ceSRXFB_Ä<L>ÐkFBHXuk`A >@Nk`f@BB

×Bek`A q?B%>@BHXFX<L÷SRXFB%EFù{J?XFXFACXlkFBH_kFEgJn>oXlVWJtk`A <?>ÄXFB%VCBek`A <?>ÐAC>
A >MkFBE`J?ek`A q?Bø/Túub Jnÿ@ÿRV AWe%JnkFAC<L>GJn>R_Î<

RXFB%E`qjA >RNÐ_cA
^BEFB>?kPXFBJnEgegfXlkFEgJtkFBNLACBX
+
HkgJLek`ACeX
kFfRJnkÝkFf@B8XlBHJnEgegf@B%EgX"e<?S@VC_SoXlBH_'AC>Pk`f@B%ACEÝAC>?k`B%EgJLekFAC<L>idAk`f+Jø/TúubÑX
cXuk`B%û idAk`fPSRXFB%EFù
JLX`XlAWXuk`B_9k`E`JL>RXlVWJtk`A <?>PXlBV BHekFAC<L>÷àBHJtk`S@EFB?[c]8SREJn>RJLV
cXFACX=XlSRNLNLBHXukgXkFfRB,SRXFB÷àS@VC>@BHXFX<n÷akFfRB
Jnÿ@ÿ@E`<?J?egfGtJn>R_'k`f@B,_cACqLBE`XFAk
<L÷×k`JLekFAWe%X$k`f@B,XFBJnEgegf@BE`XJL_RJnÿck`B_kF<k`J

LB.J?_cqtJn>Mk`JLNLB/<n÷
kFf@BZB

jk`E`JAC>?k`B%EgJLekFAC<L><?ÿ@ÿ^<LEFkFS@>@A k
ÿ@E`<tqjAC_cBH_
SRXFB%EFùJLX`XlAWXuk`B_k`E`JL>RXFVCJnkFAC<L>'XFB%VCBekFAC<L>[
O.<ti/B%qLBEGk`f@B,B

^BHek`A q?B%>@BHXFX<n÷×kFf@BJnÿ@ÿREF<MJLegf9ACX=_cB%ÿ^B%>R_@B%>Mk=<?>kFf@BegfRJnEgJLekFB%E`AWXuk`ACeX<n÷
kFf@B9kF<?ÿ@AWenG×kFfRB'k`A ûBÿ@E`BX`XlSREFB?G^JL>R_¸k`f@BPKMSRJnVCAk
6<L÷k`f@BPeS@BHX%[

@SRElk`f@B%E_cBqLBV <?ÿ@ûB%>Mk
<n÷SRXFB%EFùJLX`XlAWXuk`B_k`E`JL>RXlVWJtk`A <?>¸XlBV BHek`A <?>¸idA VCV
'
oB9<L>
8
þ
>@ACfRXlAC>@NJn>RJLV
jmA >@NÒXlBHJnEgegf@B%EgX
XlBHJnEgegf
oBfRJqjA <?E`XGoJL>R_¸_cBHXlACNL>
oB%klkFBEB%qtJnVCSRJtk`A <?>6ûBJLXFS@E`BX
?þ._cBHXlACNL>RA >@NJn>¸BHJLX
<

ckgJnAC>@B_Jn>R_E`<

@SoXuk.eSRB8k`fRJtk,eJn>ÿ@E`<tqMAW_cB
^BXlk.B

cÿ@VWJn>RJnkFAC<L>JnVCV×kFf@Bk`A ûBL[
ú>ÒJL_R_cAk`A <?>Gji=B8÷à<ceSRXFB_+<L>+kFf@B8k`J?X

cX=<n÷É_cB%kFBEFûAC>@A >RN9_c<ce%S@ûB%>MkdEFBV BqJL>ReB?[
"
Vù
kFf@<?S@NLfÛk`f@BO,ö X
cXuk`B%û XlfR<ti.XXF<LûB+ÿ@E`<LûAWXlB3÷à<LE'kFf@AWX'k`JLX
×Gk`f@BÒE`BXFS@V k`X'A >o_cACeJtk`B
kFfRJnkÝkFf@B8X

cXlkFB%û fRJLXÝ>@<nk
?BkE`BJ?egf@B_9Jÿo<?A >MkÝidf@BEFB
^BkFkFBEE`BXFS@VkgXÝJnE`B.e<?>RXFACXlkFB>?k`V
<

ckgJnAC>@B_a[nø=<L>Mk`A >jS@BH__cB%q?B%VC<Lÿ@ûB>?k$<L>'f@BJ?_cV AC>@B=NLB%>RB%EgJtkFAC<L>idACVCV?÷à<ce%SRXU<?>ACû9ÿREF<tqjAC>@N
kFf@B+KMSRJLV A k
Ð<L÷ZkFf@B3<?SckFÿRSck`XkFfRJnk'JnE`BPNLB>@B%EgJtk`B_a[ú>ÛÿoJnEFkFAWeS@VWJnEHG×kFf@B3÷à<LVCV <tidAC>@N6ACû'ù
ÿ@EF<tq?B%ûB%>MkgX/JLEFBÿ@VWJn>@>RB_Ò÷à<LEdf@BHJL_cVCAC>@BNLB%>RB%EgJtkFAC<L>

ý
8
þ
%
8XlB<L÷$Jn>>cù{NLEgJnû VWJn>RNLSRJLNLB
û9<c_cBV$÷à<LEXlBV BHek`A >@NÒkFfRB
^BXlkkFEgJn>RXFVCJnkFAC<L>ÐXFS@E`EF<?N?JnkFBÿ@E`<c_cSRe%B_
kFfRBX
cXuk`B%û
ý
;=B%klk`B%EXlBV BHek`A <?>Ð<n÷kFf@B9idA >o_c<ti <n÷=i=<?E`_@X,÷àE`<LûkFfRBJLElk`ACe%V B÷àEF<?û idf@AWegf¸kFfRB9fRBJL_cù
V AC>@BPXlfR<LS@VW_
^B9egfR<?XFB%>
ý
%
8XlB9<n÷kF<LÿRACe_cB%kFBekFAC<L>ÐkF<AC_cB>MkFA ÷
¸i=<?E`_RX.k`fRJtkXlfR<LS@VW_
>@<nk
^B6_cB%VCBk`B_a[
¸<LE`B%<tqLBEG$<L>RB<L÷<?S@EP>@B

Mk3XlkFBÿRXPAWX9kF<ÛSRXFB6O,ö A >âkFfRBe%<L>MkFB

jk
<n÷ÝXlSRû9ûPJLEFACmJnkFAC<L><n÷
@E`<?JL_Re%JLXlkd>@B%i.X[
cÿoBEFACûB%>Mk`XdidACVCVÉe<?ûÿRJnE`Bf@<ti i/B%VCVUfRBJL_cù
V AC>@BX,XlS@ÿRÿo<?ElkdfjS@ûPJn>ÿ^B%EF÷à<LE`ûJL>ReB<?>JL>B

jkFE`A >RXFAWe,kgJLX
3idA kFfEFBHXlÿ^BekF<9kF<?ÿ@AWeV AWXukgX%G
XlB>?k`B%>Re%BB

jkFEgJLekFAC<L>G
EgXlklù
dù{i=<?E`_@XGcJn>R_Ò<nk`f@B%E.XFS@ûûPJnE`A mHJtk`A <?>ÒJnÿRÿ@EF<MJLegf@BHX%[
ô

dî.ñ

Éò

"$
Uî=ï

öZf@B3JnSck`f@<LEgXi/<LS@VW_üV A
LBk`<kFfRJL>
+
ÄQ?S@VCA <
<?>@mJLV <6Jn>o_
RB%E`>RJn>o_c<6T

<Lÿ^B%m%ùu]XlkFB>@B%E`<
÷à<LE=kFf@BA E/kFACE`B%VCBX`X=B

^<?ElkgXÝk`<9e%<j<LEg_cA >oJtkFB8Aäø/T
/G
.ACmJnEZO,J

RJLXFf3÷à<?E=ÿREF<tqjAW_cA >RNSRX=kFfRB
hjÿRJn>RACXFfcù
Ý>@N?V AWXlf
@ACV AC>@N?SRJnVck`B%E`ûV AWXukHG?JL>R_
6ACegfoJnB%V

.<?X`X`JnVj÷à<LE=_cB%q?B%VC<Lÿ@AC>@NkFfRBdBJnE`VCA BE
qLB%EgXFA <?>'<L÷^k`f@B
6ACEgJLeVCB.X
jXlkFBû[?öZf@AWX"i/<LE

fRJ?X
oBB%>3XFS@ÿ@ÿ^<LEFkFBH_A >PÿRJLElk
D
"
b
"
e<j<Lÿ^B%EgJtk`A q?BJLNLE`B%B%ûB>?kgX
!
8

'%
8
JL>R_;/;
8öø=<L>Mk`E`J?ek
%
!!
*(
%
c[

:

Uî,ô
.
Ô.$ÇMgwR

R`t
$
g|gwtzd%%ugg`wnz=W%dwM|wM×yggygÔoÌÉL~Mzu|Hwj%wM+y{LFÇ?Ê
H|9gy~?u`yg

Ú
.*-
HHÜÝÈH


-
tÔ.$|wMygcÒÔ
jÕÇLugZH`wM`lzu|HZ`ÆL|g|yn?gy$Cy{zl%zu|y{zu|%^juy|wM?Ô?autggL|wMHy
%azuÇMdÈ
0
zuÇPË
Ú
.**
HHÜ
ÈnÔ
/Öj%yÇo
(
Ô

Ô

/gw?`l%zu|w?ʶÇMt
=LÖLu| ,%FÇ?|w?"Õol%wMy%zu|HwRÔÇMÐzuÇMgy|ygZgM%zÊ
gwtz"%É$H?~?zu`=ng|gwMgM=wM|`uy|}z¥%U%LwM%z/$Hgau
Ú
%HÈÜ
LÔ
=HÔ%Ù6%wM?

?Ô

ZlR8ÔÙ Ô
(
Hyyu%äLÒÔ
n$HM%u|wM/~My`Êxyy|y{zu%wj~?zuHzu|
/~?`'Õolw?y zu|HwoÔjut`g?|w?Hy/%UË^ÌUÍ$Ï 
Ú
Ü
0
tÔZØdw?|ÇtznØÔMug~onÔ
Mnzlzu|y{zu|`y{ÊxÖMyy~Mu|

g%zu|Hwy{zugHw?
LygwtzugwMg=gHLugy{Ê
y|HwRÔcautggL|wMHyU=/vxÊ¥
.
Ú
%H
.
Ü
-
nÔ.9|`@cÔjÉLy{zläjÒÔMÍMÆ@
8Ô
/%yÇjgÅd?ËUÔcnFÇtÅ%z

H
,ÔMnzuwMH
.ÔLÙg|yFÇ??`à
R=H%u|zuÇ?y/zuÇjzdËR%uw3zu9ÌaÆnzl`zZv¥w?Cuzu|w
%'% (
RZgy`u|Lzu|wÒ%$zuÇ?nv{ÍaÕ
t?y{zu`\y/yW%Z9ZÉÊ¥nÔcautggg?|wMy=%azuÇM.9ZÉÊ{
Ú
.**,
Ü
tÔ.9|`$@Ô

=yÇMÅd×ËUÔÍMÆ@

,ÔoÙg|ylÇMLgä
a wMgÉ~Myy{zl%zu|y{zu|%M%uy{Ê
|wMzu`Ænzl`z/|w?W%u%zu|Hw3Cu zu`ÆnzÔ@autggg?|wMyZUzuÇM
.
gy{z,9``zu|wMUzuÇM
(
%zuÇ
`u`u|w$Çj%?zu`azuÇ?dËUjLzzuH?Ù+
Ú
HÜH
-

L%ÈHÈ
,

ZlR?ÔnÙ ÔMËRgÅd

8ÔjÖc

ygc=Ô
jË^ÌU͸ÌÆLc`u|gwtzuy"z/%Lwj
Mnzl%zu|y{zu|%
tzug|wM'wjÒÖjl%ÞÐzl%wMy%zu|woÔa×Fzu`uyg=Ô^?|}zuaÉuHyy{ÊxË^%wM~j'vxw?Cu%zu|w
`zu|gUwMÒÌH%~j%zu|w

@Ù%uLyÇ?H+Éuyy{ÊxË^w?H~MHÌ~jzu|wÍM%u~MoËoÌÉÍ
%HHn@Ëo|yÖcwoM×zu~MH
Ú
HÜ
.

-
.,
H
*
nÔd|}uHL×,Ô
oÕÇMÌaÞ@g`zuy.%
/~M`Òtzu~M`zu~Lu%wj3Z|`zu|Hwj6n`zu~M?yZ|wZ|`zu|wj%nÊ
%
%yÐÉuHyy{ÊxË^%wM~j'vxw?Cu%zu|w
=`zu|gäÔ×utg`?|wMy%"zuÇM'
.
`y{zwMwn~j%Évxw?Ê
zu`uwM%zu|HwM" nv

/v
Ñ$HwLW`u`wMg8Hw
=`y%ulÇ3wM3/ggH?gwtzÝ|w+vxw?Cu%zu|w
`zu|gäc9`Öc~?uw?Hc~My{zl|
Ú
.**,
... Other studies have looked at how users interact with cross language functionality, even if language skills are not explicitly considered as a variable. Dorr et al. [10] noted that letting users edit machine translated output led to a more satisfying overall experience (although this control was still not as effective as query reformulation). What this study did not examine, however, was the role that knowledge of the target language played and how this could have affected users' behaviour. ...
... Query editing occurred only 3 times out of all 144 topics, and these were exclusively in the L2 condition. Based on the tools available (which offered limited editing assistance for translated queries), users were much more likely to reformulate or edit the query in the source language than to deal with the machine translation, behaviour also noted by Dorr et al. [10]. ...
Conference Paper
Full-text available
Multilingual access is an important area of research, especially given the growth in multilingual users of online resources. A large body of research exists for Cross-Language Information Retrieval (CLIR); however, little of this work has considered the language skills of the end user, a critical factor in providing effective multilingual search functionality. In this paper we describe an experiment carried out to further understand the effects of language skills on multilingual search. Using the Google Translate service, we show that users have varied language skills that are non-trivial to assess and can impact their multilingual searching experience and search effectiveness.
... It has been confirmed that users tended to choose their native language significantly more than a second language in formulating their queries (Steichen and Lowe, 2021). They were more likely to reformulate or edit the query in the source language based on the available tools than with the machine translation (Dorr et al., 2003). When a query is vague or inaccurately translated, it is discovered that alternate word recommendations are required (Marlow et al., 2008). ...
Article
Purpose Ethnic minorities (EMs), who make up a sizable proportion of multilingual users, are more likely to browse and search in their native language. It is helpful to identify multilingual users' information needs to provide public digital cultural services (PDCS) for making their life better. Design/methodology/approach The in-context interview is an efficient way to explore EMs' information needs and evoke their daily experience with PDCS. The material from 31 one-on-one interviews with EMs in China was recorded and analyzed using thematic analysis. Findings The findings reveal that language proficiency is a critical factor influencing multilingual information access (MLIA) and multilingual users' information needs. Moreover, language ability, digital literacy and cultural literacy are important components of multilingual information literacy (MLIL), which is helpful for EMs to access PDCS. In light of Kochen's theory, the information needs of PDCS can be classified into the aroused need of resources, the recognized need of functions and services and expressed need. For the expressed need, it is necessary to develop a one-stop convergence platform of PDCS to process various requests of resources, functions and services in the future. Originality/value The findings will be valuable for governments, public institutions and social organizations in identifying, addressing and resolving these issues about PDCS.
... La Universidad de Maryland (Dorr et˜al., 2003), que participó conjuntamente con BBN Technologies, 30 evaluó la posibilidad de usar breves resúmenes construídos a partir de titulares -generados automáticamente a partir de las primeras cuarenta palabras de cada documento-sin perder precisión. Los usuarios participantes eran hablantes nativos de inglés y ejecutaron las búsquedas sobre documentos en español, lengua de la que poseían poco o ningún conocimiento. ...
... 6.3.5 Spanish to English Summarization for CLIRTrimmer was also used in University of Maryland's submission to the Interactive Track of the Cross-Language Evaluation Forum (iCLEF) 2003(Dorr et al., 2003a). Experiments were performed to investigate a searcher's ability to recognize relevant documents based on English summaries of Spanish documents. ...
... However, there are qualitative analyses of the CLIR interactions too. For example, the using of target language terms in queries has been discussed in reports from various sites [15,16], and the effect of mistranslations/missing translations is presented in CLEF 2005 [16]. ...
Article
Full-text available
We often talk as if information retrieval systems were machines, but in reality the "systems" that we use to retrieve information are synergistic combinations of collections, machines, and processes that people use to search the collection(s) using the machine(s). Model-based evaluations such as those pioneered at Cranfield and now used in TREC, CLEF, and SIGIR focus on some functions of the machine (in particular, how best to build ranked lists). This paper expands that focus to examine what we have learned about the processes by which those machines will be used to perform Cross-Language Information Retrieval (CLIR), concluding with a brief description of how that perspective informs the nature of our research in DARPA's new GALE program.
... Participants have included the National Distance Education University (UNED) and the University of Alicante in Spain, the Swedish Institute of Computer Science, the University of Sheffield in the United Kingdom, and our group at the University of Maryland in the United States of America. The user studies reported in this paper were conducted using the 2002 and 2003 iCLEF study designs, and the results of those studies have been previously reported (He, Wang, Oard, & Nossal, 2002;Dorr et al., 2003;He, Oard, & Plettenberg, 2006). This paper draws together those results and includes substantial additional analysis that could not be completed within the time constraints of annual evaluation cycles. ...
Article
Full-text available
Interactive Cross-Language Information Retrieval (CLIR), a process in which searcher and system collaborate to find documents that satisfy an information need regardless of the language in which those documents are written, calls for designs in which synergies between searcher and system can be leveraged so that the strengths of one can cover weaknesses of the other. This paper describes an approach that employs user-assisted query translation to help searchers better understand the system’s operation. Supporting interaction and interface designs are introduced, and results from three user studies are presented. The results indicate that experienced searchers presented with this new system evolve new search strategies that make effective use of the new capabilities, that they achieve retrieval effectiveness comparable to results obtained using fully automatic techniques, and that reported satisfaction with support for cross-language searching increased. The paper concludes with a description of a freely available interactive CLIR system that incorporates lessons learned from this research.
Article
Combining existing advancements in cross-language information retrieval (CLIR) with the new usercentered Web paradigm could allow tapping into Web-based multilingual clusters of language information that are rich, up-to-date in terms of language usage, that increase in size, and have the potential to cater for all languages. In this chapter, we set out to explore existing CLIR systems and their limitations, and we argue that in the current context of a widely adopted social Web, the future of large-scale CLIR and iCLIR systems is linked to the use of the Web as a lexical resource, as a distribution infrastructure, and as a channel of communication between users. Such a synergy will lead to systems that grow organically as more users with different linguistic skills join the network, and that improve in terms of language translations disambiguation and coverage.
Article
The emergence of the Internet allows millions of people to use a variety of electronic information retrieval systems, such as: digital libraries, Web search engines, online databases, and online public access catalogs. Interactive Information Retrieval in Digital Environments provides theoretical framework in understanding the nature of information retrieval, and offers implications for the design and evolution of interactive information retrieval systems. Interactive Information Retrieval in Digital Environments includes the integration of existing frameworks on user-oriented information retrieval systems across multiple disciplines; the comprehensive review of empirical studies of interactive information retrieval systems for different types of users, tasks, and subtasks; and the discussion of how to evaluate interactive information retrieval systems. Researchers, designers, teachers, scholars, and professionals will gain the foundation for new research on this subject matter, and guidance to evaluate new information retrieval systems for the general public as well as for specific user groups.
Article
This article describes a framework for cross-language information retrieval that efficiently leverages statistical estimation of translation probabilities. The framework provides a unified perspective into which some earlier work on techniques for cross-language information retrieval based on translation probabilities can be cast. Modeling synonymy and filtering translation probabilities using bidirectional evidence are shown to yield a balance between retrieval effectiveness and query-time (or indexing-time) efficiency that seems well suited large-scale applications. Evaluations with six test collections show consistent improvements over strong baselines.
Article
Full-text available
Searching is inherently a user-centered process; people pose the questions for which machines seek answers, and ultimately people judge the degree to which retrieved documents meet their needs. Rapid development of interactive systems that use queries expressed in one language to search documents written in another poses five key challenges: (1) interaction design, (2) query formulation, (3) cross-language search, (4) construction of translated summaries, and (5) machine translation. This article describes the design of MIRACLE, an easily extensible system based on English queries that has previously been used to search French, German, and Spanish documents, and explains how the capabilities of MIRACLE were rapidly extended to accommodate Cebuano and Hindi. Evaluation results for the cross-language search component are presented for both languages, along with results from a brief full-system interactive experiment with Hindi. The article concludes with some observations on directions for further research on interactive cross-language information retrieval.
Article
Full-text available
For MUC-7, BBN has for the first time fielded a fully-trained system for NE, TE, and TR; results are all the output of statistical language models trained on annotated data, rather than programs executing handwritten rules. Such trained systems have some significant advantages: . They can be easily ported to new domains by simply annotating data with semantic answers. . The complex interactions that make rule-based systems difficult to develop and maintain can here be learned automatically from ...
Conference Paper
Full-text available
For the 2002 Cross-Language Evaluation Forum Interactive Track, the University of Maryland team focused on query formulation and reformulation. Twelve people performed a total of forty eight searches in the German document collection using English queries. Half of the searches were with user-assisted query translation, and half with fully automatic query translation. For the user-assisted query translation con- dition, participants were provided two types of cues about the meaning of each translation: a list of other terms with the same translation (potential synonyms), and a sentence in which the word was used in a translation- appropriate context. Four searchers performed the ocial iCLEF task, the other eight searched a smaller collection. Searchers performing the ocial task were able to make more accurate relevance judgments with user-assisted query translation for three of the four topics. We observed that the number of query iterations seems to vary systematically with topic, system, and collection, and we are analyzing query content and ranked retrieval measures to obtain further insight into these variations in search behavior.
Article
Full-text available
algorithms have demonstrated a breakthrough in parsing accuracy, as measured against the UPenn TREEBANK as a gold standard. In this paper we report adapting a lexicalized, probabilistic context-free parser to information extraction and evaluate this new technique on MUC-7 template elements and template relations.
Conference Paper
this paper, the translation polysemy and the dictionary coverage problems were attacked by means of the combination of a general language MRD and a domain specific MR D i.e., a medical dictionary. The domain was restricted to medicine and health by choosing as test requests TREC&apos;s (see Harman, 1996) health related topics. The performance of translated Finnish queries against English documents was compared to the performance of original English queries against English documents. Because the domain was medicine and health, it was assumed that the medical dictionary disambiguates word senses, giving less incorrect senses than the general dictionary, and that it contains such search keys that are not found in the general dictionary
Conference Paper
The University of Maryland participated in the CLEF 2000 multilingual task, submitting three official runs that explored the impact of applying language-independent stemming techniques to dictionarybased cross-language information retrieval. The paper begins by describing a cross-language information retrieval architecture based on balanced document translation. A four-stage backoff strategy for improving the coverage of dictionary-based translation techniques is then introduced, and an implementation based on automatically trained statistical stemming is presented. Results indicate that competitive performance can be achieved using four-stage backoff translation in conjunction with freely available bilingual dictionaries, but that the the usefulness of the statistical stemming algorithms that were tried varies considerably across the three languages to which they were applied.
Article
When humans produce summaries of documents, they do not simply extract sentences and concatenate them. Rather, they create new sentences that are grammatical, that cohere with one another, and that capture the most salient pieces of information in the original document. Given that large collections of text/abstract pairs are available online, it is now possible to envision algorithms that are trained to mimic this process. In this paper, we focus on sentence compression, a simpler version of this larger challenge. We aim to achieve two goals simultaneously: our compressions should be grammatical, and they should retain the most important pieces of information. These two goals can conflict. We devise both noisy-channel and decision-tree approaches to the problem, and we evaluate results against manual compressions and a simple baseline. Introduction Most of the research in automatic summarization has focused on extraction, i.e., on identifying the most important claus...
Article
This paper describes GenerationHeavy Hybrid Machine Translation (GHMT), a novel approach for trans- lating between structurally-divergent language pairs with asymmetrical resources. The approach depends on the existence of rich target language resources such as word lexical semantics, categorial variations and subcategorization frames. These resources are used to overgenerate multiple lexico-structural variations from a target-glossed syntactic dependency representation of the source language sentence. This symbolic overgeneration, which accounts for a wide range of possible variations, is constrained by a statistical targetlanguage model. The exploitation of target language resources (symbolic and statistical) to handle a problem usually reserved for Transfer and Interlingual MT is useful for translation from source languages with scarce linguistic resources. A preliminary evaluation on the application of this approach to Spanish-English MT is conducted with promising results.
Article
In this paper we first propose a new statistical parsing model, which is a generative model of lexicalised context-free gram- mar. We then extend the model to in- clude a probabilistic treatment of both subcategorisation and wh~movement. Results on Wall Street Journal text show that the parser performs at 88.1/87.5% constituent precision/recall, an average improvement of 2.3% over (Collins 96).