Conference PaperPDF Available

Virtuous cycles of learning: Redesigning testing during the digital revolution

Authors:
Theo Dawson at Lectica, Inc.
Theo Dawson
  • Lectica, Inc.
Zachary Stein
Zachary Stein
Zachary Stein
  • This person is not on ResearchGate, or hasn't claimed this research yet.
Download full-text PDFDownload full-text PDF
Read full-text
Download citation

Abstract and Figures

This paper explores positive new directions for the future of educational testing by examining trends at the interface of the learning sciences and advances in educational technologies. A brief history of the relation between testing and technology sets the stage for a look at emerging “edu-tech” trends and what these might mean for the future of testing. This historical-critical look at past and present testing practices reveals that the learning sciences have been less influential in shaping the growth of testing infrastructures than cumulative advances in technology that have enabled large-scale standardization and automation. We argue that during the current “digital revolution” the learning sciences ought to assume more responsibility for shaping the adoption of new testing technologies. We propose a set of principles that, if followed, would move tomorrow’s testing infrastructures toward learning-centric design. Combining the affordances of new digital technologies with advances in our understanding of learning make it possible to build tests that promote multi-level learning in educational systems, catalyzing virtuous cycles of learning for everyone they affect—students, teachers, school leaders, policy makers, and researchers. The DiscoTest™ Initiative is presented as a reform effort that is guided by these design principles, serving as an example of positive new possibilities for testing at the interface of the learning sciences and new educational technologies.
Figures - uploaded by Theo Dawson
Author content
All figure content in this area was uploaded by Theo Dawson
Content may be subject to copyright.
2012_0929_virtuous_cycl
es.pdf
Content uploaded by Theo Dawson
Author content
All content in this area was uploaded by Theo Dawson on Dec 28, 2019
Content may be subject to copyright.
2012_0929_virtuous_cycl
es.pdf
Content uploaded by Theo Dawson
Author content
All content in this area was uploaded by Theo Dawson on Sep 24, 2014
Content may be subject to copyright.
!
!
"#$%&$'(!)*$+(!,-!./0%1!2'34!5#33'$#(!6/3%1'78%/*(!9:!;<;=;!
2>?6@!
"@A5)A:!
!
B<,C,D;C-E<E!
1%%8FGGH#$%&$'+/3I!
!
!
Virtuous cycles of learning:
J#K#L&I*&*I!%#L%&*I!K03&*I!%1#!K&I&%'H!3#M/H0%&/*!
51#/!"+!N'OL/*(!21+N+!'*K!P'$1'3Q!.%#&*(!@K+9+!
?3&I&*'HHQ!83#L#*%#K!&*!D;<<!'%!%1#!!""#$%&'()#$(*(&+%*"%$&,#$&-./%*"/,/.&+01"0$%(!@3&$#!R.&$&HQS(!)%'HQ(!'L!8'3%!/T!%1#!
)*%#3*'%&/*'H!.$1//H!/*!9&*K(!U3'&*(!'*K!@K0$'%&/*+!
!
!
!
!"#$%&'$(
51&L!8'8#3!#V8H/3#L!8/L&%&M#!*#O!K&3#$%&/*L!T/3!%1#!T0%03#!/T!#K0$'%&/*'H!%#L%&*I!WQ!#V'7&*&*I!%3#*KL!'%!%1#!
&*%#3T'$#!/T!%1#!H#'3*&*I!L$&#*$#L!'*K!'KM'*$#L!&*!#K0$'%&/*'H!%#$1*/H/I&#L+!:!W3&#T!1&L%/3Q!/T!%1#!3#H'%&/*!
W#%O##*!%#L%&*I!'*K!%#$1*/H/IQ!L#%L!%1#!L%'I#!T/3!'!H//4!'%!#7#3I&*I!X#K0C%#$1Y!%3#*KL!'*K!O1'%!%1#L#!7&I1%!
7#'*!T/3!%1#!T0%03#!/T!%#L%&*I+!51&L!1&L%/3&$'HC$3&%&$'H!H//4!'%!8'L%!'*K!83#L#*%!%#L%&*I!83'$%&$#L!3#M#'HL!%1'%!%1#!
H#'3*&*I!L$&#*$#L!1'M#!W##*!H#LL!&*TH0#*%&'H!&*!L1'8&*I!%1#!I3/O%1!/T!%#L%&*I!&*T3'L%30$%03#L!%1'*!$070H'%&M#!
'KM'*$#L!&*!%#$1*/H/IQ!%1'%!1'M#!#*'WH#K!H'3I#CL$'H#!L%'*K'3K&Z'%&/*!'*K!'0%/7'%&/*+![#!'3I0#!%1'%!K03&*I!%1#!
$033#*%!XK&I&%'H!3#M/H0%&/*Y!%1#!H#'3*&*I!L$&#*$#L!/0I1%!%/!'LL07#!7/3#!3#L8/*L&W&H&%Q!T/3!L1'8&*I!%1#!'K/8%&/*!
/T!*#O!%#L%&*I!%#$1*/H/I&#L+![#!83/8/L#!'!L#%!/T!83&*$&8H#L!%1'%(!&T!T/HH/O#K(!O/0HK!7/M#!%/7/33/O\L!%#L%&*I!
&*T3'L%30$%03#L!%/O'3K!H#'3*&*IC$#*%3&$!K#L&I*+!A/7W&*&*I!%1#!'TT/3K'*$#L!/T!*#O!K&I&%'H!%#$1*/H/I&#L!O&%1!
'KM'*$#L!&*!/03!0*K#3L%'*K&*I!/T!H#'3*&*I!7'4#!&%!8/LL&WH#!%/!W0&HK!%#L%L!%1'%!83/7/%#!70H%&CH#M#H!H#'3*&*I!&*!
#K0$'%&/*'H!LQL%#7L(!$'%'HQZ&*I!M&3%0/0L!$Q$H#L!/T!H#'3*&*I!T/3!#M#3Q/*#!%1#Q!'TT#$%]L%0K#*%L(!%#'$1#3L(!L$1//H!
H#'K#3L(!8/H&$Q!7'4#3L(!'*K!3#L#'3$1#3L+!51#!N&L$/5#L%^!)*&%&'%&M#!&L!83#L#*%#K!'L!'!3#T/37!#TT/3%!%1'%!&L!I0&K#K!
WQ!%1#L#!K#L&I*!83&*$&8'HL(!L#3M&*I!'L!'*!#V'78H#!/T!8/L&%&M#!*#O!8/LL&W&H&%&#L!T/3!%#L%&*I!'%!%1#!&*%#3T'$#!/T!%1#!
H#'3*&*I!L$&#*$#L!'*K!*#O!#K0$'%&/*'H!%#$1*/H/I&#L+!!!! !
!
"@A5)A:(!)6A+!
D!
!
)*$%+,-'$.+*/(%0,0#.1*.*1($0#$.*1(,-%.*1($20(,.1.$&3(%04+3-$.+*(
:KM'*$#L!&*!%#$1*/H/IQ!&*$3#'L&*IHQ!&*TH0#*$#!#K0$'%&/*'H!83'$%&$#!'*K!3#L#'3$1+!_/3!#V'78H#(!K03&*I!%1#!T&3L%!
%#*!Q#'3L!/T!%1#!D<L%!A#*%03Q!H'3I#!L$'H#!#K0$'%&/*'H!%#L%&*I!1'L!W#$/7#!'H7/L%!#*%&3#HQ!$/780%#3&Z#K(!'*K!
$H'LL3//7!%#L%&*I!&L*\%!T'3!W#1&*K+!51&L!8'8#3!#V8H/3#L!%1#!T0%03#!/T!#K0$'%&/*'H!%#L%&*I!&*!%1#!$/*%#V%!/T!
#7#3I&*I!8/L%C&*K0L%3&'H!%#L%&*I!&*T3'L%30$%03#L!'*K!'KM'*$#L!&*!%1#!H#'3*&*I!L$&#*$#L+!:L!W'$4I3/0*K(!O#!
83/M&K#!'!W3&#T!1&L%/3Q!/T!%1#!3#H'%&/*!W#%O##*!%#$1*/H/IQ!'*K!L%'*K'3K&Z#K!%#L%&*I(!#V8H/3&*I!1/O!%#$1*/H/I&$'H!
'KM'*$#L!1'M#!L1'8#K!%1#!O'Q!O#!%1&*4!'W/0%!'*K!#78H/Q!#K0$'%&/*'H!%#L%L+!?03!H//4!'%!%1#!1&L%/3Q!/T!%#L%&*I!
H#'KL!0L!%/!$/*$H0K#!%1'%(!%/!K'%#(!%#L%&*I!83'$%&$#L!1'M#!W##*!&*TH0#*$#K!7/3#!WQ!%#$1*/H/I&$'H!&**/M'%&/*L!&*!
%#L%!K#L&I*!'*K!'K7&*&L%3'%&/*!%1'*!WQ!'KM'*$#L!&*!%1#!H#'3*&*I!L$&#*$#L+!51#!1&L%/3Q!/T!%#L%&*I!'HL/!L1#KL!H&I1%!
/*!/03!$033#*%!%#L%&*I!83'$%&$#L!'*K!O1'%!%1#!*#'3!T0%03#!7&I1%!1/HK+!!!
)*%#3*#%!%#$1*/H/IQ!'*K!/%1#3!X#K0C%#$1Y!%3#*KL!O&HH!%3'*LT/37!L%'*K'3K&Z#K!%#L%&*I!&*!%1#!$/7&*I!K#$'K#L+![#!
'3I0#!%1'%!%1#!H#'3*&*I!L$&#*$#L!L1/0HK!'LL07#!7/3#!3#L8/*L&W&H&%Q!T/3!L1'8&*I!%1#!K#M#H/87#*%!'*K!'88H&$'%&/*!
/T!*#O!%#L%&*I!%#$1*/H/I&#L+!:88#'H&*I!%/!%1#!H#I'$Q!/T!$/*L%30$%&M&L7!'*K!%1#!#7#3I&*I!T&#HK!/T!7&*K(!W3'&*(!'*K!
#K0$'%&/*(!O#!L0II#L%!*#O!1%($*/*23.%*"$/.&K&3#$%&/*L!T/3!%1#!K#M#H/87#*%!/T!%#L%&*I!%#$1*/H/I&#L+![#!'3I0#!
%1'%!7/L%(!&T!*/%!'HH(!%#L%L!$'*!'*K!L1/0HK!W#!K#L&I*#K!%/!'&K!K&3#$%HQ!&*!%1#!83/$#LL!/T!H#'3*&*I!'*K!%#'$1&*I+!51&L!
&L!%1#!&K#'H!/T!%#L%&*I!&*!%1#!L#3M&$#!/T!H#'3*&*I(!7'K#!8/LL&WH#!%13/0I1!'KM'*$#L!&*!$/780%#3!%#$1*/H/IQ(!%1#!
H#'3*&*I!L$&#*$#L(!'*K!8LQ$1/7#%3&$L+!51#!N&L$/5#L%^!)*&%&'%&M#!L#3M#L!'L!'*!#V'78H#!/T!%1#L#!8/L&%&M#!*#O!
K&3#$%&/*L!T/3!%#L%&*I+!!
:%!%1#!$/3#!/T!%1#!N&L$/5#L%!&*&%&'%&M#!'3#!'!I3/O&*I!*07W#3!/T!L0W`#$%CL8#$&T&$(!3#L#'3$1CW'L#K(!#7W#KK#K(!
T/37'%&M#(!'*K!K&'I*/L%&$!'LL#LL7#*%L(!'HH!/T!O1&$1!'3#!L%'*K'3K&Z#K!%/!_&L$1#3aL!.4&HH!.$'H#!R_&L$1#3(!<Eb;c!
_&L$1#3!d!U&K#HH(!D;;=S!%13/0I1!%1#!0L#!/T!%1#!"#$%&$'H!:LL#LL7#*%!.QL%#7!RN'OL/*(!D;<;c!N'OL/*C50*&4(!D;;BS+!
51#L#!3#L/03$#C3&$1!'LL#LL7#*%L!L088/3%!70H%&CH#M#H!H#'3*&*I!&*!#K0$'%&/*'H!LQL%#7L!WQ!'KM'*$&*I!
%1#!0*K#3L%'*K&*I!/T!L%0K#*%L(!%#'$1#3L(!K#$&L&/*!7'4#3L(!'*K!3#L#'3$1#3L!RN'OL/*!d!.%#&*(!D;;bc!.%#&*(!
N'OL/*(!d!_&L$1#3(!D;<;S+![#!H//4!'%!%1#!3#L#'3$1!'*K!K#M#H/87#*%!W#1&*K!N&L$/5#L%L!'*K!%1#!%#$1*/H/I&$'H!
'KM'*$#L!%1'%!7'4#!%1#7!8/LL&WH#+!_&*'HHQ(!O#!#V8H/3#!%1#!#K0$'%&M#!'*K!7#'L03#7#*%!T0*$%&/*L!/T!N&L$/5#L%L!
&*!L$1//HL(!O1#3#!%1#Q!83/M&K#!3#'HC%&7#!K#M#H/87#*%'HHQ!'883/83&'%#!T##KW'$4!%/!L%0K#*%L(!&*K&M&K0'H!'*K!
$H'LL3//7!H#M#H!&*L&I1%L!&*%/!L%0K#*%!H#'3*&*I!T/3!%#'$1#3L(!LQL%#7LCH#M#H!83/T&H#L!/T!H#'3*&*I!T/3!'K7&*&L%3'%/3L(!
'*K!0*83#$#K#*%#K!7&$3/C!'*K!7'$3/CK#M#H/87#*%'H!K'%'!T/3!3#L#'3$1#3L+!:L!O#!#V8H'&*(!N&L$/5#L%L!'&7!%/!
83/7/%#!4/$"0#05&.6.1%5&#,&1%($*/*2!T/3!#M#3Q/*#!&*M/HM#K(!7'4&*I!I//K!/*!%1#!8/LL&W&H&%&#L!/T!%1#!K&I&%'H!
3#M/H0%&/*!WQ!H#M#3'I&*I!%1#!*#O!L$&#*$#!/T!H#'3*&*I+!
!
"@A5)A:(!)6A+!
,!
!("%.05(2.#$+%6(+5($0#$.*1(&*,($0'2*+3+16(
:KM'*$#L!&*!$/780%#3!%#$1*/H/IQ!1'M#!#*'WH#K!I/M#3*7#*%L!'*K!&*K0L%3&#L!%/!W#I&*!T0*K'7#*%'HHQ!$%7%5/2*/*2!
W'L&$!&*T3'L%30$%03#L!T/3!%3'*L8/3%'%&/*(!$/770*&$'%&/*L(!'*K!%1#!K#H&M#3Q!/T!#*#3IQ+!@K0$'%&/*'H!LQL%#7L!'L!'!
O1/H#(!'*K!%#L%&*I!&*T3'L%30$%03#L!&*!8'3%&$0H'3(!'3#!'HL/!W#&*I!3#K#L&I*#K!&*!%1#!O'4#!/T!%1#!K&I&%'H!3#M/H0%&/*+!)T!
$033#*%!%3#*KL!$/*%&*0#(!%1#!I/'HL!/T!83/M&K&*I!I/M#3*7#*%CL0WL&K&Z#K!W3/'KW'*K!'*K!X/*#!H'8%/8!8#3!$1&HKY!
'3#!H&4#HQ!%/!W#!3#'H&Z#K!&*!%1#!*#'3!T0%03#+!5/7/33/O\L!X#K0C%#$1Y!O&HH!#*'WH#!*#O!T/37L!/T!%#'$1&*I!'*K!
H#'3*&*I(!'L!O#HH!'L!*#O!T/37L!/T!%#L%&*I(!'K7&*&L%3'%&/*(!'*K!3#L#'3$1+!U0%!O&HH!%1#L#!*#O!T/37L!/T!%#L%&*I!
7#3#HQ!L#3M#!'L!7/3#!L%3#'7H&*#K!M#1&$H#L!T/3!L#3M&*I!08!$/*M#*%&/*'H!'LL#LL7#*%L(!/3!O&HH!#K0$'%&/*'H!%#L%&*I!
&%L#HT!W#!%3'*LT/37#Ke!![#!'3I0#!%1'%!%3'*LT/37'%&/*!&L!8/LL&WH#!&T!%1#!K#M#H/87#*%!/T!*#O!%#L%&*I!
&*T3'L%30$%03#L!&L!I0&K#K!WQ!'!$/*$#8%&/*!/T!%#L%&*I!%1'%!#7W/K&#L!%1#!W#L%!/T!O1'%!O#!4*/O!'W/0%!%#'$1&*I!'*K!
H#'3*&*I+!!
:*!&78/3%'*%!%1#7#!&*!%1#!1&L%/3Q!/T!L%'*K'3K&Z#K!%#L%&*I!&L!%1#!$/**#$%&/*!W#%O##*!'KM'*$#L!&*!%#$1*/H/IQ!
'*K!'KM'*$#L!&*!%1#!'7W&%&/*L(!L$/8#(!'*K!#TT&$&#*$Q!/T!%#L%&*I!83'$%&$#L+!_/3!%1&L!W3&#T!K&L$0LL&/*!O#!T/$0L!/*HQ!
/*!%1#!1&L%/3Q!/T!%#L%&*I!&*!%1#!f*&%#K!.%'%#L+!)78/3%'*%HQ(!f*&%#K!.%'%#L!%#L%&*I!83'$%&$#L!1'M#!L#%!%1#!8'$#!T/3!
7'*Q!$/0*%3&#L(!'H%1/0I1!*/%!'HH!R>'*#Q(!9'K'0L(!d!"Q/*L(!<EE,S+!51#!I/'H!/T!%1&L!L#$%&/*!&L!%/!L#%!'!$/*%#V%!T/3!
K&L$0LL&*I!%1#!#TT#$%L!%1'%!$/*%#78/3'3Q!'KM'*$#L!&*!&*T/37'%&/*!%#$1*/H/IQ!O&HH!1'M#!/*!L%'*K'3K&Z#K!%#L%&*I!
&*!%1#!K#$'K#L!%/!$/7#+!!
5#$1*/H/I&$'H!'KM'*$#L!1'M#!$1'*I#K!%1#!O'Q!%#L%L!'3#!'K7&*&L%#3#K!'*K!L$/3#K(!T3/7!8'8#3!'*K!8#*!%#L%L!
L$/3#K!'*K!$/77#*%#K!WQ!107'*L(!%/!8#*$&H!'*K!W0WWH#CL1##%!%#L%L!L$/3#K!WQ!7'$1&*#L]'*K!*/O!%/!T0HHQ!
$/780%#3&Z#K!%#L%!'K7&*&L%3'%&/*!83/$#LL#L!%1'%!&*M/HM#!'0%/7'%#K!L$/3&*I!'HI/3&%17L!'*K!$/78H#V!L%'%&L%&$'H!
'*'HQL#L+!@'$1!7'`/3!%#$1*/H/I&$'HHQ!&*K0$#K!$1'*I#!&*!#K0$'%&/*'H!%#L%&*I!1'L!W##*!'$$/78'*&#K!WQ!$1'*I#L!&*!
&%L!T/37!'*K!T0*$%&/*+!23&/3!%/!%1#!&*%3/K0$%&/*!/T!L%'*K'3K&Z#K!70H%&8H#C$1/&$#!%#L%L(!W/%1!$H'LL3//7!'*K!
g0'H&TQ&*I!'LL#LL7#*%L!%//4!7'*Q!T/37L+!51#Q!80HH#K!/*!'!O&K#!3'*I#!/T!L4&HHL!'*K!4*/OH#KI#(!&*$H0K&*I!%1/L#!
T/3!O3&%&*I(!3#'L/*&*I(!/3'H!#V83#LL&/*(!'*K!4*/OH#KI#!'88H&$'%&/*(!'*K!/T%#*!&*M/HM#K!/*#C/*C/*#!&*%#3'$%&/*!
O&%1!'!%#'$1#3+!>/O#M#3(!%1#L#!%#L%L!O#3#!L$/3#K!L0W`#$%&M#HQ!'*K!O#3#!*/%!L%'*K'3K&Z#K+!51#3#!O'L!*/!O'Q!/T!
4*/O&*I!&T!L%0K#*%L!&*!/*#!$H'LL3//7!O#3#!W#&*I!#M'H0'%#K!/*!%1#!L'7#!%#37L!'L!L%0K#*%L!&*!'*/%1#3!$H'LL3//7+!
51#L#!83/WH#7L!O#3#!L/HM#K!O&%1!%1#!'KM#*%!/T!8#*$&H!'*K!W0WWH#CL1##%!%#L%L!%1'%!7'K#!&%!8/LL&WH#!%/!
'K7&*&L%#3!L%'*K'3K&Z#K!/W`#$%&M#!%#L%L!%/!%1/0L'*KL!/T!L%0K#*%L+!>/O#M#3(!%1#3#!O#3#!$/L%L+!51#!*#O!%#L%L!
O#3#!$/78/L#K!#V$H0L&M#HQ!/T!70H%&8H#C$1/&$#!&%#7L!O&%1!3&I1%!'*K!O3/*I!'*LO#3L(!H&7&%&*I!%1#!3'*I#!/T!L4&HHL!
%1#Q!$/0HK!'KK3#LL+!2#31'8L!7/3#!&78/3%'*%HQ(!%1#!3/H#!/T!%#L%&*I!'L!'!7#'*L!/T!L/3%&*I!L%0K#*%L!W#I'*!%/!
/M#3L1'K/O!%1#!3/H#!/T!%#L%&*I!'L!8'3%!/T!%1#!H#'3*&*I!$Q$H#+!!
51#!T&3L%!/T!%1#!8#*$&H!'*K!W0WWH#CL1##%!'LL#LL7#*%L!O#3#!83&7'3&HQ!0L#K!%/!XL/3%Y!L%0K#*%L!'%!%1#!H#M#H!/T!%1#!
L$1//H(!1'M&*I!H&%%H#!#TT#$%!08/*!$H'LL3//7!&*L%30$%&/*!/3!%#L%&*I!W#Q/*K!%1#!I3'K0'H!&*%3/K0$%&/*!/T!70H%&8H#C
$1/&$#!&%#7L!&*%/!$H'LL3//7!'LL#LL7#*%L+!>0*K3#KL!/T!%#L%!80WH&L1#3L!L/HK!%#L%L!%/!%1/0L'*KL!/T!L$1//HL(!'*K!
!
"@A5)A:(!)6A+!
B!
O1&H#!H/$'H!83'$%&$#L!K&TT#3#K(!%#L%CW'L#K!%3'$4&*I!R'*K!#V$H0L&/*S!W#$'7#!%1#!*/37+!:L!%1&L!*#O!T/37!/T!%#L%&*I!
I'&*#K!&*!8/80H'3&%Q(!'KM'*$#L!&*!%#L%!K#M#H/87#*%!'*K!'0%/7'%#K!L$/3&*I!O/0HK!7'4#!&%!8/LL&WH#!%/!$3#'%#!'!
*'%&/*'H!%#L%&*I!&*T3'L%30$%03#(!3#'H&Z#K!&*!%1#!f*&%#K!.%'%#L!O&%1!%1#!T/0*K&*I!/T!%1#!@K0$'%&/*'H!5#L%&*I!.#3M&$#+!
@M#*%0'HHQ(!T#K#3'H!8/H&$&#L!O/0HK!#V8'*K!%1&L!6'%&/*'H!%#L%&*I!&*T3'L%30$%03#!%/!&*$H0K#!'HH!hC<D!L$1//HL(!'!7/M#!
O1&$1!1'L!K3'7'%&$'HHQ!'H%#3#K!%#L%&*I!83'$%&$#L(!K##8HQ!'TT#$%&*I!$H'LLC3//7!83'$%&$#L(!L%3'&*&*I!#V&L%&*I!%#L%&*I!
3#L/03$#L(!'*K!$3#'%&*I!'!K#7'*K!T/3!&783/M#K!%#L%&*I!&*T3'L%30$%03#L!'*K!1&I1#3!g0'H&%Q!%#L%L!O&%1!I3#'%#3!
#K0$'%&/*'H!M'H0#+!!
[#!%3'$#!$/**#$%&/*L!W#%O##*!%#L%&*I!'*K!%#$1*/H/IQ!'$3/LL!%13##!W3/'K!1&L%/3&$'H!#3'LF!&*K0L%3&'H!R<bb;!C!
<E,;Sc!H'%#!&*K0L%3&'H!R<E,;!C!<Eb;Sc!8/L%C&*K0L%3&'H!R<Eb;!i!83#L#*%S+!51#L#!#3'L!'3#!K&TT#3#*%&'%#K!T/3!1#03&L%&$!
8038/L#L!'*K!3#TH#$%!$/78'3'WH#!K&M&L&/*L!T/0*K!&*!%1#!1&L%/3&$'H!L/03$#L!$&%#K!W#H/O+!!!!!!!
)*K0L%3&'H!@3'!R<bb;C<E,;S!
51#!3//%L!/T!7/K#3*!#K0$'%&/*'H!%#L%&*I!$'*!W#!T/0*K!&*!%1#!O/34!/T!#'3HQ!8LQ$1/H/I&L%L!R?aN/**#HH(!<Eb-S+!
23#$&L#HQ!#*I&*##3#K!#H#$%3&$'H!#g0&87#*%!'*K!*#OHQ!&*M#*%#K!8LQ$1/7#%3&$!%#$1*&g0#L!'HH/O#K!T/3!%1#!4&*KL!/T!
83#$&L#!7#'L03#7#*%L!%1'%!W3/0I1%!#'3HQ!83#L%&I#!%/!8LQ$1/81QL&$L(!'*K!H'%#3(!W#1'M&/3&L7+!:L!8LQ$1/H/IQ!I3#O!
W#Q/*K!%1#!H'W/3'%/3Q(!%1#!&78/3%'*$#!'*K!83#L%&I#!/T!7#'L03#7#*%!3#7'&*#K(!'*K!%1#!83'$%&$#!/T!7#*%'H!
%#L%&*I!W#$'7#!$#*%3'H!%/!%1#!&K#*%&%Q!/T!%1#!#7#3I&*I!K&L$&8H&*#!RU3/O*(!<EEDS+!)j!%#L%&*I(!&*!8'3%&$0H'3(!
$'8%03#K!%1#!80WH&$!&7'I&*'%&/*!'*K!T/0*K!&%L!O'Q!&*%/!%1#!8H'*L!/T!8/H&$Q!7'4#3L!'*K!#K0$'%&/*'H!3#T/37#3L!
Rk/0HK(!<Eb<S+!!
5#L%&*I!O'L!H'W/3!&*%#*L&M#!&*!%1#!K'QL!O1#*!%1#!K/7&*'*%!%#$1*/H/I&#L!T/3!#K0$'%&/*!O#3#!%1#!%#V%W//4(!%1#!
$1'H4W/'3K(!'*K!8#*!'*K!8'8#3+!5#L%!'K7&*&L%3'%/3L!O#3#!3#g0&3#K!%/!1'*KH#!%#L%C%'4#3L!K&3#$%HQ(!/T%#*!/*#C/*C
/*#(!'*K!*07#3/0L!8#3L/**#H!O#3#!*##K#K!%/!L$/3#!%#L%L!'*K!$/780%#!L$/3#L!WQ!1'*K+!U0%!%1#!&*M#*%&/*!/T!%1#!
70H%&8H#C$1/&$#!%#L%!$1'*I#K!#M#3Q%1&*I!R.'7#HL/*(!<EE;S+!N03&*I!7/W&H&Z'%&/*!#TT/3%L!T/3!%1#!_&3L%![/3HK!['3(!
:7#3&$'*!8LQ$1/H/I&L%L!O#3#!3#$30&%#K!%/!'K7&*&L%#3!#V'7&*'%&/*L]%1#!f.!:37Q!:H81'!5#L%L]%/!/M#3!%O/!
7&HH&/*!L/HK&#3L+!51&L!H'3I#!L$'H#!%#L%&*I!#TT/3%!O'L!8/LL&WH#!7'&*HQ!W#$'0L#!/T!%1#!&*M#*%&/*!/T!%1#!70H%&8H#C
$1/&$#!%#L%!&%#7!T/37'%+!90H%&8H#C$1/&$#!%#L%L!$/0HK!W#!#'L&HQ!'K7&*&L%#3#K(!%1#*!L$/3#K!3'8&KHQ!O&%1!L%#*$&HL!
%1'%!/M#3H'&K!'*LO#3!L1##%L+!51#!:37Q!#TT/3%L!K#7/*L%3'%#K!%1'%!'*!)jC%#L%&*I!&*T3'L%30$%03#!R/T!X&*K0L%3&'H!
L$'H#YS!$/0HK!W#!W0&H%!'*K!7'&*%'&*#K!R./4'H(!<EE;S+!
:%!%1#!%03*!/T!%1#!$#*%03Q(!&*K0L%3&'H&Z'%&/*(!03W'*&Z'%&/*(!'*K!&77&I3'%&/*!T/3$#K!7'`/3!$1'*I#L!&*!:7#3&$'*!
80WH&$!#K0$'%&/*(!#L8#$&'HHQ!&*!H'3I#!03W'*!K&L%3&$%L(!O1&$1!#V8#3&#*$#K!L4Q3/$4#%&*I!L%0K#*%!*07W#3L!RA3#7&*(!
<EbbS+!51'*4L!&*!8'3%!%/!%1#!#V'78H#!/T!%1#!O'3!%&7#!%#L%&*I!#TT/3%L(!)jC%#L%&*I!'*K!3#H'%#K!T/37L!/T!
XL%'*K'3K&Z#KY!'LL#LL7#*%!T&I03#K!83/7&*#*%HQ!&*!%1#!W03#'0$3'%&$!'*K!8#K'I/I&$'H!3#T/37L!%1'%!$3#'%#K!%1#!
L$1//H&*I!83'$%&$#L!$1'3'$%#3&L%&$!/T!%1#!&*K0L%3&'H!#3'+!UQ!<E,;(!)jCL%QH#!70H%&8H#C$1/&$#!L%'*K'3K&Z#K!%#L%&*I!
!
"@A5)A:(!)6A+!
-!
O'L!0W&g0&%/0L!&*!:7#3&$'*!80WH&$!L$1//HL(!'*K!O'L!%Q8&$'HHQ!0L#K!%/!%3'$4!L%0K#*%L!&*%/!K&TT#3#*%!I3/08L!T/3!
&*L%30$%&/*!'*K!7'*'I#7#*%!RA1'87'*(!<EbbS+!51&L!I3/O&*I!%#L%&*I!&*T3'L%30$%03#!'HL/!'HH/O#K!T/3!%1#!
W#I&**&*IL!/T!%1#!XL$&#*%&T&$!7'*'I#7#*%Y!/T!L$1//H!/8#3'%&/*L!RA'HH'1'*(!<E=BS+!!@K0$'%&/*'H!3#L#'3$1#3L!
W#I'*(!T/3!%1#!T&3L%!%&7#(!%/!LQL%#7'%&$'HHQ!0L#!%#L%!3#L0H%L!%/!&*T/37!%1#&3!%1&*4&*I!'W/0%!L$1//H!&783/M#7#*%L!
R"'I#7'**(!D;;;S+!51#!I3#'%#L%!L%3#*I%1L!/T!%1#L#!T&3L%!H'3I#CL$'H#!%#L%&*I!#TT/3%L!O#3#!%1#&3!$/*%3&W0%&/*L!%/!
/3I'*&Z'%&/*'H!#TT&$&#*$Q!'*K!#K0$'%&/*'H!3#L#'3$1(!O1#3#!%1#Q!R/L%#*L&WHQS!/TT#3#K!70$1!*##K#K!/W`#$%&M&%Q!'*K!
83/T#LL&/*'H!$H/0%!&*!%1#!&*$3#'L&*IHQ!$/78H#V!'*K!8/H&%&$&Z#K!O/3HK!/T!#K0$'%&/*+!!!
>/O#M#3(!#'3HQ!%#L%&*I!&*T3'L%30$%03#L!O#3#!#V8#*L&M#(!#33/3!83/*#(!'*K!O&K#HQ!$3&%&$&Z#K(!O&%1!$/*%#*%&/0L!
K#W'%#L!'W/0%!)j!%#L%&*I!&*!%1#!80WH&$!L81#3#(!L$'*K'HL(!'*K!%1#!H#I'$Q!/T!@0I#*&$L!Rk/0HK(!<Eb<S+!5#L%CW'L#K!
%3'$4&*I!83'$%&$#L!'*K!#V$H0L&/*!%//4!/*!&*$3#'L&*I!L&I*&T&$'*$#!'L!#$/*/7&$!$1'*I#L!7'K#!#K0$'%&/*'H!
'%%'&*7#*%!&*$3#'L&*IHQ!*#$#LL'3Q!T/3!/$$08'%&/*'H!L0$$#LL+!51#!O#'4*#LL#L!/T!#'3HQ!H'3I#CL$'H#!%#L%&*I!#TT/3%L!
&*$H0K#!%1#&3!30&*/0L!#TT#$%L!/*!%1#!#K0$'%&/*'H!%3'`#$%/3&#L!/T!L/7#!L%0K#*%L(!3'78'*%!W&'L!'*K!T3#g0#*%!#33/3L!
&*!&%#7!$/*L%30$%&/*!'*K!L$/3&*I(!'*K!%1#!&*$3#'L&*I!0L#!/T!70H%&8H#C$1/&$#(!3'%1#3!%1'*!/8#*C#*K#K(!&%#7L!&*!
$H'LL3//7!%#L%L+!51#!Q/0*I!%#L%&*I!&*K0L%3Q!3#L8/*K#K!%/!80WH&$!$3&%&$&L7!WQ!8H'$&*I!'*!#781'L&L!/*!/W`#$%&M&%Q!
'*K!L%'*K'3K&Z'%&/*(!O1&$1!&%!803L0#K!WQ!$/*L%3'&*&*I!&%#7!$/*%#*%!'*K!7'4&*I!T03%1#3!&**/M'%&/*L!&*!%#L%C
L$/3&*I!%#$1*/H/IQ(!L%'%&L%&$'H!7/K#H&*I(!'*K!%#L%!K#L&I*+!U0%!%1#Q!H'3I#HQ!&I*/3#K!$/*$#3*L!#V83#LL#K!WQ!
%#'$1#3L!'*K!#K0$'%&/*'H!8LQ$1/H/I&L%L!'W/0%!%1#!#TT#$%L!/T!%1&L!4&*K!/T!%#L%&*I!/*!%#'$1&*I!'*K!H#'3*&*I!&*!%1#!
$H'LL3//7+!:0%/7'%#K!%#L%!L$/3&*I!%#$1*/H/IQ!'*K!I3/O&*I!T#K#3'H!&*TH0#*$#!/*!%1#!L1'8#!/T!80WH&$!#K0$'%&/*!
O/0HK!L//*!$3#'%#!'!7'`/3!3/H#!T/3!%#L%&*I!&*!:7#3&$'\L!&*$3#'L&*IHQ!H'3I#!'*K!$/78H#V!#K0$'%&/*'H!LQL%#7!
RA3#7&*(!<Ebbc!"#7'**(!<EEEc!.83&*I(!<EbES+!!
"'%#C)*K0L%3&'H!@3'!R<E,<C<Eb;S!
)*!<E,<!'!Q/0*I!1&I1!L$1//H!L$&#*$#!%#'$1#3!T3/7!9&$1&I'*!L/HM#K!'!%#$1*/H/I&$'H!83/WH#7!%1'%!)U9!1'K!W##*!
O/34&*I!/*!0*L0$$#LLT0HHQ!T/3!Q#'3LF!'0%/7'%#K!%#L%!L$/3&*I+!51#!&78H&$'%&/*L!'*K!L0WL#g0#*%!%#$1*&$'H!
K#M#H/87#*%L]L0$1!'L!%1#!.$'*%3/*!7'$1&*#]O/0HK!T'$&H&%'%#!%1#!$/*L%30$%&/*!/T!%1#!T&3L%!*'%&/*'H!
L%'*K'3K&Z#K!%#L%&*I!&*T3'L%30$%03#!R"#7'**(!<EEES+!!51#!$#*%#38&#$#!/T!%1&L!*#OHQ!'0%/7'%#K!%#L%&*I!
&*T3'L%30$%03#!O'L!%1#!@K0$'%&/*'H!5#L%&*I!.#3M&$#!R@5.S(!O1&$1!#7#3I#K(!&*!8'3%(!'L!'!3#L0H%!/T!%1#!T#K#3'H!
I/M#3*7#*%\L!&*%#3#L%!&*!#V#3$&L&*I!g0'H&%Q!$/*%3/H!'*K!K#%#37&*&*I!1/O!W#L%!%/!T0*K!3#L#'3$1!'*K!
K#M#H/87#*%+!51#!.:5]'!70H%&8H#!$1/&$#!%#L%!O&%1!K&3#$%!H&*#'I#!%/!%1#!:37Q!:H81'L]$1'*I#K!%1#!*'%03#!/T!
$/HH'I#!'K7&LL&/*L!83/$#LL#L!'*K!L1'8#K!%1#!#K0$'%&/*'H!$'3##3L!/T!%1#!7&HH&/*L!O1/!TH//K#K!&*%/!%1#!1&I1#3!
#K0$'%&/*!LQL%#7!&*!%1#!8/L%CO'3!K#$'K#L!R.83&*I(!<EbES+!!
.#M#3'H!O'M#L!/T!LO##8&*I!T#K#3'H!#K0$'%&/*'H!H#I&LH'%&/*!K03&*I!%1#!A/HK!['3!$/*L/H&K'%#K!%1#!L1'8#!/T!H'%#C
&*K0L%3&'H!#3'!#K0$'%&/*+!51#L#!&*$H0K#K!T#K#3'H!T0*K&*I!%/!$3#'%#!%1#!6._!'*K!83/7/%#!.5@9!#K0$'%&/*!&*!hC<D(!
$&M&H!3&I1%L(!K#L#I3#I'%&/*(!'*K!%1#!['3!/*!2/M#3%Q!83/I3'7L(!L0$1!'L!>#'K!.%'3%+!51#!T#K#3'H!I/M#3*7#*%!W#I'*!
!
"@A5)A:(!)6A+!
=!
3#$30&%&*I!%1#!%#L%&*I!&*K0L%3Q!%/!'&K!&*!8/H&$Q!'*K!83/I3'7!#M'H0'%&/*!L%0K&#L!RA'78W#HH(!<El-S+!:L!%1#!XL$&#*%&T&$!
7'*'I#7#*%Y!/T!#K0$'%&/*'H!3#T/37!K3#O!O&K#*&*I!L088/3%(!T#K#3'HHQ!7'*K'%#K!#K0$'%&/*'H!%#L%&*I!#V8'*K#K(!
#M#*%0'HHQ!%/!&*$H0K#!%1#!6:@2(!%1#!)/O'!%#L%L(!'*K!'!1/L%!/T!/%1#3!*'%&/*'H!hC<D!%#L%L+!51#!L%3#*I%1L!/T!%1&L!T&3L%!
O'M#!/T!*'%&/*'H!%#L%&*I!#TT/3%L!&*$H0K#!&%L!#781'L&L!/*!L/$&'H!`0L%&$#!'*K!%1#!83/7/%&/*!/T!#K0$'%&/*'H!#g0&%Qc!
@5.!O'L!T/0*K#K!O&%1!%1#!#V8H&$&%!I/'H!/T!#V8'*K&*I!$/HH#I#!'$$#LL!'*K!3#8H'$&*I!%1#!#V&L%&*I!'3&L%/$3'$Q!O&%1!'!
7#3&%/$3'$Q!R"#7'**(!<EEES+!!
>/O#M#3(!K&L$/03L#!$/*%&*0#K!'W/0%!%1#!H&7&%'%&/*L!/T!L%'*K'3K&Z#K!%#L%L(!&*$H0K&*I!$3&%&g0#L!/T!%1#!70H%&8H#C
$1/&$#!&%#7!&%L#HT(!*#O!$/*$#3*L!'W/0%!W&'L!&*!%#L%&*I!83'$%&$#L(!'*K!'!I3/O&*I!K&L$/*%#*%!'W/0%!%1#!/M#3'HH!
L1'8#!/T!%1#!#7#3I&*I!%#L%CW'L#K!7#3&%/$3'$Q!R>/TT7'*(!<E=Dc!6'&3*(!<Eb;S+!:!4#Q!O#'4*#LL!&*!%1#!8/L%CO'3!
%#L%&*I!&*T3'L%30$%03#!O'L!&%L!$/*%&*0#K!3#H&'*$#!/*!'!*'33/O!3'*I#!/T!&%#7!K#L&I*L(!O&%1!%1#!M'L%!7'`/3&%Q!/T!
%#L%L!R&*$H0K&*I!%1#!.:5S!O#KK#K!0*g0#L%&/*'WHQ!%/!%1#!70H%&8H#C$1/&$#!T/37'%!'*K!'H7/L%!#*%&3#HQ!0*&*T/37#K!
WQ!'KM'*$#L!&*!H#'3*&*I!%1#/3Q!'*K!#K0$'%&/*'H!8LQ$1/H/IQ+!51#!T#K#3'H!&*TH0V!/T!L088/3%!T/3!%#L%&*I!H#K!'HL/!%/!
W3/'K!$/*$#3*L!%1'%!%1#!#K0$'%&/*'H!LQL%#7!O'L!W#&*I!%03*#K!&*%/!'!4&*K!/T!XL/3%&*I!7'$1&*#Y!T/3!107'*!
$'8&%'H(!3#O'3K&*I!'!H&7&%#K!L#%!/T!#K0$'%&/*'H!%3'`#$%/3&#L!%13/0I1!%1#!0L#!/T!%#L%L!%1'%!T/$0L!/*!7/L%HQ!.5@9!
3#H'%#K!L4&HHL!'*K!$/78#%#*$&#L!R.83&*I(!<EbES+!!J#H'%#KHQ(!%1#!*#I'%&M#!#TT#$%L!/T!&*$3#'L#K!%#L%&*I!/*!$H'LL3//7!
83'$%&$#!$/*%&*0#K!%/!7/0*%(!'L!%1#!1&I1CL%'4#L!70H%&8H#C$1/&$#!#V'7!$'7#!%/!LQ7W/H&Z#!:7#3&$'*!#K0$'%&/*!
&%L#HT!R.'$4L(!<EEEc!.'7#HL/*(!<EE;S+!
6#M#3%1#H#LL(!%1'*4L!%/!T#K#3'H!'*K!83&M'%#!&*%#3#L%L(!'*K!%1#!/L%#*L&M#!/W`#$%&M&%Q!%#L%L!83/M&K#K!T/3!#K0$'%/3L!
MQ&*I!T/3!83/T#LL&/*'H!'*K!L$&#*%&T&$!3#L8#$%'W&H&%Q(!%1#!L%'*K'3K&Z#K!%#L%&*I!&*K0L%3Q!$/*%&*0#K!%/!#V8'*K!'*K!
K&M#3L&TQ!R>'*#Q(!#%!'H+(!<EE,S+!A/780%#3!%#$1*/H/IQ(!&*!8'3%&$0H'3(!T0#HH#K!'7W&%&/*L!T/3!W0&HK&*I!%#L%&*I!
&*T3'L%30$%03#L!/T!&*$3#'L&*I!L&Z#!'*K!L/81&L%&$'%&/*+!N03&*I!%1#!l;\L!'*K!&*%/!%1#!b;L!%1#!3/H#!/T!H'3I#CL$'H#!
L%'*K'3K&Z#K!%#L%&*I!&*T3'L%30$%03#L!&*!80WH&$!#K0$'%&/*!W#$'7#!&*$3#'L&*IHQ!L&I*&T&$'*%!'*K!7/3#!$/78H#V(!O&%1!
%1#!T&3L%!'88#'3'*$#!/T!1&I1CL%'4#L!L%'%#CO&K#!I3'K0'%&/*!#V'7L(!%1#!:2(!kJ@(!".:5(!'*K!'*!#M#3CI3/O&*I!%#L%C
83#8!'*K!%0%/3&*I!L#$%/3!R.'$4L(!<EEES+!!!
2/L%C&*K0L%3&'H!R<Eb;C!83#L#*%S!
A/*%&*0#K!'KM'*$#L!&*!%1#!$/780%#3&Z#K!'K7&*&L%3'%&/*!'*K!L$/3&*I!/T!%#L%L(!'L!O#HH!'L!'KM'*$#L!&*!K'%'!
7'*'I#7#*%!%#$1*&g0#L(!T0#H#K!8/H&$Q!7'4#3L\!'7W&%&/*L!%/!W0&HK!'!*'%&/*'H!hC<D!%#L%&*I!&*T3'L%30$%03#!T/3!0L#!
&*!83/I3'7!#M'H0'%&/*!'*K!LQL%#7LCH#M#H!'$$/0*%'W&H&%Q!R21&HH&8L(!D;;,S+!51#!T&*'H!80L1!%/O'3K!'!$/783#1#*L&M#!
T#K#3'H!%#L%&*I!&*T3'L%30$%03#!W#I'*!O&%1!23#L&K#*%!U0L1\L!89%$/.(&:;;;!RU0L1(!<EE<S(!&*!O1&$1!1#!83/8/L#K!'!
*'%&/*'H!%#L%&*I!'88'3'%0L!%1'%!O/0HK!W#!%&#K!%/!'!*'%&/*'H!$033&$0H07!'*K!0L#K!%/!'LL03#!%1#!#g0&%'WH#!
K&L%3&W0%&/*!/T!#K0$'%&/*'H!/88/3%0*&%Q!'L!O#HH!'L!:7#3&$'*!$/78#%&M#*#LL!&*!%1#!IH/W'H!7'34#%8H'$#+!23#L&K#*%!
AH&*%/*!H'%#3!#*K/3L#K!%1#!8H'*!W0%!W'$4#K!/TT!%1#!&K#'!/T!'!*'%&/*'H!%#L%+!)*!D;;<(&<#&+=/17&>%,"&?%=/*7!R>#LL!d!
2#%3&HH&(!D;;=S!83/M&K#K!'!T#K#3'H!7'*K'%#!%/!W0&HK!'!hC<D!%#L%&*I!&*T3'L%30$%03#!T/3!'$$/0*%'W&H&%Q!8038/L#L(!W0%!
!
"@A5)A:(!)6A+!
l!
*/%!&*!%1#!T/37!/T!'!L&*IH#!*'%&/*'H!%#L%+!)*L%#'K(!'!K#$#*%3'H&Z#K!$/78#%&%&/*C/3&#*%#K!L#%!/T!%#L%&*I!83'$%&$#L!
O'L!3/HH#K!/0%(!O&%1!I3#'%!M'3&'%&/*!T3/7!L%'%#!%/!L%'%#(!0L1#3&*I!&*!'*!#V8'*K&*I!T/3C83/T&%!$/780%#3C&*%#*L&M#!
%#L%&*I!&*K0L%3Q!R5/$1(!D;;=S+!!
51#!M#3K&$%!/*!6A"U!'L!'!%#L%&*I!&*&%&'%&M#!&L!/TT&$&'HHQ!L%&HH!/0%(!W0%!%1#!#7#3I&*I!3#L0H%L!'3#!7/L%HQ!*#I'%&M#!
R>03L1(!D;;bS(!#M#*!'7/*I!%1/L#!O&%1!LQ78'%1&#L!%/O'3K!6A"U\L!W3/'K!I/'HL!Rh/3#%Z(!D;;bc!J'M&%$1(!D;<;S+!:!
D;<<!3#8/3%!T3/7!J:6N!'3I0#L!%1'%!6A"U!%#L%&*I!1'L!L&I*&T&$'*%HQ!'*K!*#I'%&M#HQ!$/*L%3'&*#K!$H'LL3//7!
83'$%&$#L!&*!7'*Q!8H'$#L(!'*K!$'HHL!T/3!*#O!'883/'$1#L!%/!#K0$'%&/*'H!7#'L03#7#*%(!#L8#$&'HHQ!%1/L#!%1'%!
$/*%3&W0%#!%/!H#'3*&*I!'*K!H#M#3'I#!*#O!%#$1*/H/I&#L!R.$1O'3%Z(!>'7&H%/*(!.%#$1#3(!d!.%##H#(!D;<<S+!A'HHL!T/3!
L#3&/0LHQ!3#%1&*4&*I!%1#!%#L%&*I!&*T3'L%30$%03#!1'M#!'HL/!$/7#!T3/7!%1#!6'%&/*'H!J#L#'3$1!A/0*$&H!RD;;<S(!O1&$1!
H&4#O&L#!'3I0#!T/3!'!%#L%&*I!&*T3'L%30$%03#!W0&H%!'3/0*K!%1#!H#'3*&*I!L$&#*$#L!'*K!*#O!%#$1*/H/I&#L+!23/7&*#*%!
H#'3*&*I!L$&#*%&L%L!'*K!#K0$'%/3L!1'M#!%'4#*!L%3/*I!L%'*KL!'I'&*L%!$033#*%!%#L%&*I!83'$%&$#L!RN'3H&*IC>'77/*K(!
<EE=S+!
A#*%3'H!%/!7'*Q!/T!%1#L#!$3&%&$&L7L!&L!%1#!T'$%!%1'%!%#L%L!W0&H%!&*!%1#!O'4#!/T!6A"U!1'M#!$/*%&*0#K!%/!1#'M&HQ!3#HQ!
/*!'![[)!#3'!%#$1*/H/IQ]%1#!70H%&8H#C$1/&$#!&%#7+!)*!8'3%(!%1&L!&L!W#$'0L#!%1#!%#L%&*I!&*K0L%3Q!&L!L%3#%$1#K!
%1&*(!O&%1/0%!'K#g0'%#!L$&#*%&T&$!8#3L/*'H!/3!3#L#'3$1!'*K!K#M#H/87#*%!$'8'W&H&%&#L!R5/$1(!D;;=S+!51#!'K/8%&/*!
/T!*#O!%#$1*/H/I&#L!&*!%#L%!K#L&I*(!'K7&*&L%3'%&/*(!'*K!L$/3&*I!&L!K3&M#*!83&7'3&HQ!WQ!$/*$#3*L!'W/0%!#TT&$&#*$&#L!
T/3!K#'H&*I!O&%1!#$/*/7&#L!/T!L$'H#(!'L!*/O!7&HH&/*L!/T!L%0K#*%L!70L%!W#!%#L%#K!#M#3Q!Q#'3+!"&4#O&L#(!'L!1&L%/3Q!
1'L!L1/O*(!'KM'*$#L!&*!%1#!H#'3*&*I!L$&#*$#L!K/!*/%!K3&M#!%#L%!K#L&I*!/3!T3'7#!%1#!'K/8%&/*!/T!*#O!%#$1*/H/I&#L!
T/3!%#L%&*I+!20%%&*I!%#L%&*I!&*!%/0$1!O&%1!%1#!*#O!L$&#*$#L!/T!H#'3*&*I!&L!*/%!/*!%1#!'I#*K'!/T!7/L%!H'3I#!%#L%&*I!
T&37L!R_'3H#Q(!D;;ES+!51#!*'33/O!T/$0L!/T!&%#7!$/*L%30$%&/*!'*K!%1#!*'33/O!3'*I#!/T!'$'K#7&$!$/*%#*%!1'L!
W#I0*!%/!K3'L%&$'HHQ!'TT#$%!$H'LL3//7!83'$%&$#L(!7/M&*I!7'*Q!L$1//HL!%/O'3K!'!T/$0L!/*!%#L%C83#8(!'*K!
L/7#%&7#L!%/O'3K!/0%3&I1%!$1#'%&*I!R>03L1(!D;;bS!R6&$1/HL!d!U#3H&*#3(!D;;lS!6#M#3%1#H#LL(!T#K#3'H!8/H&$Q!&L!
H&4#HQ!%/!7'*K'%#!7/3#!%#L%&*I(!'*K!%/!$/*%&*0#!%/!L088/3%!%1#!1&I1CL%'4#L!%#L%CK3&M#*!3#T/37L(!L$1//H!$H/L03#L(!
'*K!$1'3%#3!L$1//H!3/%'%&/*L!%1'%!K/7&*'%#!7'*Q!L$1//H!LQL%#7L!RJ'M&%$1(!D;<;S+!
51#!?W'7'!'K7&*&L%3'%&/*!1'L!L#*%!7&V#K!7#LL'I#L!'W/0%!T0%03#!/T!%#L%&*I+!51#Q!1'M#!W##*!/8#*HQ!$3&%&$'H!/T!
6A"U(!L8#$&T&$'HHQ!*/%&*I!%1#!*#I'%&M#!#TT#$%L!/T!%#L%&*I!R?W'7'(!D;;bS(!O1&H#!'%!%1#!L'7#!%&7#(!?W'7'\L!
N#8'3%7#*%!/T!@K0$'%&/*!1'L!T0*K#K!%O/!H'3I#!%#L%CK#M#H/87#*%!$/*L/3%&'!%'L4#K!O&%1!W0&HK&*I!%1#!W#I&**&*IL!
/T!'!*#O!*'%&/*'H!%#L%&*I!&*T3'L%30$%03#(!O1&$1!&L!%/!W#!O#KK#K!%/!%1#!*#O!A/77/*!A/3#!.%'*K'3KL!Rf.!
K#8'3%7#*%!/T!#K0$'%&/*(!D;<<S+!51#!$'HH!&L!T/3!*#O!'LL#LL7#*%L!%1'%!7#'L03#!D<L%!$#*%03Q!L4&HHL(!I/&*I!W#Q/*K!
70H%&8H#C$1/&$#!&%#7L!'*K!L1'HH/O!'LL#LL7#*%L!/T!L4&HH+!./(!O1&H#!%1#!L1'8#!/T!%/7/33/O\L!*'%&/*'H!%#L%&*I!
&*T3'L%30$%03#!&L!&*K#%#37&*'%#(!O#!$'*!W#!L03#!&%!O&HH!W#!H'3I#3(!7/3#!$/78H#V(!'*K!&*%#I3'%#K!O&%1!*#O!
%#$1*/H/I&#L+!!!!
!
"@A5)A:(!)6A+!
b!
N/M#%'&H&*I!O&%1!L/7#!/T!%1#L#!$#*%3'H!&LL0#L(!O1&$1!K&3#$%HQ!$/*$#3*!%1#!08$/7&*I!3#'0%1/3&Z'%&/*!/T!6A"U!WQ!
%1#!?W'7'!'K7&*&L%3'%&/*(!L/7#!#K0$'%/3L!'3I0#!%1'%(!&33#L8#$%&M#!/T!%1#!#TT&$'$Q!/T!83&/3!%#L%&*I!8/H&$&#L(!
%#$1*/H/IQ!1'L!3#*K#3#K!%1#!83&/3!#3'\L!%#L%&*I!&*T3'L%30$%03#!/WL/H#%#!RA/HH&*L!d!>'HM#3L/*(!D;;ES+!:!3#8/3%!
T3/7!%1#!6'%&/*'H!.$&#*$#!_/0*K'%&/*!%'L4!T/3$#!/*!$QW#3!H#'3*&*I!R6._!%'L4!T/3$#!/*!$QW#3H#'3*&*I(!D;;bS(!
T/$0L&*I!/*!%1#!T0%03#!/T!#K0$'%&/*'H!%#$1*/H/IQ(!K#L$3&W#L!W03I#/*&*I!7'34#%L!T/3!#K0$'%&/*'H!%#$1*/H/I&#L!
%1'%!3#HQ!/*!1&I1CL8##K!&*%#3*#%!L#3M&$#!'*K!8/O#3T0H!$/780%&*I+!2/L%C&*K0L%3&'H!#3'!%#L%&*I!&*T3'L%30$%03#L!O&HH!
W#!W0&H%!08/*!O1'%#M#3!*#O!%#$1*/H/I&#L!$/7#!%/!8H'Q!'!K/7&*'*%!3/H#!&*!#K0$'%&/*+!51#!6._!L0II#L%L!%1'%!
%#L%&*I!O&HH!H&4#HQ!W#$/7#!O#KK#K!%/!%#$1*/H/I&#L!%1'%!'HH/O!T/3!#7W#KK#K!%#L%&*I!%1'%!&L!3#8#'%#K(!T/37'%&M#(!
'*K!&*!%1#!L#3M&$#!/T!3#'HC%&7#!H#'3*&*I!R@A/7S+!!
51#3#!&L!'!I3#'%!K#'H!/T!L8#$0H'%&/*!$/*$#3*&*I!%/7/33/O\L!#K0$'%&/*'H!%#$1*/H/IQ]%1#!L/C$'HH#K!#7#3I&*I!
X#K0C%#$1+Y!!)*!8'3%&$0H'3(!%1#3#!'3#!L/7#!&78/3%'*%!$1'3'$%#3&L%&$L!'*K!%3#*KL!&*!#7#3I&*I!#K0$'%&/*'H!
%#$1*/H/I&#L!%1'%!'3#!3#H#M'*%!%/!%#L%&*I!RA/HH&*L!d!>'HM#3L/*(!D;;Ec!6._!%'L4!T/3$#!/*!$QW#3H#'3*&*I(!D;;bSF!!
• 70'2*+3+16(#&$-%&$.+*/(A/780%#3L!'*K!/%1#3!*#%O/34#K!K#M&$#L!O&HH!3#'$1!'*!&*$3#'L&*IHQ!H'3I#!8/3%&/*!
/T!%1#!8/80H'%&/*(!#L8#$&'HHQ!L%0K#*%L+!.7'3%!81/*#L!'*K!/%1#3!8/3%'WH#!K#M&$#L!'3#!'H3#'KQ!0W&g0&%/0L+!
51#!?*#!"'8%/8!2#3!A1&HK!&*&%&'%&M#!&L!'!%#L%'7#*%!%/!%1&L!%3#*K+!
• 8-#$(.*($.90(30&%*.*1/("#'3*#3L!O&HH!0L#!%#$1*/H/I&#L!%1'%!/3I'*&Z#!K'%'W'L#L!/T!3#L/03$#L!%1'%!'HH/O!T/3!
&*L%'*%!'$$#LL!%/!O1'%#M#3!*##KL!%/!W#!H#'3*#K+!
• :-#$+9.;&$.+*/!"#'3*#3L!O&HH!0L#!%#$1*/H/I&#L!%1'%!'3#!3#L8/*L&M#!%/!&*K&M&K0'H!K&TT#3#*$#L(!'L!
#K0$'%&/*'H!/88/3%0*&%&#L!'3#!I0&K#K!WQ!0L#3!83#T#3#*$#!'*K!8#3T/37'*$#+!!
• <'&55+3,.*1/("#'3*#3L!O&HH!0L#(%#$1*/H/I&#L!%1'%!L%30$%03#!%1#!K#H&M#3Q!/T!%'L4L!'*K!H#'3*&*I!
/88/3%0*&%&#L!W'L#K!/*!$H/L#C%/C3#'HC%&7#!'LL#LL7#*%L!/T!8#3T/37'*$#+!!
• =0530'$.+*/("#'3*#3L!O&HH!0L#(%#$1*/H/I&#L(%1'%(K/$07#*%!%1#!1&L%/3Q!/T!0L#3!8#3T/37'*$#L!'*K!%1#*!
83#L#*%!$/78'3&L/*L!W#%O##*!0L#3L\!1&L%/3&#L!'*K!%1/L#!/T!/%1#3L+!5#$1*/H/IQ!O&HH!#*'WH#!K#%'&H#K!
8/3%T/H&/!7'*'I#7#*%!LQL%#7L(!%#78H'%#L(!L$/3&*I!&*%#3T'$#L(!'*K!K'%'W'L&*I+!!
• >.#$&*'0(30&%*.*1(&*,(+*3.*0(0,-'&$.+*/(9/3#!#K0$'%&/*!O&HH!%'4#!8H'$#!'%!'!K&L%'*$#!%13/0I1!/*CH&*#!
H#'3*&*I!#*M&3/*7#*%L(!O&%1!&783/M#K!#TT&$'$Q!K0#!%/!'KM'*$#L!&*!M&K#/!$/*T#3#*$&*I!'*K!$/*%#*%!
K#H&M#3Q!LQL%#7L+!
• >&$&"&#0#(&*,(030'$%+*.'(30&%*.*1(%0'+%,#/([&%1!#7W#KK#K!'LL#LL7#*%L!'*K!'0%/7'%#K!83/I3#LL!'*K!
W#1'M&/3!7/*&%/3&*I!%#$1*/H/I&#L(!#K0$'%&/*'H!3#$/3K!4##8&*I!O&HH!W#$/7#!'L!K#%'&H#K!'*K!$/78H#V!'L!
7#K&'H!3#$/3K!4##8&*I+!!
!
"@A5)A:(!)6A+!
E!
51&L!H&L%!/T!%3#*KL!'*K!$1'3'$%#3&L%&$L!&L!*/%!#V1'0L%&M#(!W0%!&%!&L!*#M#3%1#H#LL!L0II#L%&M#!/T!O1'%!%/7/33/O\L!
#K0$'%&/*'H!&*L%&%0%&/*L!O&HH!1'M#!%/!O/34!O&%1+!51#!1&L%/3Q!/T!%#L%&*I!L1/0HK!%#'$1!0L!%1'%!'KM'*$#L!&*!
%#$1*/H/IQ!$'*!3'K&$'HHQ!'H%#3!%#L%&*I!83'$%&$#L!'*K!T/3$#!0L!%/!3#$/*L&K#3!%1#!T0*$%&/*!/T!%#L%&*I!&*!#K0$'%&/*'H!
LQL%#7L+!)T!%1&L!H&L%!$'8%03#L!%1#!$1'3'$%#3&L%&$L!/T!%1#!%#$1*/H/I&#L!%1'%!O&HH!W#$/7#!#LL#*%&'H!%/!/03!#K0$'%&/*'H!
$/*T&I03'%&/*L(!%1#*!O#!L1/0HK!W#!&*g0&3&*I!&*%/!%1#!83#T#3'WH#!K&3#$%&/*L!T/3!%#L%&*I!%1'%!%1#Q!7'4#!8/LL&WH#+!)*!
8'3%&$0H'3(!O#!T/HH/O!%1#!'T/3#7#*%&/*#K!6JA!'*K!6._!3#$/77#*K'%&/*L(!'*K!W#H&#M#!%1'%!%#L%&*I!
&*T3'L%30$%03#L!L1/0HK!83/7/%#!H#'3*&*I!'*K!W#!W'L#K!/*!'!L$&#*$#!/T!H#'3*&*I(!'L!/88/L#K!%/!W#&*I!0L#K!
83&7'3&HQ!T/3!%1#!8038/L#L!/T!#TT&$&#*$Q(!%3'$4&*I(!'*K!'$$/0*%'W&H&%Q+!?03!%'L4!W#H/O!&L!%/!#V8H/3#!/*#!'883/'$1!
%/!$3#'%&*I!'!%#L%&*I!&*T3'L%30$%03#(!W'L#K!&*!'!*#O!L$&#*$#!/T!H#'3*&*I!%1'%!H#M#3'I#L!#7#3I&*I!#K0$'%&/*'H!
%#$1*/H/I&#L+!>/O#M#3(!%1&L!K#8#*KL!T&3L%!/*!$H'3&TQ&*I!O1'%!O#!7#'*!WQ!%1#!H#'3*&*I!L$&#*$#L(!O1&$1!&*M/HM#L(!
&*!8'3%(!L/7#!'*LO#3L!%/!g0#L%&/*L!'W/0%!%1#!*'%03#!/T!H#'3*&*I!&%L#HT+!!
?0$$.*1($20(*0@(#'.0*'0(+5(30&%*.*1(.*$+($+9+%%+@A#(0,-B$0'2(
[#!1'M#!3'&L#K!'!W3/'K!g0#L%&/*!T'$&*I!7'*Q!#K0$'%/3LF!1/O!%/!3#7'&*!$/77&%%#K!%/!%1#!W#L%!/T!O1'%!&L!4*/O*!
'W/0%!%#'$1&*I!'*K!H#'3*&*I!O1&H#!'HL/!&*$/38/3'%&*I!K&M#3L#!*#O!#K0$'%&/*'H!%#$1*/H/I&#L+!51#3#!&L!O&K#L83#'K!
#V$&%#7#*%!'W/0%!%1#!8/LL&W&H&%&#L!T/3!1&I1C%#$1!#K0$'%&/*'H!T0%03#L!RA13&L%#*L/*(!m/1*L/*(!d!>/3*(!D;;bc!
P0$4#3(!D;;bS+!U0%!&*!/3K#3!%/!3#L8/*L&WHQ!K#L&I*!'*K!0L#!%#$1*/H/I&#L!%1'%!'&K!L%0K#*%!H#'3*&*I!O#!70L%!O/34!
T3/7!'*!#V8H&$&%!%1#/3Q!/T!H#'3*&*I!R6._!%'L4!T/3$#!/*!$QW#3H#'3*&*I(!D;;bS+!6/%!'HH!&*T/37'%&/*'H!#*M&3/*7#*%L!
'3#!#K0$'%&/*'H!#*M&3/*7#*%L(!'*K!*/%!'HH!*#O!%#$1*/H/I&#L!L1/0HK!W#!O&K#HQ!'K/8%#K!L&78HQ!W#$'0L#!%1#Q!
#V&L%+![#!'3I0#!%1'%!%1#!K#M#H/87#*%!/T!*#O!%#L%&*I!&*T3'L%30$%03#L!L1/0HK!W#!I0&K#K!WQ!'!$/*$#8%&/*!/T!%#L%&*I!
%1'%!$/78H#7#*%L!%1#!W#L%!/T!O1'%!O#!4*/O!'W/0%!&%L!3/H#!&*!%#'$1&*I!'*K!H#'3*&*I+!6#O!%#$1*/H/I&#L!T/3!
%#L%&*I!L1/0HK!L#3M#]*/%!K3&M#]H#'3*&*I!'*K!%#'$1&*I+!!
[#!M&#O!H#'3*&*I!'L!'!4&*K!/T!4/$"0#05&.6.1%B&'!3#8#'%#K!83/$#LL!/T!I/'HCK&3#$%#K!'$%&/*(!O1&$1!&L!$Q$H&$'HHQ!
&783/M#K!%13/0I1!%1#!83/$#LL&*I!/T!T##KW'$4!T3/7!%1#!#*M&3/*7#*%+!"#'3*&*I!&L!'!$3#'%&M#(!$/*L%30$%&M#(!%3&'HC
'*KC#33/3!83/$#LL!%1'%!&L!K##8HQ!W&/H/I&$'H+!U3/'KHQ!L8#'4&*I!%1&L!M&#O!$'*!W#!8H'$#K!0*K#3!%1#!W'**#3!/T!
.#*5"$0."/4/59B&/*#!/T!%1#!7/L%!$/1#3#*%!'*K!$/783#1#*L&M#!T'7&H&#L!/T!H#'3*&*I!%1#/3&#L!RU'HKO&*(!n<E;=o!
<El-c!2&'I#%(!<E=;S+!J#$#*%!%1#/3&L%L!&*!%1&L!%3'K&%&/*!1'M#!W3/'K#*#K!%1#!3#L#'3$1!1/3&Z/*L!/T!$/*L%30$%&M&L7!
&*%/!*#03/L$&#*$#(!$/780%#3!L$&#*$#(!'*K!%1#!T&#HK!/T!9&*K(!U3'&*(!'*K!@K0$'%&/*!R_&L$1#3(!D;;Ec!9'3#L$1'H(!#%!
'H+(!D;;lS+!51#!M&3%0/0L!$Q$H#!M&#O!/T!H#'3*&*I!&L!W3/'KHQ!'88H&$'WH#(!$1'3'$%#3&Z&*I!*#03'HC*#%O/34!7/K#HL!
R.8&%Z#3(!<EEES(!H'*I0'I#!'$g0&L&%&/*!R5/7'L#HH/(!D;;-S!'*K!#M#*!8/H&%&$'H!%1#/3Q!'*K!I/M#3*'*$#!RU0$4!d!
p&HH&*#L(!D;;lS+![#!W#H&#M#!%1'%!%1#!*'%03'H(!O#HH!T0*$%&/*&*I(!M&3%0/0L!$Q$H#!/T!H#'3*&*I!&L!'!L&78H#!W0%!8/O#3T0H!
7/K#H!%1'%!&L!O#HH!O/3%1!#7W#KK&*I!&*!*#O!#K0$'%&/*'H!%#$1*/H/I&#L+!!
!
"@A5)A:(!)6A+!
<;!
k/'HC'$%&/*CT##KW'$4F!!51#!T/0*K'%&/*'H!XT##KW'$4!H//8Y!/T!H&T#!'*K!H#'3*&*I!
9/L%!H#'3*&*I!L$&#*%&L%L]'H%1/0I1!%1#Q!/TT#3!K&TT#3&*I!'$$/0*%L]'I3##!%1'%!'L!'!I#*#3'H!7/K#H!/T!H#'3*&*I!%1#!
XI/'HC'$%&/*CT##KW'$4!H//8Y!83#L#*%L!H#'3*&*I!'%!&%L!7/L%!T0*K'7#*%'H!'*K!I#*#3'H!R.$1O'3%Z!d!N'OL/*(!D;<;S+!
51&L!H//8!$/*%'&*L!T/03!#LL#*%&'H!$/78/*#*%LF!I/'H(!'$%&/*(!T##KW'$4(!'*K!3#8#'%+![1#*!&*%#I3'%#K!KQ*'7&$'HHQ(!
%1#Q!'HH/O!0L!%/!T/$0L!/*!%1#!I/'H(!$1//L#!'*!'883/83&'%#!'$%&/*(!&*%#383#%!%1#!/0%$/7#(!'*K!K#$&K#!1/O!%/!
$/33#$%!/3!'K`0L%!%1#!$033#*%!'M'&H'WH#!8//H!/T!'$%&/*L!'*K!&K#'L!%/!W#%%#3!3#'$1!%1#!I/'H!/*!%1#!*#V%!'%%#78%+!
A/I*&%&M#!'*K!W#1'M&/3'H!H#'3*&*I!L$&#*%&L%L!R_&L$1#3!d!U&K#HH(!D;;=S(!#M/H0%&/*'3Q!8LQ$1/H/I&L%L!RA'78W#HH(!
<EblS(!'*K!*#03/L$&#*%&L%L!R9'3#L$1'H(!#%!'H+(!D;;lS!1'M#!3#8#'%#KHQ!3#K&L$/M#3#K!%1&L!7/L%!W'L&$!7#$1'*&L7!/T!
H#'3*&*I+!2&'I#%!'*K!U'HKO&*!T&3L%!$1'3'$%#3&Z#K!%1&L!T##KW'$4!H//8!'L!'*!/*I/&*I!'%%#78%!%/!'$1&#M#!W'H'*$#!
W#%O##*!'LL&7&H'%&/*!'*K!'$$/77/K'%&/*+!9/3#!3#$#*%HQ(!*#03/L$&#*%&L%L!1'M#!/WL#3M#K!%1'%!*#03/*L!&*!%1#!
*#/C$/3%#V!'$%!&*!$/1/3%L!O1#3#!3#8#'%#K!L%&70H'%&/*!/T!%1#!*#%O/34!&*!'!M'3&#%Q!/T!$/*%#V%L!T&*#C%0*#L!%1#!
#7#3I#*$#!/T!L8#$&T&$!8'%%#3*L!R@A/7S+![#!'3I0#!%1'%(!O1#%1#3!M&#O&*I!%1#!107'*!H#'3*&*I!T3/7!%1#!8#3L8#$%&M#!
/T!*#03/*L!/3!W#1'M&/3(!L0$$#LL!K#8#*KL!/*!#*I'I&*I!&*!'!M&3%0/0L!$Q$H#]%1#!8/L&%&M#!T##KW'$4!H//8!/T!H#'3*&*I+!!
51#!L'7#!83/$#LL!&L!'HL/!%1/0I1%!%/!$1'3'$%#3&Z#!/3I'*&Z'%&/*'H!H#'3*&*I+!.&*$#!%1#!<E=;L!LQL%#7L!%1#/3&L%L!
R_/33#L%#3(!<E=BS(!$QW#3*#%&$&L%L!RU##3(!<Eb<S(!'*K!/3I'*&Z'%&/*'H!8LQ$1/H/I&L%L!R.#*I#(!<EE;S(!1'M#!$/*M&*$&*IHQ!
83/8/L#K!%1'%!&*L%&%0%&/*L!L1/0HK!#7W#K!T##KW'$4CH//8L!%1'%!#*'WH#!I/'H!7/*&%/3&*I!'*K!L#HTC$/33#$%&/*+!:!
H#'3*&*I!/3I'*&Z'%&/*!&L!/*#!%1'%!$'*!'K`0L%!&%L!8/H&$#L!W'L#K!/*!K'%'!'W/0%!1/O!O#HH!%1#Q!O/34+!51&L!*/%&/*!&L!
#M#*!#7W#KK#K!&*!%1#!I0&K&*I!&K#'HL!/T!K#7/$3'%&$!L/$&#%&#L(!L0$1!'L!%1#!&K#'!%1'%!L/$&'H!8/H&$&#L!L1/0HK!W#!
&78H#7#*%#K!&*!'*!#V8#3&7#*%'H!7//K!'*K!3#7'&*!/8#*!%/!3#M&L&/*!&*!'!M&3%0/0L!$Q$H#!%1'%!#*L03#L!O#!'3#!
$/*%&*0'HHQ!H#'3*&*I!'W/0%!/03!L$1#7#L!/T!L/$&'H!/3I'*&Z'%&/*!'*K!%1#&3!#TT#$%&M#*#LL+!!!
:*K!/T!$/03L#(!L$&#*$#!&%L#HT!&L!'!4&*K!/T!M&3%0/0L!$Q$H#+!A/*%#78/3'3Q!81&H/L/81#3L!/T!L$&#*$#!#$1/!U'$/*(!
2#&3$#(!'*K!2/88#3!&*!'3I0&*I!%1'%!%1#!L$&#*%&T&$!7#%1/K!L1/0HK!W#!0*K#3L%//K!'L!'!H#'3*&*I!83/$#LL!%1'%!
&*M/HM#L!%#L%&*I!'!1Q8/%1#L&L!'I'&*L%!%1#!O/3HK!#V8#3&7#*%'HHQ(!3#$/*L&K#3&*I!%1'%!1Q8/%1#L&L!&*!H&I1%!/T!O1'%!%1#!
#V8#3&7#*%!3#M#'HL(!'*K!%1#*!%#L%&*I!'!*#O!3#M&L#K!1Q8/%1#L&L(!'*K!L/!/*!RU3'*K/7(!<EEBc!@HI&*(!<EE=S+!.1&T%L!%/!
*#O!L$&#*%&T&$!8'3'K&I7L!$'*!W#!$/*$#&M#K!/T!'L!8'3%!/T!%1&L!/*I/&*I!$Q$H#!/T!$/*$#8%0'H!3#M&L&/*L!'*K!
#V8#3&7#*%'%&/*+!
@K0$'%/3L!1'M#!H/*I!L/0I1%!%/!T/L%#3!M&3%0/0L!$Q$H#L!/T!H#'3*&*I!'%!70H%&8H#!H#M#HL!&*!%1#!#K0$'%&/*'H!LQL%#7F!T/3!
L%0K#*%L!&*!$H'LL3//7L(!T/3!'K7&*&L%3'%/3L!'L!'!8'3%!/T!/3I'*&Z'%&/*'H!H#'3*&*I!&*!L$1//HL(!'*K!T/3!3#L#'3$1#3L!'L!'!
O'Q!/T!W0&HK&*I!'!$070H'%&M#!4*/OH#KI#W'L#!'W/0%!%#'$1&*I!'*K!H#'3*&*I!RN#O#Q(!<EDEc!"'I#7'**(!D;;;S+!6#O!
#K0$'%&/*'H!%#$1*/H/I&#L!O&HH!7'4#!7'*Q!%1&*IL!8/LL&WH#(!&*$H0K&*I!*#O!O'QL!%/!#*'WH#!/*CI/&*I!H#'3*&*I!
83/$#LL#L!%1'%!'3#!&*%#I3'%#K!'$3/LL!K&TT#3#*%!H#M#HL!/T!%1#!#K0$'%&/*'H!LQL%#7!RA/HH&*L!d!>'HM#3L/*(!D;;ES+![#!
*/O!%03*!W'$4!%/!%#L%&*I!'*K!#V8H/3#!*#O!8/LL&W&H&%&#L!T/3!$/08H&*I!/T!$/*L%30$%&M&L%!%1#/3&#L!/T!H#'3*&*I!O&%1!%1#!
!
"@A5)A:(!)6A+!
<<!
'TT/3K'*$#L!/T!*#O!%#$1*/H/I&#L+![#!'3I0#!%1'%!&%!&L!*/O!8/LL&WH#!%/!W0&HK!'!%#L%&*I!&*T3'L%30$%03#!%1'%!#*'WH#L!
70H%&CH#M#H!H#'3*&*I!&*!#K0$'%&/*'H!LQL%#7L+!!!
"#M#3'I&*I!%/7/33/O\L!#K0C%#$1!%/!83/7/%#!%#L%&*I!&*!%1#!L#3M&$#!/T!H#'3*&*I!
51#!I/'H!/T!0L&*I!%1#!H#'3*&*I!L$&#*$#L!%/!&*T/37!%1#!K#L&I*!'*K!'K/8%&/*!/T!*#O!#K0$'%&/*'H!%#$1*/H/I&#L!
L1/0HK!W#!'!%/8!83&/3&%Q!R6'%&/*'H!J#L#'3$1!A/0*$&H!A/77&%%##!/*!5#L%&*I!'*K!:LL#LL7#*%(!D;;<c!6._!%'L4!T/3$#!
/*!$QW#3H#'3*&*I(!D;;bc!23#L&K#*%aL!$/0*$&H!/T!'KM&L/3L!/*!L$&#*$#!'*K!%#$1*/H/IQ(!D;<DS+!>/O#M#3(!%1#!1&L%/3Q!
/T!%#L%&*I!'*K!%#$1*/H/IQ!/TT#3#K!'W/M#!L1/OL!%1'%!'KM'*$#L!&*!H#'3*&*I!%1#/3Q!1'M#!*#M#3!K3&M#*!%1#!'K/8%&/*!
'*K!K#L&I*!/T!*#O!%#L%&*I!%#$1*/H/I&#L+!J'%1#3(!$/*$#3*L!'W/0%!#TT&$&#*$Q!'*K!LQL%#7CH#M#H!'$$/0*%'W&H&%Q!1'M#!
1&L%/3&$'HHQ!%3078#K!$/*$#3*L!'W/0%!%#'$1&*I!'*K!H#'3*&*I+!k&M#*!%1#L#!1&L%/3&$'H!%3#*KL(!&%!&L!H&4#HQ!%1'%!*#O!
#K0$'%&/*'H!%#$1*/H/I&#L!7&I1%!83&7'3&HQ!W#!0L#K!%/!K#H&M#3!%1#!L'7#!/HK!70H%&8H#C$1/&$#!%#L%L(!/*HQ!T'L%#3(!%/!
7/3#!L%0K#*%L(!O&%1!I3#'%#3!T3#g0#*$Q(!'*K!7/3#!L/81&L%&$'%#K!K'%'C'*'HQ%&$!%#$1*&g0#L+!51#!L1/3%!H&L%!/T!
#7#3I&*I!#K0C%#$1!%3#*KL!83#L#*%#K!'W/M#(!&*$H0K&*I!*#O!8/LL&W&H&%&#L!T/3!70H%&%0K&*/0L(!#7W#KK#K(!3#'HC%&7#!
'LL#LL7#*%(!$/0HK!3#L0H%!&*!'!%#L%&*I!&*T3'L%30$%03#!%1'%!&L!&*$3#'L&*IHQ!&*L#*L&%&M#!%/!%1#!*##KL!/T!%#'$1#3L!'*K!
L%0K#*%L(!K&M/3$#K!T3/7!3#L#'3$1!'W/0%!H#'3*&*I(!'*K!0L#K!7'&*HQ!T/3!%1#!3#'HC%&7#!LQL%#7LCH#M#H!L03M#&HH'*$#!/T!
%#'$1#3(!L%0K#*%(!'*K!L$1//H!8#3T/37'*$#+!!
U0%!%1#L#!L'7#!%#$1*/H/I&$'H!%3#*KL!/8#*!08!8/LL&W&H&%&#L!T/3!3'K&$'HHQ!*#O!%#L%&*I!'883/'$1#L!%1'%!'3#!W0&H%!
'3/0*K!%1#!W#L%!/T!O1'%!O#!4*/O!'W/0%!%1#!83/$#LL!/T!H#'3*&*I+!U0&HK&*I!L0$1!%#L%L!O&HH!&*M/HM#!#V8H&$&%HQ!
'K/8%&*I!'!%1#/3Q!/T!H#'3*&*I(!L0$1!'L!%1#!$/*L%30$%&M&L%!&*L8&3#K(!70H%&CH#M#H!M&3%0/0L!$Q$H#L!7/K#H!&*%3/K0$#K!
'W/M#(!'*K!0L&*I!%1&L!%1#/3Q!T3/7!%1#!/0%L#%!%/!L%30$%03#!3#L#'3$1!'*K!K#M#H/87#*%!#TT/3%L+!51&L!$0%L!'I'&*L%!
%1#!I3'&*!/T!%1#!1&L%/3Q!/T!%#L%&*I!&*!L/!T'3!'L!'*!#V8H&$&%!%1#/3Q!/T!H#'3*&*I!O/0HK!K3&M#!%#L%!K#L&I*!'*K!
%#$1*/H/IQ!'K/8%&/*+![#!W#H&#M#!%1'%!&%!&L!*/O!8/LL&WH#!1'3*#LL!*#O!%#$1*/H/I&#L!%/!$3#'%#!'!*#O!4&*K!/T!
%#L%&*I!&*T3'L%30$%03#!%1'%!&L!H#'3*&*IC$#*%3&$+!!
5#L%L!$/7W&*&*I!$/*L%30$%&M&L%!%1#/3&#L!/T!H#'3*&*I!O&%1!*#O!%3#*KL!&*!#K0$'%&/*'H!%#$1*/H/I&#L!O/0HK!'%!H#'L%!
$/*T/37!%/!%1#!T/HH/O&*I!K#L&I*!83&*$&8H#L+!51#Q!O/0HK!W#F!
• C4.,0*'0B"&#0,/(83&/3&%&#L!L1/0HK!W#!L1&T%#K!L/!%1'%(%#L%!K#M#H/87#*%!&L!I0&K#K!WQ!%1#!H#'3*&*I!L$&#*$#L(!
&*T/37#K!WQ!3#L#'3$1!'W/0%!H#'3*&*I+!
• D*+@30,10("-.3,.*1F!I&M#*!%3#*KL!%/O'3K!&*$3#'L&*IHQ!H'3I#!7/2/"(1!7("(A(5%5&#,&%1%."$#*/.&1%($*/*2&
$%.#$75(!%#L%L!L1/0HK!'&7!%/!$/*%3&W0%#!%/!%1#!H#'3*&*I!L$&#*$#L!%13/0I1!K'%'!$/HH#$%&/*!'*K!1/0L&*I+!!
• E%+&,36(&4&.3&"30F!I&M#*!%3#*KL!%/O'3K!"%.=*#1#26&5("0$("/#*!'*K!#*1/*%&%70.("/#*(!%#L%L!L1/0HK!
H#M#3'I#!)*%#3*#%!'*K!$/780%#3!%#$1*/H/I&#L!%/!L#3M#!%1#!H#'L%!'KM'*%'I#K+!!
!
"@A5)A:(!)6A+!
<D!
• <-FF+%$.40(+5($0&'2.*1(&*,(30&%*.*1F!%#L%L!L1/0HK!#*'WH#!.05"#9/C("/#*(!5.(,,#17/*2B&'*K&)05"&/*&"/9%&
1%($*/*2!WQ!/3I'*&Z&*I!%1#!K#H&M#3Q!/T!#*1/*%&%70.("/#*!3#L/03$#L!%/!#K0$'%/3L(!L%0K#*%L(!'*K!8'3#*%L+!!
• G+@B#$&H0#F!)05"&/*&"/9%&1%($*/*2!3#g0&3#L!70H%&%0K&*/0L!#7W#KK#K!'LL#LL7#*%Lc!7'*Q!H/OCL%'4#L!
T/37'%&M#!%#L%L(!K&M#3L#!%/8&$L(!*/!1&I1CL%'4#L!%#L%&*I!'*V&#%Q+!
• =0304&*$F!%#L%L!L1/0HK!H#M#3'I#!%1#!K&M#3L&%Q!'*K!#M#3!#V8'*K&*I!'TT/3K'*$#L!/T!#*1/*%&%70.("/#*(1&
%*4/$#*9%*"5!%/!'HH/O!L%0K#*%L!%/!/8#3'%#!/*!4*/OH#KI#!%1'%!7'%%#3L!%/!%1#7!'*K!83'$%&$#!#LL#*%&'H!
H&T#!L4&HHL(!O1&H#!'HL/!O/34&*I!%/O'3K!7'L%#3Q!/T!%1#!'$'K#7&$!$/78#%#*$&#L!%'3I#%#K!WQ!L%'*K'3KL+!
• C9"0,,&"30F!%#L%L!%1'%!#*'WH#!)05"&/*&"/9%&1%($*/*2!'*K!$%,1%."/#*!L1/0HK!W#!8'3%!/T!$H'LL3//7!H#LL/*L!
'*K!%1#!H#'3*&*I+!
• I+%9&$.40F!%#L%L!%1'%!#*'WH#!.05"#9/C("/#*!'*K!5.(,,#17/*2!L1/0HK!W#!H#'3*&*I!#V8#3&#*$#L!&*!
%1#7L#HM#L(!K&3#$%HQ!$/*%3&W0%&*I!%/!L%0K#*%!0*K#3L%'*K&*I+!!!!!
• >.&1*+#$.'F!%#L%L!%1'%!#*'WH#!.05"#9/C("/#*(!5.(,,#17/*2(!'*K!$%,1%."/#*!L1/0HK!W#!W'L#K!/*!3#L#'3$1!
'W/0%!L%0K#*%!H#'3*&*I(!83/M&K&*I!&*L&I1%L!&*%/!O1'%!%1#!L%0K#*%!$'*!K/!*/O!'*K!O1'%!O/0HK!7/L%!
W#*#T&%!%1#&3!H#'3*&*I!*#V%+!!
• <$&*,&%,.;0,($+(&('+99+*(30&%*.*1(#'&30F!&*$3#'L&*IHQ!H'3I#!7/2/"(1!7("(A(5%5&#,&%1%."$#*/.&1%($*/*2&
$%.#$75!O&HH!*##K!%/!W#!W0&H%!'3/0*K!$/77/*!7#'L03#L!'*K!&*K#V#L!%/!#*'WH#!W/%1!L$&#*%&T&$!'*K!
/3I'*&Z'%&/*'H!H#'3*&*Ic!%#L%L!L1/0HK!%10L!W#!L%'*K'3K&Z#K!%/!'!$/77/*!H#'3*&*I!L$'H#+!
51#L#!K#L&I*!8'3'7#%#3L!3#g0&3#!7/3#!#H'W/3'%&/*!%1'*!L8'$#!83/M&K#L!T/3!1#3#(!W0%!%1#Q!L1/0HK!I&M#!'!3/0I1!
L#*L#!/T!%1#!*#O!8/LL&W&H&%&#L!T/3!%#L%&*I!%1'%!#7#3I#!'%!%1#!&*%#3T'$#!/T!%1#!H#'3*&*I!L$&#*$#L!'*K!*#O!
#K0$'%&/*'H!%#$1*/H/I&#L+!51#!1&L%/3Q!/T!%#L%&*I!1'L!%'0I1%!%1'%!O1&H#!*#O!%#$1*/H/I&#L!W3&*I!%3'*LT/37'%&/*L!&*!
%#L%&*I!83'$%&$#L(!%1#L#!%3'*LT/37'%&/*L!1'M#!/$$033#K!&*!&L/H'%&/*!T3/7!%1#!H#'3*&*I!L$&#*$#L+!51#!&*M#*%&/*!/T!
%1#!70H%&8H#C$1/&$#!g0#L%&/*(!'*K!%1#*!%1#!.$'*%3/*!7'$1&*#(!K&K!7/3#!%/!L1'8#!%#L%&*I!%1'*!'*Q!'KM'*$#L!&*!
/03!0*K#3L%'*K&*I!/T!H#'3*&*I+!.%0K#*%L!'*K!%#'$1#3L!8'&K!%1#!83&$#(!'L!%1#!K#7'*KL!/T!/3I'*&Z'%&/*'H!#TT&$&#*$Q!
'*K!LQL%#7LCH#M#H!'$$/0*%'W&H&%Q!$/*L&L%#*%HQ!%3078#K!$/*$#3*L!'W/0%!%#'$1&*I!'*K!H#'3*&*I!&*!%1#!K#L&I*!'*K!
'K/8%&/*!/T!*#O!%#$1*/H/I&#L!T/3!%#L%&*I+!:L!%1#!L%'I#!&L!*/O!L#%!T/3!'!*#O!%#$1*/H/IQCO3/0I1%!3#M/H0%&/*!/T!
%#L%&*I!83'$%&$#L(!&%!&L!$3&%&$'H!%1'%!#K0$'%/3L!'*K!8/H&$Q!7'4#3L!W0&HK!$/*L#*L0L!'3/0*K!'!L#%!/T!K#L&I*!
8'3'7#%#3L!H&4#!%1#!/*#L!'W/M#!&*!/3K#3!%/!L1'8#!%1#!*#O!%#L%&*I!&*T3'L%30$%03#!&*!O'QL!%1'%!O&HH!W#!7/3#!
W#*#T&$&'H!T/3!%#'$1#3L!'*K!L%0K#*%L+!![#!*/O!H//4!'%!'*!'%%#78%!%/!'$%0'H&Z#!8/L&%&M#(!H#'3*&*IC$#*%3&$(!
%#$1*/H/IQ!#*'WH#K!K&3#$%&/*L!T/3!%#L%&*I]%1#!N&L$/5#L%!)*&%&'%&M#+!51&L!&*&%&'%&M#!&L!'*!'%%#78%!%/!W0&HK!'!*#O!
4&*K!/T!%#L%&*I!&*T3'L%30$%03#!W'L#K!/*!%1#!K#L&I*!8'3'7#%#3L!/0%H&*#K!'W/M#+!!!!!!
!
"@A5)A:(!)6A+!
<,!
720(>.#'+70#$()*.$.&$.40/(-#.*1(*0@($0'2*+3+1.0#($+(0*&"30(4.%$-+-#('6'30#(+5(30&%*.*1((
[#!1'M#!'H3#'KQ!7#*%&/*#K!3#8/3%L!T3/7!%1#!6JA!'*K!%1#!6._!%1'%!$'HH!T/3!'!%#L%&*I!&*T3'L%30$%03#!W'L#K!7/3#!
/*!%1#!L$&#*$#!/T!H#'3*&*I!'*K!*#O!K&I&%'H!%#$1*/H/I&#L+!?%1#3L!1'M#!'HL/!$/*%3&W0%#K!%/!%1&L!$'HH+!_/3!#V'78H#(!
5/$1!RD;;=S!K#L$3&W#L!%1#!0*K#3T0*K#K!'*K!0*K#3L%'TT#K!L%'%#!/T!%1#!8/L%C6A"U!%#L%&*I!&*K0L%3Q(!O1&$1!T/3!%1#!
7/L%!8'3%!H'$4L!'!L0TT&$&#*%!*07W#3!/T!8LQ$1/7#%3&$&'*L!'*K!H#'3*&*I!L$&#*%&L%L!%/!$/*K0$%!%1#!*#$#LL'3Q!
3#L#'3$1!'*K!K#M#H/87#*%!%/!K#M#H/8!1&I1Cg0'H&%Q!%#L%L+!:KK&%&/*'HHQ(!%1#3#!'3#!$/*%&*0&*I!1&I1C83/T&H#!$'HHL!T/3!
'*!&*T0L&/*!/T!*#O!&K#'L!&*%/!hC<D!%#L%&*I(!&*$H0K&*I!$'HHL!T/3!3#$/*L&K#3'%&/*!/T!%1#!W3/'K!3/H#!/T!%#L%&*I!&*!
3#T/37!'*K!8/H&%&$L!RJ'M&%$1(!D;<;S+!51#3#!&L!'HL/!&*$3#'L&*I!83#LL03#!%/!#V8'*K!'*K!K&M#3L&TQ!%#L%&*I(!83/7/%#!
&**/M'%&M#!3#L#'3$1!'*K!K#M#H/87#*%(!'*K!%/!3#C%1&*4!%#L%&*I!83'$%&$#L!&*!H&I1%!/T!*#O!%#$1*/H/I&$'H!8/LL&W&H&%&#L!
RA/HH&*L!d!>'HM#3L/*(!D;;Ec!.$1O'3%Z(!#%!'H+(!D;<<S+!)*!%1&L!L#$%&/*!O#!83#L#*%!'*!/M#3M&#O!/T!/*#!$033#*%!
3#L#'3$1!'*K!K#M#H/87#*%!#TT/3%!%1'%!W3&*IL!%1#L#!%1#7#L!%/I#%1#3+!
!)*!"'%&*(!7/5.#!7#'*L!q%/!H#'3*(Y!'*K!*/O!L#3M#L!&*!@*IH&L1!'L!%1#!3//%!T/3!L0$1!O/3KL!'L!7/5.#03L#!'*K!7/5.#M#3Q+!
A/&*$&K#*%'HHQ(!&*!7/K#3*!%&7#L(!7/5.#!'HL/!#M/4#L!%1#!&7'I#!/T!Q/0*I!8#/8H#!`/QT0HHQ!&*%#3'$%&*I!O&%1!70L&$(!'*!
&7'I#!%1'%!L&%L!O#HH!O&%1!%1#!*/%&/*!/T!H#'3*&*I!'L!,0*!RN'OL/*C50*&4(!D;;BS+!N&L$/5#L%L!'3#!3#L#'3$1CW'L#K(!
L0W`#$%C'3#'!L8#$&T&$(!#7W#KK'WH#(!T/37'%&M#(!$/780%#3C'K7&*&L%#3#K!'LL#LL7#*%L+!51#Q!$/*L&L%!/T!XW#L%!
83'$%&$#LY!T/37'%&M#!'LL#LL7#*%L!$/78/L#K!/T!/8#*C#*K#K!#LL'Q!g0#L%&/*L!%1'%!'L4!L%0K#*%L!%/!3#L8/*K!%/!/113
5"$0."0$%7!3#'HCO/3HK!83/WH#7L]83/WH#7L!O&%1/0%!$H#'3!$0%!'*LO#3L]'*K!83/M&K#!L%'*K'3K&Z#K!L$/3#L!'L!O#HH!
'L!3&$1!3#'HC%&7#!#K0$'%&M#!T##KW'$4!T/3!L%0K#*%L!'*K!%#'$1#3L+!N&L$/5#L%L!O&HH!W#!'K7&*&L%#3#K!T3#g0#*%HQ!&*!
H/OCL%'4#L!$/*%#V%L!%/!L088/3%!%#'$1&*I!'*K!H#'3*&*I+!U#$'0L#!%1#Q!'3#!$'H&W3'%#K!%/!'!$/77/*!%1#/3#%&$'HHQ!
&*T/37#K!'*K!#M&K#*$#CW'L#K!H#'3*&*I!7#%3&$(!%1#Q!'3#!'HL/!$'8'WH#!/T!83/M&K&*I!'K7&*&L%3'%/3L!O&%1!LQL%#7C
H#M#H!K'%'!T/3!83/I3'7!#M'H0'%&/*!8038/L#L+!:KK&%&/*'HHQ(!%1#Q!'3#!0*&g0#HQ!8/O#3T0H!%//HL!T/3!3#L#'3$1#3L(!K0#!
%/!%1#&3!3#L#'3$1C&*%#*L&M#!$/*L%30$%&/*(!%1#!T3#g0#*$Q!O&%1!O1&$1!%1#Q!$'*!W#!%'4#*(!%1#&3!K&M#3L&%Q(!'*K!%1#&3!
L%'*K'3K&Z'%&/*+!!
U#H/O!O#!/0%H&*#!%1#!3#L#'3$1!'*K!K#M#H/87#*%!#TT/3%L!%1'%!I/!&*%/!%1#!$/*L%30$%&/*!/T!N&L$/5#L%L!'*K!%1#*!
3#M&#O!%1#&3!#K0$'%&M#!'*K!7#'L03#7#*%!T0*$%&/*L+!)%!L1/0HK!W#$/7#!$H#'3!%1'%!%1#!'W&H&%Q!/T!N&L$/5#L%L!%/!
#*'WH#!70H%&CH#M#H!H#'3*&*I!&*!#K0$'%&/*'H!LQL%#7L!L%#7L(!&*!H'3I#!8'3%(!T3/7!'!$'3#T0HHQ!$3'T%#K!&*%#3T'$#!/T!%1#!
H#'3*&*I!L$&#*$#L!O&%1!'KM'*$#L!&*!$/780%#3!%#$1*/H/IQ+!!
N&L$/5#L%!3#L#'3$1!'*K!K#M#H/87#*%!
U0&HK&*I!N&L$/5#L%L!&*M/HM#L!'!L#%!/T!3#H'%#K!0*K#3%'4&*ILF!R<S!#L%'WH&L1&*I!$/HH'W/3'%&/*L!O&%1!#K0$'%/3Lc!RDS!
$/*K0$%&*I!W'L&$!3#L#'3$1!&*%/!1/O!L%0K#*%L!H#'3*!%1#!L8#$&T&$!$/*$#8%L!'*K!L4&HHL!%'3I#%#K!WQ!%#L%!&%#7Lc!R,S!
W0&HK&*I!$/780%#3CW'L#K!H/OC&*T#3#*$#!L$/3&*I!30W3&$L!'*K!H#'3*&*I!L#g0#*$#L!%1'%!'3#!W'L#K!/*!%1&L!3#L#'3$1c!
'*K!RBS!$/78&H&*I!#V8#3%HQ!M#%%#K!H#'3*&*I!3#L/03$#L+!51#!T&*&L1#K!83/K0$%!&L!'!7'%03#!N&L$/5#L%(!$/78H#%#!O&%1!
$/K&*I!30W3&$L(!K&'I*/L%&$!3#8/3%L!T/3!L%0K#*%L(!%#'$1#3L(!'*K!8'3#*%L(!%'3I#%#K!H#'3*&*I!3#L/03$#L!T/3!&*K&M&K0'H!
!
"@A5)A:(!)6A+!
<B!
L%0K#*%L(!'!3'*I#!/T!%#'$1&*I!3#L/03$#L(!&*$H0K&*I!'!M'3&#%Q!/T!3#'H!%&7#!3#8/3%L!'*K!H#LL/*!8H'*L!%1'%!$'*!W#!
%'&H/3#K!%/!%1#!*##KL!/T!L8#$&T&$!$H'LL3//7L(!'*K!3#'HC%&7#!I3/08CH#M#H!K'%'!T/3!K#$&L&/*!7'4#3L+!51#!W3/'K!I/'H!
/T!%1#!&*&%&'%&M#!&L!%/!W0&HK!K/Z#*L!/T!%#L%L(!L8'**&*I!*07#3/0L!'$'K#7&$!L0W`#$%!'3#'L(!'L!8'3%!/T!'!*#O!4&*K!/T!
%#L%&*I!&*T3'L%30$%03#&+!!
>#3#!O#!g0&$4HQ!L4#%$1!%1#!W3/'K!%#L%!K#M#H/87#*%!83/$#LL(!%1#*!%'4#!'!$H/L#3!H//4!'%!L/7#!/T!&%L!7/L%!
&78/3%'*%!#H#7#*%L(!#L8#$&'HHQ!%1/L#!7'K#!8/LL&WH#!%13/0I1!#7#3I&*I!#K0$'%&/*'H!%#$1*/H/I&#L+!9/3#!K#%'&H#K!
'$$/0*%L!/T!3#L#'3$1!'*K!K#M#H/87#*%!#TT/3%L!1'M#!W##*!83#L#*%#K!#HL#O1#3#!RN'OL/*!d!.%#&*(!D;;bc!.%#&*(!#%!
'H+(!D;<;S+!
51#!83/$#LL!W#I&*L!WQ!L#H#$%&*I!L0W`#$%C'3#'!L8#$&T&$!$/*$#8%L!'*K!L4&HHL!&*!$/HH'W/3'%&/*!O&%1!#K0$'%/3L+!
J#L#'3$1#3L!%1#*!L#%!/0%!%/!L%0KQ!1/O!L%0K#*%L!H#'3*!%1#L#!$/*$#8%L!'*K!L4&HHL+!fL&*I!7#%1/KL!T3/7!$/I*&%&M#!
K#M#H/87#*%'H!8LQ$1/H/IQ(!3#L#'3$1#3L!W0&HK!'!L#%!/T!#78&3&$'HHQCI3/0*K#K!1%($*/*2&5%D0%*.%5(!O1&$1!83#L#*%!&*!
K#%'&H!%1#!K#M#H/87#*%!/T!$/*$#8%L!$#*%3'H!%/!%1#!%/8&$L!%'3I#%#K!WQ!%1#!'LL#LL7#*%!RN'OL/*!d!.%#&*(!D;;bc!
N'OL/*C50*&4(!D;;BS+!51#L#!H#'3*&*I!L#g0#*$#L!&*T/37!%1#!$3#'%&/*!/T!1#E3/*,%$%*.%&$0A$/.5(!O1&$1!'3#!%#L%#K(!
$'H&W3'%#K!%/!'LL03#!L%'*K'3K&Z'%&/*(!'*K!T&*'HHQ!0L#K!WQ!%#'$1#3L!'*K!L%0K#*%L!%/!L$/3#!7'%03#!N&L$/5#L%L+!51#!
H#'3*&*I!L#g0#*$#L!'HL/!&*T/37!%1#!$3#'%&/*!/T!%/8&$CL8#$&T&$!H#'3*&*I!3#L/03$#L!'*K!H#LL/*!8H'*L(!O1&$1!'3#!
M#%%#K!T/3!g0'H&%Q!'*K!/3I'*&Z#K!K#M#H/87#*%'HHQ!'H/*I!%1#!L'7#!L$'H#!'L!%1#!H#'3*&*I!L#g0#*$#L+!./7#!/T!%1#L#!
$03'%#K!H#'3*&*I!3#L/03$#L!7'4#!08!'!8'3%!/T!%1#!&*K&M&K0'H&Z#K!T##KW'$4!#'$1!L%0K#*%!3#$#&M#L!'T%#3!%'4&*I!'!
N&L$/5#L%+!51#Q!'HL/!$/*%3&W0%#!%/!%1#!%#'$1#3!3#L/03$#!'3#'!&*!O1&$1!&*K&M&K0'H!'*K!$H'LL3//7CH#M#H!83/T&H#L!/T!
L%0K#*%!8#3T/37'*$#!'3#!'$$/78'*&#K!WQ!3#H#M'*%!H#'3*&*I!3#L/03$#L!'*K!H#LL/*!8H'*L+!
:L&K#!T3/7!%1#&3!T0*$%&/*!&*!%#'$1&*I!'*K!H#'3*&*I(!N&L$/5#L%L!'HL/!L#3M#!'L!L%'*K'3K&Z#K!'LL#LL7#*%L!%1'%!
83/M&K#!L$/3#L!T/3!'HH!8#3T/37'*$#L!'H/*I!'!L&*IH#!H#'3*&*I!L$'H#&&+!?M#3!%&7#(!'L!L%0K#*%L!%'4#!N&L$/5#L%L!&*!
K&TT#3#*%!L0W`#$%L!'*K!I3'K#L(!%1#!'$$070H'%#K!1&L%/3Q!/T!%1#&3!L$/3#L!'*K!3#8/3%L!T/37L!'!$/78H#V(!K#%'&H#K!
#H#$%3/*&$!H#'3*&*I!3#$/3K(!83/M&K&*I!3&$1!K'%'!T/3!3#L#'3$1#3L!'*K!K#%'&H#K!H#'3*&*I!3#$/3KL!T/3!L$1//HL(!K&L%3&$%L(!
'*K!#K0$'%/3L+!U0%!W#T/3#!#V8H/3&*I!%1#!#K0$'%&M#!'*K!7#'L03#7#*%!T0*$%&/*L!/T!N&L$/5#L%L(!O#!K&L$0LL!%1#!
3#L#'3$1!'*K!K#M#H/87#*%!83/$#LL!&*!7/3#!K#%'&H+!!!!!
"#'3*&*I!L#g0#*$#L!'*K!H/O!&*T#3#*$#!30W3&$L!
51#!H&*#'I#!/T!$/*L%30$%&M&L7!&*M/4#K!'W/M#(!&*$H0K&*I!U'HKO&*(!2&'I#%(!'*K!_&L$1#3(!1'L!L1/O*!%1'%!
&783/M#7#*%!&*!$/I*&%&M#!8#3T/37'*$#!3#TH#$%L!7/3#!%1'*!%1#!&*$3#7#*%'H!'$$070H'%&/*!/T!&*T/37'%&/*+!U/%1!
4*/OH#KI#!'*K!$/I*&%&M#!L4&HHL!K#M#H/8!%13/0I1!'!L#3&#L!/T!1&#3'3$1&$'HHQ!/3I'*&Z#K!H#M#HL!R/3!5"(2%5S+!@'$1!
L0$$#LL&M#!H#M#H!&L!7/3#!$/78H#V!'*K!'WL%3'$%!%1'*!%1#!H#M#H!%1'%!83#$#K#K!&%+!)*!/%1#3!O/3KL(!L0$$#LL&M#!H#M#HL!
'3#!7/3#!'WL%3'$%(!$/78H#V(!'*K!&*%#I3'%#K+!N#M#H/87#*%!O&%1&*!'!H#M#H!7'*&T#L%L!'L!'*!&*$3#'L&*IHQ!#H'W/3'%#!
3#8#3%/&3#!/T!4*/OH#KI#!'*K!L4&HHL!'%!%1'%!H#M#H+!9/M&*I!T3/7!/*#!H#M#H!%/!%1#!*#V%!/$$03L!O1#*!%1#!$033#*%!H#M#H!
!
"@A5)A:(!)6A+!
<-!
3#'$1#L!'!%&88&*I!8/&*%(!%1#!LQL%#7!3#/3I'*&Z#L(!'*K!'!*#O!O'Q!/T!%1&*4&*I!#7#3I#L+!51&L!K#M#H/87#*%'H!7/K#H!
K#L$3&W#L!'!*("0$(1!M&3%0/0L!$Q$H#!/T!H#'3*&*I+!
Figure 1: DiscoTest report card
!
N03&*I!%1#!H'%%#3!Q#'3L!/T!%1#!D;%1!$#*%03Q(!L#M#3'H!3#L#'3$1#3L!K#M#H/8#K!7#%3&$L!W'L#K!08/*!%1&L!
K#M#H/87#*%'H!7/K#H(!0H%&7'%#HQ!&K#*%&TQ&*I!<,!g0'H&%'%&M#HQ!K&L%&*$%!H#M#HL!%13/0I1!O1&$1!4*/OH#KI#!'*K!
$/I*&%&M#!L4&HHL!K#M#H/8+!51#!7/L%!83#$&L#!/T!%1#L#!7#%3&$L!&L!%1#!"#$%&$'Hr!:LL#LL7#*%!.QL%#7!R":.S!RN'OL/*(!
D;<;c!N'OL/*!d![&HL/*(!D;;BS+!51#!7/L%!3#$#*%!M#3L&/*!/T!%1#!":.!$'*!3#H&'WHQ!7#'L03#L!83/I3#LL!%13/0I1!%1#!
!
"@A5)A:(!)6A+!
<=!
H'L%!l!/T!%1#L#!H#M#HL!&*!s!H#M#H!&*$3#7#*%L!$'HH#K!F=(5%5///(!'*K!1'L!W##*!L1/O*!%/!1'M#!'!M'H&K&%Q!'*K!3#H&'W&H&%Q!
83/T&H#!%1'%!7'4#!&%!L0&%'WH#!T/3!0L#!&*!'H7/L%!'*Q!'LL#LL7#*%!$/*%#V%(!T3/7!%1#!$H'LL3//7!%/!1&I1CL%'4#L!%#L%&*I!
R/A/7S+!51#!":.!&L!'%!%1#!$/3#!/T!%1#!N&L$/5#L%!3#L#'3$1!'*K!K#M#H/87#*%!83/$#LL(!'*K!&L!%1#!$/77/*!L$'H#!'H/*I!
O1&$1!L%0K#*%!8#3T/37'*$#L(!H#'3*&*I!L#g0#*$#L(!30W3&$L(!'*K!H#'3*&*I!3#L/03$#L!'3#!'HH!'H&I*#K(!8#37&%%&*I!%1#!
K#H&M#3Q!/T!K#M#H/87#*%'HHQ!'883/83&'%#!#K0$'%&M#!T##KW'$4+!!!!!!
51#!":.!7'4#L!&%!8/LL&WH#!%/!0L#!'!$/7W&*'%&/*!/T!H/*I&%0K&*'H!'*K!$3/LLCL#$%&/*'H!K'%'!%/!$/*L%30$%!'$$03'%#!
L$/3&*I!30W3&$L!'*K!H#'3*&*I!L#g0#*$#L!%1'%!K#%'&H!%1#!K#M#H/87#*%!/T!L8#$&T&$!$/*$#8%L!'*K!L4&HHL!RN'OL/*C
50*&4(!D;;BS+!51#!3#L#'3$1!83/$#LL!T/3!W0&HK&*I!30W3&$L!'*K!H#'3*&*I!L#g0#*$#L!W#I&*L!O&%1!%1#!K#L&I*!/T!'*!
&*%#3M&#O!&*L%307#*%!$/78/L#K!/T!'!L#%!/T!/8#*C#*K#K!&%#7L+!51#*(!3#L#'3$1#3L!$/HH#$%!K'%'!#&%1#3!WQ!
$/*K0$%&*I!83/W#K(!$H&*&$'H!&*%#3M&#OL!/3!'K7&*&L%#3&*I!/*H&*#!&*L%307#*%L+!51#L#!'3#!&*K#8#*K#*%HQ!R<S!L$/3#K!
O&%1!%1#!":.!%/!K#%#37&*#!%1#&3!K#M#H/87#*%'H!81'L#!'*K!RDS!L0W7&%%#K!%/!'!$/783#1#*L&M#!'*'HQL&L!/T!%1#&3!
$/*%#*%+![1#*!W/%1!'*'HQL#L!1'M#!W##*!$/78H#%#K(!'*'HQL%L!W#I&*!'*!&%#3'%&M#!83/$#LL!/T!3#$/*L%30$%&*I!%1#!
3#H'%&/*!W#%O##*!H#M#H!/T!8#3T/37'*$#!'*K!$/*$#8%0'H!$/*%#*%+![#!$'HH!%1&L!83/$#LL!$("/#*(1&$%.#*5"$0."/#*+!
51#3#!'3#!L#M#3'H!L%#8L!&*!%1&L!83/$#LLF!
<+ 23/K0$#!'*!/3I'*&Z#K!#78&3&$'H!&*M#*%/3Q!/T!$/*$#8%&/*L!'*K!#V#78H'3L(!/3I'*&Z#K!WQ!%1#7#L!'*K!
L0W%1#7#L(!'*K!/3K#3#K!'$$/3K&*I!%/!%1#!K#M#H/87#*%'H!81'L#L!&*!O1&$1!8'3%&$0H'3!$/*$#8%&/*L!O#3#!
T/0*K(!'*K!!
D+ p#%!%1#!&*%#I3&%Q!/T!%1&L!&*M#*%/3Q(!#V8H/3&*I!/%1#3!8/LL&WH#!%1#7'%&$!$/7W&*'%&/*L!/T!$/*$#8%L(!#*L03&*I!
%1'%!#V#78H'3L!3#83#L#*%!%1#!$/*$#8%L!O&%1!O1&$1!%1#Q!'3#!'LL/$&'%#K(!'*K!W#I&**&*I!%1#!83/$#LL!/T!
&K#*%&TQ&*I!K#T#*L&WH#!H#'3*&*I!L#g0#*$#L+!
,+ :%!%1&L!8/&*%(!'*'HQL%L!W#I&*!30W3&$!'*K!L#g0#*$#!$/*L%30$%&/*(!O1&$1!3#g0&3#L!&K#*%&TQ&*I!$H#'3!#M&K#*$#!
/T!$/*$#8%0'H!H#'3*&*I!L#g0#*$#L(!'*K!K#L$3&W&*I!1/O!L8#$&T&$!$/*$#8%L!K#M#H/8!/M#3!%&7#+!!
J#HQ&*I!08/*!%1#!#78&3&$'H!L#g0#*$#L(!K#M#H/87#*%'H!%1#/3Q(!'*K!4*/OH#KI#!'W/0%!3#H'%#K!H#'3*&*I!L#g0#*$#L(!
'*'HQL%L!'%%#78%!%/!#V8H'&*!O1Q!/*#!T/37!/T!'!$/*$#8%!7&I1%!T/HH/O!'*/%1#3!&*!'*!#78&3&$'H!L#g0#*$#+!5'WH#!<!
&HH0L%3'%#L!%1#!TH/O!/T!%1&L!O/34+!U#I&**&*I!O&%1!#V#78H'3L!%1'%!'3#!'LL/$&'%#K!O&%1!8'3%&$0H'3!L0W!%1#7#L!'*K!
81'L#L(!'*'HQL%L!I3'K0'HHQ!%#'L#!/0%!$1'&*L!/T!%1#7'%&$'HHQ!3#H'%#K!$/*$#8%&/*L!%1'%!L8'*!%1#!%'3I#%#K!
K#M#H/87#*%'H!3'*I#+!_&3L%(!'*'HQL%L!K#L$3&W#!%1#!$/*$#8%L!3#83#L#*%#K!WQ!I3/08L!/T!L&7&H'3!#V#78H'3L!R'L!
L1/O*!&*!%1#!L#$/*K!$/H07*!/T!5'WH#!<S+!?*$#!%1#L#!K#L$3&8%&/*L!1'M#!W##*!$/78H#%#K(!'*'HQL%L!#V'7&*#!1/O!
%1#Q!'3#!3#H'%#K!%/!/*#!'*/%1#3!'$3/LL!H#M#HL!R'L!L1/O*!&*!%1#!%1&3K!$/H07*!/T!5'WH#!<S+![1#*!%1&L!83/$#LL!&L!
L0$$#LLT0H(!#'$1!*#O!/T!H#M#H!/T!0*K#3L%'*K&*I!$'*!W#!L##*!%/!W0&HK!08/*!%1#!$/*$#8%&/*L!/T!%1#!83#$#K&*I!H#M#H+!
51#!T0HH!83/$#LL!/T!3'%&/*'H!3#$/*L%30$%&/*!&L!K#L$3&W#K!7/3#!%1/3/0I1HQ!#HL#O1#3#!RN'OL/*C50*&4(!D;;Bc!
N'OL/*!d!.%#&*(!D;;bS+!
!
"@A5)A:(!)6A+!
<l!
Table 1: The physics of energy—“What is happening to the energy of the ball as it hits the
floor?”
Exemplar
Sequence description
@"&E(5&,(11/*2&7#E*&$%(116&,(5"B&"=%*&/"&
=/"&"=%&,1##$&(*7&A#0*.%7&A(.G&0FB&A0"&
*#"&(5&,(5"H&I=%*&@&=(4%&1#"5&#,&%*%$26B&
@&$0*&$%(116&,(5"H&
@V8#3&#*$#!O&%1!7/M&*I!/W`#$%L(!$/7W&*#K!O&%1!%1#!
0L#!/T!%1#!%#37!#*#3IQ!%/!K#L$3&W#!&**#3!L%'%#L!
$/**#$%#K!O&%1!'!K#L&3#!T/3!7/%&/*(!83/M&K#!'!
$/*$3#%#!W'L&L!T/3!$/**#$%&*I!#*#3IQ!O&%1!
7/M#7#*%+!!
@"&=(7&(&1#"&#,&%*%$26&E=%*&/"&E(5&
,(11/*2&7#E*B&A0"&/"&1#5"&5#9%&#,&/"5&
%*%$26&E=%*&/"&.(9%&A(.G&0FH&
51#!$/**#$%&/*!/T!#*#3IQ!O&%1!7/M#7#*%!'%!%1#!
83#M&/0L!H#M#H!L#%L!%1#!L%'I#!T/3!%1#!K&TT#3#*%&'%&/*!
/T!%1#L#!$/*$#8%L+!.%0K#*%L!W#I&*!%/!0*K#3L%'*K!
%1'%!#*#3IQ!'*K!7/M#7#*%!'3#!*/%!#V'$%HQ!%1#!
L'7#!%1&*I(!#M#*!%1/0I1!#*#3IQ!&L!'HO'QL!
'LL/$&'%#K!O&%1!7/M#7#*%+!
@"&=(7&"=%&9#5"&%*%$26&E=%*&/"&=/"&"=%&
2$#0*7B&A%.(05%&/"&E(5&5F%%7/*2&0F&
E=/1%&/"&E(5&,(11/*2B&"=%*&5#9%&#,&/"5&
%*%$26&E%*"&/*"#&"=%&,1##$&(*7&9(7%&(&
*#/5%H&&&
?*$#!%1#!3#H'%&/*!W#%O##*!#*#3IQ!'*K!7/%&/*!&L!
0*K#3L%//K!'L!'*!'LL/$&'%&/*(!&%!&L!8/LL&WH#!%/!
T03%1#3!K&TT#3#*%&'%#!%1#L#!$/*$#8%L+!@*#3IQ!$'*!W#!
$/**#$%#K!%/!1#'%!/3!L/0*K!R'L!'!$'0L#S(!'*K!#'3HQ!
$/*$#8%&/*L!/T!4&*#%&$!#*#3IQ!R%1#!#*#3IQ!/T!
7/%&/*S!'*K!8/%#*%&'H!#*#3IQ!R%1#!8/%#*%&'H!T/3!
#*#3IQ!%/!1'88#*S!#7#3I#+!51#L#!$/*$#8%&/*L!'3#!
#LL#*%&'H!T/3!'!W#I&**&*I!0*K#3L%'*K&*I!/T!#*#3IQ!
%3'*LT#3(!&*!O1&$1!#*#3IQ!&L!M&#O#K!'L!'!4&*K!/T!
g0'L&CL0WL%'*$#!%1'%!7/M#L!W#%O##*!/W`#$%L+!
@"&=(7&"=%&9#5"&G/*%"/.&%*%$26&E=%*&/"&
=/"&"=%&2$#0*7B&A%.(05%&"=("&E(5&E=%*&
/"&E(5&9#4/*2&,(5"%5"B&A0"&E=%*&/"&=/"&
"=%&2$#0*7B&5#9%&#,&"=%&G/*%"/.&%*%$26&
E(5&"$(*5,#$9%7&/*"#&5#0*7&%*%$26&
(*7&%1(5"/.&F#"%*"/(1&%*%$26H&&
?*$#!#*#3IQ!1'L!W##*!K&TT#3#*%&'%#K!&*%/!L%'%#L!'*K!
T/37L(!&%!&L!8/LL&WH#!%/!$/*L%30$%!'*!0*K#3L%'*K&*I!
/T!%3'*LT/37'%&/*L+!51#L#!$'*!W#!3#83#L#*%#K!&*!
g0'*%&%'%&M#!%#37L(!'HH/O&*I!L%0K#*%L!%/!83/M#!%/!
%1#&3!/O*!L'%&LT'$%&/*!%1'%!#*#3IQ!$'*!*#&%1#3!W#!
$3#'%#K!*/3!K#L%3/Q#K+!!
!
N03&*I!%1#!3'%&/*'H!3#$/*L%30$%&/*!83/$#LL(!'*'HQL%L!&K#*%&TQ!'!*07W#3!/T!H#'3*&*I!L#g0#*$#L!H&4#!%1#!/*#!&*!%1#!
#*#3IQ!#V'78H#+!51#L#!L#g0#*$#L(!'H/*I!O&%1!%1#!/3I'*&Z#K!#78&3&$'H!&*M#*%/3Q!/T!$/*$#8%&/*L!'*K!#V#78H'3L(!
&*T/37!%1#!$/*L%30$%&/*!/T!H/OC&*T#3#*$#!30W3&$L+!51#!H#'3*&*I!L#g0#*$#!K#L$3&W#K!&*!5'WH#!<!$/*%3&W0%#K(!'H/*I!
O&%1!/%1#3!L#g0#*$#L(!%/!%1#!K#M#H/87#*%!/T!L#M#3'H!30W3&$L!T/$0L#K!/*!4&*#%&$!#*#3IQ(!8/%#*%&'H!#*#3IQ(!'*K!
#*#3IQ!%3'*LT#3G%3'*LT/37'%&/*+!!
:H%1/0I1!30W3&$L!'3#!&*T/37#K!WQ!H#'3*&*I!L#g0#*$#L(!'*K!L$/3#L!$'H$0H'%#K!T3/7!30W3&$!L$/3#L!$'*!W#!'H&I*#K!
'H/*I!%1#!L'7#!L$'H#!'L!%1#!H#'3*&*I!L#g0#*$#L(!H/O!&*T#3#*$#!30W3&$!$1/&$#L!K/!*/%!H//4!70$1!H&4#!H#'3*&*I!
L#g0#*$#L+!)*L%#'K(!30W3&$!$1/&$#L!'3#!7/3#!H&4#!%1#!L8#$&T&$!%1&*IL!L%0K#*%L!L'Q!&*!3#L8/*L#!%/!'!8'3%&$0H'3!
83/WH#7+!5'WH#!D!L1/OL!/*#!/T!-!30W3&$L!RT/3!4&*#%&$!#*#3IQ(!8/%#*%&'H!#*#3IQ(!T/3$#L!RI3'M&%QS(!O/34(!#*#3IQ!
%3'*LT/37'%&/*(!'*K!#*#3IQ!$/*L#3M'%&/*S!0L#K!%/!L$/3#!L%0K#*%!3#L8/*L#L!%/!'*!&%#7!%1'%!'L4L!L%0K#*%L!%/!
!
"@A5)A:(!)6A+!
<b!
K#L$3&W#!%1#!#*#3IQ!/T!'!,(11/*2&A(11+!@'$1!O'Q!/T!K#L$3&W&*I!%1#!#*#3IQ!/T!'!T'HH&*I!W'HH!&L!'LL/$&'%#K(!&*!'*!
#78&3&$'H!&*M#*%/3Q!/T!$/*$#8%&/*L!'*K!#V#78H'3L(!O&%1!%1#!8'3%&$0H'3!K#M#H/87#*%'H!81'L#!K03&*I!O1&$1!&%!
W#$'7#!$/77/*!&*!L%0K#*%!8#3T/37'*$#L+!
Table 2: Rubric choices for kinetic energy—falling ball scenario
Codes
Score
(
J(
K(
L(
M(
N(
9#*%&/*L!#*#3IQ!W0%!T'&HL!%/!#V8H'&*!1/O!&%!3#H'%#L!%/!%1#!83/WH#7!
t!
!
!
!
!
AH'&7L!%1'%!%1#!W'HH!1'L!#*#3IQ!O1&H#!&%!&L!T'HH&*I!
!
t!
!
!
!
AH'&7L!%1'%!%1#!W'HHaL!#*#3IQ!&*$3#'L#L!'L!&%!T'HHL!
!
!
t!
!
!
AH'&7L!%1'%!%1#!W'HHaL!#*#3IQ!&*$3#'L#L!'L!&%!T'HHL!W#$'0L#!&%!L8##KL!08!
!
!
!
t!
!
AH'&7L!%1'%!%1#!W'HHaL!h)6@5)A!#*#3IQ!&*$3#'L#L!'L!&%!T'HHL!W#$'0L#!&%!L8##KL!08!
R/3!'$$#H#3'%#LS!
!
!
!
!
t!
!
51#!0H%&7'%#!I/'H!/T!30W3&$!$/*L%30$%&/*!&L!%/!7'4#!%#'$1#3C!'*K!L%0K#*%CT3&#*KHQ!$/K&*I!7#*0L!%1'%!$'*!W#!0L#K!
&*!%1#!$H'LL3//7!%/!L$/3#!N&L$/5#L%L!&*!3#'H!%&7#+!51#!3#L#'3$1!%#$1*&g0#L!0L#K!%/!$3#'%#!%1#!H#'3*&*I!L#g0#*$#L!
83/M&K#!'!O&*K/O!&*%/!%1#!K#M#H/87#*%!/T!4#Q!$/*$#8%L(!'*K!&*L&I1%L!&*%/!1/O!%1#L#!$/*$#8%L!'3#!#V83#LL#K!'%!
K&TT#3#*%!H#M#HL!/T!$/78H#V&%Q+!51&L!&L!%1#!W'L&L!/T!%1#!30W3&$!$3#'%&/*!83/$#LL(!O1&$1!'&7L!%/!$'8%03#!'L!$H#'3HQ!'L!
8/LL&WH#!%1#!4#Q!K#M#H/87#*%'H!K&TT#3#*$#L!&*!L%0K#*%!8#3T/37'*$#L+!51#L#!30W3&$L!'3#!#TT#$%&M#(!W#$'0L#!%1#Q!
'3#!W0&H%!T3/7!'*!#78&3&$'HHQ!I3/0*K#K(!K#M#H/87#*%'HHQ!/3I'*&Z#K!&*M#*%/3Q!/T!L0W`#$%CL8#$&T&$!$/*$#8%L+!:*K!
W#$'0L#!%1#!30W3&$L!'3#!W'L#K!/*!3#L#'3$1!&*%/!1/O!L%0K#*%L!H#'3*!L8#$&T&$!$/*$#8%L(!%1#Q!$'*!W#!0L#K!%/!
I#*#3'%#!W/%1!'!K#M#H/87#*%'H!L$/3#!'*K!%'3I#%#K!#K0$'%&M#!T##KW'$4+!!!
"#'3*&*I!3#L/03$#L!
51#!K#M#H/87#*%'H!K&TT#3#*$#L!3#M#'H#K!WQ!%1#!H#'3*&*I!L#g0#*$#L!'HL/!&*T/37!%1#!$/78&H'%&/*!/T!3#H'%#K!
H#'3*&*I!3#L/03$#L+!A033&$0H07!L8#$&'H&L%L!O/34!%/!$3#'%#(!$/78&H#(!'*K!$03'%#!L0W`#$%CL8#$&T&$!H#'3*&*I!
3#L/03$#L+!51#!7'%#3&'HL!'3#!%1#*!/3I'*&Z#K!&*!%#37L!/T!%1#!$/78H#V&%Q!/T!%1#&3!%'L4!K#7'*KL!'*K!%1#&3!
$/*$#8%0'H!T/$0L(!'HH/O&*I!%1#7!%/!W#!H&*4#K!%/!30W3&$CK#3&M#K!L$/3#L!'*K!K#H&M#3#K!&*!3#'H!%&7#!%/!%#'$1#3L!'*K!
L%0K#*%L+!51#L#!H#'3*&*I!3#L/03$#L!'3#!&*%#*K#K!%/!L088/3%!W/%1!%#'$1#3!'*K!L%0K#*%!H#'3*&*I(!'*K!T/L%#3!
&*$3#'L&*IHQ!#TT#$%&M#!%#'$1&*I!'*K!H#'3*&*I+!!!!
!
"@A5)A:(!)6A+!
<E!
5#L%&*I!'!*#O!N&L$/5#L%!
!?*$#!'*!&*&%&'H!L#%!/T!30W3&$L!&L!K#M&L#K(!'!*#O!N&L$/5#L%!$'*!0*K#3I/!'!T&3L%!3/0*K!/T!$H'LL3//7!%#L%&*I+!5O/!%/!
%13##!3/0*KL!/T!%#L%&*I!'3#!3#g0&3#K!%/!3#T&*#!30W3&$L(!$1#$4!%1#!'$$03'$Q!/T!H#'3*&*I!L#g0#*$#L(!#M'H0'%#!&%#7!
T0*$%&/*&*I(!'*K!/8%&7&Z#!3#H&'W&H&%Q+!!
@K0$'%&M#!'*K!7#'L03#7#*%!T0*$%&/*L!/T!N&L$/5#L%L!
51#!#V%#*L&M#*#LL!/T!%1#!3#L#'3$1!'*K!K#M#H/87#*%!83/$#LL(!'*K!%1#!$/78H#V&%Q!/T!%1#!T&*'H!3#L0H%!7'4#!
N&L$/5#L%L!0*H&4#!$/*M#*%&/*'H!L%'*K'3K&Z#K!%#L%L!&*!7'*Q!O'QL+!?*$#!W0&H%(!'!N&L$/5#L%!$'*!W#!0L#K!&*K#T&*&%#HQc!
L%0K#*%L!$'*!%'4#!%1#!L'7#!/*#!L#M#3'H!%&7#L!O&%1/0%!#V1'0L%&*I!&%L!8/%#*%&'H!%/!1#H8!%1#7!I'&*!'*!&*$3#'L&*IHQ!
L/81&L%&$'%#K!0*K#3L%'*K&*I!/T!%'3I#%#K!$/*$#8%L+!51&L!&L!W#$'0L#!%1#!&%#7L!'3#!K#H&W#3'%#HQ!$/*L%30$%#K!%/!W#!
'*LO#3'WH#!'%!L#M#3'H!K&TT#3#*%!H#M#HL!/T!L/81&L%&$'%&/*+!9/3#/M#3(!W#$'0L#!%1#!83&7'3Q!3/H#!/T!N&L$/5#L%L!&L!
#K0$'%&M#(!3#K0$&*I!%1#!L%'4#L!'%%'$1#K!%/!#'$1!%#L%&*I!#M#*%(!$/*$#3*L!'W/0%!$1#'%&*I!'3#!7&*&7'H+!
_03%1#37/3#(!'L!'H3#'KQ!7#*%&/*#K(!N&L$/5#L%L!'3#!W/%1!#K0$'%&M#!'*K!L%'*K'3K&Z#K+!:HH!8#3T/37'*$#L!'3#!
8H'$#K!/*!%1#!L'7#(!K/7'&*!&*K#8#*K#*%(!I#*#3'H!L$'H#+!51&L!7'4#L!&%!8/LL&WH#!%/!$/78'3#!H#'3*&*I!%3'`#$%/3&#L!
'$3/LL!'*Q!3'*I#!/T!L0W`#$%L!/3!$/*%#V%L+!51&L!&*$3#'L#L!%1#!8/O#3!/T!N&L$/5#L%L!'L!3#L#'3$1!&*L%307#*%L+!
@M#*%0'HHQ!%1#Q!O&HH!Q&#HK!H'3I#!H/*I&%0K&*'H!K'%'W'L#L!%1'%!O&HH!'HH/O!3#L#'3$1#3L!'*K!'K7&*&L%3'%/3L!%/!$/*L%30$%!
&*$3#'L&*IHQ!3#T&*#K!'$$/0*%L!/T!1/O!L%0K#*%L!H#'3*!&78/3%'*%!L4&HHL!'*K!$/*$#8%L!'*K!O1'%!4&*K!/T!%#'$1&*I!
83'$%&$#L!'3#!7/L%!H&4#HQ!%/!L088/3%!/8%&7'H!H#'3*&*I+!!
[#!1'M#!K&L$0LL#K!1/O!*#O!%#$1*/H/I&$'H!8/LL&W&H&%&#L!'3#!$1'*I&*I!%1#!L1'8#!/T!#K0$'%&/*(!'*K!%#L%&*I!&*!
8'3%&$0H'3+!:L!%1#!%#$1*/H/I&$'H!W'L#!/T!/03!#K0$'%&/*'H!83'$%&$#L!1'M#!%3'*LT/37#K(!L/!1'L!%1#!W3/'K!T0*$%&/*!/T!
%#L%&*I+!UQ!$/7W&*&*I!'KM'*$#L!&*!%#$1*/H/IQ!O&%1!%1#!*#O!L$&#*$#!/T!H#'3*&*I(!N&L$/5#L%L!'3#!'WH#!%/!T'$&H&%'%#!
M&3%0/0L!$Q$H#L!/T!H#'3*&*I!'%!70H%&8H#!H#M#HL!&*!%1#!#K0$'%&/*'H!LQL%#7+!:L!*/%#K!'W/M#(!%1&L!&L!'!8/O#3T0H!O'Q!%/!
T&%!%1#!W#L%!/T!O1'%!O#!4*/O!'W/0%!%#'$1&*I!'*K!H#'3*&*I!&*%/!%/7/33/O\L!#K0$'%&/*'H!%#$1*/H/I&#L+!)*!%1#!*#V%!
L#$%&/*!O#!83/M&K#!'*!/M#3M&#O!/T!%1#!$#*%3'H!#K0$'%&M#!'*K!7#'L03#7#*%!T0*$%&/*!/T!N&L$/5#L%L(!H//4&*I!'%!
O1'%!%1#Q!K/!T/3!L%0K#*%L(!%#'$1#3L(!#K0$'%&/*'H!H#'K#3L(!'*K!3#L#'3$1#3L+!!!
Tests that help students learn
N&L$/5#L%L!L088/3%!L%0K#*%!H#'3*&*I!WQ!I'%1#3&*I!#M&K#*$#!'W/0%!%1#!H#M#H!/T!'!L%0K#*%\L!8#3T/37'*$#(!%1#*!
83/M&K&*I!%1'%!L%0K#*%!R'*K!1&L!/3!1#3!%#'$1#3S!O&%1!3&$1!T##KW'$4!%1'%!8/&*%L!%/!%1#!L8#$&T&$!$/*$#8%L!'*K!L4&HHL!
%1'%!L%0K#*%!&L!7/L%!H&4#HQ!%/!W#*#T&%!T3/7!H#'3*&*I!*#V%+!!N&L$/5#L%L!#*I'I#!L%0K#*%L!&*!'!M&3%0/0L!$Q$H#!O1#3#&*!
%1#&3!3#L8/*L#L!83/78%!&77#K&'%#!'*K!0L#T0H!T##KW'$4!'W/0%!O1#3#!%1#Q!'3#!&*!%1#&3!H#'3*&*I!83/$#LL!'*K!O1'%!
%1#Q!'3#!7/L%!H&4#HQ!%/!W#*#T&%!T3/7!H#'3*&*I!*#V%+!!
N&L$/5#L%!3#L0H%L!'3#!3#$/3K#K!&*!'!K&I&%'H!H#'3*&*I!3#$/3K!%1'%!&L!L077'3&Z#K!&*!%1#!N&L$/5#L%!J#8/3%!A'3K!RL##!
_&I03#!<S+!51&L!3#8/3%!$'3K!L1/OL!%1#!L$/3#!3#$#&M#K!T/3!#'$1!%#L%!#M#*%!R3#83#L#*%#K!/*!%1#!3#8/3%!$'3K!WQ!'!
!
"@A5)A:(!)6A+!
D;!
$&3$H#S!&*!#'$1!L0W`#$%!%#L%#K+!:HH!L$/3#L!'3#!$'H&W3'%#K!%/!%1#!"#$%&$'H!L$'H#(!7'4&*I!&%!8/LL&WH#!%/!83#L#*%!I3/O%1!
&*!'HH!%#L%#K!L0W`#$%L!/*!%1#!L'7#!L$'H#+!23/I3#LL!$'*!W#!%3'$#K!&*!&*K&M&K0'H!L0W`#$%L!'*K!$/78'3&L/*L!$'*!W#!
7'K#!'$3/LL!L0W`#$%L+!51#!3#L0H%!&L!'!$070H'%&M#!8&$%03#!/T!'!L%0K#*%L\!I3/O%1!&*!L#M#3'H!L0W`#$%L!/M#3!%&7#+!)*!
'$%0'H!/*H&*#!N&L$/5#L%!3#8/3%!$'3KL(!#'$1!%#L%!#M#*%!&L!'HL/!H&*4#K!%/!'!K#%'&H#K!3#8/3%!'W/0%!%1#!L%0K#*%\L!
8#3T/37'*$#!/*!%1'%!8'3%&$0H'3!N&L$/5#L%+!
Tests that help teachers teach
N&L$/5#L%L!'HL/!#*I'I#!#K0$'%/3L!&*!'!M&3%0/0L!$Q$H#!/T!H#'3*&*I+!5#'$1#3L!'3#!&*M&%#K!%/!H#'3*!T3/7!N&L$/5#L%L!&*!
'!M'3&#%Q!/T!O'QL+!_&3L%(!O1#*!%1#Q!0L#!30W3&$L!%/!L$/3#!8#3T/37'*$#L(!%#'$1#3L!1'M#!'*!/88/3%0*&%Q!%/!3#TH#$%!
08/*!8'%%#3*L!&*!L%0K#*%!8#3T/37'*$#+!:T%#3!%#L%L!'3#!L$/3#K(!%#'$1#3L!'3#!83/M&K#K!O&%1!&*K&M&K0'H!'*K!
L077'3Q!3#8/3%L!%1'%!#V8H'&*!O1#3#!L%0K#*%L!'3#!H/$'%#K!/*!%1#!8'%1!%/!'$1&#M&*I!H#'3*&*I!I/'HL+!51#L#!3#8/3%L!
'3#!H&*4#K!%/!M#%%#K!H#'3*&*I!3#L/03$#L!'*K!H#LL/*!8H'*L!%1'%!'3#!4#Q#K!%/!L%0K#*%L\!H#M#HL!/T!8#3T/37'*$#+!
J#8/3%L!'*K!%#'$1&*I!3#L/03$#L!'3#!K#L&I*#K!%/!83/M&K#!'!O&*K/O!&*%/!%1#!H#'3*&*I!83/$#LL!&%L#HT(!'HH/O&*I!
#K0$'%/3L!$/*%&*0'HHQ!%/!&783/M#!%1#&3!I3'L8!/T!1/O!H#'3*&*I!0*T/HKL!&*!%1#&3!K/7'&*]'*K!1/O!%1#Q!$'*!
L088/3%!L%0K#*%L!'H/*I!%1#!O'Q+!!
Tests that help leaders understand and develop schools
51#!N&L$/5#L%!&*T3'L%30$%03#!1'L!W##*!K#L&I*#K!%/!L088/3%!M&3%0/0L!$Q$H#L!&*!O1&$1!#K0$'%&/*'H!H#'K#3L!$'*!
7/*&%/3!1/O!8/H&$&#L!'*K!#K0$'%&/*'H!83'$%&$#L!'TT#$%!L%0K#*%!H#'3*&*I+!_/3!*#'3HQ!'!$#*%03Q(!#K0$'%&/*'H!H#'K#3L!
1'M#!0L#K!$/*M#*%&/*'H!L%'*K'3K&Z#K!%#L%L!%/!H#'3*!1/O!%1#&3!&*L%&%0%&/*L!'3#!8#3T/37&*I+!A/*%#78/3'3Q!
#K0$'%&/*'H!3#T/37!#TT/3%L!'3#!W0&H%!/*!%1#!&K#'!%1'%!L%'*K'3K&Z#K!%#L%L!$'*!W#!0L#K!%/!7#'L03#!%1#!
#TT#$%&M#*#LL!/T!*#O!8/H&$&#L!'*K!83'$%&$#L+!:L!*/%#K!&*!/03!'$$/0*%!/T!%1#!1&L%/3Q!/T!%#L%&*I(!3#$#*%!%3#*KL(!&*!
8'3%&$0H'3(!1'M#!#781'L&Z#K!%1#!0L#!/T!%#L%L!T/3!'$$/0*%'W&H&%Q!8038/L#L+!.%'*K'3K&Z#K!%#L%!1'M#!W#$/7#(!T/3!
W#%%#3!'*K!O/3L#(!'*!&*L%307#*%'H!8'3%!/T!7'*'I&*I!/03!L$1//H!LQL%#7L+!!!!!!!
51#L#!LQL%#7C7/*&%/3&*I!L%'*K'3K&Z#K!%#L%L!7'Q!W#!'WH#!%/!83/M&K#!'*!/M#3M&#O!/T!O1/!&L!K/&*I!O#HH!'*K!O1/!&L!
*/%(!W0%!%1&L!4*/OH#KI#!&L!K&M/3$#K!T3/7!'*Q!&*L&I1%!&*%/!%1#!H#'3*&*I!83/$#LL#L!&*!g0#L%&/*+!9/L%!%3'K&%&/*'H!
%#L%L!L'Q!*/%1&*I!'W/0%!%1#!4&*KL!/T!$/*T0L&/*L!%1'%!'3#!$/77/*!/3!'W/0%!%1#!3'*I#!/T!$/*$#8%&/*L!'*K!&K#'L!
1#HK!WQ!K&TT#3#*%!&*K&M&K0'HL!/3!I3/08L!'*K!1/O!%1#L#!'3#!3#H'%#K!%/!T0%03#!83/L8#$%L!T/3!H#'3*&*I+!:L!'H3#'KQ!
*/%#K(!N&L$/5#L%L!1'M#!'!H#'3*&*IC$#*%3&$!T/$0L!%1'%!L#%L!%1#7!'8'3%!T3/7!$/*M#*%&/*'H!L%'*K'3K&Z#K!%#L%L+!51#Q!
'3#!K#L&I*#K!*/%!/*HQ!%/!83/M&K#!L%'*K'3K&Z#K!L$/3#L(!W0%!'HL/!%/!83/M&K#!L$/3#L!%1'%!'3#!7#'*&*IT0H!'L!&*K&$#L!
/T!4#Q!H#'3*&*I!#M#*%L!'*K!%1#!#78&3&$'HHQ!K#%#37&*#K!L#g0#*$#L!&*!O1&$1!%1#Q!'3#!#7W#KK#K+!:*K!W#$'0L#!
%1#L#!L$/3#L!'3#!*/%!/*HQ!L%'*K'3K&Z#K(!W0%!$'H&W3'%#K!%/!'!L&*IH#!%1#/3#%&$'HHQ!&*T/37#K!7#%3&$(!%1#Q!$'*!W#!0L#K!
%/!7/*&%/3!H#'3*&*I!/M#3!%&7#!&*!'!O&K#!3'*I#!/T!L$1//H!L0W`#$%L(!'HH/O&*I!T/3!7#'*&*IT0H!'*K!83#$&L#!$3/LLC
L0W`#$%!$/78'3&L/*L+!!
!
"@A5)A:(!)6A+!
D<!
Tests that help researchers build usable knowledge
51#!N&L$/5#L%!&*&%&'%&M#!'&7L!%/!T'$&H&%'%#!M&3%0/0L!$Q$H#L!&*!3#L#'3$1!'W/0%!%#'$1&*I!'*K!H#'3*&*I!RN'OL/*!d!
.%#&*(!D;;bS+!U#$'0L#!N&L$/5#L%L!'3#!'K7&*&L%#3#K!/*H&*#(!L%0K#*%!8#3T/37'*$#L!$/*%3&W0%#!%/!'!I3/O&*I!
K'%'W'L#!$/*%'&*&*I!3&$1!&*T/37'%&/*!'W/0%!L%0K#*%!H#'3*&*I+!9/3#/M#3(!W#$'0L#!'HH!N&L$/5#L%L!'3#!$'H&W3'%#K!%/!
'!$/77/*!L$'H#(!3#L#'3$1#3L!$'*!'L4!&78/3%'*%!g0#L%&/*L!$/*$#3*&*I(!T/3!#V'78H#(!%1#!K&TT#3#*%&'H!K&L%3&W0%&/*!
/T!L%0K#*%!$'8'W&H&%&#L!'$3/LL!L0W`#$%!'3#'L(!%1#!T'$%/3L!%1'%!L1'8#!%1#!#K0$'%&/*'H!%3'`#$%/3&#L!/T!&*K&M&K0'H!
L%0K#*%L(!'*K!%1#!M'H0#!/T!&**/M'%&/*L!&*!8#K'I/IQ!/3!$033&$0H'+!51#!$'8'$&%Q!%/!#*I'I#!3#L#'3$1!g0#L%&/*L!/T!
%1&L!4&*K(!#78H/Q&*I!K'%'!T3/7!%1/0L'*KL!/T!L%0K#*%L!%#L%#K!H/*I&%0K&*'HHQ!&*!'!O&K#!3'*I#!L0W`#$%L!&L!H&4#HQ!%/!
1'M#!'!L&I*&T&$'*%!&78'$%!08/*!/03!0*K#3L%'*K&*I!/T!H#'3*&*I!'*K!%#'$1&*I+!
Discussion: toward learning-centric testing technologies
51#!N&L$/5#L%!&*&%&'%&M#!1'L!L#3M#K!'L!'*!#V'78H#!/T!O1'%!*#O!$/780%#3!%#$1*/H/I&#L!$/0HK!K/!T/3!%#L%&*I!'*K!
H#'3*&*I+!)78/3%'*%HQ(!%1&L!'883/'$1!%/!W0&HK&*I!'!L%'*K'3K&Z#K!%#L%&*I!&*T3'L%30$%03#!$/*T/37L!%/!K#L&I*!
8'3'7#%#3L!%1'%!$/K&TQ!4#Q!H#LL/*L!T3/7!%1#!H#'3*&*I!L$&#*$#L]H#LL/*L!%1'%!O#!W#H&#M#!/0I1%!%/!L1'8#!%1#!
K#M#H/87#*%!/T!*#O!%#L%&*I!%#$1*/H/I&#L+!)%!&L!O/3%1!L077'3&Z&*I!1/O!%1#!N&L$/5#L%!&*&%&'%&M#(!'L!'*!#V'78H#!/T!
H#'3*&*IC$#*%3&$!%#L%&*I!%#$1*/H/IQ(!T&%L!%1#L#!K#L&I*!8'3'7#%#3L+!N&L$/5#L%L!'3#!W0&H%!83&7'3&HQ!%/!50FF#$"!
"%(.=/*2&(*7&1%($*/*2+!51#Q!'3#!'K7&*&L%#3#K!/*CH&*#!'*K!O&%1!7&*&7'H!L/T%O'3#!'*K!1'3KO'3#!3#g0&3#7#*%L(!
7'4&*I!%1#7!A$#(716&(4(/1(A1%+!51#!&K#'HL!/T!0*&M#3L'H!'$$#LL!'*K!0*&M#3L'H!K#L&I*!%1'%!&*T0L#!'!I3#'%!K#'H!/T!
#K0$'%&/*'H!%#$1*/H/IQ!'3#!H#M#3'I#K!%/!W3&*I!1&I1Cg0'H&%Q!%#L%L!%/!#M#3Q/*#+!N&L$/5#L%L!'3#!W0&H%!%/!W#!
%9A%77%7!&*!%1#!$033&$0H07!'*K!$%1%4(*"&%/!%1#!83#L#*%!'*K!T0%03#!H&M#L!/T!L%0K#*%L(!7'4&*I!%1#7!1#E35"(G%5!
'*K!$'8'WH#!/T!7#3I&*I!&*%/!%1#!TH/O!/T!$H'LL3//7!83'$%&$#+!51#Q!'&K!8#K'I/IQ!%13/0I1!%1#&3!,#$9("/4%!'*K!
7/(2*#5"/.!T0*$%&/*L+!!
51#!W3/'K!I/'H!/T!W0&HK&*I!0*/W%30L&M#!%#'$1#3C#*'WH&*I!%#$1*/H/IQ!1'L!&78/3%'*%!$/*L#g0#*$#L!T/3!%#L%&*I+!
)*T/37#K!WQ!%1#!H#'3*&*I!L$&#*$#L(!*#O!T/37L!/T!%#L%&*I(!H&4#!N&L$/5#L%(!L1/0HK!7/M#!0L!%/O'3K!%#L%L!%1'%!K/!*/%!
&78/L#!08/*!%1#!%#'$1#3!'*K!L%0K#*%(!W0%!3'%1#3!$'%'HQZ#!W#%%#3!%#'$1&*I!'*K!H#'3*&*I+!U#$'0L#!N&L$/5#L%L!'3#!
5"(*7($7/C%7!'*K!Q&#HK!H'3I#!K'%'W'L#L!/T!K#%'&H#K!L%0K#*%!H#'3*&*I!3#$/3KL(!%1#Q!'3#!0L#T0H!T/3!&*T/37&*I!
LQL%#7CH#M#H!K#$&L&/*!7'4&*I!'*K!A0/17/*2&G*#E1%72%!'W/0%!H#'3*&*I!'*K!#K0$'%&/*'H!3#T/37!&*!I#*#3'H+!!
51&L!#V'78H#!L1/OL!1/O!%1#!&*%#3T'$#!/T!%1#!H#'3*&*I!L$&#*$#L!'*K!*#O!%#$1*/H/IQ!$'*!83/K0$#!%#L%L!$'8'WH#!/T!
T'$&H&%'%&*I!70H%&CH#M#H!H#'3*&*I!&*!#K0$'%&/*'H!LQL%#7L+!@7#3I&*I!%#$1*/H/I&#L!$/0HK!83/M&K#!'!0*&g0#!8/&*%!/T!
H#M#3'I#!T/3!8/L&%&M#!$1'*I#L!%/!L$1//H&*I!83'$%&$#!R.%#&*(!#%!'H+(!D;<;S+!?T!$/03L#(!*/%!'HH!%#L%&*I!7'K#!8/LL&WH#!
%13/0I1!$/780%#3!%#$1*/H/I&#L!O&HH!W#!&*!%1#!L#3M&$#!/T!H#'3*&*I+!)T!$033#*%!%3#*KL!$/*%&*0#(!%/7/33/O\L!%#L%&*I!
&*T3'L%30$%03#L!$/0HK!K#H&M#3!*/%1&*I!7/3#!%1'*!$/78H#V!T/37L!/T!%1#!1&I1CL%'4#L(!'$$/0*%'W&H&%QC/3&#*%#K!%#L%L!
%1'%!K/7&*'%#!#K0$'%&/*!%/K'Q+!)%!&L!&78/3%'*%!%1'%!#K0$'%/3L!L#&Z#!%1#!/88/3%0*&%Q!%/!L1'8#!%1#!0L#!/T!
#7#3I&*I!#K0$'%&/*'H!%#$1*/H/I&#L!&*!O'QL!%1'%!'3#!W#*#T&$&'H!%/!L%0K#*%L+!!
!
"@A5)A:(!)6A+!
DD!
:+*'3-#.+*/($0'2*+3+1.0#($2&$('2&*10(0,-'&$.+*('2&*10($0#$.*1(
51&L!K&L$0LL&/*!1'L!W##*!I0&K#K!WQ!g0#L%&/*L!'W/0%!1/O!%/!7#3I#!%1#!W#L%!/T!O1'%!O#!4*/O!'W/0%!%#'$1&*I!'*K!
H#'3*&*I!O&%1!%/7/33/O\L!#K0$'%&/*'H!%#$1*/H/I&#L+!)*!8'3%&$0H'3(!O#!$/*L&K#3#K!%1#!T0%03#!/T!H'3I#CL$'H#!
L%'*K'3K&Z#K!%#L%&*I!&*T3'L%30$%03#L+!>&L%/3Q!L0II#L%L!%1'%!'L!%1#!%#$1*/H/I&$'H!W'L#!L088/3%&*I!#K0$'%&/*!L1&T%L(!
L/!K/!7'*Q!/T!&%L!$/3#!83'$%&$#L(!&*$H0K&*I!%#L%&*I+!.&*$#!%1#!#*K!/T![[))!L%'*K'3K&Z#K!%#L%&*I!&*T3'L%30$%03#L!
1'M#!I3/O*!#V8/*#*%&'HHQ!'*K!'3#!*/O!'%!%1#!$#*%#3!/T!T#K#3'H!#K0$'%&/*'H!8/H&$Q+!u#%(!%1#L#!%3'*LT/37'%&/*L!
'*K!#V8'*L&/*L!/T!%#L%&*I!1'M#!W##*!K&M/3$#K!T3/7!'KM'*$#L!&*!%1#!H#'3*&*I!L$&#*$#L+!:L!*#O!$/770*&$'%&/*L!
%#$1*/H/I&#L!83/H&T#3'%#!'*K!%1#!K#7'*KL!/*!#K0$'%&/*'H!LQL%#7L!$1'*I#(!%#L%&*I!83'$%&$#L!O&HH!$1'*I#!'L!O#HH+!
51#!g0#L%&/*!&LF!%/!O1'%!#V%#*%!O&HH!%1#L#!$1'*I#L!W#!L1'8#K!%/!L#3M#!%1#!&*%#3#L%!/T!%#'$1#3L!'*K!L%0K#*%Le!!!
:L!%1#!N&L$/5#L%!#V'78H#!L1/OL(!%/7/33/O\L!#K0$'%&/*'H!%#$1*/H/I&#L!$/0HK!'HH/O!T/3!T3#g0#*%(!#7W#KK#K(!
T/37'%&M#!'LL#LL7#*%L!%1'%!KQ*'7&$'HHQ!K#H&M#3!3#'HC%&7#!T##KW'$4(!WH033&*I!%1#!H&*#L!W#%O##*!%#L%&*I!'*K!
H#'3*&*I+!:H%1/0I1!$033#*%!%3#*KL!1'M#!Q#%!%/!K&LH/KI#!K/7&*'*%!%#L%&*I!83'$%&$#L(!O1&$1!L%&HH!3#HQ!1#'M&HQ!/*!
K##8HQ!8/H&%&$&Z#K(!L077'%&M#(!1&I1CL%'4#L!%#L%&*I!%1'%!&L!K&M/3$#K!T3/7!%#'$1&*I!'*K!H#'3*&*I!R>03L1(!D;;bc!
J'M&%$1(!D;<;S(!%1#!T0%03#!&L!H&4#HQ!%/!W#!I3#'%HQ!&*TH0#*$#K!WQ!%1#!K&L308%&M#!8/O#3!/T!*#O!#K0$'%&/*'H!
%#$1*/H/I&#L!RA13&L%#*L/*(!#%!'H+(!D;;bc!A/HH&*L!d!>'HM#3L/*(!D;;ES+!5#L%&*I(!&*!8'3%&$0H'3(!&L!H&4#HQ!%/!$1'*I#!&*!%1#!
O'4#!/T!%1#!K&I&%'H!3#M/H0%&/*+!)%!&L!%1#!3#L8/*L&W&H&%Q!/T!#K0$'%/3L!'*K!H#'3*&*I!L$&#*%&L%L!%/!L1'8#!%1#L#!$1'*I#L!
&*!O'QL!%1'%!'3#!W#*#T&$&'H!%/!#M#3Q/*#(!WQ!O/34&*I!%/!$/*L%30$%!H#'3*&*IC$#*%3&$!%#L%L!'*K!%#L%&*I!
&*T3'L%30$%03#L+!!!!!
!(
!
"@A5)A:(!)6A+!
D,!
=050%0*'0#(
!
!
"@A5)A:(!)6A+!
DB!
!!
!
U'HKO&*(!m+!9+!R!n<E;=o!<El-S+!J=#02="&(*7&"=/*25K&8&5"076&/*&"=%&7%4%1#F9%*"&(*7&9%(*/*2&#,&"=#02="&#$&2%*%"/.&
1#2/.!Rp/H+!<S+!6#O!u/34F!9'$7&HH'*!A/+!
U##3(!.+!R<Eb<S+!J=%&A$(/*&#,&"=%&,/$9K&J=%&9(*(2%$/(1&.6A%$*%"/.5&#,&#$2(*/C("/#*+!6#OQ!u/34F!m+![&H#Q+!
U3'*K/7(!J+!R<EEBS+!'(G/*2&/"&%LF1/./"+!A'7W3&KI#!9:F!>'3M'3K!f*&M#3L&%Q!23#LL+!
U3/O*(!m+!R<EEDS+!J=%&7%,/*/"/#*&#,&(&F$#,%55/#*K&J=%&(0"=#$/"6&#,&(&9%"(F=#$&/*&"=%&=/5"#$6&#,&/*"%11/2%*.%&"%5"/*2+!
23&*$#%/*!23&*$#%/*!f*&M#3L&%Q!23#LL+!
U0$4(!m+(!d!p&HH&*#L(!.+!RD;;lS+!I%&"=%&F%#F1%K&+#*5%*"/*2&"#&(&7%%F%$&7%9#.$(.6M&(&20/7%&"#&5#./#.$("/.&F$/*./F1%5&
(*7&9%"=#75+!['L1&*I%/*!NAF!./$&/$3'$Q+&*T/+!
U0L1(!k+!>+![+!R<EE<S+!89%$/.(&:;;;K&877$%55&"#&"=%&*("/#*&#*&*("/#*(1&%70.("/#*(1&5"$("%26+!['L1&*I%/*(!NA+!
A'HH'1'*(!J+(!@+!R<E=BS+!!70.("/#*&(*7&"=%&.01"&#,&%,,/./%*.6+!A1&$'I/F!f*&M#3L&%Q!/T!A1&$'I/!23#LL+!
A'78W#HH(!N+(!5+!R<EblS+!@M/H0%&/*'3Q!#8&L%#7/H/IQ+!)*!J'K&*&%Z4Q!d!U'3%HQ!R@KL+S(!!4#10"/#*($6&%F/5"%9#1#26B&
"=%#$6&#,&$("/#*(1/"6B&(*7&"=%&5#./#1#26&#,&G*#E1%72%+!"'!.'HH#(!)"F!?8#*!A/03%+!
A'78W#HH(!N+!5+!R<El-S+!855%55/*2&"=%&/9F(."&#,&F1(**%7&5#./(1&.=(*2%+!>'*/M#3(!6>F!20WH&$!:TT'&3L!A#*%#3(!
N'3%7/0%1!A/HH#I#+!
A1'87'*(!2+!R<EbbS+!-.=##15&(5&5#$"%$5K&>%E/5&9H&J%$9(*B&(FF1/%7&F56.=#1#26B&(*7&"=%&/*"%11/2%*.%&"%5"/*2&
9#4%9%*"B&NOP;3NPQ;+!6#O!u/34F!6#O!u/34!f*&M#3L&%Q!23#LL+!
A13&L%#*L/*(!A+(!m/1*L/*(!A+(!d!>/3*(!9+!RD;;bS+!R/5$0F"/*2&.1(55K&S#E&7/5$0F"/4%&/**#4("/#*&E/11&.=(*2%&"=%&E(6&
"=%&E#$17&1%($*5+!6#O!u/34F!9$k3'OC>&HH!!
A/HH&*L(!:+(!d!>'HM#3L/*(!J+!RD;;ES+!T%"=/*G/*2&%70.("/#*&/*&"=%&(2%&#,&"%.=*#1#26K&J=%&7/2/"(1&$%4#10"/#*&(*7&
5.=##1/*2&/*&(9%$/.(+!6#O!u/34F!5#'$1#3L!A/HH#I#!23#LL+!
A3#7&*(!"+!R<EbbS+!89%$/.(*&%70.("/#*K&J=%&9%"$#F#1/"(*&%LF%$/%*.%B&NOUV3NPO;+!6#O!u/34F!>'38#3!'*K!J/O+!
N'3H&*IC>'77/*K(!"+!R<EE=S+!51#!3&I1%!%/!H#'3*!'*K!%1#!'KM'*$#7#*%!/T!%#'$1&*IF!J#L#'3$1(!8/H&$Q(!'*K!83'$%&$#!
T/3!K#7/$3'%&$!#K0$'%&/*+!!70.("/#*(1&T%5%($.=%$B&:W(!-C<l+!
N'OL/*(!5+!"+!RD;<;S+!51#!H#$%&$'H^!'LL#LL7#*%!LQL%#7!J#%3&#M#K!9'3$1!,;(!D;<;(!T3/7!1%%8FGGH#$%&$'+&*T/!
N'OL/*(!5+!"+(!d!.%#&*(!P+!RD;;bS+!AQ$H#L!/T!3#L#'3$1!'*K!'88H&$'%&/*!&*!#K0$'%&/*F!"#'3*&*I!8'%1O'QL!T/3!#*#3IQ!
$/*$#8%L+!'/*7B&?$(/*B&X&!70.("/#*B&:RDS(!E;C<;,+!
N'OL/*(!5+!"+(!d![&HL/*(!9+!RD;;BS+!51#!H''LF!:!$/780%#3&Z#K!K#M#H/87#*%'H!L$/3&*I!LQL%#7!T/3!L7'HHC!'*K!H'3I#C
L$'H#!'LL#LL7#*%L+!!70.("/#*(1&855%559%*"B&P(!<-,C<E<+!
N'OL/*C50*&4(!5+!"+!RD;;BS+!X:!I//K!#K0$'%&/*!&LvY!%1#!K#M#H/87#*%!/T!#M'H0'%&M#!%1/0I1%!'$3/LL!%1#!H&T#CL8'*+!
Y%*%"/.B&-#./(1B&(*7&Y%*%$(1&Z56.=#1#26&'#*#2$(F=5B&NQ;R<S(!BC<<D+!
N#O#Q(!m+!R<EDES+!-#0$.%5&#,&(&5./%*.%&#,&%70.("/#*+!6#O!u/34F!"&M#3&I1%+!
@HI&*(!A+!R<EE=S+!+#*5/7%$%7&)0729%*"+!23&*$#%/*(!6#O!m#3L#QF!23&*$#%/*!f*&M#3L&%Q!23#LL+!
_'3H#Q(!5+!RD;;ES+!'(G/*2&"=%&2$(7%5K&'6&9/5(74%*"0$%5&/*&"=%&5"(*7($7/C%7&"%5"/*2&/*705"$6+!.'0L'H&%/(!A:F!
2/H&2/&*%!23#LL+!
_&L$1#3(!h+![+!R<Eb;S+!:!%1#/3Q!/T!$/I*&%&M#!K#M#H/87#*%F!51#!$/*%3/H!'*K!$/*L%30$%&/*!/T!1&#3'3$1&#L!/T!L4&HHL+!
Z56.=#1#2/.(1&T%4/%EB&OU(!BllC-,<+!
_&L$1#3(!h+![+!RD;;ES+!9&*K(!W3'&*(!'*K!#K0$'%&/*F!U0&HK&*I!'!L$&#*%&T&$!I3/0*KO/34!T/3!H#'3*&*I!'*K!%#'$1&*I+!
'/*7B&?$(/*B&(*7&!70.("/#*B&QR<S(!,C<=+!
!
"@A5)A:(!)6A+!
D-!
_&L$1#3(!h+![+(!d!U&K#HH(!5+!J+!RD;;=S+!NQ*'7&$!K#M#H/87#*%!/T!'$%&/*(!%1/0I1%(!'*K!#7/%&/*+!)*![+!N'7/*!d!J+!
9+!"#3*#3!R@KL+S(!S(*7A##G&#,&.=/17&F56.=#1#26K&J=%#$%"/.(1&9#7%15&#,&=09(*&7%4%1#F9%*"!R=!#K+(!p/H+!<(!88+!
,<,C,EES+!6#O!u/34F![&H#Q+!
_/33#L%#3(!m+!R<E=BS+!@*705"$/(1&76*(9/.5+!A'7W3&KI#(!9:F!9)5!23#LL+!
k/0HK(!.+!m+!R<Eb<S+!J=%&9/59%(50$%&#,&9(*+!6#O!u/34F!6/3%/*+!
>'*#Q(![+(!9'K'0L(!k+!_+(!d!"Q/*L(!J+!R<EE,S+!J=%&,$(."0$%7&9($G%"F1(.%&,#$&5"(*7($7/C%7&"%5"/*2+!6/3O#HH(!9:F!
hH#O#3!:$'K#7&$!20WH&L1#3L+!
>#LL(!_+(!d!2#%3&HH&(!9+!RD;;=S+!<#&.=/17&1%,"&A%=/*7+!6#O!u/34F!2#%#3!"'*I+!
>/TT7'*(!U+!R<E=DS+!J=%&"6$(**6&#,&"%5"/*2+!6#O!u#34F!A3/O#HHCA/HH&#3!23#LL+!
>03L1(!N+!RD;;bS+!S/2=35"(G%5&"%5"/*2&(*7&"=%&7%.1/*%&,#&"%(.=/*2&(*7&1%($*/*2+!6#O!u/34F!J/O7'*!d!"&%%H#T#&HK+!
h/3#%Z(!N+!9+!RD;;bS+!'%(50$/*2&0FK&I=("&%70.("/#*(1&"%5"/*2&$%(116&"%115&05+!A'7W3&KI#F!>'3M'3K!f*&M#3L&%Q!
23#LL+!
"'I#7'**(!@+!RD;;;S+!8*&%105/4%&5./%*.%K&J=%&"$#0A1/*2&=/5"#$6&#,&%70.("/#*(1&$%5%($.=+!A1&$'I/F!f*&M#3L&%Q!/T!
A1&$'I/!23#LL+!
"#7'**(!6+!R<EEES+!J=%&A/2&"%5"K&J=%&5%.$%"&=/5"#$6&#,&"=%&(9%$/.(*&9%$/"#.$(.6+!6#O!u/34F!_'33'3(!.%3'0L!'*K!
k3&/0V+!
9'3#L$1'H(!N+(!m/1*L/*(!9+(!.&3/&L(!.+(!.83'%H&*I(!9+(!51/7'L(!9+(!d![#L%#37'**(!k+!RD;;lS+!<%0$#.#*5"$0."/4/59K&
[#109%5&/&X&//&?VT/3KF!?VT/3K!f*&M&#3%L&Q!23#LL+!
6'&3*(!:+!R<Eb;S+!J=%&$%/*&#,&%"5K&J=%&.#$F#$("/#*&"=("&9(G%5&0F&9/*75K&J=%&$(1F=&*(7%$&$%F#$"&#*&"=%&%70.("/#*(1&
"%5"/*2&5%$4/.%H!['L1&*I%/*(!NA+!
6'%&/*'H!J#L#'3$1!A/0*$&H!A/77&%%##!/*!5#L%&*I!'*K!:LL#LL7#*%!RD;;<S+!\*#E/*2&E=("&5"07%*"5&G*#EK&J=%&
5./%*.%&(*7&7%5/2*&#,&%70.("/#*(1&(55%559%*"+!['1&*I%/*(!N+A+F!6'%&/*'H!:$'K#7Q!23#LL+!
6&$1/HL(!.+!"+(!d!U#3H&*#3(!N+!A+!RD;;lS+!+#11("%$(1&7(9(2%K&S#E&=/2=35"(G%5&"%5"/*2&.#$$0F"5&(9%$/.(]5&5.=##15+!
A'7W3&KI#F!>'3M'3K!@K0$'%&/*!23#LL+!
6._!%'L4!T/3$#!/*!$QW#3H#'3*&*I!RD;;bS+!^#5"%$/*2&1%($*/*2&/*&"=%&*%"E#$G%7&E#$17K&J=%&.6A%$1%($*/*2&
#FF#$"0*/"6&(*7&.=(11%*2%+!['L1&*I%/*(!NAF!6'%&/*'H!.$&#*$#!_/0*K'%&/*+!
?aN/**#HH(!m+!9+!R<Eb-S+!J=%&#$/2/*5&#,&A%=(4/#$/59K&89%$/.(*&F56.=#1#26&NOU;3NP:;+!6#O!u/34F!6#O!u/34!
f*&M#3L&%Q!23#LL+!
?W'7'(!U+!RD;;bS+!-F%%.=&"#&"=%&N_V"=&(**0(1&9%%"/*2&#,&"=%&OU"=&$%F$%5%*"("/4%&(55%9A16&#,&"=%&*("/#*(1&
%70.("/#*&(55#./("/#*+!['L1&*I%/*(!NA+!
21&HH&8L(!h+!J+!RD;;,S+!J%5"/*2&.#*"$#4%$56K&8&$=%"#$/.&#,&%70.("/#*&$%,#$9&A3#LL4&HH(!6mF!>'78%/*!23#LL+!
2&'I#%(!m+!R<E=;S+!J=%&F56.=#1#26&#,&/*"%11/2%*.%+!2'%%#3L/*(!6#O!m#3L#QF!"&%%H#T&#HK(!:K'7L+!
23#L&K#*%aL!$/0*$&H!/T!'KM&L/3L!/*!L$&#*$#!'*K!%#$1*/H/IQ!RD;<DS+!!*2(2%&"#&%L.%1K&Z$#70./*2&#*%&9/11/#*&
(77/"/#*(1&.#11%2%&2$(70("%5&E/"=&7%2$%%5&/*&5./%*.%B&"%.=*#1#26B&%*2/*%%$/*2B&(*7&9("=%9("/.5+!
['L1&*I%/*(!NA+!
J'M&%$1(!N+!RD;<;S+!J=%&1/,%&(*7&7%("=&#,&"=%&2$%("&(9%$/.(*&5.=##1&565"%9K&S#E&"%5"/*2&(*7&.=#/.%&($%&
0*7%$9/*/*2&%70.("/#*+!6#O!u/34F!U'L&$!U//4L+!
.'$4L(!2+!R<EEES+!-"(*7($7/C%7&9/*75K&J=%&=/2=&F$/.%&#,&(9%$/.(]5&"%5"/*2&.01"0$%&(*7&E=("&E%&.(*&7#&"#&.=(*2%&
/"+!A'7W3&KI#(!9:F!2#3L#0L!23#LL+!
.'7#HL/*(!_+!R<EE;S+!['L!#'3HQ!7#*%'H!%#L%&*IF!:S!3'$&L%!&*L8&3#K(!WS!/W`#$%&M#!L$&#*$#(!$S'!%#$1*/H/IQ!T/3!
K#7/$3'$Q(!KS!%1#!/3&I#*!/T!%1#!70H%&8H#C$1/&$#!#V'7(!#S!*/*#!/T!%1#!'W/M#+!)*!9+!./4'H!R@K+S(!Z56.=#1#2/.(1&
"%5"/*2&/*&(9%$/.(*&5#./%"6K&NOP;3NPQ;&`FFH&NNQ3N:Oa+!6#O!U30*LO&$4F!J0%I#3L!f*&M#3L&%Q!23#LL+!
!
"@A5)A:(!)6A+!
D=!
.$1O'3%Z(!>+(!>'7&H%/*(!"+!.+(!.%#$1#3(!U+!9+(!d!.%##H#(!m+(!"+!RD;<<S+!!LF(*7%7&9%(50$%5&#,&5.=##1&F%$,#$9(*.%+!
:H&I&*%/*(!p:+F!J:6N!@K0$'%&/*+!
.$1O'3%Z(!9+(!d!N'OL/*(!5+(!"!RD;<;S+!-"(*7($75&X&(55%559%*"5K&J=%&$#1%&#,&7%F"=&4%$505&A$%(7"=&/*&5"07%*"&
50..%55+!2'8#3!83#L#*%#K!'%!%1#!:!$/77&%7#*%!%/!#V$#HH#*$#F!J#K#L&I*&*I!L%0K#*%!L0$$#LL!&*!#'3HQ!
$1&HK1//K(!#H#7#*%'3Q(!L#$/*K'3Q!'*K!8/L%L#$/*K'3Q!#K0$'%&/*+!!
.#*I#(!2+!9+!R@K+S+!R<EE;S+!J=%&,/,"=&7/5./F1/*%K&J=%&($"&(*7&F$(."/.%&#,&"=%&1%($*/*2&#$2(*/C("/#*+!6#O!u/34F!
N/0WH#K'Q+!
./4'H(!9+!R@K+S+!R<EE;S+!Z56.=#1#2/.(1&"%5"/*2&/*&(9%$/.(*&5#./%"6K&NOP;3NPQ;+!6#O!U30*LO&$4F!J0%I#3L!f*&M#3L&%Q!
23#LL+!
.8&%Z#3(!9+!R<EEES+!J=%&9/*7&E/"=/*&"=%&*%"K&'#7%15&#,&1%($*/*2B&"=/*G/*2B&(*7&(."/*2+!A'7W3&KI#(!9:F!
9'LL'$10LL#%%L!)*L%&%0%#!/T!5#$1*/H/IQ+!
.83&*I(!m+!>+!R<EbES+!J=%&5#$"/*2&9(.=/*%&$%4/5/"%7K&<("/#*(1&%70.("/#*(1&F#1/.6&5/*.%&NP_W+!6#O!u/34F!"/*I7'*+!
.%#&*(!P+(!N'OL/*(!5+!"+(!d!_&L$1#3(!h+![+!RD;<;S+!J#K#L&I*&*I!%#L%&*IF!?8#3'%&/*'H&Z&*I!%1#!*#O!L$&#*$#!/T!
H#'3*&*I+!)*!9+!.+!h1&*#!d!)+!9+!.'H#1!R@KL+S(!<%E&5./%*.%&#,&1%($*/*2K&+#9F0"%$5B&.#2*/"/#*&(*7&.#11(A#$("/#*&
/*&%70.("/#*+!6#O!u/34F!.83&*I#3+!
5/$1(!5+!RD;;=S+!'($2/*5&#,&%$$#$K&J=%&%70.("/#*&"%5"/*2&/*705"$6&/*&"=%&*#&.=/17&1%,"&A%=/*7&%$(+!['L1&*I%/*!N+A+F!
@K0$'%&/*!.#$%/3+!
5/7'L#HH/(!9+!RD;;-S+!+#*5"$0."/*2&(&1(*20(2%K&8&05(2%3A(5%7&"=%#$6&#,&1(*20(2%&(.D0/5/"/#*+!A'7W3&KI#!9:F!
>'3M'3K!f*&M#3L&%Q!23#LL+!
f.!K#8'3%7#*%!/T!#K0$'%&/*!RD;<<S+!T(.%&"#&"=%&"#F&(55%559%*"&F$#2$(9+!
P0$4#3(!:+!RD;;bS+!J$(*5,#$9/*2&5.=##15&E/"=&"%.=*#1#26K&S#E&59($"&05%&#,&7/2/"(1&"##15&=%1F5&(.=/%4%&5/L&G%6&
%70.("/#*(1&2#(15+!A'7W3&KI#(!9:F!>'3M'3K!@K0$'%&/*!23#LL+!
!
!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
&!51#L#!%#L%L!O&HH!W#!'M'&H'WH#!%/!&*K&M&K0'H!%#'$1#3L!'*K!L%0K#*%L!'%!*/!$/L%!R%/!#*L03#!%1'%!%1#!H#'L%!'KM'*%'I#K!'3#!L#3M#KS(!'*K!
K#H&M#3#K!%/!L$1//HL!'*K!L$1//H!K&L%3&$%L!T/3!'!H/O!8#3C'LL#LL7#*%!T##+!N&L$/5#L%L!'3#!7'K#!WQ!'!*/*C83/T&%!/3I'*&Z'%&/*(!%1#!
N#M#H/87#*%'H!5#L%&*I!.#3M&$#(!)*$+!_##L!O&HH!L088/3%!%1#!7'&*%#*'*$#!'*K!K#M#H/87#*%!/T!N&L$/5#L%L!'*K!%1#!K&LL#7&*'%&/*!/T!
4*/OH#KI#!'W/0%!H#'3*&*I+!
&&!51&L!0*&M#3L'H!H#'3*&*I!L$'H#!&L!_&L$1#3\L!.4&HH!.$'H#!R_&L$1#3(!<Eb;c!_&L$1#3!d!U&K#HH(!D;;=S!/8#3'%&/*'H&Z#K!'*K!3#T&*#K!&*!%1#!"#$%&$'Hr!
:LL#LL7#*%!.QL%#7!RN'OL/*(!D;<;S+!!
&&&!&_&M#!%/!L#M#*!/T!%1#L#!81'L#L!'3#!I#*#3'HHQ!&K#*%&T&#K!&*!'*!&*K&M&K0'H!hC<D!$H'LL3//7+!
Theo
Dawson
Digitally signed by
Theo Dawson
DN: cn=Theo Dawson,
o=Lectica®, Inc., ou,
email=THEO@DEVTEST
SERVICE.ORG, c=US
Date: 2012.09.30
10:18:07 -05'00'
... • The coherence of arguments/explanations is generally taken as an indication of quality of understanding. [7,14] • The practice of argumentation has been shown to support learning and development. [7,13,14] • Consequently, the quality of students' argumentation skills is likely to predict the slope of their developmental trajectories. ...
... [7,14] • The practice of argumentation has been shown to support learning and development. [7,13,14] • Consequently, the quality of students' argumentation skills is likely to predict the slope of their developmental trajectories. ...
An examination of the relationship between argumentation quality and students’ growth trajectories.
Conference Paper
Full-text available
  • Oct 2017
In order to sustain cognitive developmental growth over time, it is necessary to ensure that students build robustly connected knowledge networks.The quality of our knowledge networks is reflected in explanation, application, and transfer.In explanations, high quality argumentation can be taken as evidence of robustly connected knowledge networks. If this is true, the rate of cognitive developmental growth should be predicted by the overall quality of students’ argumentation. In this paper, we show that there are important (even staggering) differences in the average developmental trajectories of students in different kinds of schools, and show that depth of understanding, as captured in a set of argumentation scales, explains about 35% of the variance in developmental trajectories.
View
... There are several electronic performance support systems (EPSS) that combine assessment and development, sometimes with AI anchored in neo-Kolbergian models of developmental psychology that show distinct linear and nonlinear developmental levels of a latent construct (e.g. Barney & Riley, 2018;Dawson & Stein, 2011). This trend is likely to continue to impact I-O psychology, just as it is affecting every profession with knowledge workers. ...
The Cambridge Handbook of Technology and Employee Behavior
Article
  • Feb 2019
Cambridge Core - Organisation Studies - The Cambridge Handbook of Technology and Employee Behavior - edited by Richard N. Landers
View
... There are several electronic performance support systems (EPSS) that combine assessment and development, sometimes with AI anchored in neo-Kolbergian models of developmental psychology that show distinct linear and nonlinear developmental levels of a latent construct (e.g. Barney & Riley, 2018;Dawson & Stein, 2011). This trend is likely to continue to impact I-O psychology, just as it is affecting every profession with knowledge workers. ...
The Reciprocal Roles of AI and IO Psychology for AI Safety
Chapter
  • Feb 2019
Chapter in Landers, R., (Ed.) (2019) The Cambridge Handbook of Technology and Employee Behavior
View
... That is what we will be doing if we move to a lottery format to select medical students. Although there is evidence that some selection methods (academic records, multiple mini-interviews, and situational judgment tests) perform better than others (traditional interviews, personal statements, and references), 1 it is also true that, in a robust learning model, 8 failure is information, and the goal-experience-feedback cycle can improve future performance. In fact, just as we should be selecting for students with the capacity and courage to learn from their mistakes, students with resilience, 9 curiosity, 10 and an ability to adapt to uncertainty and complexity, we must rise to the challenge of continuing to learn, research, and evolve with the patients and populations whom we serve, in selecting for and supporting the development of good doctors. ...
CJEM Debate Series: #BetterSelection – Medical school acceptance tests select the wrong doctors: We need fewer memorizers and more thinkers and communicators in modern medicine
Article
  • Jul 2018
CJEM Debate Series: #BetterSelection – Medical school acceptance tests select the wrong doctors: We need fewer memorizers and more thinkers and communicators in modern medicine - Volume 20 Issue 4 - John M. Steeves, David A. Petrie, Paul R. Atkinson
View
Addressing the Complexity Gap: Developing Integrated Thinking Skills at Board Level
Article
  • Feb 2016
  • Board Leader
Drawing on insights from adult developmental psychology, Matthew Rich-Tolsma and John Oliver, certified consultants with Lectica, Inc., highlight the explicit thinking skills that are unique to the challenges at the board level, in the context of increasing volatility, uncertainty, complexity, and ambiguity (VUCA) in the world. The invitation is for boards to think about their thinking skills, with the help of the latest research in frameworks of integrated thinking skills.
View
A Theory of Cognitive Development: The Control and Construction of Hierarchies of Skills
Article
Full-text available
  • Nov 1980
Skill theory provides tools for predicting developmental sequences and synchronies in any domain at any point in development by integrating behavioral and cognitive-developmental concepts. Cognitive development is explained by skill structures called "levels," together with transformation rules relating these levels to each other. The transformation rules specify the developmental steps by which a skill moves gradually from one level of complexity to the next. At every step in these developmental sequences, the individual controls a particular skill. Skills are gradually transformed from sensory-motor actions to representations and then to abstractions. The transformations produce continuous behavioral changes; but across the entire profile of a person's skills and within highly practiced task domains, a stagelike shift in skills occurs as the person develops to an optimal level. The theory suggests a common framework for integrating developmental analyses of cognitive, social, language, and perceptual-motor skills and certain behavioral changes in learning and problem solving. (6 p ref)
View
The LAAS: A Computerized Scoring System for Small and Large-Scale Developmental Assessments
Article
Full-text available
  • Aug 2004
The evaluation of developmental interventions has been hampered by a lack of practical, reliable, and objective developmental assessment systems. This article describes the construction of a domain-general computerized developmental assessment system for texts: the Lexical Abstraction Assessment System (LAAS). The LAAS provides assessments of the order of hierarchical complexity of oral and written texts, employing scoring rules developed with predictive discriminant analysis. The LAAS is made possible by a feature of conceptual structure we call hierarchical order of abstraction, which produces systematic quantifiable changes in lexical composition with development. The LAAS produces scores that agree with human ratings of hierarchical complexity more than 80% of the time within one-third of a complexity order across 6 complexity orders (18 levels), spanning the portion of the lifespan from about 4 years of age through adulthood. This corresponds to a Kendall’s tau of.93.
View
Dynamic Development of Action and Thought
Chapter
Full-text available
  • Jun 2007
Human activity is both organized and highly variable. Analysis of the variation illuminates the dynamic order in development, learning, and emotional change. Action is nowhere near as stable as the static conceptions of psychology predict. Dynamic structural analysis provides a framework and tools for analyzing the variation and detecting the order in it – the dynamic organization of self-constructed, socially embedded skills and activities (actions, thoughts, and emotions). Key discoveries and tools include: (1) the emergence of a series of cognitive abilities that form a universal scale for development and learning, (2) methods for analyzing microdevelopment and learning pathways, (3) tools for depicting emotional development, including affective splitting and cultural shaping, and (4) a model connecting cognitive growth with brain development. Keywords: brain development; cognition; dynamic structuralism; emotion; microdevelopment; skill theory; variation
View
View
Mind, Brain, and Education: Building a Scientific Groundwork for Learning and Teaching
Article
  • Jan 2009
The primary goal of the emerging field of Mind, Brain, and Education is to join biology, cognitive science, development, and education in order to create a sound grounding of education in research. The growing, worldwide movement needs to avoid the myths and distortions of popular conceptions of brain and genetics and build on the best integration of research with practice, creating a strong infrastructure that joins scientists with educators to study effective learning and teaching in educational settings. Science and practice together provide many potentially powerful tools to improve education. Neuroscience and genetics make possible analysis of the "black box" of biological processes that underpin learning. Understanding the biology of abilities and disabilities helps educators and parents to facilitate individual students' learning and development. Cognitive science provides analyses of the mental models/metaphors that pervade meaning making in human cultures, creating tools for avoiding unconscious distortions and crafting effective educational tools. Developmental and learning science produce tools to analyze learning pathways, including both shared patterns and learning differences. To reach the potential of grounding education effectively in research requires improving the infrastructure by creating (a) research schools where practice and science jointly shape educational research, (b) shared databases on learning and development, and (c) a new profession of educational engineers or translators to facilitate connecting research with practice and policy.
View
Cycles of Research and Application in Education: Learning Pathways for Energy Concepts
Article
  • Jun 2008
ABSTRACT— We begin this article by situating a methodology called developmental maieutics in the emerging field of mind, brain, and education. Then, we describe aspects of a project in which we collaborated with a group of physical science teachers to design developmentally informed activities and assessments for a unit on energy. Pen-and-paper assessments, called teasers, were employed, along with interviews, to study how students learned about the physics of energy. Results were used to describe students’ learning pathways and to design a scoring rubric for teacher use. We hypothesized that (a) teasers, by themselves, could be used effectively to evaluate the developmental level of students’ reasoning about energy and (b) teachers could employ the scoring rubric with minimal instruction. Encouraged by our findings, we went on to create a freely available online version of the energy teaser, including a new rubric designed to improve the accuracy with which teachers can assess the developmental level of students’ energy conceptions.
View
!Fostering&learning&in&the&networked&world:&The&cyberlearning& opportunity&and&challenge
  • Jan 2008
NSF!task!force!on!cyberlearning!(2008).!Fostering&learning&in&the&networked&world:&The&cyberlearning& opportunity&and&challenge.!Washington,!DC:!National!Science!Foundation.!
!The&origins&of&behaviorism:&American&psychology&187031920
  • Jan 1985
  • O ' Donnell
O'Donnell,!J.!M.!(1985).!The&origins&of&behaviorism:&American&psychology&187031920.!New!York:!New!York! University!Press.!