[PDF] Appendix F: the role of data in digital advertising - Govuk





Loading...








[PDF] Measuring the Effectiveness of Multi Platform Advertising - IRIS

platform advertising, a company can spread its message far and wide Multi platform campaigns include a multitude of combinations of TV spots or sponsorship 




[PDF] Strategies of closed online advertising platforms — cases Google

30 mai 2018 · Online advertising, closed ad platform, Google, Facebook journey is becoming more and more dispersed across multiple channels: 61 of 

[PDF] Essential Strategies for Cross-Channel Marketing - Oracle

By launching personalized marketing campaigns across multiple platforms and devices, you'll see higher engagement and conversion rates from your customers 3

[PDF] PLANNING FOR SYNERGY

Planting the seeds to create multi-platform media synergy Figure 8: Build in ad awareness across multiple platforms Source: Dres Consulting 2010

[PDF] Not all Reach is Equal ThinkTV

An Investigation into Cross Platform Advertising Effectiveness across different platforms and devices different brands - including the ones they




[PDF] The Future of Digital Advertising - Accenture

31 août 2017 · And the lack of standard cross-platform measurement was, by far, the biggest challenge for sellers in gauging advertising ROI The advertising 

[PDF] Accenture Multimedia Advertising Platform

Meet: The Accenture Multimedia Advertising Platform (AMAP) single view of advertising inventories across multiple media, directly accessible by buyers 

[PDF] The Impact of TV Ads on the Individual User's Online Purchasing

The synergies caused by the interdependencies of different online can be used to apportion the marketing budget across the channels and to predict the 

[PDF] Multi-Sided Platform Approach Emerging Into Growth Accenture

intelligent enterprise, and improve advertisers' return-on-investment Figure 2 MEDIA COMPANY MULTI-SIDED PLATFORM Bolster the talent pipeline

[PDF] Appendix F: the role of data in digital advertising - Govuk

Source: CMA Sources of data 26 Large platforms are able to gather different types of data from a wide range of

[PDF] OMNICHANNEL MARKETING AUTOMATION - Emarsys

journey on one platform, only to jump to another, and finally Combining multiple channels across a brand to form a cohesive omnichannel strategy to ensure

PDF document for free
  1. PDF document for free
[PDF] Appendix F: the role of data in digital advertising - Govuk 3003_1Appendix_F___role_of_data_in_digital_advertising_v_4_WEB.pdf F1 ,QWURGXFWLRQ

:HKDYHVRXJKWWRXQGHUVWDQGZKHWKHUDFFHVVWRGDWDRUFHUWDLQW\SHVRIGDWDPD\FRQIHUDFRPSHWLWLYHDGYDQWDJHWRODUJHSODWIRUPVDQGLQKLELWHQWU\DQGH[SDQVLRQE\VPDOOHUSODWIRUPVRQERWKVLGHVRIWKHPDUNHW±

W KH  XV HU  DQGDGYHUWLVLQJVLGHV7KHUROHRIGDWDRQWKHXVHUVLGHLVGLVFXVVHGLQ &KDSWHU

7KLVDSSHQGL[GUDZVRQDFDGHPLFOLWHUDWXUHVXEPLVVLRQVDQGGRFXPHQWVIURPPDUNHWSDUWLFLSDQWVWRDVVHVVWKHIROORZLQJWRSLFV

2XUYLHZRQWKHUROHRIGDWDLQGLJLWDODGYHUWLVLQJLVVXPPDULVHGEHORZ F2 F3 :HKDYHGUDZQIURPH[LVWLQJOLWHUDWXUHVWDNHKROGHUYLHZVDQGSUHYLRXV UHSRUWVWRLGHQWLI\IRXUEURDGFDWHJRULHVRIGDWDIRURXUSXUSRVHVQDPHO\

7KHVHFDWHJRULHVDUHQRWPXWXDOO\H[FOXVLYHRUH[KDXVWLYHDQGWKHUHDUHPDQ\JUH\DUHDVLQZKLFKDQ\JLYHQNLQGRIGDWDPD\EHXVHGIRUGLIIHUHQW

SXUSRVHVDQGFRXOGEHLQFOXGHGLQVHYHUDORIWKHVHFDWHJRULHV  :HFRQVLGHUWKLVLVWKHPRVWXVHIXOFDWHJRULVDWLRQWRDVVHVVWKHUROHVWKDW VSHFLILFW\SHVRIGDWDSOD\LQSODWIRUPV¶PDUNHWSRZHULQWKHSURYLVLRQRIGLJLWDO DGYHUWLVLQJ:HDOVRFRQVLGHUWKDWWKLVFODVVLILFDWLRQLVKHOSIXOWRIUDPHDQG

DVVHVVFRQFHUQVUHODWHGWRFRQVXPHUSULYDF\

F4 7KLVSURFHVVFRPELQHVYROXQWHHUHG DQGREVHUYHGGDWDDERXWRQHFRQVXPHUDQGDERXWRWKHUFRQVXPHUVWR LQIHUDGGLWLRQDOLQIRUPDWLRQDERXWWKDWRQHFRQVXPHU)RUH[DPSOHD XVHU¶V,3DGGUHVVFDQEHXVHGWRLQIHUWKHLUORFDWLRQ,QWXUQWKLVFDQEH FRPELQHGZLWKFHQVXVGHPRJUDSKLFLQIRUPDWLRQWRLQIHUFKDUDFWHULVWLFV VXFKDVHGXFDWLRQLQFRPHDQGHWKQLFLW\(PSLULFDOUHVHDUFKVKRZV WKDWLWLVSRVVLEOHWRLQIHUDODUJHQXPEHURIXVHUDWWULEXWHVZLWK VDWLVIDFWRU\OHYHOVRIDFFXUDF\LQFOXGLQJVRPHFRPSOH[RQHVVXFKDV

SHUVRQDOLW\WUDLWV

 

$QRWKHUUHOHYDQWFDWHJRULVDWLRQIRURXUSXUSRVHVGLVWLQJXLVKHVXVHUGDWDEHWZHHQSHUVRQDODQGQRQSHUVRQDOGDWD3HUVRQDOGDWDLVDZLGHFRQFHSW

XQGHUUHOHYDQWGDWDSURWHFWLRQOHJLVODWLRQ VXFKDV*'35DQG'3$ WK DW LQFOXGHVDQ\LQIRUPDWLRQDERXWQDWXUDOSHUVRQVZKRFDQEHLGHQWLILHGHLWKHU GLUHFWO\IURPWKHLQIRUPDWLRQRULQGLUHFWO\IURPXVLQJWKDWLQIRUPDWLRQLQ

FRPELQDWLRQZLWKRWKHULQIRUPDWLRQ

 $SHUVRQFDQEHLGHQWLILHGLIWKH\FDQEH GLVWLQJXLVKHGIURPRWKHULQGLYLGXDOV2QOLQHLGHQWLILHUVVXFKDV,3DGGUHVVHV FRRNLH,'VDGYHUWLVLQJ,'VHPDLODGGUHVVHVXVHUDFFRXQWVDQGGHYLFH ILQJHUSULQWV LHKLJKO\VSHFLILFLQIRUPDWLRQDERXWWKHFRPELQDWLRQRIYHUVLRQV *XLGHWRWKHJHQHUDOGDWDSURWHFWLRQUHJXODWLRQ SS 

6HH.RVLQVNL0%DFKUDFK<.RKOL36WLOOZHOO'DQG*UDHSHO7  µ0DQLIHVWDWLRQVRIXVHUSHUVRQDOLW\LQ

ZHEVLWHFKRLFHDQGEHKDYLRXURQRQOLQHVRFLDOQHWZRUNV¶0DFKLQHOHDUQLQJSS  0DW]6&0HQJHV-,

6WLOOZHOO'-DQG6FKZDUW]+$  µ3UHGLFWLQJLQGLYLGXDO

 OHYHOLQFRPHIURP)DFHERRNSURILOHV¶3OR6RQH

SH9RONRYD6%DFKUDFK<$UPVWURQJ0DQG6KDUPD9  µ,QIHUULQJODWHQWXVHUSURSHUWLHVIURP

WH[WVSXEOLVKHGLQVRFLDOPHGLD¶7ZHQW\1LQWK$$$,&RQIHUHQFHRQ$UWLILFLDO,QWHOOLJHQFH  ,&2:KDWLVSHUVRQDOGDWD" F5 

7KLVODWWHUFODVVLILFDWLRQLVPRVWXVHIXOZKHQFRQVLGHULQJWKHUHODWLYHFRPSHWLWLYHSRVLWLRQVRISODWIRUPVLQUHODWLRQWRWKHDPRXQWRIGDWDWKH\FROOHFW

DQGXVH

 DVGHVFULEHGLQWKHµ&RQFHQWUDWLRQDQGTXDOLW\RIGDWD¶VHFWLRQ EHORZ DQGWKHUROHRIGDWDLQWDUJHWLQJDGYHUWLVLQJ

$VIRUXVHUGDWDVRPHFRQWH[WXDOGDWDFDQEHSHUVRQDOGDWDLILWLVDVVRFLDWHGZLWKDQLGHQWLILDEOHSHUVRQ)RULQVWDQFHVHDUFKTXHULHVDQGKLVWRULHVDQGORFDWLRQGDWDUHFRUGHGDJDLQVWVSHFLILFXVHUV¶SURILOHVPD\EHFRQVLGHUHGSHUVRQDOGDWDZLWKLQWKHPHDQLQJRIUHOHYDQWGDWDSURWHFWLRQOHJLVODWLRQ+RZHYHULQJHQHUDOFRQWH[WXDOGDWDLQYROYHVDPXFKPRUHOLPLWHG

XVHRISHUVRQDOGDWDLIDQ\DWDOODQGWKHUHIRUHUDLVHVIHZHUSULYDF\

FRQFHUQV

&RQWH[WXDOGDWDDORQJVLGHXVHUGDWDFDQEHXVHGWRWDUJHWUHVXOWVDQG

DGYHUWLVHPHQWVWRWKHFRQVXPHU

:KDWDUHLGHQWLILHUVDQGUHODWHGIDFWRUV" F6 6RPHDQDO\WLFVGDWDFDQDOVREHSHUVRQDOGDWDLIDGYLHZVFOLFNV FRQYHUVLRQVDQGRWKHUVXEVHTXHQWEHKDYLRXUVDUHDVVRFLDWHGZLWKVSHFLILF

LGHQWLILDEOHLQGLYLGXDOV

7KLVGDWDLVYDOXDEOHWRDGYHUWLVHUVDVGHVFULEHGIXUWKHUEHORZDQGLQ $SSHQGL[2EHFDXVHLWDOORZVWKHPWRXQGHUVWDQGZKHWKHUWKHLU DGYHUWLVHPHQWLVVHUYHGWRWKHLQWHQGHGDXGLHQFH YHULILFDWLRQ DQGDVVHVV DQGPHDVXUHWKHUHDFKDQGVXFFHVVRIWKHLUDGYHUWLVLQJ DWWULEXWLRQDQG

HYDOXDWLRQRIHIIHFWLYHQHVV 

7KLVLQFOXGHVQRQXVHUGDWDDQGPHWDGDWDDERXWZHEVLWHVDQGZHESDJHV OLQNVWRRWKHUZHESDJHVRQHDFKSDJHDQGWKHSDWWHUQRUQHWZRUNRIOLQNVRQ WKHLQWHUQHWWKHFRQWHQWVRIHDFKSDJHDQGWKHUHSXWDWLRQRUUHOLDELOLW\RI ZHESDJHV ZKLFKPD\LQFOXGHWKHMXGJHPHQWVRIKXPDQUHYLHZHUV 6HDUFK HQJLQHVDOVRXVHGDWDIHHGVIURPWKLUGSDUWLHVWRVXSSOHPHQWWKHLUGDWDIURP FUDZOLQJDQGLQGH[LQJDQGWRSURYLGHEHWWHUDQVZHUVWRFHUWDLQTXHULHVVXFK WKRVHUHODWLQJWRVSRUWVFRUHVH[FKDQJHUDWHVDQGZHDWKHUIRUHFDVWV 6HDUFKGDWDDOVRLQFOXGHVXVHUGDWDVXFKDVZKDWFRQVXPHUVVHDUFKIRUDQG ZKLFKUHVXOWVLIDQ\WKH\FOLFNRQIURPDUHVXOWVSDJH FOLFNDQGTXHU\GDWD  ZKLFKLVXVHGWRUHILQHVHDUFKHQJLQHV¶DOJRULWKPVWRVHOHFWDQGRUGHUUHOHYDQW

UHVXOWV

:HFRQVLGHUWKHUROHRIWKLVGDWDLQPRUHGHWDLOLQ$SSHQGL[, F7 8VHUGDWD

9ROXQWHHUHGGDWD1DPHHPDLODGGUHVVGDWHRIELUWKGHFODUHGLQWHUHVWVSRVWV

SKRWRVFRPPHQWVOLNHV

2EVHUYHGGDWD&OLFNDQGTXHU\GDWDFOLFNVWUHDPGDWDWLPHVSHQWRQD

ZHESDJHGHYLFHEURZVHUILQJHUSULQW

,QIHUUHGGDWD,QIHUUHGGHPRJUDSKLFVLQIHUUHGLQWHUHVWV

&RQWHQWRIDZHESDJHDSSORFDWLRQZHDWKHUFRQGLWLRQV

1XPEHURIFRQVXPHUVWKDWFOLFNRQDQDGDFWLRQVWDNHQDIWHU

VHHLQJWKHDG :HEFUDZOLQJDQGLQGH[LQJ &OLFNDQGTXHU\GDWD6HDUFKHVRQVHDUFKHQJLQHV 'DWDIHHGV'DWDDERXWZHESDJHV 6RXUFH&0$

7KHUHDUHPDQ\GLIIHUHQWVRXUFHVDQGPDQ\SRVVLEOHZD\VWRFDWHJRULVHWKHP:HGLVWLQJXLVKEHWZHHQWZREURDGVRXUFHVWKDWSODWIRUPVXVHWRFROOHFW

GDWD L GDWDJDWKHUHGIURPWKHSODWIRUPV¶RZQFRQVXPHUIDFLQJVHUYLFHVDQG SURGXFWVDQG LL GDWDFROOHFWHGIURPWKLUGSDUWLHVQRWDEO\WKRVHWKDWXVHWKH SODWIRUPV¶VHUYLFHVVXFKDVDGYHUWLVHUVDQGSXEOLVKHUV

7KHVXEVHFWLRQVEHORZGHVFULEHHDFKRIWKHVHVRXUFHVLQWXUQIRFXVVLQJRQ*RRJOHDQG)DFHERRNFRQVXPHUIDFLQJVHUYLFHVDQGLGHQWLI\LQJIRXUVSHFLILF

VRXUFHVRIGDWDZLWKLQWKHEURDGFDWHJRU\RIGDWDFROOHFWHGIURPWKLUGSDUWLHV )LQDOO\WKHODVWVXEVHFWLRQSUHVHQWVDQGGLVFXVVHVHYLGHQFHRQWKH

FRQFHQWUDWLRQ

DQGTXDOLW\RIGDWDRIGLIIHUHQWSODWIRUPV,QGRLQJVRZHGUDZ RQWKHDFDGHPLFOLWHUDWXUHDQGRQSODWIRUPV¶DQGRWKHUSDUWLHV¶VXEPLVVLRQV 

0DQ\SODWIRUPVFROOHFWGDWDRQ L FRQVXPHUFKDUDFWHULVWLFVVXFKDVGHPRJUDSKLFV LL FRQVXPHUDFWLYLWLHVVXFKDVVHDUFKKLVWRU\FOLFNVFRQWHQWFUHDWHGDQGVKDUHGDQG LLL ORFDWLRQWKURXJKXVHUV¶GHYLFHLQIRUPDWLRQ7KH

F8

0DMRUSODWIRUPVVXFKDV*RRJOHDQG)DFHERRNFDQFROOHFWODUJHGDWDVHWVIURPWKHKLJKQXPEHURIFRQVXPHUVWKDWDUHERWKORJJHGLQDQGQRWORJJHGLQRQWR

WKHLUDUUD\RIVHUYLFHVDQGWKHPXOWLSOLFLW\RIGHYLFHVWKHVHDUHRIIHUHGRQ %HLQJDEOHWRFROOHFWXVHUGDWDIURPGLIIHUHQWGHYLFHVJUDQWVSODWIRUPVDFFHVV WRODUJHUTXDQWLWLHVRIYROXQWHHUHGDQGREVHUYHGXVHUGDWD DVSODWIRUPVFDQ REVHUYHDZLGHUUDQJHRIEHKDYLRXUDOGDWDE\FDSWXULQJDODUJHUSDUWRIWLPH

VSHQWRQOLQHE\PXOWLGHYLFHXVHUV

 3ODWIRUPVFDQWKHQFUHDWHPRUHDFFXUDWH XVHUSURILOHVE\XVLQJDULFKHUDUUD\RIXVHUV¶EHKDYLRXUVDVZHOOD

VSURYLGH

PRUHDFFXUDWHDWWULEXWLRQVHUYLFHV

%HORZZHGHVFULEHLQPRUHGHWDLOWKHGDWDJDWKHUHGE\*RRJOHDQG)DFHERRNWKURXJKWKHLUFRQVXPHUIDFLQJVHUYLFHVDQGSURGXFWV

 *RRJOHSURYLGHVPRUHWKDQFRQVXPHUIDFLQJVHUYLFHVDQGSURGXFWVLQWKH

8.LQFOXGLQJ*RRJOH6HDUFKDQGJDWKHUVGDWDWKURXJKWKHP7KLVGDWD

LQFOXGHV

  

7KLVXVHUGDWDLQFOXGHVLQIRUPDWLRQYROXQWDULO\SURYLGHGE\DFRQVXPHU

ZKHQFUHDWLQJD

*RRJOH$FFRXQWVXFKDVQDPHFRQWDFWGHWDLOVDFFRXQW DXWKHQWLFDWLRQGDWD HJXVHUQDPHDQGSDVVZRUG GHPRJUDSKLF LQIRUPDWLRQ HJJHQGHUDQGGDWHRIELUWK DQGSD\PHQWLQIRUPDWLRQDQG

DVVRFLDWHGGHWDLOV XVHGIRU*RRJOH

3D\RULGHQWLW\YHULILFDWLRQ  F9

*RRJOHFROOHFWVGDWDDOVRIURPPRELOHGHYLFHVUXQQLQJ$QGURLG*RRJOH¶VRZQRSHUDWLQJV\VWHPDQGIURPSUHLQVWDOOHGDSSVRQ$QGURLGSKRQHV7DEOH)

VKRZVDQH[DPSOHRIWKHGHWDLOHGLQIRUPDWLRQFROOHFWHG F10  F11 F12 7KURXJKWKHVHWRROVSODWIRUPVFDQ FROOHFWGDWDUHODWLQJWRFRQVXPHUV¶DFWLYLWLHVRQWKLUGSDUW\VLWHVDQGDSSVVXFK DVH[LVWLQJXVHURUGHYLFHLGHQWLILHUVRUWKHLULQWHUDFWLRQVZLWKWKHLUVLWHV $GYHUWLVHUVDQGSXEOLVKHUVFDQDOORZSODWIRUPVWRFROOHFWREVHUYHGDQG YROXQWHHUHGGDWDGLUHFWO\IURPWKHLURZQRQOLQHVHUYLFHVWKURXJKWHFKQRORJLHV VXFKDV6RIWZDUH'HYHORSPHQW.LWV 6'.V SL[HOWDJVDQGFRRNLHV)RU H[DPSOH)DFHERRNSDUWQHUVFDQLQVWDOOVXFKFRGHRQWKHLUZHEVLWHVRUDSSV LQRUGHUWREHWWHUDVVHVVWKHHIIHFWLYHQHVVRIH[LVWLQJDGYHUWLVLQJFDPSDLJQV WRWDUJHWSRWHQWLDOFXVWRPHUVZLWKIXWXUHDGVPRUHDFFXUDWHO\DQGWRREWDLQ

RWKHULQVLJKWVDERXWWKHLUXVHUEDVH



7KHFRGHLQVWDOOHGE\SDUWQHUVSURYLGHV

LQIRUPDWLRQDERXWFRQVXPHUV¶DFWLYLWLHVRQWKHLUZHEVLWHRUDSS±LQFOXGLQJ LQIRUPDWLRQDERXWGHYLFHZHEVLWHVYLVLWHGHWF±ZKHWKHURUQRWWKHFRQVXPHU KDVD)DFHERRNDFFRXQWRUDUHORJJHGLQWR)DFHERRN,QDVLPLODUZD\ DGYHUWLVHUDQGSXEOLVKHUZHEVLWHVFDQDOVRLQVWDOO*RRJOH$QDO\WLFVZKLFK SURYLGHVPHDVXUHPHQWGDWDRQKRZFRQVXPHUVDUHHQJDJLQJZLWKFRQWHQW DQGDGV7KURXJK*RRJOH$QDO\WLFVDQGRWKHUWRROV*RRJOHFROOHFWVDZLGH UDQJHRIGDWDDERXWFRQVXPHUVDQGKRZWKH\LQWHUDFWZLWKWKLUG SDUW\VLWHV

DQGDSSV

,QDGGLWLRQPDQ\ZHEVLWHVDQGDSSVPDNHXVHRISODWIRUPV¶6'.VWRSURYLGHVRFLDOVKDULQJEXWWRQVVXFKDV)DFHERRN¶Vµ/LNH¶DQGµ6KDUH¶EXWWRQVDQG7ZLWWHU¶Vµ7ZHHW¶EXWWRQWRHQFRXUDJHH[LVWLQJFRQVXPHUVWRVKDUHRQ

SODWIRUPVDQGDWWUDFWQHZFRQVXPHUV7KURXJKWKHVHEXWWRQVZHEVLWHVDQG DSSVVHQGDGGLWLRQDOGDWDFRQFHUQLQJWKRVHXVHUV¶DFWLYLWLHVRQWKDWZHEVLWHRU

DSSWRWKHSODWIRUPWKURXJK6'.V

7KHHYLGHQFHVHWRXWLQ$SSHQGL[*VKRZVWKDWWKHUHDFKRI*RRJOHDQG)DFHERRNWRROVRQWKLUGSDUW\VLWHVDQGDSSVLVYHU\H[WHQVLYH:HKDYH

IRXQGWKDW*RRJOHLVWKHOHDGHULQWHUPVRIFRYHUDJHRIZHEVLWHV SUHYDOHQFH  EXWHYHQPRUHVRLIZHWDNHLQWRDFFRXQWVLWHV¶SRSXODULW\ SURPLQHQFH ,Q RWKHUZRUGVLWVUHDFKLVZLGHURQPRVWSRSXODUZHEVLWHV$IWHU*RRJOH F13 )RUH[DPSOH2UDFOH0RDWVDLGWKDWLWLVGLIILFXOWLIQRWLPSRVVLEOHWRXVHWKH LQWHUQHWZLWKRXWHQFRXQWHULQJ*RRJOH$QDO\WLFVDVDSSUR[LPDWHO\RIWKH WRSZHEVLWHVRQWKHLQWHUQHWXVH*RRJOH$QDO\WLFV&KDQQHOQRWHG WKDW)DFHERRN¶VDWWULEXWLRQWRRODOORZVDGYHUWLVHUVWRWUDFNYLHZVRIWKHLUDGV RQ)DFHERRNXVHUV¶IHHGVDQGWKHQOLQNWKLVWREHKDYLRXURQWKHDGYHUWLVHU¶V VLWH&KDQQHOFODLPHGWKDWWKHVHNLQGVRIWRROVSODFHWKHGLJLWDOJLDQWVDWD KXJHFRPPHUFLDODGYDQWDJHDVWKH\FDQFROOHFWDQGDQDO\VHYLHZLQJGDWD IURPFRQWHQWSURYLGHUVVXFKDV&KDQQHOEXWWKHQGRQRWSURYLGHWKLVGDWDWR

WKHFRQWHQWSURYLGHU

*RRJOHVDLGWKDWWKHXVHRIWKLVIXQFWLRQDOLW\GRHVQRWUHVXOWLQ*RRJOHFROOHFWLQJDGGLWLRQDOGDWDDERXWWKHFRQVXPHU¶VDFWLYLW\LQWKDWDSSEXWWKDW*RRJOHVWRUHVWKHFRQWH[WXQGHUZKLFKWKHXVHUDXWKHQWLFDWHVOLNHLQIRUPDWLRQDERXWWKHGHYLFH,3DGGUHVVDQGLGHQWLILHUVIRUWKHDSSWRZKLFKWKHFRQVXPHUKDVDXWKHQWLFDWHG

 +RZHYHULIFRQVXPHUVFKRRVHWRFRQQHFWWKHLUDFFRXQW ZLWKWKHWKLUGSDUW\DSSWRIRUH[DPSOHLPSURYHWKHLUH[SHULHQFHRQWKHDSS WKHQ*RRJOHZLOOFROOHFWGDWDRQWKHXVHUVKHOGE\WKHWKLUG SDUW\VHUYLFH (TXDOO\ZKHQDFRQVXPHUDFFHVVHVDWKLUGSDUW\VLWHRUDSSWKURXJK )DFHERRN/RJLQ)DFHERRNUHFHLYHVGDWDIURPWKHEURZVHURUPRELOH6'. VXFKDVWKH,3DGGUHVVRIWKHEURZVHUWKHGDWHDQGWLPHWKH+773UHTXHVW ZDVPDGHWKHEURZVHUW\SHDQGYHUVLRQHWF DFRRNLHILOH FRPSULVHGRID UDQGRPVHULHVRIOHWWHUVDQGQXPEHUVWKDWLVDVVRFLDWHGZLWKWKHEURZVHU  DGGLWLRQDOGDWDWKDWSHUWDLQVWRWKHXVHDQGIXQFWLRQDOLW\RIWKHFRRNLH HJWKH F14 *RRJOHSURYLGHGGDWDVKRZLQJWKDW>@RI8.ZHEVLWHVDQG>@RI DSSVDFFHVVHGE\8.XVHUVRQ$QGURLGXVHGWKH*RRJOH6LJQ ,Q

IXQFWLRQDOLW\

 )DFHERRNHVWLPDWHGWKDWLQDSSUR[LPDWHO\>@RI8.

VLWHVDQGDSSVDUHFRYHUHGE\LWV6LJQ

LQIXQFWLRQDOLW\  +RZHYHUWKHVH ILJXUHVPD\XQGHUHVWLPDWHWKHUHDFKRIWKLVIXQFWLRQDOLW\EHFDXVHIRU H[DPSOH*RRJOHILJXUHVH[FOXGHDSSVQRWXVHGRQ$QGURLGPRELOHGHYLFHV

0RUHRYHUDQGPRUHLPSRUWDQWO\WKHVHILJXUHVGRQRWWDNHLQWRDFFRXQWWKH

SRSXODULW\RIVLWHVDQGDSSV)HZVWXGLHVSUHVHQWHGLQ$SSHQGL[*WKDW FRQVLGHUWKHSRSXODULW\RIVLWHVIRXQGWKDW*RRJOHDQG)DFHERRNKDYHWKH PRVWUHDFKZLWKUHVSHFWWRXVHUVRQOLQHRQERWKZHEDQGPRELOH ,QWKLVZD\WKH\XVXDOO\FROOHFWXVHUGDWDDQG FRQWH[WXDOGDWDZKLFKFDQEHGLVVHPLQDWHGWRDODUJHQXPEHURI LQWHUPHGLDULHVDQGDGYHUWLVHUVLQELGUHTXHVWVLIDGYHUWLVLQJLVEHLQJVROG SURJUDPPDWLFDOO\3ODWIRUPVDOVRFROOHFWDQDO\WLFVGDWDDQGDGGLWLRQDOXVHU GDWDZKHQSURYLGLQJYHULILFDWLRQDWWULEXWLRQDQGPHDVXUHPHQWRIDGYHUWLVLQJ HIIHFWLYHQHVV PRUHGHWDLOLQWKHµ5ROHRIGDWDLQGLJLWDODGYHUWLVLQJ¶VHFWLRQ

EHORZ 

)RUH[DPSOH*RRJOHDXWRPDWLFDOO\FROOHFWVFHUWDLQXVHUGDWDZKHQLWVDGYHUWLVLQJVHUYHUVUHFHLYHDUHTXHVWIURPDXVHU¶VGHYLFH7KLVUHTXHVWPD\

EHWULJJHUHGE\WKH

FRQVXPHULQWHUDFWLQJHLWKHUZLWKD*RRJOHDGYHUWLVLQJ

VHUYLFHRUZLWKDWKLUG

SDUW\ZHEVLWHRUDSSWKDWXVHVD*RRJOHDGYHUWLVLQJ VHUYLFH*RRJOHFROOHFWVGDWDIURP*RRJOH$GV*RRJOH$G0DQDJHU $XWKRUL]HG%X\HU$G6HQVH$G0RE'9&DPSDLJQ0DQDJHUDQG6$ $OWKRXJKWKLVPD\YDU\E\*RRJOHVHUYLFHSXEOLVKHU¶VVHWWLQJVFRQVXPHU¶V SUHIHUHQFHVDQGGHYLFHXVHGWKHFROOHFWHGGDWDJHQHUDOO\LQFOXGHV F15 $PD]RQDOVRUHFHLYHVLQIRUPDWLRQIURPWKLUGSDUW\SXEOLVKHUVLWHVZKHUHD SXEOLVKHUPRQHWLVHVLWVDGLQYHQWRU\WKURXJK$PD]RQ3XEOLVKHU6HUYLFHRU $PD]RQDGH[FKDQJH7KLVLQFOXGHVLQIRUPDWLRQVXFKDVFDPSDLJQ LQIRUPDWLRQDGSODFHPHQWLQIRUPDWLRQ HJSODFHPHQWRQSDJHVL]H DERYHEHORZIROG ELGLQIRUPDWLRQ VXFKDVELGIORRUDQG&30 FROOHFWHGDV SDUWRIELGVLPSUHVVLRQVRUFOLFNV$PD]RQDOVRFROOHFWVFRRNLH,'VZKHQ FXVWRPHUVXVHDZHEEURZVHUDQGPRELOHDGYHUWLVLQJ,'VZKHQXVLQJPRELOH

GHYLFHV

*RRJOHDQG)DFHERRNKDYHVLJQLILFDQWDQGHQGXULQJPDUNHWSRZHULQFRQVXPHUIDFLQJVHUYLFHVLQVHDUFKDQGVRFLDOPHGLDUHVSHFWLYHO\$VD

UHVXOW*RRJOHLVWKHSODWIRUPZLWKWKHODUJHVWGDWDVHWFROOHFWHGLQDGGLWLRQWR *RRJOH6HDUFKIURPLWVOHDGLQJFRQVXPHUIDFLQJVHUYLFHVVXFKDVFKDFURVV F16 )DFHERRNKDVDYHU\ODUJHDXGLHQFHZLWKRYHUPLOOLRQXQLTXHPRQWKO\ DFWLYHXVHUVLQWKH8.DFURVVLWVWKUHHPDLQVHUYLFHV)DFHERRN,QVWDJUDP

DQG:KDWV$SS

  IURPZKLFKLWFROOHFWVYHU\JUDQXODUXVHUGDWD)DFHERRN

VDLGWKDWWKHUHDUHPDQ\VRXUFHVRIKLJK

TXDOLW\XVHUGDWDDYDLODEOHWR DGYHUWLVHUVEH\RQG*RRJOHDQG)DFHERRNDQGRWKHUODUJHSODWIRUPVLQFOXGLQJ GDWDEURNHUVGDWDPDQDJHPHQWSODWIRUPVDQGFUHGLWUHIHUHQFHVDJHQFLHV:H GLVFXVVVRPHRIWKHVHLQ$SSHQGL[*ZKHUHORRNLQJDWWKHHYLGHQFHLQWKH URXQGZHIRXQGWKDWODUJHSODWIRUPVKDYHJUHDWHURSSRUWXQLW\WRWUDFNXVHUV

DQGFROOHFWGDWD

0RUHRYHUDVVKRZQDERYHWKHUHDFKRI*RRJOHDQG)DFHERRNWRROVRQWKLUG

SDUW\VLWHVDQGDSSVLVH[WHQVLYH

DQGIDUJUHDWHUWKDQWKDWRIRWKHUSODWIRUPV *RRJOHDQG)DFHERRNDOVRKDYHDQDGYDQWDJHLQWKHFROOHFWLRQRIFHUWDLQ

W\SHVRIGDWD

2YHUDOO*RRJOHDQG)DFHERRNFROOHFWPDQ\W\SHVRIKLJKTXDOLW\GDWDIURP DFURVVWKHZHEDQGRWKHUVRXUFHVDWVFDOHDQGXVHLWWRSURYLGHSUHFLVH F17  $VVHWRXWLQ &KDSWHUEHFDXVH RIWKHLUVFDOHDQGXQLTXHSRVLWLRQLQVHDUFKDQGGLVSOD\ DGYHUWLVLQJWKH\KDYHPDUNHWSRZHULQGLJLWDODGYHUWLVLQJHDUQLQJVLJQLILFDQW

UHYHQXHVDQGUHLQIRUFLQJWK

HLUPDUNHWSRZHURQWKHXVHUVLGH7KLVLQWXUQ

UHLQIRUFHVWKHLUDGYDQWDJHLQGDWD

&RPSDUHGZLWK*RRJOHDQG)DFHERRNZHFRQVLGHUWKDWRWKHUSODWIRUPV¶GDWD

WDUJHWLQJ

DQGDWWULEXWLRQFDSDELOLWLHVDUHUHODWLYHO\OLPLWHGWRXVHUGDWDIURP WKHLURZQVHUYLFHVDQGOLPLWHGUHDFKRQWKLUGSDUW\VLWHVDQGDSSV7KLVZDV VXSSRUWHGE\UHVSRQVHVWRRXULQWHULPUHSRUWPRVWRIZKLFKDJUHHGZLWKRXU DVVHVVPHQWWKDW*RRJOHDQG)DFHERRNKDYHH[FOXVLYHDFFHVVWRODUJH

DPRXQWRIGDWD

ZKLFKJLYHVWKHPDVLJQLILFDQWFRPSHWLWLYHDGYDQWDJHRYHU

RWKHUPDUNHWSDUWLFLSDQWV VHH$SSHQGL[% 

$PD]RQFROOHFWVDODUJHKLJKTXDOLW\GDWDVHWIURPFRQVXPHUVRILWVRZQHGDQG RSHUDWHGVHUYLFHV VXFKDVLWVRQOLQHVKRSSLQJ3ULPH9LGHR.LQGOH$PD]RQ

0XVLFHWF

 +RZHYHUZHDUHRIWKHYLHZWKDWWKLVGDWDLVPRUHOLPLWHGLQ EUHDGWKFRPSDUHGWR*RRJOHDQG)DFHERRNDVLWUHODWHVWRFRQVXPHUV

LQWHUDFWLRQVLQDUHWDLOHQYLURQPHQW

0LFURVRIWFROOHFWVGDWDIURPFRQVXPHUVRILWVVHUYLFHVVXFKDV%LQJ/LQNHG,Q061;ER[DQGWKH:LQGRZVRSHUDWLQJV\VWHP+RZHYHUZHXQGHUVWDQG

WKDWWKHLQIRUPDWLRQLWFDQJDWKHUIURPWKLUGSDUW\VLWHVLVOLPLWHGEHFDXVHRI WKHOLPLWHGFRYHUDJHRILWVSL[HODFURVVWKHLQWHUQHW$OWKRXJK0LFURVRIWDOVR JDWKHUVVHDUFKDQGFRQWH[WXDOGDWDWKURXJKLWVVHDUFKHQJLQHWKHDPRXQWRI WKLVGDWDLWFDQFROOHFWLVVLJQLILFDQWO\OLPLWHGJLYHQWKDWLQ LWDFFRXQWHGIRU OHVVWKDQRIWKHHVWLPDWHG8.VKDUHRIVHDUFKUHYHQXHDQGRIVKDUHV RIVXSSO\E\SDJHUHIHUUDO PRUHGHWDLOLQ$SSHQGL[&   $OWKRXJKPRVWUHFHQWHQWUDQWSODWIRUPVVXFKDV7ZLWWHU7LN7RN3LQWHUHVWDQG

6QDSSRVVHVVKLJK

DFFXUDF\GDWDDERXWWKHLUXVHUVWKLVLVOLPLWHGE\WKH UHDFKRIWKHLUFRQVXPHUIDFLQJVHUYLFHVDQGWDJVRQWKLUGSDUW\VLWHVDQG

DSSV

)LJXUH)LOOXVWUDWHVRXUXQGHUVWDQGLQJRQWKHYROXPHRIGDWDWKDWFHUWDLQ ODUJHSODWIRUPVDQGDJURXSRIVPDOOHUSODWIRUPVSRVVHVV F18 ,QWKHQH[WVHFWLRQZHGLVFXVVWKHLPSOLFDWLRQVRIGDWDFRQFHQWUDWLRQIRU FRPSHWLWLRQLQWKHSURYLVLRQRIDGYHUWLVLQJDQGDGYHULILFDWLRQDQGDWWULEXWLRQ

VHUYLFHV



7KHIROORZLQJVXEVHFWLRQVGLVFXVVWKHUROHRIGDWDLQWDUJHWHGGLJLWDODGYHUWLVLQJDQGLQYHULILFDWLRQDWWULEXWLRQDQGPHDVXUHPHQWRIHIIHFWLYHQHVV

GUDZLQJRQWKHDFDGHPLFOLWHUDWXUHDQGSDUWLHV¶VXEPLVVLRQV

7KHUHDUHPDQ\W\SHVRIWDUJHWLQJZKLFKFDQEHEURDGO\JURXSHGLQWZRFDWHJRULHVFRQWH[WXDODQGSHUVRQDOLVHGDGYHUWLVLQJDFFRUGLQJWRWKHGHJUHHRIWDUJHWLQJDQGWKHXVHRIXVHUVSHFLILFGDWD$WRQHHQGRIWKHVSHFWUXP

F19 &RQWH[WXDODGYHUWLVLQJLVDSSOLFDEOHIRUERWKVHDUFKDQGGLVSOD\DGYHUWLVLQJ )RUH[DPSOHDFRQVXPHUYLHZLQJDVHDUFKHQJLQHUHVXOWVSDJHRUDVSHFLILF ZHESDJHDERXWUXQQLQJVKRHVPD\EHVKRZQDGVIRUIRRWZHDUFORWKLQJ HTXLSPHQWDQGDFFHVVRULHVWKDWDUHUHOHYDQWWRUXQQLQJ $OWKRXJKVRPHVHDUFKHQJLQHVDOORZDGYHUWLVHUVWRWDUJHWDORQJVLGHWKH FRQWH[WRIWKHSDJHDXGLHQFHV HJGHPRJUDSKLFVDIILQLW\LQ PDUNHWVLPLODU DXGLHQFHVHWF FRQWHQWDQGGHYLFHV FRPSXWHUPRELOHHWF WKH\SULPDULO\ UHO\RQWKHFRQWH[W LHWKHVHDUFKWHUP WRWDUJHWDGV  $QH[SHULPHQW FRQGXFWHGE\*RRJOHVKRZVWKDWWKHXVHU¶VVHDUFKTXHU\LVHVVHQWLDOO\ZKDW GULYHV*RRJOH¶VWDUJHWLQJWRJHWKHUZLWKLQIRUPDWLRQDERXWWKHURXJKORFDWLRQRI WKHXVHU7KLVH[SHULPHQWVKRZVWKDWWKHLPSRUWDQFHRIRWKHUGDWDIRU WDUJHWLQJLQVHDUFKLVPDUJLQDO%\GLVDEOLQJWKHXVHRIGHPRJUDSKLFVLQ PDUNHWDQGDIILQLW\DQGUHPDUNHWLQJDXGLHQFHVPRQHWLVDWLRQGHFUHDVHGE\> @ >@DQG>@UHVSHFWLYHO\FRPSDUHGWRWKHFRQWUROJURXS 7KHUHIRUHVHDUFKDGYHUWLVLQJFDQEHWKRXJKWDVRQHRIWKHPRVWYDOXDEOH IRUPRIFRQWH[WXDODGYHUWLVLQJ&RQWH[WXDODGYHUWLVLQJDOVRDSSOLHVWRVRFLDO PHGLDSODWIRUPVZKHUHIRUH[DPSOHDSKRWRXSORDGHGE\DXVHUFDQEH FRQVLGHUHGWKHFRQWH[WZLWKLQZKLFKWRVHUYHDGV,QWKLVH[DPSOHSODWIRUPV VHOHFWDGVRQWKHEDVLVRIWKHSKRWR¶VEDFNJURXQGZLWKRXWXVLQJDQ\XVHU VSHFLILFGDWDWRWDUJHWDGV$OWKRXJKWKLVLVWKHFDVHDQGVRFLDOPHGLD SODWIRUPVXVHFRQWH[WXDODGYHUWLVLQJWKHYDVWPDMRULW\RIDGYHUWLVLQJRQWKHVH

SODWIRUPVLVSHUVRQDOLVHGDGYHUWLVLQJ

&RQWH[WXDODGYHUWLVLQJW\SLFDOO\XVHVOLPLWHGXVHUGDWDVXFKDVVHDUFKWHUPV GHYLFHORFDWLRQDQGODQJXDJHWKDWLVFROOHFWHGLQUHDOWLPHUDWKHUWKDQKLVWRULF F20

7REXLOGWKHVHSURILOHVPDUNHWSDUWLFLSDQWVXVHYDULRXVWHFKQLTXHVDQGWHFKQRORJLHVWRLGHQWLI\FRQVXPHUVDVVLJQLGHQWLILHUVIRUWKHP VXFKDVFRRNLH,'RUPRELOHDGYHUWLVLQJ,' PDWFKWKHVH LIQHFHVVDU\ ZLWKWKHLGHQWLILHUVXVHGE\RWKHUSDUWLFLSDQWVDQGVKDUHWKHVHLGHQWLILHUVZLWKHDFKRWKHUVRWKDWWKHUHLVDFRPPRQDQGPXWXDOO\XQGHUVWRRGZD\WRUHIHUWRHDFKLQGLYLGXDOFRQVXPHU9ROXQWHHUHGREVHUYHGDQGLQIHUUHGGDWDDUHUHFRUGHGLQXVHU

SURILOHVDQGPDUNHWSDUWLFLSDQWVPD\HQKDQFHWKHLUILUVWSDUW\GDWDDERXW FRQVXPHUVE\EX\LQJDQGVHOOLQJGDWDIURPWKLUGSDUWLHV7KHUHDUHVLJQLILFDQW WUDQVIHUVRISHUVRQDOGDWDDFURVVWKHDGYHUWLVLQJHFRV\VWHPLQRUGHUWREXLOG XSDPRUHFRPSOHWHSLFWXUHRILQGLYLGXDOVZKLFKKHOSVWDUJHWDGYHUWLVLQJDQG PHDVXUHWKHHIIHFWVRIDGYHUWLVLQJ VHH$SSHQGL[*  3ODWIRUPVW\SLFDOO\JURXSWKHVHXVHUSURILOHVLQWRµDXGLHQFHV¶FKDUDFWHULVHGE\ DVSHFLILFLQWHQWGHPRJUDSKLFFKDUDFWHULVWLFVDQGLQWHUHVWVDQGWKHVH DXGLHQFHVHJPHQWVDUHWKHQRIIHUHGWRDGYHUWLVHUVDVEDVHVIRUWDUJHWHG DGYHUWLVLQJ$Q\JLYHQLQGLYLGXDOFDQEHDPHPEHURIPXOWLSOHDXGLHQFH VHJPHQWV7KHUHDUHYHU\PDQ\DXGLHQFHVHJPHQWVVRPHRIZKLFKFDQEH YHU\JUDQXODUDQGDGYHUWLVHUVFDQXVHFRPELQDWLRQVRIVHJPHQWVWRDFKLHYH

KLJKO\WDUJHWHGDGYHUWLVLQJ

7KHPRVWFRPPRQDXGLHQFHVHJPHQWVRIIHUHGE\DGYHUWLVLQJSODWIRUPVDUHGHPRJUDSKLFVXFKDVµ)HPDOH¶µ\HDUVROG¶µ(GXFDWLRQ6WDWXV

%DFKHORU¶V'HJUHH¶µ+RPHRZQHUVKLS6WDWXV+RPHRZQHUV¶µ0DULWDO6WDWXV,Q D5HODWLRQVKLS¶DQGµ3DUHQWDO6WDWXV1RW$3DUHQW¶DQGDODUJHYDULHW\RI LQWHUHVWEDVHGVHJPHQWVVXFKDVµ+RPH,PSURYHPHQW¶µ3HWV¶DQGµ&RPSXWHU +DUGZDUH¶6HDUFKDGYHUWLVLQJSODWIRUPVRIIHUµLQ PDUNHW¶DXGLHQFHVHJPHQWV EDVHGRQWKHXVHU¶VUHFHQWVHDUFKTXHULHVZKLFKDUHSDUWLFXODUO\YDOXDEOHWR DGYHUWLVHUVDVWKH\VLJQDOWKDWDFRQVXPHULVDFWLYHO\FRQVLGHULQJ RUµLQWKH PDUNHWIRU¶ DSXUFKDVH6RPHSODWIRUPVDOVRRIIHUDGYHUWLVHUVWKHDELOLW\WR FUHDWHµFXVWRPDXGLHQFHV¶XVLQJWKHLURZQILUVWSDUW\GDWDWKDWWKH\VXSSO\WR F21 (DFKLV

GHVFULEHGLQPRUHGHWDLOEHORZ

 

*RRJOHKDVUHFHQWO\ODXQFKHGDGHWDLOHGGHPRJUDSKLFDXGLHQFHWKDWJURXSVSHRSOHRQWKHEDVLVRIORQJWHUPVWDWXVHVVXFKDVHGXFDWLRQOHYHOPDULWDO

VWDWXVKRPHRZQHUVKLSDQGSDUHQWDOVWDWXV

  7KHVHGHWDLOVDOORZ DGYHUWLVHUVWRUHILQHWKHLUELGGLQJVWUDWHJLHVDQGLPSURYHHIILFLHQFLHV

'HPRJUDSKLFDXGLHQFHVDUHW\SLFDOO\XVHGZKHQDGYHUWLVHUVDUHLQWHUHVWHGLQEURDGFDPSDLJQREMHFWLYHVVXFKDVLQFUHDVLQJEUDQGDZDUHQHVVRUEUDQG

FRQVLGHUDWLRQ+RZHYHUWKH\DUHDOVRXVHGWRSUHGLFWFRQVXPHU¶VSUHIHUHQFHV DQGLQWHUHVWVZKHQWKHUHLVDODFNRIGLUHFWLQIRUPDWLRQRQFRQVXPHU¶V

LQWHUHVWVDQGEHKDYLRXUV

$ERXWDXGLHQFHWDUJHWLQJ±*RRJOH$GV+HOS 

7KLVDXGLHQFHFDQEHXVHGRQO\IRUDGYHUWLVLQJRQFHUWDLQSURSHUWLHVQDPHO\*PDLO'LVFRYHU\6HDUFK

6KRSSLQJDQG9LGHR

F22 )DFHERRNJHQHUDWHVLQWHUHVWFDWHJRULHVXVLQJ> *RRJOH RIIHUV$IILQLW\DQG&XVWRP$IILQLW\WRROVWKDWDOORZDGYHUWLVHUVWRUHDFK  FRQVXPHUVEDVHGRQDKROLVWLFSLFWXUHRIWKHLUOLIHVW\OHVSDVVLRQVDQGKDELWV &XVWRP$IILQLW\DXGLHQFHVDUHPRUHWDLORUHGDXGLHQFHVFRPSDUHGWREURDGHU DIILQLW\DXGLHQFHV)RUH[DPSOHZLWK&XVWRP$IILQLW\UDWKHUWKDQUHDFKLQJD VSRUWIDQDXGLHQFHDQDGYHUWLVHUFDQUHDFKDYLGPDUDWKRQUXQQHUVLQVWHDG   ,QRUGHUWRFUHDWHLQWHUHVWEDVHGVHJPHQWV$PD]RQXVHVLQIRUPDWLRQVXFKDV VHDUFKHVIRUSURGXFWVRUVHUYLFHVRUGHUKLVWRU\FRQILJXUDWLRQDQGXVHRI VHWWLQJVRQDGHYLFHORFDWLRQLQIRUPDWLRQ,3DGGUHVVFRQWHQWGRZQORDGHG VWUHDPHGDQGRUYLHZHGLQIRUPDWLRQRQGHWDLOSDJHYLHZVDQGDFFRXQW

LQIRUPDWLRQ

  :HXQGHUVWDQGWKDW0LFURVRIWXVHVSULPDULO\GDWDHQWHUHGE\ FRQVXPHUVLQDORJJHGLQHQYLURQPHQWDQGLQIHUVFRQVXPHU¶VDJHJHQGHUDQG

LQWHUHVWVWREXLOGWDUJHWLQJVHJPHQWV

7KHVHDXGLHQFHVDUHULFKHUWKDQGHPRJUDSKLFDXGLHQFHVDQGFDQSUHGLFWZLWKPRUHDFFXUDF\FRQVXPHUV¶LQWHUHVWVDQGWKHLUOLNHO\UHVSRQVHWRDGYHUWLVHPHQW+RZHYHUWKHVHDUHVWLOOLPSHUIHFWEHFDXVHFRQVXPHUVPLJKW

QRWEHFXUUHQWO\LQWKHPDUNHWIRUDVSHFLILFSURGXFWRUVHUYLFH $ERXWDXGLHQFHWDUJHWLQJ±*RRJOH$GV+HOS 

$PD]RQVDLGWKDWLWRQO\REWDLQVDQGSURFHVVHVSHUVRQDOGDWDLQDFFRUGDQFHZLWKLWVSULYDF\QRWLFH

F23 :HQRWHWKDWWKLVGRHVQRWDSSHDUHQWLUHO\FRQVLVWHQWZLWKWKHUHVXOWVRIWKH H[SHULPHQWFRQGXFWHGE\*RRJOHDQGGHVFULEHGLQDQLQWHUQDOGRFXPHQWDW

SDUDJUDSKDERYH

6RPHDGYHUWLVHUVDOVRLQGLFDWHGWKDWLQPDUNHWDXGLHQFHVDUHDPRQJWKHPRVW YDOXDEOHWDUJHWLQJWRROV)RUH[DPSOH&RQIXVHGFRPVDLGWKDWLQ PDUNHW DXGLHQFHVDUHYHU\YDOXDEOHDVWKH\HQDEOHLWWRWDUJHWFXVWRPHUVZKRDUH DFWLYHO\VHDUFKLQJIRULWVSURGXFWVZKLFKUHVXOWVLQUHOHYDQWDQGPRUHHIILFLHQW PDUNHWLQJ2QHODUJHDGYHUWLVHUVDLGWKDWLWJHQHUDOO\XVHV*RRJOH¶V

SURSULHWDU\GDWD VXFKDVLWVLQ

PDUNHWVHJPHQWV RYHUFKDUDFWHULVWLFWDUJHWLQJ VXFKDVGHPRJUDSKLF DVWKHVHDUHEHWWHULQGLFDWRUVRILQWHUHVWRULWV

SURGXFWVDQGVHUYLFHV

  $GYHUWLVHUV PD\KDYHFROOHFWHGWKLVGDWDIURPWKHLUZHEVLWHVDSSVSK\VLFDOVWRUHVRU RWKHUVLWXDWLRQVZKHUHFXVWRPHUVKDYHVKDUHGWKLVLQIRUPDWLRQGLUHFWO\ $OWHUQDWLYHO\SODWIRUPVFDQFROOHFWGDWDRQDGYHUWLVHUV¶FXVWRPHUVGLUHFWO\ IURPWKHLUZHEVLWHVWKURXJK6'.VFRRNLHVDQGSL[HOWDJVHQDEOLQJ

DGYHUWLVHUVWRWDUJHWWKHVHFRQVXPHUV

F24 0RVWSODWIRUPVRIIHUWKLVUHWDUJHWLQJWRRO)RUH[DPSOHWKURXJK*RRJOH$GV DGYHUWLVHUVFDQPDWFKWKHLUFXVWRPHUOLVWVZLWK*RRJOHDFFRXQWVDQGUHWDUJHW FRQVXPHUVRQ6HDUFK*PDLODQGWKHEDVLVRIWKHLURQ SODWIRUPEHKDYLRXUVXFKDVOLNHVWRDVSHFLILF)DFHERRN

3DJH$PD]RQVDLGWKDWLWPD\UHFHLYHGDWDGLUHFWO\IURPDGYHUWLVHUVRUIURP

GDWDPDQDJHPHQWSODWIRUPVDWWKHUHTXHVWRIDQDGYHUWLVHUFXVWRPHULQZKLFK FDVHWKHVHJPHQWVDUHXVHGRQO\E\WKDWDGYHUWLVHU  )RUH[DPSOH)DFHERRNODXQFKHGµ/RRNDOLNH$XGLHQFHV¶LQWRDOORZ DGYHUWLVHUVWRUXQDGFDPSDLJQVWKDWDUHGLUHFWHGDW)DFHERRNXVHUVZLWK FKDUDFWHULVWLFVVLPLODUWRWKHLUH[LVWLQJFXVWRPHUVRUWRWKRVHXVHUVZKRKDYH OLNHGDQDGYHUWLVHU¶V)DFHERRN3DJH$GYHUWLVHUVFDQVHOHFWD&XVWRP $XGLHQFHDVWKHLUVHHGDXGLHQFHDQGDVN)DFHERRNWRILQGDEURDGHUVHWRI FRQVXPHUVWKDWPDWFKWKHFKDUDFWHULVWLFVRIWKHVHHGDXGLHQFH)DFHERRNZLOO WKHQUXQDQDQDO\VLVEDVHGRQWKHDWWULEXWHVRIWKHVHHGDXGLHQFHDQGXVLQJ WKHXVHUGDWDDYDLODEOHWRLWFUHDWHDµ/RRNDOLNH$XGLHQFH¶FRPSULVLQJ )DFHERRNXVHUVZKRVHDWWULEXWHVDUHPRVWKLJKO\FRUUHODWHGZLWKWKRVHRIWKH

VHHGDXGLHQFH

V\VWHPVDQGPHWKRGVIRUJHQHUDWLQJH[SDQGHGXVHUVHJPHQWV F25 6HYHUDODGYHUWLVHUVWROGXVWKDW*RRJOHDQG)DFHERRNRIIHUPRUHJUDQXODUDQG KLJKHUTXDOLW\SHUVRQDOLVHGWDUJHWLQJWRROVFRPSDUHGWRRWKHUSODWIRUPV,Q VHDUFKPDQ\DGYHUWLVHUVDQGPHGLDDJHQFLHVDUHRIWKHYLHZWKDW*RRJOH RIIHUVPRUHLQGHSWKWDUJHWLQJRSWLRQVGULYHQE\LWVXQLTXHDQGYDVWGDWD FRPSDUHGWR0LFURVRIW7KHWDUJHWLQJFDSDELOLWLHVWKDW*RRJOHRIIHUVLQVHDUFK DUHDOVRH[WHQGHGWRGLVSOD\DGYHUWLVLQJDQGWDUJHWLQJDXGLHQFH VDORQJWKHFXVWRPHUMRXUQH\DQGLQSDUWLFXODUIRUGULYLQJ VDOHV2WKHUSODWIRUPVZHUHKDUGO\PHQWLRQHGE\UHVSRQGHQWVZLWKWKH H[FHSWLRQRI7ZLWWHUZKLFKVRPHUHVSRQGHQWVLQGLFDWHGRIIHUVWKHSRVVLELOLW\ WRUHDFKQLFKHDQGKLJKO\UHOHYDQWDXGLHQFHVWKURXJKNH\ZRUGWDUJHWLQJDQGD UDQJHRIDGVROXWLRQVWKDWDUHGLIIHUHQWWRRWKHUV  $VVHVVLQJDQGHYDOXDWLQJWKHTXDOLW\RIGLJLWDODGYHUWLVLQJLVDSURFHVVZKLFK

LQYROYHVDQXPEHURIGLIIHUHQWVWDJHV

F26 9HULILFDWLRQDQGPHDVXUHPHQWRIHIIHFWLYHQHVVDOORZDGYHUWLVHUVSXEOLVKHUV

DQGSODWIRUPVWRFRQILUPZKHWKHUDQGWKH

H[WHQWWRZKLFKDGVZHUHVKRZQWR

WKHULJKWQXPEHUDQGNLQGVRISHRSOH

9HULILFDWLRQLQYROYHVWKHDXWKHQWLFDWLRQRIWKHSODFLQJRIDQDGYHUWDQGLVDNH\VWDUWLQJSRLQWLQEHLQJDEOHWRPHDVXUHWKHHIIHFWLYHQHVVRIRQOLQHDGYHUWLVLQJ)RULQVWDQFHWREHDEOHWRPHDVXUHWKH5HWXUQRQ,QYHVWPHQW µ5R,¶ RIDQ

DGYHUWLVLQJFDPSDLJQWKHUHLVDQHHGILUVWWREHDEOHWRHVWDEOLVKWKDWWKH DGYHUWKDVEHHQYLHZHGE\DSRWHQWLDOFXVWRPHUEHIRUHPRYLQJRQWR HYDOXDWLQJZKDWDFWLRQWKH\WRRNDVDUHVXOWDQGZKDWWKHLPSDFWRQSURILWV

ZDV

7KHYHULILFDWLRQRIGLJLWDODGYHUWLVLQJLVVRPHWLPHVSRUWUD\HGDVVRPHWKLQJZKLFKLVMXVWRIFRQFHUQWRDGYHUWLVHUV+RZHYHUSXEOLVKHUVDOVRKDYHDQLQWHUHVWLQEHLQJDEOHWRFRQILUPWKHLQWHJULW\RIWKHLUDGYHUWLVLQJLQYHQWRU\DVDPHDQVRIEXLOGLQJDQGPDLQWDLQLQJWUXVWLQWKHTXDOLW\RIWKHLUDGYHUWLVLQJLQYHQWRU\

$VVHWRXWLQ$SSHQGL[2ZHIRXQGWKDWDOWKRXJK*RRJOHDQG)DFHERRNDOORZWKLUGSDUW\YHULILFDWLRQRIWKHLURZQLQYHQWRU\WKH\SODFHUHVWULFWLRQVRQWKH

DELOLW\RIDGYHUWLVHUVWRFDUU\RXWWKHLURZQLQGHSHQGHQWYHULILFDWLRQDQGDVD UHVXOWDGYHUWLVHUVKDYHWRUHO\RQGDWDWKDWKDVEHHQFROODWHGE\*RRJOHDQG )DFHERRN   0HDVXUHPHQWRIDGHIIHFWLYHQHVVDQGDWWULEXWLRQRIGLJLWDODGYHUWLVLQJLVQRW VWUDLJKWIRUZDUG$FFXUDWHPHDVXUHPHQWUHTXLUHVFRQVLVWHQWGHILQLWLRQVRI PHWULFVDQGPHWKRGRORJLHVDFURVVGLIIHUHQWDGYHUWLVLQJSODWIRUPVDQGD QXPEHURIUHVSRQVHVIURPDGYHUWLVHUVDQGDJHQFLHVDUJXHGWKDWDODFNRI F27 $WWULEXWLRQLVDLPHGDWLGHQWLI\LQJDVHWRIFRQVXPHUV¶DFWLRQVRIWHQDFURVV ZHEVLWHVDQGGHYLFHVWKDWFRQWULEXWHLQVRPHZD\WRDGHVLUHGDGYHUWLVLQJ

RXWFRPHDQGWKHQDVVLJQLQJYDOXHWRHDFKRIWK

HVHDFWLRQV)RUWKLVUHDVRQ

DWWULEXWLRQRIWHQUHTXLUHVWKHPDWFKLQJRIGDWDRQFRQVXPHUV¶H[SRVXUHWR DGYHUWVZLWKGDWDRQWKHVXEVHTXHQWFRQVXPHUV¶DFWLRQV7KHFRQVXPHUV¶ DFWLRQVWKDWDUHPRVWRIWHQPRQLWRUHGDUHFXVWRPHUSXUFKDVHVEXWVXFK DFWLRQVFDQDOVREHGHILQHGPRUHEURDGO\GHSHQGLQJRQDGYHUWLVHUV¶ REMHFWLYHVHJVSHQGLQJDVSHFLILFDPRXQWRIWLPHRQDZHEVLWHDVSHFLILF

DFWLRQWDNHQRQDZHESDJHRUDVWRUHYLVLW

$GYHUWLVHUVPD\DOVREHLQWHUHVWHGLQPHDVXULQJWKHLPSDFWRIDGVRQRWKHUWKLQJVOLNHEUDQGDZDUHQHVVDQGSRVLWLYHEUDQGVHQWLPHQW+RZHYHULWLV

RIWHQPRUHGLIILFXOWWRFRQGXFWDWWULEXWLRQDQDO\VHVIRUWKHVHRXWFRPHV EHFDXVHWKHVHDUHQRWGLUHFWO\REVHUYDEOHDFWLRQVE\FRQVXPHUVDQGUHTXLUH WKHXVHRIWHFKQLTXHVVXFKDVFRQVXPHUVXUYH\V7RPHDVXUHFRQYHUVLRQV DGYHUWLVHUVQHHGWREHDEOHWRWUDFNFRQVXPHUDFWLRQVRQOLQH DQGWRVRPH

H[WHQWRIIOLQH

µ:DOOHGJDUGHQ¶SODWIRUPVDUHDEOHWRFRPELQHWKHDELOLW\WR DFFXUDWHO\PRQLWRUFRQYHUVLRQVZLWKWKHDELOLW\WRWUDFNXVHUVDFURVVGLIIHUHQW GHYLFHVDQGVHVVLRQVDQGVRDWWULEXWHFRQVXPHUV¶DFWLRQVPRUHDFFXUDWHO\,Q WKHFDVHRI*RRJOHLWLVDEOHWRWUDFNXVHUVDFURVVPRUHWKDQFRQVXPHU IDFLQJVHUYLFHVZKLFKLWRZQV,WVDFFHVVWRPRELOHGDWDIURP$QGURLGDOVR JLYHVLWVRPHDELOLW\WRPRQLWRUWKHDFWLRQVRIFRQVXPHUVRIIOLQH HJWRLGHQWLI\

VWRUHYLVLWV 

,QWKHFDVHRI)DFHERRNLWVVLQJOHXVHUORJLQIHDWXUH  JLYHVLWDVLJQLILFDQW

PHDVXUHPHQWDGYDQWDJHRYHUPRUHVWDQGDUGFRRNLH

EDVHGDSSURDFKHVLQ WKDWLWLVDEOHWRDVVRFLDWHDOOH[SRVXUHVDQGFRQYHUVLRQVDFURVVGHYLFHVDQG VHVVLRQVZLWKDVSHFLILFXVHUDVRSSRVHGWRDEURZVHURQDODSWRSZKLFKFRXOG  EHVKDUHGEHWZHHQGLIIHUHQWSHRSOHLQDIDPLO\)DFHERRNDOVRUHFHLYHVGDWD IURPFRQVXPHUVDFWLYLWLHVDFURVVDZLGHUDQJHRIRWKHUZHEVLWHVDQGDSSV ZKHQWKRVHVHUYLFHVDUHXVLQJ)DFHERRN%XVLQHVV7RROV 7KHDELOLW\WRPHDVXUHWKHHIIHFWLYHQHVVRIDGYHUWLVLQJLVDQLPSRUWDQWGULYHURI DGYHUWLVHUV¶GHFLVLRQVRQKRZWRDOORFDWHWKHLUDGYHUWLVLQJVSHQGDFURVV

SXEOLVKHUVDQGSODWIRUPV

 *RRJOHDQG)DFHERRNKDYHDQDGYDQWDJHLQ WHUPVRIEHLQJDEOHWRWUDFNFRQVXPHUVDFURVVWKHLURZQZDOOHGJDUGHQ µHFRV\VWHP¶DQGDFURVVDODUJHQXPEHURIWKLUGSDUW\VLWHVDQGDSSV$VD F28  :HQRWHGLQRXULQWHULPUHSRUW*RRJOH¶VGHFLVLRQWRSUHYHQWWKH'RXEOH&OLFN XVHU,'VEHLQJDFFHVVHGE\DGYHUWLVHUVDQGDJHQFLHV,Q*RRJOH UHVWULFWHGDFFHVVWRLWV8VHU,'V WKH'RXEOH&OLFN,' E\UHPRYLQJLWIURPLWV &DPSDLJQ0DQDJHUDQG'63VORJILOHVDQGFXUWDLOHGWKHDYDLODELOLW\XVHUOHYHO

H[SRVXUHGDWDIUR

PDGFDPSDLJQV7KLVPHDQWWKDWDGEX\HUVFRXOGQRORQJHU H[WUDFWGDWDIURPWKH'RXEOH&OLFN&DPSDLJQ0DQDJHUIRUUHSRUWLQJRQDG

SHUIRUPDQFHDQGDGDWWULEXWLRQ

*RRJOHLQGLFDWHGWKDWWKH'RXEOH&OLFN,'FRXOGEHWLHGWRVHQVLWLYHLQIRUPDWLRQOLNHXVHUVHDUFKKLVWRULHVDQGFRXOGYLRODWHWKHVWULFWGDWDSULYDF\UHTXLUHPHQWVRI*'35

6WDNHKROGHUVRQWKHEX\HUVLGHVXJJHVWHGWKDWVWULSSLQJRXWWKH'RXEOH&OLFN,'UHPRYHGYLVLELOLW\DERXWXVHUDFWLYLW\ZLWKLQWKH'RXEOH&OLFNHFRV\VWHPDQGPDGHLWDOPRVWLPSRVVLEOHWRFRPSDUHDGSHUIRUPDQFHEHWZHHQDGVSXUFKDVHGWKURXJKWKH*RRJOHDGWHFKVWDFNDQGDGVSXUFKDVHGWKURXJKRWKHULQWHUPHGLDULHV,WZDVDOVRVXJJHVWHGWKDWWKHFKDQJHPDGHLQGHSHQGHQWDGDWWULEXWLRQPXFKPRUHGLIILFXOW

7KHUHDUHWKUHHPDLQUHDVRQVZK\LWLVKHOSIXOWRPHDVXUHKRZYDOXDEOHRU

XVHIXOGDWDLV

F29 

7KLVVHFWLRQGLVFXVVHVWKHHYLGHQFHRQWKHYDOXHRIGDWDDQGLQSDUWLFXODU L WKHYDOXHRISHUVRQDOLVHGDGYHUWLVLQJUHODWLYHWRFRQWH[WXDOLQGLVSOD\

DGYHUWLVLQJ LL WKHYDOXHRIGLIIHUHQWW\SHVRIGDWD LLL WKHYDOXHRI PHDVXUHPHQWDQGDWWULEXWLRQVHUYLFHVDQG LY WKHLQFUHPHQWDOYDOXHRI DGGLWLRQDOGDWD,QGRLQJWKLVDVVHVVPHQWWKLVVHFWLRQGUDZVRQWKHDFDGHPLF OLWHUDWXUHDQGRQSDUWLHV¶TXDQWLWDWLYHDQGTXDOLWDWLYHVXEPLVVLRQV 7KLVLVDOVRVXSSRUWHGE\*RRJOHLQWHUQDO *RRJOHVXEPLWWHGWKDWWKHUROHRIGDWDLQGLJLWDODGYHUWLVLQJLVLQGHHGD

IXQGDPHQWDOTXHVWLRQ,WVXEPLWWHGWKDWWKHYDOXHRIDSDUWLFXODUW\SHRIGDWDPD\GHSHQGRQLWVXVHIXOQHVV

PHDVXUHGDJDLQVWFULWHULDVXFKDVYDULHW\YHORFLW\YROXPHDQGYDOXH ZKHWKH

UVLPLODUGDWDDUHDYDLODEOHIURP

RWKHUVRXUFHVZKHWKHUFRQVXPHUVFDQSRUWWKHLUGDWDEHWZHHQVHUYLFHVKRZWKHGDWDLVXVHGDQGUHVWULFWLRQVRQ

GDWDXVH



6HH0DURWWD99LEKDQVKX$DQG$FTXLVLWL$  µ2QOLQH7UDFNLQJDQG3XEOLVKHUV¶5HYHQXHV$Q(PSLULFDO

$QDO\VLV¶ F30 $WDQDJJUHJDWHOHYHOUHFHQWHPSLULFDOHYLGHQFHFRQVLVWHQWO\ILQGVWKDW

SXEOLVKHUUHYHQXHVIURPGLVSOD\DGYHUWLVLQJ

LQFUHDVHDVDUHVXOWRI SHUVRQDOLVHGDGYHUWLVLQJDVRSSRVHGWRFRQWH[WXDODGV+RZHYHUWKH PDJQLWXGHRIWKLVLPSDFWLQUHFHQWDFDGHPLFZRUNLVXQFOHDU )RUH[DPSOHDUHFHQWSDSHUIURP0DURWWDHWDOIRXQGWKDWSXEOLVKHUV¶

UHYHQXH

VLQFUHDVHGE\DVPDOOPDUJLQ  ZKHQXVHUVSHFLILFGDWDZDVXVHG FRPSDUHGWRZKHQFRQVXPHUVFRXOGQRWEHLGHQWLILHGDQGWDUJHWHGGXHWRWKHLU

FRRNLHVHWWLQJV

 +RZHYHUWKHSDSHULVEDVHGRQDQRQUDQGRPLVHG

REVHUYDWLRQDOGHVLJQ

DQGUHOLHVRQDUHODWLYHO\QDUURZVHWRIXVHU FKDUDFWHULVWLFVWRDFFRXQWIRUVHOHFWLRQELDV:HH[SHFWWKDWHYLGHQFHIURP UDQGRPLVHGH[SHULPHQWVZRXOGEHEHWWHUDEOHWRDGGUHVVELDVGHULYLQJIURP WKHFRPSDULVRQRIXVHUVQDYLJDWLQJZLWKDQGZLWKRXWFRRNLHV*RRJOHKDV UHFHQWO\UXQLWVRZQH[SHULPHQWWRWHVWWKLVUHVXOWDQGZHG

LVFXVVLWEHORZ

7KH SULPDU\SXUSRVHRIWKH5&7ZDVWRDVVHVVWKHLPSDFWRIGLVDEOLQJFRRNLH LQIRUPDWLRQ LHDVLIWKHXVHU¶VEURZVHUKDGGLVDEOHGWKLUG SDUW\FRRNLHV RQ

SXEOLVKHUUHYHQXHVIURPGLVSOD\DG

V   *RRJOHPDGHWKH8.GDWDIURPWKHH[SHULPHQWDYDLODEOHWRWKH&0$  :H KDYHUHSOLFDWHGWKHRULJLQDODQDO\VLVDQGH[SDQGHGLWWRDFFRXQWIRUSRWHQWLDO

VHOHFWLRQLVVXHV

 0RUHGHWDLOVFDQEHIRXQGLQWKHDQQH[DWWKHHQGRIWKLV

DSSHQGL[

KHUHDQGWKHPHWKRGRORJ\LVGHVFULEHGKHUH



%ORFNLQJDFFHVVWRFRRNLHLQIRUPDWLRQZDVDFKLHYHGLQWZRZD\V)RUELGUHTXHVWVJRLQJWRQRQ*RRJOH

'63VWKHSXEOLVKHUFRRNLH,'ZDVVLPSO\UHPRYHG)RUELGUHTXHVWVJRLQJWR*RRJOHDVD'63[] F31 +RZHYHUWKHVHUHVXOWVQHHGWREHLQWHUSUHWHGZLWKFDXWLRQDVWKHUHDUHVRPH LPSRUWDQWHIIHFWVWKDWWKHDQDO\VLVFDQQRWFDSWXUH,QSDUWLFXODUWKHDQDO\VLVLV

XQDEOHWRDQVZHUWKHTXHVWLRQR

IZKDWWKHORQJUXQPDUNHWZLGHHIIHFWVRIWKH

UHPRYDORIWKLUG

SDUW\FRRNLHVWKURXJKRXWWKHHQWLUHHFRV\VWHPZRXOGEH7KLV LVEHFDXVHDGYHUWLVHUVSODWIRUPVDQGSXEOLVKHUVZRXOGEHH[SHFWHGWR UHVSRQGWRWKLVFKDQJHLQZD\VWKDWDUHGLIILFXOWWRSUHGLFW)RUH[DPSOHRYHU WLPHSULYDF\HQKDQFLQJWHFKQRORJLHVDVGLVFXVVHGLQ$SSHQGL[*FRXOG

EHFRPHDQHIIHFWLYHVXEVWLWXWHIR

USHUVRQDOLVHGDGYHUWLVLQJDQGDWWULEXWLRQ

XVLQJXVHUGDWD

  7KHFKDQJHFRXOGDOVROHDGWRWKHGHYHORSPHQWRIPRUH VRSKLVWLFDWHGDSSURDFKHVWRFRQWH[WXDODGYHUWLVLQJDVDVXEVWLWXWHIRU

SHUVRQDOLVHGDGYHUWLVLQJ

)XUWKHULWFRXOGDOVRLQFUHDVHUHOLDQFHRQILUVWSDUW\

GDWDIRUWDUJHWLQJ

+RZHYHUWKLVH[SHULPHQWFOHDUO\LQGLFDWHVWKDWLQWKHVKRUWUXQXQHTXDO DFFHVVWRWKLUGSDUW\FRRNLHVDQGWKHGHWDLOHGXVHULQIRUPDWLRQDVVRFLDWHG ZLWKWKHPKDVDVLJQLILFDQWQHJDWLYHLPSDFWRQWKRVHSXEOLVKHUVZKRFDQQRW VHOO SHUVRQDOLVHGDGYHUWLVLQJZKHQFRPSHWLQJZLWKWKRVHZKRFDQ F32 7KHVHSXEOLVKHUVDUHFRQFHUQHGWKDWWKHDQQRXQFHGUHPRYDORIWKLUGSDUW\ FRRNLHVIURP&KURPHFRXOGKDYHDVLPLODUQHJDWLYHLPSDFWRQWKHLUUHYHQXH  $VPHQWLRQHGDERYHLQUHODWLRQWRWKH*RRJOH5&7WKHVHVWXGLHVRQO\FDSWXUH VKRUWUXQHIIHFWVDQGFDQQRWDFFRXQWIRUORQJWHUPHTXLOLEULXPFKDQJHVVXFK DVWKHJUHDWHUGHYHORSPHQWDQGXVHRIFRQWH[WXDODGYHUWLVLQJ)RUWKLVUHDVRQ ZHZRXOGH[SHFWWKDWWKHORQJUXQHIIHFWRIUHVWULFWLQJDFFHVVWRXVHUGDWDIRU SHUVRQDOLVHGDGYHUWLVLQJZRXOGEHORZHUWKDQWKHVHVKRUWUXQHVWLPDWHV 2YHUDOOWKHDFDGHPLFOLWHUDWXUHHYLGHQFHIURPVWDNHKROGHUVDQGRXURZQ DQDO\VLVRIWKH*RRJOH5&7GDWDLQGLFDWHWKDWSHUVRQDOLVHGDGYHUWLVLQJ LQFUHDVHSXEOLVKHU¶VUHYHQXHDVRSSRVHGWRFRQWH[WXDODGYHUWLVLQJZKHQERWK

DUHDYDLODEOH

 +RZHYHUFRQVXPHUVSHFLILFGDWDDSSHDUVOHVVYDOXDEOHLQVHDUFKDGYHUWLVLQJ WKDQLQGLVSOD\*RRJOHVDLGWKDWPDQ\VHDUFKTXHULHVDUHQRWDIIHFWHGE\ SHUVRQDOLVDWLRQVLJQDOVHYHQLIKLVWRULFGDWDLVDYDLODEOH6LPLODUO\RQHODUJH DGYHUWLVHUVDLGWKDWILUVWSDUW\GDWDLVOHVVXVHIXODQGWKH\UHO\PRUHKHDYLO\

RQWKLUG

SDUW\GDWDIRUH[DPSOHWKH\XVHFKDUDFWHULVWLFVVXFKDVORFDWLRQWR HQVXUHWKH\VHUYHDGVRIUHOHYDQWSURGXFWVWRWKH8.1RQHWKHOHVVGDWDFDQ F33  7KHYDOXHRIFRQVXPHUVSHFLILFGDWDLQGLVSOD\DGYHUWLVLQJDSSHDUVWREH PXFKKLJKHU7KLVLVQRWVXUSULVLQJDVGLVSOD\DGYHUWLVLQJUHDFKHVFRQVXPHUV ZKRDUHQRWµLQPDUNHW¶±LHFRQVXPHUVZKRDUHQRWORRNLQJIRUVSHFLILF SURGXFWVVHUYLFHVEXWDUHORRNLQJIRUGLIIHUHQWRQOLQHH[SHULHQFHV HJFRQQHFW ZLWKIULHQGVRQ)DFHERRNZDWFKYLGHRVRQFRVWVSHULPSUHVVLRQIRUDGYHUWLVHUV  )RUH[DPSOHWKHUHVXOWVRIWKH*RRJOH UHVHDUFKPHQWLRQHGLQWKHSDUDJUDSKDERYHVKRZWKDWWKHXVHRIUHWDUJHWLQJ

OHDGVRQDYHUDJHWR>

   7KHUHDUHFHUWDLQFDWHJRULHVRIGDWDWKDWDUHFRQVLGHUHGPRUHYDOXDEOHWKDQ RWKHUVEXWWKLVPD\YDU\E\VHFWRU)RUH[DPSOHZHKDYHKHDUGWKDWLQWKH LQVXUDQFHVHFWRUWKHPRVWYDOXDEOHGDWDLVWKHUHQHZDOGDWHEHFDXVHWKLV

LQGLFDWHVZKHQFXVWRPHUVDUHLQ

PDUNHW0DQ\DGYHUWLVHUVVDLGWKDWGDWD DERXWWKHLURZQDXGLHQFHV DGYHUWLVHUV¶ILUVWSDUW\GDWD LVWKHPRVWLPSRUWDQW DVLWLVXQLTXHWRWKHPDQGWKHLUSURSRVLWLRQ6HYHUDOUHVSRQGHQWVPHQWLRQHG WKDWDJHJHQGHUORFDWLRQDQGLQWHUHVWVDUHYDOXDEOH)RUH[DPSOH

0F'RQDOG¶VYLHZLVWKDWDJHLQWHUHVWVSDVVLRQSRLQWVDQGJHQGHUGDWDFDQEH

PDSSHGRQWRWKHLQWHQGHGWDUJHWDXGLHQFHRIDSDUWLFXODUFDPSDLJQZKHUHDV ORFDWLRQDOORZVWDUJHWLQJEDVHGRQSUR[LPLW\WRDUHVWDXUDQW*HQHUDOO\DPL[

RIGDWDSRLQWVD

UHXVHGDFURVVDOOFDPSDLJQVZLWKGHPRJUDSKLFWDUJHWLQJWKH

PRVWLPSRUWDQW

:HKDYHDOVRKHDUGWKDWWKHYDOXHRIGDWDDOVRGHSHQGVRQ F34  F35 $VWXG\FRQGXFWHGE\/LQNHG,QSURYLGHVIXUWKHUHYLGHQFH7KLVVWXG\VKRZV WKDWWKHXVHRI/LQNHG,QFRQYHUVLRQWUDFNLQJZDVDVVRFLDWHGZLWKD VXEVWDQWLDOO\IDVWHULQFUHDVHLQDGYHUWLVHUVSHQGYLVjYLVQRQXVHUVRI FRQYHUVLRQWUDFNLQJEHFDXVHWKHWUDFNLQJHQDEOHVDGYHUWLVHUVWRRSWLPL]H FDPSDLJQVDQGEHWWHUXQGHUVWDQGWKHYDOXHEHLQJGULYHQE\WKHLUVSHQG > $OWKRXJKOLPLWHGWKLVVWXG\DORQJVLGHYLHZVH[SUHVVHGE\VWDNHKROGHUV GXULQJWKHFRXUVHRIRXUVWXG\SURYLGHVDXVHIXOLQGLFDWLRQRIWKHRYHUDOOYDOXH RI

YHULILFDWLRQDQGDWWULEXWLRQVHUYLFHV

F36 7KLVLQGLFDWHVWKDWWKHYDOXHRILQFUHPHQWDOGDWDLVSRVLWLYHDVE\LQFUHDVLQJ WKHLQIRUPDWLRQDYDLODEOHDERXWRQHFRQVXPHUSODWIRUPVFDQWDUJHWFRQVXPHUV

PRUHDFFXUDWHO\

7KLVLVVXSSRUWHGE\VRPHRIWKHDFDGHPLFOLWHUDWXUHZKLFKVXJJHVWVWKDWWKHFRPELQDWLRQRIGDWDRQWKHVDPHFRQVXPHULQFUHDVHVWKHYDOXHRIVXFKVHWRI

GDWDZLWKUHVSHFWWRWKHVXPRIYDOXHVRIWKHLQGLYLGXDOSLHFHVRIGDWD  ,Q RWKHUZRUGVWKHUHDUHHFRQRPLHVRIVFDOHDQGVFRSHLQGDWDZKHUHE\ODUJHU GDWDVHWVOHDGWRJUHDWHUSUHFLVLRQDQGVPDOOHUSUHGLFWLRQHUURUV+RZHYHUWKH DFDGHPLFOLWHUDWXUHDOVRILQGVWKDWWKHUHDUHGLPLQLVKLQJUHWXUQVWRVFDOHLQ GDWDVXFKWKDWDGGLQJH[WUDLQIRUPDWLRQGRHVQRWLPSURYHWKHSUHGLFWLYHSRZHU

DIWHUDFHUWDLQWKUHVKROG

    'DWDLVQRWKRPRJHQHRXVDQGDVVXFKLWVYDOXHGHSHQGVRQWKHW\SHVRI GDWDDQGWKHVHWWLQJLQZKLFKDGYHUWLVLQJLVGHOLYHUHG1RQHWKHOHVVLWLVVWLOO WKHFDVHWKDWPRUHGHWDLOHGGDWDDEOHWRSURYLGHGLUHFWVLJQDOVRQFRQVXPHUV¶ SXUFKDVHLQWHQWVLVFRQVLGHUHGPRUHYDOXDEOHDQGXVHIXOWRSURYLGH SHUVRQDOLVHGDGYHUWLVLQJ2WKHUIDFWRUVWKDWKDYHDQLPSDFWRQWKHYDOXHRI F37

3ODWIRUPVDOVRSURYLGHYHULILFDWLRQDQGDWWULEXWLRQVHUYLFHVWRDGYHUWLVHUV)RUWKLVSXUSRVHSODWIRUPV¶DELOLW\WRFROOHFWGDWDEH\RQGWKHLURZQFRQVXPHU

IDFLQJVHUYLFHVIURPWKLUG

SDUW\VLWHVDQGDSSVDQGWRFRPELQHLWZLWK DQDO\WLFVGDWDWRSUHVHQWDXQLILHGYLHZRIFDPSDLJQSHUIRUPDQFHWR DGYHUWLVHUVLVYHU\LPSRUWDQWWRGHPRQVWUDWHWKHLUHIIHFWLYHQHVVLQGLJLWDO

DGYHUWLVLQJ

*RRJOHDQG)DFHERRNKDYHDFRPSHWLWLYHDGYDQWDJHLQWHUPVRIEHLQJDEOHWRFDUU\RXWDWWULEXWLRQDFFXUDWHO\IRUFDPSDLJQVWKDWDGYHUWLVHUVUXQDWOHDVWLQSDUWRQWKHLURZQµZDOOHGJDUGHQ¶SODWIRUPV$WWKHVDPHWLPH*RRJOHDQG

)DFHERRN VWUDFNLQJVROXWLRQVDUHZLGHO\GLVWULEXWHGDFURVVPDQ\RWKHU ZHEVLWHV5LYDOSODWIRUPVVXFKDV0LFURVRIWDQG$PD]RQKDYHDFFHVVWR

VRPHGHWDLOHGKLJK

TXDOLW\GDWDDERXWFRQVXPHUVDQGWRRWKHUW\SHVRIGDWD EXWWKLVGRHVQRWH[WHQGZLGHO\WRWKHUHVWRIWKHLQWHUQHW7KLVPRUHOLPLWHG DFFHVVWRGDWDLQWHUPVRITXDQWLW\DQGRUTXDOLW\RIDQDO\WLFVGDWDRQ*RRJOH DQG)DFHERRN¶VSURSHUWLHVFRQVWLWXWHVDEDUULHUWRHQWU\DQGH[SDQVLRQ DOWKRXJKWKHH[WHQWWRZKLFKPD\YDU\E\VHFWRU IRUVPDOOHUULYDOVLQWKH SURYLVLRQRISHUVRQDOLVHGDGYHUWLVLQJ,QSDUWLFXODUODFNRIDFFHVVLQKLELWV LQGHSHQGHQWSURYLGHUVRIDWWULEXWLRQVHUYLFHVDQGLWFRXOGPDNHLWPRUH GLIILFXOWIRUDGYHUWLVHUVWRFRPSDUHWKHUHODWLYHSHUIRUPDQFHRIDGVRQ*RRJOH DQG)DFHERRNDJDLQVWDGVRQRWKHUZHEVLWHVDQGDSSV7KHUHIRUHUHVWULFWLRQV

RQWKLUG

SDUW\DFFHVVWRJUDQXODUDQDO\WLFVGDWDRQ*RRJOHDQG)DFHERRN¶V SURSHUWLHVJLYH*RRJOHDQG)DFHERRNDFRPSHWLWLYHDGYDQWDJH 7KLVILQGLQJKDVVHYHUDOLPSOLFDWLRQVIRUWKHUROHRIGDWDLQGLJLWDODGYHUWLVLQJ WKDWZHGLVFXVVDQGDVVHVVWKURXJKRXWWKHUHSRUW,Q&KDSWHUZHGLVFXVV WKHH[WHQWWRZKLFKGDWDFRXSOHGZLWKRWKHUEDUULHUVWRHQWU\DQGH[SDQVLRQ LPSHGHVHIIHFWLYHFRPSHWLWLRQEHWZHHQVPDOOHUSODWIRUPVDQG*RRJOHDQG F38 F39 7KLVDQQH[SUHVHQWVWKHUHVXOWVRIRXUDQDO\VLVRIWKH*RRJOHH[SHULPHQW:H ILUVWGHVFULEHWKHH[SHULPHQWDQGWKHGDWDFROOHFWLRQSURFHVV:HWKHQGHWDLO VRPHSRWHQWLDOVHOHFWLRQLVVXHVWKDWPLJKWDULVHLQWKLVVHWWLQJ1H[WZHDLPWR UHSOLFDWH*RRJOH¶VRZQWUHDWPHQWHIIHFWHVWLPDWH:HWKHQH[SDQGLWVVFRSH E\DGGUHVVLQJSRWHQWLDOVDPSOHVHOHFWLRQLVVXHVXVLQJHFRQRPHWULF DSSURDFKHVDQGH[SORUHWKHKHWHURJHQHLW\RIWUHDWPHQWHIIHFWVXVLQJD PDFKLQHOHDUQLQJDSSURDFK)LQDOO\ZHUHIOHFWRQZKDWWKHUHVXOWVRIWKLV H[SHULPHQWFDQ DQGFDQQRW WHOOXVDERXWWKHYDOXHRIGDWDLQDGWHFK  )ROORZLQJRXUUHTXHVW*RRJOHSUHVHUYHGDQGVXEPLWWHGWKHGDWDDVVRFLDWHG ZLWKWKHH[SHULPHQWIRU8.EDVHGZHEXVHUVWKDWKDGQRWDOUHDG\EHHQ

GHOHWHGLQ*RRJOH¶VRUGLQDU\FRXUVHRIEXVLQH

VVSULRUWRRXUUHTXHVWDQG

H[WHQGHGWKHGXUDWLRQRIWKHH[SHULPHQWWR6HSWHPEHU7KHGDWD VXEPLWWHGXVFRYHUVWKHLPSUHVVLRQVRIDUDQGRPVDPSOHRI8.EDVHGZHE XVHUVLQWKHSHULRGIURP-XQHWR6HSWHPEHUWKDWZHUHVHUYHG GLVSOD\DGVYLDLQYHQWRU\WKDWZDVHLWKHUD VROGE\SXEOLVKHUVXVLQJ*RRJOH¶V VXSSO\VLGHSODWIRUP 663 VROXWLRQV HLWKHU*RRJOH$G6HQVHRU*RRJOH$G;  RUE ERXJKWE\DGYHUWLVHUVXVLQJ*RRJOH¶VGHPDQGVLGHSODWIRUP '63 

V\VWHPV HLWKHU*RRJOH$GVRU*RRJOH'Y

 RUF ERWK

KHUHDQG

KHUH. F40

*RRJOHVWDWHGWKDWWKHEORFNLQJRIFRRNLHLQIRUPDWLRQZDVDFKLHYHGLQGLIIHUHQWZD\VGHSHQGLQJRQWKHUROHSOD\HGE\*RRJOHLQWKHWUDQVDFWLRQ7KLVVLWXDWLRQLVVXPPDULVHGLQ7DEOH)



,PSRUWDQWO\WKHH[SHULPHQWH[FOXGHVDIUDFWLRQRIWKHXVHUVZKRZHUHQDYLJDWLQJZKLOHORJJHGLQWRWKHLU*RRJOH$FFRXQW'XULQJWKHH[SHULPHQW

*RRJOHKDGEHHQUROOLQJRXWWKHXVHRI*RRJOH$FFRXQWGDWDIRUGLVSOD\ LPSUHVVLRQVVROGYLD*RRJOH663VROXWLRQV7KHXVHUVIRUZKRPWKLV IXQFWLRQDOLW\ZDVXVHGZHUHH[FOXGHGIURPWKHVDPSOHVXEPLWWHGWRXV7KH\ DFFRXQWIRU>@RIWKHWRWDOWUDIILFVHHQE\*RRJOH663VROXWLRQVDVSDUW F41 7KHVHXVHUVPLJKWGLIIHUIURPWKHXVHUVWKDWFDQEH REVHUYHGLQWKLVVWXG\LQWHUPVRIFKDUDFWHULVWLFVEURZVLQJKDELWVDQGWKH UHYHQXHWKH\JHQHUDWHIRUSXEOLVKHUV,QWKLVVHQVHWKHVDPSOHLVQRW UHSUHVHQWDWLYHRIWUDIILFWKURXJKWKH*RRJOHVWDFNIURP8.XVHUV  

$QRWKHUDVSHFWWREHFRQVLGHUHGFRQFHUQVDGIUDXGDQGWKHXVHRIFRRNLHVDVTXDOLW\VLJQDOV$ODUJHSURSRUWLRQRIWUDIILFSDUWLFXODUO\IURP6DIDULDQG)LUHIR[

ZLWKWUDFNLQJSUHYHQWLRQHQDEOHGLVFRRNLHOHVVUHJDUGOHVVRIWKHH[SHULPHQW '63DOJRUL WKPVDUHDOUHDG\XVHGWRELGGLQJRQVXFKFRRNLHOHVVTXHULHV +RZHYHUIRUQRQ6DIDULRU)LUHIR[TXHULHVWKHODFNRIFRRNLH,'LQDELG UHTXHVWFRXOGLQFUHDVH'63V¶SUREDELOLVWLFDVVHVVPHQWWKDWWKHUHTXHVW

RULJLQDWHVIURPQRQ

KXPDQ LHµERW¶ RURWKHUZLVHLQYDOLGWUDIILF7KH LQWHUYHQWLRQPLJKWWKXVOHDGWRORZHUELGGLQJE\'63VQRWRQO\GXHWRWKHLU LQDELOLW\WRDFFHVVXVHUSURILOHVOLQNHGZLWKDFRRNLH,'EXWDOVRGXHWR LQFUHDVHGOLNHOLKRRGRIWUDIILFEHLQJGHHPHGRISRRUTXDOLW\RUSRWHQWLDOO\ IUDXGXOHQW7KHGDWDGRHVQRWDOORZWRSXWDVL]HRQWKLVFRQFHUQEXWQHLWKHU *RRJOHQRUWKH&0$H[SHFWWKLVWRSOD\DODUJHUROHLQWKHDQDO\VLV 2QFHDXVHU,'ZDVLQFOXGHGLQWKHVWXG\GDWDRQDOORIWKH LPSUHVVLRQVVHUYHGDVSDUWRIWKHLUEURZVLQJDFWLYLW\GXULQJWKHVWXG\SHULRG

ZDVFROOHFWHG

$WLPHOLQHRIWKHQXPEHURILPSUHVVLRQVLQFOXGHGLQWKHH[SHULPHQWLVGLVSOD\HGLQ)LJXUH)1RWHWKDWWKHVDPSOLQJUDWHZDVLQFUHDVHGRQ

6HSWHPEHUWRDFKLHYHLQFUHDVHGDFFXUDF\

F42 6DPSOLQJZDVSHUIRUPHGDWWKHXVHUOHYHO+RZHYHUQRWDOOXVHUVFDQEH FRQVLVWHQWO\LGHQWLILHGWKURXJKRXWWKHLUWUDIILF8VHUVZKRDOORZFRRNLHVGXULQJ QDYLJDWLRQFDQEHLGHQWLILHGE\WKHLUFRRNLH,'7KLV,'LVSHUVLVWHQW±DWOHDVW XQWLOFRRNLHVDUHGHOHWHGE\WKHXVHUXVLQJWKHLUEURZVHURUGHYLFHVHWWLQJV± DQGFDQWKXVEHXVHGWRPDWFKLPSUHVVLRQVVHUYHGWRWKHVDPHXVHULQWLPH DFURVVGLIIHUHQWGRPDLQV2QFHDXVHULGHQWLILHGE\DFRRNLH,'LVUDQGRPLVHG WREHLQHLWKHUFRQWURORUWUHDWPHQWDOOWKHLPSUHVVLRQVWKDWZHUHVHUYHGWR

WKHPFDQEHDOORFDWHGWRWKHVDPHJURXS

2QWKHRWKHUKDQGXVHUVQDYLJDWLQJZLWKRXWFRRNLHVFDQQRWEHLGHQWLILHGDFURVVWKHLUEURZVLQJIURPDVDPSOLQJSHUVSHFWLYHWKHVHDUHWUHDWHGDVµQHZ¶XVHUVHYHU\WLPHWKH\DSSHDULQ*RRJOH¶VWUDIILF7KLVPHDQVWKDWWKHVDPHXVHUPLJKWDSSHDULQERWKFRQWURODQGWUHDWPHQW

7KHUHDUHWZRPDLQUHDVRQVZK\*RRJOHGLGQRWKDYHDFFHVVWRDFRRNLH,'IRUVRPHXVHUVLQWKLVH[SHULPHQW

F43  ܺ LQIRUPDWLRQ 

8VHU&RRNLHDJH)LYHLQWHUYDOVRIDSSUR[LPDWHO\HTXDO

VL]HXSWRRQHZHHN  GD\V RQHWR ZHHNV  GD\V WRZHHNV GD\V WRZHHNV  GD\V DQGRYHUZHHNV  GD\V  

3XEOLVKHU8.GRPDLQLISXEOLVKHU

Advertising Documents PDF, PPT , Doc

12345 Next 200000 acticles