[PDF] Committee Assessment Research Citation Statistics

Committee Assessment Research Citation Statistics

We do not dismiss citation statistics as a tool for assessing the quality of research—citation data and statistics can provide some valuable information We recognize that assessment must be practical, and for this reason easily‐derived citation statistics almost surely will be part of the process

In the Classroom Teaching Pragmatic Competence: A Journey

l’importance de cette compétence mais note la pénurie de ressources pour appuyer les enseignants d’ALS à cet égard S’appuyant sur la théorie de la compétence communicative et son application à l’apprentissage d’une langue seconde, cet ar-ticle offre un exemple de ce qu’il faut enseigner, et comment, en matière de compé-

LA FORMATION DES PASTEURS L EÇON

Deux chrétiens sur cinq maintiennent que de telles pensées sont justes, rejetant en effet le code inconditionnel d'éthique et de moralité trouvé dans la Bible Trois chrétiens sur dix sont d'accord que rien n'est plus important dans la vie que leur bonheur personnel Des chrétiens manifestent un tel amour pour l'argent, leurs

Document de travail sur l’agroforesterie no

Document de travail sur l’agroforesterie no 1 Promouvoir l’agroforesterie dans les politiques publiques Guide pour les décideurs L’agroforesterie est un système de gestion des ressources naturelles dynamique basé sur des principes écologiques qui, grâce à l’intégration des arbres dans les exploitations et les

La protection de lenvironnement en

La principale raison d'être de cette étude sur la protection de l'environnement en Islam est assurément ma conviction, partagée par nombre de mes collègues, de l'importance que revêt le concept de gestion de l'environnement dans le processus de conservation de la nature et du développement durable

Introduction

Sur le plan général, la communication, en affirmant l’identité de l’entreprise, vise à répondre aux besoins d’appartenance et de contribution des Hommes qui forment son environnement socio-économique (Personnel, consommateur,

La maltraitance psychologique chez lenfant

L'enfant joue ainsi un rôle de bouc-émissaire et va tenter de camoufler la réalité de son vécu, malgrè l'importance de son stress émotionnel Lorsque la situation est dévoilé, il redoute la réaction de ses parents et adopte donc des attitudes de soumission et de fuite Il protègera ses

[PDF] faire de la grammaire au cm2 programmation

[PDF] citation école humour

[PDF] faire de la grammaire au cm2 correction

[PDF] citation pour l'école

[PDF] faire de la grammaire cm2 picot programmation

[PDF] citation sur l'école maternelle

[PDF] faire de la grammaire au cm2 picot progression

[PDF] citation sur l'école et l'éducation

[PDF] transposer un texte au passé composé cm2

[PDF] citation drole rentrée scolaire

[PDF] faire de la grammaire au cm2 pdf

[PDF] citation sur l'école primaire

[PDF] textes picot cm2

[PDF] proverbe sur l'école

[PDF] cours de méthodologie de recherche en sciences de gestion pdf

Statistics(IMS)

Correctedversion,

6/12/08

RobertAdler,JohnEwing(Chair),PeterTaylor

6/11/2008

2

Executive

Summary

citationstatistics. understandingofresearch - anunderstandingthatisvalidonlywhenreinforcedbyother Using citationdatatoassessresearchultimatelymeansusingcitationͲbasedstatisticstorankthings - oftenmisunderstoodandmisused. itoccurs. 3 Wedonotdismisscitationstatisticsasatoolforassessingthequalityofresearch - citationdataand withonlyasinglecoarsetool. order itsquality.

PeterTaylor,UniversityofMelbourne

Fromthecommitteecharge

Thedrivetowardsmoretransparencyand

accountabilityintheacademicworldhas createda"cultureofnumbers"inwhich decisionscanbereachedbyalgorithmic evaluationofsomestatisticaldata;unable tomeasurequality(theultimategoal), thattheycanmeasure.Thistrendcallsfor commentfromthosewhoprofessionally "dealwithnumbers" - mathematiciansand statisticians. 4

Introduction

money order universityresearch - theUKResearchAssessmentExercise(RAE) - shouldbereplacedafterthe Those research enterprise - journals,papers,people,programs,andevenentiredisciplines - simplyand Those citationmeansthesamethingaboutthecitedresearch - its"impact".Thisisanassumptionthat isunprovenandquitelikelyincorrect. Those research implicitlyholdsuchabelief.Wenotonlyneedtousestatisticscorrectly - weneedto usethemwiselyaswell. 5 rely predominantlyon"simpleandobjective"citationͲbasedmetrics - ademandthatoftenis research hasbeenmadebefore(forexample[Martin1996] in some review - thejudgmentoffellowscientists - isanimportant component ofassessment.(Weshouldnotdiscardpeer review role used 1 This

Researchusuallyhasmultiple

goals anditistherefore reasonablethatitsvaluemust bejudgedbymultiplecriteria. 6

Ranking

journals:Theimpactfactor 2

Information),

3 For generally tocomparejournals. counted 4 7 compute

0%2%4%6%8%10%12%14%

2003 2002 2001 2000 1999 1998 1997 1996 1995 1994

Percentof2003citations

CitationCurves

CellBiology

Education

Economics

Mathematics

00.511.522.53

"Impact

Factors"

Top100MathematicsJournals

2Ͳyear

5Ͳyear

10

Ͳyear

Reviewscitationdatabase.

Impact

Factor

8 the"sourceyear"(seebelow). differentdisciplinesusingimpactfactors.

Citations

Averagecitationsperarticle

9 using be "better".Theonlymodelderivesfromtheimpactfactoritself - alargerimpactfactormeansabetter journal. hypothesis. may aboutthesethings. attention informed peerreview."[THOMSON:IMPACTFACTOR]

Ranking

papers In 10 mathematiciansaroundtheworld: second journal createdusingtheimpactfactor.) In disciplines. skewed, thatcanbemadeprecisewithanexample. in 11 pages),withcitationcountsrangingfrom0to12.Theaveragenumberofcitationsperarticlewas.846 - abouttwicethatoftheProceedings. Now superiortothefirst,publishingapaperinajournalwithhigherimpactfactor - infact,twiceashigh!Is

Proceedings?

When

0%10%20%30%40%50%60%70%80%

0123456789101112

Percentofarticles

Citations

Proceedings

oftheAMS

0%10%20%30%40%50%60%

0123456789101112

Percentofarticles

Citations

Transactions

ofAMS 12

Transactions

paper - inspiteofthefactthattheProceedingsimpactfactorisonlyhalfthatofthe

Transactions

5

Itshowsthevalueof

precise (Forexample,theJournaloftheAMSoverthesameperiodhasanimpactfactor2.63 - sixtimesthatof the thesenseofcitations,32%ofthetime.) Itfollowsthatthekindsofcalculationsperformedinthethreeexamplesabove - usingtheimpactfactor as aproxyforactualcitationcountsforindividualpapers - havelittlerationalbasis.Makingassertions anassessment.

Ranking

scientists While rankindividuals. h n citations.

Whileitisincorrecttosaythat

theimpactfactorgivesno information aboutindividual papers inajournal,the information issurprisingly vagueandcanbedramatically misleading. 13 g 2 citations. ismeanttocompensateforthis. There aremoreindices - manymoreofthem - includingvariantsofthoseabovethattakeintoaccount In

Neither

In

Conversely,

total 10 equivalent?) 6 While 14 - publications.InonenotablepaperaboutthehͲindex[LehmannͲJacksonͲLautrup2006]theauthors A In

Themeaningofcitations

Those counts, In meaningofcitations. [THOMSON:HISTORY]

Understandingoughttobethe

goalwhenassessingresearch, notmerelyensuringthatany two peoplearecomparable. 15 "Although better in journal becomethegenericwordusedtoassignmeaningtocitations - atermthatfirstaroseinashortpaper may helpthehistoriantomeasuretheinfluenceofthearticle - thatis,its'impactfactor.'" [Garfield1955,p.3] paperhasbeen"builtupon"theworkofthecited - thatcitationsarethemechanismbywhichresearch propagatesitselfforward. There assessingresearch,MartinandIrvinewrite: papers..."[MartinͲIrvine1983,p.69] In associated withacitation - anacknowledgmentthattheciting however,haveameaningquitedifferent - areferencetoa intellectual canhavebothmeanings. The meaningofcitationsisnot simpleandcitationͲbased statisticsarenotnearlyas "objective"asproponents assert. 16 whichpapertociterhetoricallydependsonmanyfactors - theprestigeofthecitedauthor(the"halo" manyexamplesofsuch"warning"citations. Thesociologyofcitationsisacomplexsubject - onethatisbeyondthescopeofthisreport.Eventhis cursory evaluationbecauseofthiscorrelation:

Usingstatisticswisely

writtenbythesociologistJoelBest: social our 17 problems. p 160]
research promotingthehͲindexanditsvariants. [Stringer 7 We aremeanttotreatthenumbersandrankingswithawe - astruthsratherthancreations. performanceassessmentofthingsotherthanresearch - publicsectorperformancemonitoringinthe firstandhealthcare/educationinthesecond - eachprovidesinsightaboutthesensibleuseofstatistics in assessingresearch. Data (We

Ifoneconsultswithdoctors

whenpracticingmedicine, surelyoneoughttoconsult withstatisticianswhen practicingstatistics. 18 assembling

StatisticalAnalysisandPresentation

publishes,

InterpretationandImpact

[GoldsteinͲSpiegelhalter1996,p.390] success unstudied. have 19 involvedintheassessmentofresearch.

PeterTaylor,UniversityofMelbourne

20

References

Adler,

http://bulletin.imstat.org/pdf/36/5

1Ͳ6.

Batista,

arXiv:physics/0510142v1

Batista,

researchers

LibrariesNews,Vol68,No.5,May2007

Best, http://dx.doi.org/

10.1111/j.1467-985X.2004.00333.x

http://dx.doi.org/10.1002/asi.4630370106

Carey,

6, (1989),pp.437Ͳ447. http://dx.doi.org/

10.1007/BF02017064

http://dx.doi.org/

10.1007/s11192-006-0144-7

21
alliance"withThomsonScientific.) association

CurrentComments#2,p.3,January12,1987.

______. 1998.Long-term vs. short-term journal impact (part II). The Scientist

12(14):12-3 (July 6, 1998).

______.2005.Agonyandtheecstasy - thehistoryandmeaningofthejournalimpactfactor.Presented 2005.
http://dx.doi.org/10.2307/2983325

Vol.102,No.46,pp.16569-16573.

No.21,pp.1003Ͳ1004.

22

Vol36,No.3(1996),pp.343Ͳ362.

http://dx.doi.org/10.1007/BF02129599 and

Technology,Vol58,No13,pp.2105Ͳ2125.

http://dx.doi.org/10.1002/asi.20677

Scientometrics.

http://imechanica.org/files/paper.pdf Monastersky, R. 2005.Thenumberthat'sdevouringscience.ChronicleHigherEd.Vol. 52, No. 8.

No6,December17,pp.1091Ͳ1092.

http://dx.doi.org/10.1083/jcb.200711140

314:497 (15 February).

arXiv:cs/0607066v1[cs.DL] forlocatinginformation.PLoSONE3(2):e1683 23
24

Endnotes

1

Vol.1,No.2(April1934),pp.163Ͳ169.

2 3

MATHEMATICS(217)

MATHEMATICSAPPLIED(177)

MATHEMATICSINTERDISCIPLINARY(76)

PHYSICS,MATHEMATICAL(44)

PROBABILITYANDSTATISTICS(96)

4 5 equivalent. timeformathematics - articlesoftentakemanyyearstoaccumulatecitations.Ifwechooselonger comparing 25
6 distribution lookslikethefollowing: citationcountsforthese15papersis: In 7 be discarded - thatis,allcitationsfromarticlesinagivenjournalJtoarticlespublishedinJduringthe

0%5%10%15%20%25%30%

01234567891011121314>15

Percentofarticles

Citations

Scientist'sCitationRecord

(84 articles)

050100150200

0510 15 20

Numberofcitations

Papers

Top15papers

26
third ofallcitations. time commonexperience.quotesdbs_dbs12.pdfusesText_18