No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Assessing the Enduring Impact of Influential Papers
Abstract
This paper investigates citations of influential papers in the marketing and management area. These papers are successful in terms of the direct citations they receive (i.e., primary citations). To be truly influential, however, the papers citing them must in turn be used and cited by subsequent papers (i.e., have secondary citations) to demonstrate their long-run relevance. We propose a measure of enduring impact that takes into account (1) both primary and secondary citations and (2) the number of citations in the bibliography. The measure is non-linearly (exponentially) related to the traditional influence measure (i.e., primary citations to a paper) and captures the dissemination of knowledge from a paper more completely than cumulative or average primary citations.
... Analisis sitasi juga digunakan untuk mengukur performa jurnal ilmiah (Aljuaid et al., 2021;Eisend & Lehmann, 2016;Nisonger, 2000). Walaupun hal tersebut menimbulkan pro dan kontra di kalangan akademisi (Bensman, 2012), performa sitasi tetap digunakan oleh beberapa pihak sebagai salah satu indikator performa jurnal ilmiah. ...
Citation analysis is one of the means of measuring a journal's progress. This study aims to analyze and provides general illustration on the distribution of citation in Jurnal Pendidikan Geografi: Kajian, Teori, dan Praktik dalam Bidang Pendidikan dan Ilmu Geografi, from 2019 to 2021. We used bibliometric analysis with Publish or Perish (PoP) software for the citation analysis. The data were garnered through the crossref metadata of the journal within the last five years. Our analysis results suggest that the Jurnal Pendidikan Geografi: Kajian, Teori, dan Praktik dalam Bidang Pendidikan dan Ilmu Geografi has published 40 articles with 9 citations within 2019-2021. Besides, its average number of citations was 3, with an average citation per article of 0.23. This result can be considered deficient as, according to the national journal accreditation assessment, it is only equal to the score of 2 out of 8. Thus, the journal should improve its strategy to improve its citation and maximize its accreditation score. Salah satu cara untuk mengukur perkembangan suatu jurnal adalah dengan melakukan analisis sitasi. Penelitian ini bertujuan untuk menganalisis dan memberikan gambaran umum tentang sebaran sitasi Jurnal Pendidikan Geografi: Kajian, Teori, dan Praktik dalam Bidang Pendidikan dan Ilmu Geografi periode 2019-2021. Analisis sitasi ini menggunakan metode bibliometrik menggunakan software Publish or Perish (PoP). Sumber data penelitian diperoleh dari metadata crosreff jurnal selama kurun waktu lima tahun. Berdasarkan hasil analisis, Jurnal Pendidikan Geografi: Kajian, Teori, dan Praktik dalam Bidang Pendidikan dan Ilmu Geografi pada periode 2019-2021 telah menerbitkan 40 artikel dengan jumlah sitasi sebanyak 9 selama 3 tahun. Rata-rata sitasi per tahun 3, dengan rata-rata sitasi per artikel 0,23. Hasil ini masih belum bisa dikategorikan sebagai hasil yang bagus karena berdasarkan evaluasi akreditasi nasional, nilai tersebut hanya dapat dikonversikan menjadi dua poin dari maksimal delapan poin. Pihak jurnal harus terus meningkatakn penggunaan strategi untuk mendapatkan sitasi yang lebih tinggi dan hasil penilaian akreditasinya yang maksimal.
... Samiee, S. and Chabowski, B. R. (2012) analyze the knowledge structure in international marketing using a multi-method bibliometric analysis. Eisend and Lehmann (2016) assessing the enduring impact of influential papers in the marketing and management are using impact factor, primary and secondary citations and bibliometrics analysis. In addition, Chen et al. (2017) carry out a bibliometric study from 1997 to 2014 concerning the state of the art on food waste research. ...
This paper presents a general overview on ethnocentrism consumer research using bibliometric indicators over the period 1984–2021 from Web of Science Core Collection database. We investigate how the research on this topic is related to international trade, and how the literature has evolved with respect of keywords analysis, co-authorship, Co-citation relative to intuitions, countries and sources titles network. Firstly, our results show that the inflation of World Bank data on international trade since 2006, coincides by simultaneously increasing of the number of publications on ethnocentrism consumer during the same period. This proving that globalization has become a highly predominant phenomenon. Secondly, the keywords analysis over 1984–2021 suggest three cluster namely the process of theoretical foundations of ethnocentrism, operability of the concept of ethnocentrism and intersection between research on the operational aspect of the construct and the conceptual aspect. Finally, this previous clusters has been mutated from one sub-period to another.KeywordsEthnocentrismConsumer researchBibliometric analysisWeb of ScienceOverview
... it is widely believed that the number of citations received by a journal or an article measures (or reflects) its influence, impact, and/or intrinsic quality (Baumgartner and Pieters 2003;Eisend and Lehmann 2016;Li et al. 2015;Stremersch et al. 2007). ...
To date, limited studies have examined the citations of articles published in predatory journals, and none appears to have been done in marketing. Using Google Scholar (GS) as a citation source, this study aims to examine the extent of citations of (articles published in) 10 predatory marketing journals. Citation analyses indicate that the most cited predatory marketing journal gathered 6,296 citations since it was first published in 2008. Four of the 10 predatory journals gathered over 732 citations each since they were launched (i.e., highly cited). Three other journals were cited between 147 and 732 times (i.e., moderately cited). The three remaining journals received below 147 citations each (i.e., trivially cited). Findings show that the 1,246 articles published in these 10 predatory journals, and which are visible to GS, received 10,935 citations with 8.776 citations per paper. About 11.624% of these 1,246 articles were cited 13 times or more. The most cited article received 217 citations, of which 21 are from journals indexed in Clarivate Analytics’ Social Sciences Citation Index. Based on these findings, this study concludes that the conventional marketing literature has been already contaminated by predatory marketing journals.
Boundary research can be risky, but it can also move academic disciplines into wider areas of influence. To help reduce the risk and increase the reward, this article describes new tools that boundary researchers can use to get started, published, and promoted. These include writing for surprising impact, positioning their research against a larger theme, developing a research impact matrix for promotion, and estimating a 10-year citation record. These tools can help move a boundary research area from fringe to focus.
Over the years, the level of analytical rigor has risen in articles published in marketing academic journals. While, ceteris paribus, rigor is desirable, there is a growing sense that rigor has become a, if not the, goal for research in marketing. Consequently, other desirable characteristics, such as relevance, communicability, and simplicity, have been downplayed, to the detriment of the field of marketing. The authors explore this imbalance, setting forth the consequences of overemphasis on rigor for (1) the manuscript review process, (2) PhD programs, (3) hiring, and (4) the tenure and promotion review process. Two surveys of "successful" authors provide empirical support for the conjectures put forth. The authors then identify the causes for this trend and propose some directions to reestablish a better balance between rigor and relevance.
This article examines the influence of citation impact on scholarship. Citation analysis allows authors to determine how often their work has been cited by others. It has become a performance metric for scholars of the influence and relevance of their work. However, the authors contends there is very little research to understand citation rates. They conclude that the pressure from journals and universities for prestige is the key element driving citation rates. Increased information technology is expected to continue this trend into the future.
Assessments of quality and productivity of academic research programs become more and more important in gaining financial support, in hiring and promoting research staff, and in building academic reputation. Most assessments are based on peer review or on bibliometric information. In this paper we analyze both bibliometric data and peer review assessments of 169 research groups in economics, econometrics and business administration. The evaluations are achieved in two independent rounds in 1995 and in 2001, permitting replication of our study.
This paper investigates the central methodological and substantive controversies surrounding the relationship between concentration and performance which lies at the heart of many strategy content models. We introduce the technique of meta-analysis to evaluate the nature of the relationship and to empirically assess the controversies using existing data. Our findings suggest that the relationship is moderated by industry definition and time period of data and is not affected by methodological artifacts. The implications of the findings are discussed with particular reference to the problems of aggregation that are likely to confront strategic management researchers in the future.
This article uses an integrative theoretical framework to review existing empirical research on the diversification-performance relationship along the three different research streams which have studied this relationship. the article highlights the considerable diversity in the findings across studies in each stream and identifies certain key theoretical and methodological issues which might help to explain the observed diversity. Also discussed is a contingency-based perspective and several useful directions for future research.
This paper investigates publication patterns of Australian academics in Economics & Business. I show that this discipline follows the general Australian trend of declining impact, measured as citations per pa-per, from the mid-1990s. However, the gap in Australia's ranking of publication quantity (number of pa-pers) and publication quality (impact) is much wider in Economics & Business than in other disciplines. The discipline combines the highest ranking in quantity with the lowest ranking in quality. Seven possible explanations for this pattern are discussed.
This paper comprehensively examined the linkages between systems of High Performance Work Practices and firm performance. Results based on a national sample of nearly one thousand firms indicate that these practices have an economically and statistically significant impact on both intermediate outcomes (turnover and productivity) and short- and long-term measures of corporate financial performance. Support for the predictions that the impact of High Performance Work Practices is in part contingent on their interrelationships and links with competitive strategy was limited.
The authors investigate the intellectual pillars of service marketing and its evolution through key subareas during 1992–2009 using a citation-based approach. They derive insights for the most promising research directions. The results reveal the dynamic influences of different research topics on service marketing. In a graphical representation, the authors further show that the main topics have changed their research orientations over time. For example, the literature on online service & technology infusion reveals an increasingly operational and customer-focused orientation. A citation-based measure of the significance of research opportunities and a comparison with the topics found in recent literature reviews indicate that research on managing business-to-business services & service infusion, complaint handling & service recovery, and enhancing and managing the service value chain are promising topics. These results assist academics and practitioners by revealing what we know about service research and what we need to know in the future.
This article reports on the first in-market experimentally based measurement of long-term TV advertising effects for a representative cross-section of 55 tests for established consumer packaged goods. The typical BehaviorScan<sup>®</sup> weight test has a test group exposed to a heavier TV advertising weight than a matched control group for a one-year period, after which the experiment stops. For this analysis, the two groups were tracked and analyzed for another two years, when the only difference between the two groups was the TV advertising treatment during the first year. The analysis shows that when TV weight increases had a significant impact during the year of the weight increases, during the following two years, on average, the sales impact of the first year is approximately double and, on average, it was from an increasing in buying rate in the test group. The analysis also shows that if TV weight increases had no significant impact during the first year, on average, they had no impact in the two following years.
This article uses meta-analysis to summarize previous empirical studies which examine the relationship between actual income/pay satisfaction and organizational commitment (OC) across different structural settings. Twenty-one studies with correlational data on the relationship between OC and income, and 27 studies dealing with OC and pay satisfaction are examined; these studies include 23 and 31 independent samples, respectively. The findings reveal a moderator effect related to type of occupation in the OC-income relationship, and to sector in the OC-pay satisfaction relationship. The findings also show the moderating effect of measurement of OC on pay satisfaction. Theoretical and methodological considerations pertaining to the OC-rewards relationship are discussed. Directions for future research and practical implications are indicated.
Despite their shortcomings (1–4), impact factors continue to be a primary means by which academics “quantify the quality of science” (5). One side effect of impact factors is the incentive they create for editors to coerce authors to add citations to their
journal. Coercive self-citation does not refer to the normal citation directions, given during a peer-review process, meant
to improve a paper. Coercive self-citation refers to requests that (i) give no indication that the manuscript was lacking
in attribution; (ii) make no suggestion as to specific articles, authors, or a body of work requiring review; and (iii) only
guide authors to add citations from the editor's journal. This quote from an editor as a condition for publication highlights
the problem: “you cite Leukemia [once in 42 references]. Consequently, we kindly ask you to add references of articles published in Leukemia to your present article” (6). Gentler language may be used, but the message is clear: Add citations or risk rejection.
This paper looks at how citations are perceived among scientists. Based on a questionnaire survey it traces the repertoire of views and experiences about citations that could be found among Norwegian scientists that had published highly cited papers. Their views circle around three issues: the relation between the quality (or importance or significance) of a paper and its citation history; the importance of visibility and how different sorts of factors play a role in determining citation in general and high citation in particular; and the fairness (or lack of fairness) of the system. Taken together, the respondents' answers and comments offer an informal (and fragmented) sociology of citations and their role in the world of science. In the final section we discuss the relevance of our findings in respect to the increasing use of citation indicators in science policy and research evaluations.
Although role ambiguity and role conflict have been studied extensively in the organizational sciences, there remain numerous empirical discrepancies among the reported research results. Consequently, disagreement exists as to what can be concluded about the role ambiguity and role conflict research. Coupled with this empirical impasse has been a persistent and relatively singular approach to conceptually studying role ambiguity and role conflict. In response to this empirical and conceptual situation, a meta-analysis and a conceptual reevaluation of the role ambiguity and role conflict research were performed. Using the Hunter, Schmidt, and Jackson (1982, Meta-analysis: Cumulating research findings across studies, Beverly Hills, CA: Sage) meta-analysis procedures, this study analyzed 29 correlates of role ambiguity and role conflict. These correlates include ten organizational context variables, five individual characteristics, ten affective reactions, and four behavioral reactions. Meta-analysis procedures were used to measure the strength and consistency of the relationship found between each of the 29 correlates and role ambiguity and role conflict. Meta-analysis was also used to determine where moderator variables should play a critical part in future role ambiguity and role conflict research. Based on the results of the meta-analysis, several empirical summaries and conclusions are presented. Along with these, several conceptual observations and reconceptualizing suggestions are offered. It is concluded that while a great deal is known about role ambiguity and role conflict in the organizational sciences much remains to be learned.
Why do some articles become building blocks for future scholars, while many others remain unnoticed? We aim to answer this question by contrasting, synthesizing and simultaneously testing three scientometric perspectives – universalism, social constructivism and presentation – on the influence of article and author characteristics on article citations. To do so, we study all articles published in a sample of five major journals in marketing from 1990 to 2002 that are central to the discipline. We count the number of citations each of these articles has received and regress this count on an extensive set of characteristics of the article (i.e. article quality, article domain, title length, the use of attention grabbers and expositional clarity), and the author (i.e. author visibility and author personal promotion). We find that the number of citations an article in the marketing discipline receives, depends upon “what one says†(quality and domain), on “who says it†(author visibility and personal promotion) and not so much on “how one says it†(title length, the use of attention grabbers, and expositional clarity). Our insights contribute to the marketing literature and are relevant to scientific stakeholders, such as the management of scientific journals and individual academic scholars, as they strive to maximize citations. They are also relevant to marketing practitioners. They inform practitioners on characteristics of the academic journals in marketing and their relevance to decisions they face. On the other hand, they also raise challenges towards making our journals accessible and relevant to marketing practitioners: (1) authors visible to academics are not necessarily visible to practitioners; (2) the readability of an article may hurt academic credibility and impact, while it may be instrumental in influencing practitioners; (3) it remains questionable whether articles that academics assess to be of high quality are also managerially relevant.
Can one assess the research performance of university departments and, if so, how? Can
research performance indicators be constructed to help in this task? These are important
questions in the current political climate as governments in many countries look more closely
at all areas of public expenditure to see whether there is scope for using limited resources
more effectively. Yet previous efforts to assess higher education institutions have proved
extremely controversial. Universities, long used to the notion of academic freedom and to
running their own affairs, have tended to see any attempt to subject them to external
monitoring as an infringement of that freedom. Moreover, the idea that an intangible, diffuse
and highly uncertain activity like research can in some way be measured with performance
indicators comes as an anathema to many.
The author presents a conceptual model of brand equity from the perspective of the individual consumer. Customer-based brand equity is defined as the differential effect of brand knowledge on consumer response to the marketing of the brand. A brand is said to have positive (negative) customer-based brand equity when consumers react more (less) favorably to an element of the marketing mix for the brand than they do to the same marketing mix element when it is attributed to a fictitiously named or unnamed version of the product or service. Brand knowledge is conceptualized according to an associative network memory model in terms of two components, brand awareness and brand image (i. e., a set of brand associations). Customer-based brand equity occurs when the consumer is familiar with the brand and holds some favorable, strong, and unique brand associations in memory. Issues in building, measuring, and managing customer-based brand equity are discussed, as well as areas for future research.
A survey of the econometric literature is undertaken to determine the duration of cumulative advertising effect on sales. The surveyed studies yield conflicting estimates of the duration interval. The data interval is shown to have a powerful influence on the implied duration of advertising effect. The evidence leads to the conclusion that the cumulative effect of advertising on sales lasts for only months rather than years.
The authors conducted a meta-analysis of the generics literature. The meta-analysis reveals the strongest predictors of a proneness to buy generic products are consumer perceptions of generics' quality and price and consumers' overall evaluation of generic products. Demographic and psychographic variables and consumer shopping behaviors are related only weakly to consumers' proneness to buy generics.
A method for exploring and quantifying the value systems of consumers through conjoint measurement is described. Since it is concerned with value systems of individual consumers, the method is most appropriate for product categories where consumers' desires are heterogeneous and where markets are highly segmented.
A general model is derived and illustrated for the analysis of field and laboratory experimental data. The model explicitly provides for the determination of the magnitude and significance of experimental effects and can be used in a diagnostic sense in the interpretation and design of experiments. Comparisons are made with the analysis of variance technique where applicable.
Assessments of quality and productivity of academic research programs become more and more important in gaining financial support, in hiring and promoting research staff, and in building academic reputation. Most assessments are based on peer review or on bibliometric information. In this paper we analyze both bibliometric data and peer review assessments of 169 research groups in economics, econometrics and business administration. The evaluations are achieved in two independent rounds in 1995 and in 2001, permitting replication of our study.The purpose of this study is twofold. In the first part we want to see to what degree bibliometric information relates to peer review judgments. The results convey how evaluators weight different output categories in their final overall judgment of academic quality. The results also have practical meaning, since they indicate what the predictive ability of bibliometric data is for future peer review outcomes. In the second part of this study we aim at explaining differences in research output quality and productivity by organizational factors, like size of the research group, composition of staff, sources of research funding and academic discipline. In this part, a composite indicator is used to represent the review committees’ overall assessment. The bibliometric data most strongly related to the peer reviews’ overall assessment are used to construct data envelopment analyses’ efficiency scores as measure of research productivity.The main conclusions from our study are that the number of publications in international top journals is the best predictor of peer review assessment results. Changes in the classification of bibliometric information, as introduced in the second evaluation round, do not alter this conclusion. Size of the research group appears to be the only permanent characteristic associated with research quality and productivity. Size is positively related to research quality but negatively related to research productivity. Larger groups appear to have the potential to improve quality, but as groups become larger, they also experience problems in maintaining the research productivity of the research team's members. The remaining organizational characteristics appear to be temporarily related to research quality and productivity. In the first evaluation round, research productivity and quality are associated with the discipline variable: research programs in more quantitative areas and characterized by a higher level of paradigm development like econometrics and operations research achieved higher levels of research quality and productivity than programs in more diverse and less quantitative areas like business administration. This relation however is not permanent, since it becomes insignificant in the second evaluation round. Instead, funding relations become more apparent in the second review round. The relative amount of national funding in the research group's funding becomes positively related to academic quality, whereas the portion of income from committed research is negatively related to academic quality of the programs’ research output. This may have been caused by the increased importance of alternative sources of research funding in the period of the second review.
Empirical work to date on the Freudian concept of projection is assessed. Previous reviews are considered and recent work integrated as well as material from several disciplines. This is an area with a substantial but convoluted research literature from which elements are distilled which seem essential for progress in the clarification of Projection, particularly with reference to its defensive qualities and its targeting. Of the many forms of projection that have been included in previous literature, two, Classical and Attributive (Holmes, 1868), are isolated as relevant to this paper. A “checklist” of pertinent factors for future designs is drawn up which integrates the strongest strands from work done under the rubric Social Psychology. It is concluded that despite the tenacity of the projection concept, work so far has provided a series of methodological caveats and much suggestive, but little conclusive data.
It is difficult to get a clear picture of the relative influence of management journals because previous studies have focused on a single sub-area in the field over a relatively restricted number of years, and/or have used inconsistent criteria to judge journal influence. Therefore, the purpose of this study is to examine journal influence using citations from 28 journals over the past two decades. The findings show that the top seven journals accounted for 61 percent of all of the citations in the journals included, and that the three journals that showed the greatest increase in influence over the past 20 years were AMJ, AMR, and SMJ. Copyright © 2005 John Wiley & Sons, Ltd.
This article provides an overview of past research on training employees for computer-mediated work. The article develops theory and propositions concerning the relationships between (a) individual factors, (b) task and person-computer interface, (c) characteristics of training design for the acquisition of computer skills and (d) the learning outcomes, namely the computer skills acquired by the employee. The review of existing research indicates that most studies are based on a narrow disciplinary and methodological focus, thereby ignoring important intervening variables that might help explain learning outcomes. Within the framework presented in this paper several otherfundamental concerns regarding existing research are identified and discussed and propositions forfurther empirical investigations are outlined. This article concludes with projections for the future based on past research and the present research climate.
This paper summarizes and integrates research concerned with a long-neglected topic in psychology: the relationship between conscious goals and intentions and task performance. The basic promise of this research is that an individual's conscious ideas regulate his actions. Studies are cited demonstrating that: (1) hard goals produce a higher level of performance (output) than easy goals; (2) specific hard goals produce a higher level of output than a goal of “do your best”; and (3) behavioral intentions regulate choice behavior. The theory also views goals and intentions as mediators of the effects of incentives on task performance. Evidence is presented supporting the view that monetary incentives, time limits, and knowledge of results do not affect performance level independently of the individual's goals and intentions. A theoretical analysis supports the same view with respect to three other incentives: participation, competition, and praise and reproof. Finally, behavioral intentions were found to mediate the effects of money and “verbal reinforcement” on choice behavior. It is concluded that any adequate theory of task motivation must take account of the individual's conscious goals and intentions. The applied implications of the theory are discussed.
Since the publication of the Bass model in 1969, research on the modeling of the diffusion of innovations has resulted in a body of literature consisting of several dozen articles, books, and assorted other publications. Attempts have been made to reexamine the structural and conceptual assumptions and estimation issues underlying the diffusion models of new product acceptance. The authors evaluate these developments for the past two decades. They conclude with a research agenda to make diffusion models theoretically more sound and practically more effective and realistic.
Purpose
The purpose of this paper is to see whether it is possible to reliably detect, prospectively, superior intellectual contributions to marketing's literature.
Design/methodology/approach
Citation data accessed on the Institute of Scientific Information Web of Science were used to examine the impact of award‐winning marketing articles with those of lead articles and non‐lead articles in the same journal issues.
Findings
Award‐winners gathered more citations than those for the two comparison groups. It is shown, however, that this finding should not be taken for granted. The peer review system frequently fails to identify high quality, innovative research.
Research limitations/implications
The paper only considers US marketing journals.
Originality/value
This is the only in‐depth study of the impact of award‐winning research in the marketing community.
An explanation of the effects of leader behavior on subordinate satisfaction, motivation, and performance is presented. The explanation is derived from a path-goal theory of motivation. Dimensions of leader behavior such as leader initiating structure, consideration, authoritarianism, hierarchical influence, and closeness of supervision are analyzed in terms of path-goal variables such as valence and instrumentality. The theory specifies some of the situational moderators on which the effects of specific leader behaviors are contingent. A set of general propositions are advanced which integrate and explain earlier fragmentary research findings. Several specific predictions are made to illustrate how the general propositions can be operationalized. The usefulness of the theory is demonstrated by showing how several seemingly unrelated prior research findings could have been deduced from its general propositions and by applying it to reconcile what appear to be contradictory findings from prior studies. Results of two empirical studies are reported that provide support for seven of eight hypotheses derived directly from the general propositions of the theory. A third study designed to test three of the original eight hypotheses is also reported. Two of these three hypotheses are successfully replicated. In the light of these results and the integrative power of the theory, it is argued that the theory shows promise and should be further tested with experimental as well as correlational methods.
The authors content analyzed 196 meta-analyses including 5,581 effect-size estimates published in Academy to assess the presumed effects of each of 21 methodological choices and judgment calls on substantive conclusions. Results indicate that, overall, the various meta-analytic methodologi-cal choices available and judgment calls involved in the conduct of a meta-analysis have little impact on the resulting magnitude of the meta-analytically derived effect sizes. Thus, the present study, based on actual meta-analyses, casts doubt on previous warnings, primarily based on selective case studies, that judgment calls have an important impact on substantive conclusions. The authors also tested the fit of a multivariate model that includes relationships among 5 Acknowledgments: We thank Winfred Arthur Jr. (Texas A&M University) and Frank L. Schmidt (University of Iowa) for constructive comments on a previous draft. A previous version of this article was presented at the annual meetings of the Academy of Management in Chicago, Illinois, August 2009.
This paper documents that salient features of (time series of annual) citations to scientific publications might be captured by a Bass type diffusion model. This is particularly useful as it allows for a comparison of these features across journals, across disciplines and over time. For the illustrative case of Econometrica 1987, it is found that the peak in citations occurs at 6.5 years, on average. Also, it is found that after 14 years there is only a little gap between cumulative citations and the estimated total cumulative amount, suggesting that on average the impact of these articles lasts for about 15 years or so. Finally, it appears that these features can partly be explained by the size of the articles, as it is found that longer papers get more citations and peak later.
Citation analysis indicates that theJournal of Marketing and theJournal of Marketing Research contribute primarily to marketing and other business areas as opposed to nonbusiness social sciences. The journals are also heavily cited by practitioner-oriented publications. A list of most cited articles is provided.
The present study investigated the findings of prior research studies on the accuracy of predictions in bankruptcy studies. While studies have reported conflicting ratings of prediction accuracy, they have also conjectured varying explanations for the variations in predictive ability. Through the use of meta-analysis, it was found that the various results did significantly vary. A source for this variation, the setting of priors, was identified.
In this paper first results are presented of a study on the correlation between bibliometric indicators and the outcomes of peer judgements made by expert committees of physics in the Netherlands. As a first step to study these outcomes in more detail, we focus on the results of an evaluation of 56 research programmes in condensed matter physics in the Netherlands, a subfield which accounts for roughly one third of the total of Dutch physics. This set of research programmes is represented by a volume of more than 5000 publications and nearly 50,000 citations. The study shows varying correlations between different bibliometric indicators and the outcomes of a peer evaluation procedure. Also a breakdown of correlations to the level of different peer review criteria has been made. We found that the peer review criterium `team' shows generally the strongest correlation with bibliometric indicators. Correlations prove to be higher for groups which are involved in basic science than for groups which are more application oriented.
Data from samples of biochemists and sociologists show that nearly all are familiar with citation indexes and that the two groups are equally likely to have used a citation index for bibliographic purposes. We develop three hypotheses from social comparison theory to account for variation in use and evaluation of citation counts as indicators of scientific achievement: (1) more highly cited scientists will more often use and more highly evaluate citation counts as indicators of scientific achievement than will less cited scientists, (2) these relationships will be stronger for sociologists than for biochemists, and (3) sociologists as a whole will more often use and more highly evaluate citation counts than biochemists. Finally, among sociologists, we hypothesize that those primarily interested in quantitative research areas will use and favor citation counts more than those with primarily qualitative or theoretical interests. Our data support all but one of these hypotheses. We also report unexpected differences in use and evaluation of citation counts by sex and departmental prestige.
As the costs of certain types of scientific research have escalated and as growth rates in overall national science budgets have declined, so the need for an explicit science policy has grown more urgent. In order to establish priorities between research groups competing for scarce funds, one of the most important pieces of information needed by science policy-makers is an assessment of those groups' recent scientific performance. This paper suggests a method for evaluating that performance.After reviewing the literature on scientific assessment, we argue that, while there are no simple measures of the contributions to scientific knowledge made by scientists, there are a number of ‘partial indicators’ — that is, variables determined partly by the magnitude of the particular contributions, and partly by ‘other factors’. If the partial indicators are to yield reliable results, then the influence of these ‘other factors’ must be minimised. This is the aim of the method of ‘converging partial indicators’ proposed in this paper. We argue that the method overcomes many of the problems encountered in previous work on scientific assessment by incorporating the following elements: (1) the indicators are applied to research groups rather than individual scientists; (2) the indicators based on citations are seen as reflecting the impact, rather than the quality or importance, of the research work; (3) a range of indicators are employed, each of which focusses on different aspects of a group's performance; (4) the indicators are applied to matched groups, comparing ‘like’ with ‘like’ as far as possible; (5) because of the imperfect or partial nature of the indicators, only in those cases where they yield convergent results can it be assumed that the influence of the ‘other factors’ has been kept relatively small (i.e. the matching of the groups has been largely successful), and that the indicators therefore provide a reasonably reliable estimate of the contribution to scientific progress made by different research groups.In an empirical study of four radio astronomy observatories, the method of converging partial indicators is tested, and several of the indicators (publications per researcher, citations per paper, numbers of highly cited papers, and peer evaluation) are found to give fairly consistent results. The results are of relevance to two questions: (a) can basic research be assessed? (b) more specifically, can significant differences in the research performance of radio astronomy centres be identified? We would maintain that the evidence presented in this paper is sufficient to justify a positive answer to both these questions, and hence to show that the method of converging partial indicators can yield information useful to science policy-makers.
Considerable progress has been made in identifying market-driven businesses, understanding what they do, and measuring the bottom-line consequences of their orientation to their markets. The next challenge is to understand how this organizational orientation can be achieved and sustained. The emerging capabilities approach to strategic management, when coupled with total quality management, offers a rich array of ways to design change programs that will enhance a market orientation. The most distinctive features of market-driven organizations are their mastery of the market sensing and customer linking capabilities. A comprehensive change program aimed at enhancing these capabilities includes: (1) the diagnosis of current capabilities, (2) anticipation of future needs for capabilities, (3) bottom-up redesign of underlying processes, (4) top-down direction and commitment, (5) creative use of information technology, and (6) continuous monitoring of progress.
Evaluating scientific quality is a notoriously difficult problem which has no standard solution. Ideally, published scientific results should be scrutinised by true experts in the field and given scores for quality and quantity according to established rules. In practice, however, what is called peer review is usually performed by committees with general competence rather than with the specialist's insight that is needed to assess primary research data. Committees tend, therefore, to resort to secondary criteria like crude publication counts, journal prestige, the reputation of authors and institutions, and estimated importance and relevance of the research field,1 making peer review as much of a lottery as of a rational process.2 3
On this background, it is hardly surprising that alternative methods for evaluating research are being sought, such as citation rates and journal impact factors, which seem to be quantitative and objective indicators directly related to published science. The citation data are obtained from a database produced by the Institute for Scientific Information (ISI) in Philadelphia, which continuously records scientific citations as represented by the reference lists of articles from a large number of the world's scientific journals. The references are rearranged in the database to show how many times each publication has been cited within a certain period, and by whom, and the results are published as the Science Citation Index (SCI) . On the basis of the Science Citation Index and authors' publication lists, the annual citation rate of papers by a scientific author or research group can thus be calculated. Similarly, the citation rate of a scientific journal—known as the journal impact factor—can be calculated as the mean citation rate of all the articles contained in the journal.4 Journal impact factors, which are published annually in SCI Journal Citation Reports , are widely regarded as …
Empirical Studies of Projection: A
- Lewis
Lewis et al. (1994) Empirical Studies of Projection: A Critical
Review
HR Review
.21
1.56
Dangers in the use of citation analysis
- D L Croom
- DL Croom