The Analytic Hierarchy Process, Planning, Piority Setting, Resource Allocation
... The survey consisted of two sections. The first section included introductory information about the research objective, a brief definition of biophilic urbanism, and the assumed benefits of its application in For the first question, a set of possible BUIs were presented, and the policymakers were asked to assess them using a pairwise comparison technique (Saaty, 1980). Table 16 shows the BUIs that were assessed in our survey. ...
... Biophilic conditions and infrastructure (group 1) Areas of pedestrian preference Green belts and greenways Green infrastructure in private spaces (green roofs, vertical gardens) Green public infrastructure (parks, squares) Restoration of natural spaces Biophilic activities (group 2) Community activities (gardens, farms, associations) Incorporation of biophilic activities in schools and programs Volunteer program for nature restoration Biophilic institutions and governance (group 3) Incorporation of biophilic design in public buildings Programs, Strategies, and Plans to increase the surface and green elements Promotion and incorporation of biophilic design in private buildings by Local Ordinance Subsidies for greening, green densification bonuses Using the nine-point Saaty (1980) scale of relative importance assessment, each BUI was valued in terms of the policymakers' preference by comparing pairs inside BUIs groups, as depicted in Table 18. ...
... where n is the size of the decision matrix, and λ is the highest eigenvalue of decision matrix A. Finally, the Random Consistency Index (RI) is determined depending on the decision matrix's size (n). Table 20 shows the RI values (Saaty, 1980 A total of 144 matrices were obtained. Four matrices were created based on the responses to each survey: ...
... Therefore, it is preferable to focus the efforts on finding a renowned group of experts and get them involved in the process. Similarly, [20] reports that for problems with biased or non-quantifiable data, the utility-ratio functions are more efficient for prioritization purposes. ...
... Several authors introduce the use of MCDA techniques for Environmental Assessment. Many of them focus on the use of the Analytic Hierarchy Process [20] which has been accepted as a leading multi-criteria decision model [26], [16], [11] to assign priorities to the criteria or indicators involved. Others introduce the use of outranking techniques such as Electre [27] and Promethee [28] in order to avoid the compensation problem of the traditional methods [29], [30], [1]. ...
... Details on the Analytic Network Process (ANP) can be found in Saaty (1996), however, the main steps are summarized here for completeness. ...
In this paper a new approach to prioritize urban planning projects in an efficient and reliable way is presented. It is based on environmental pressure indices and multicriteria decision methods.
... The most widely-used technique involving pairwise comparison judgements is the Analytic Hierarchy Process (AHP) (Saaty, 1980) where DMs structure their criteria into a hierarchy and then evaluate alternatives with respect to each of these criteria. Price, Speed and Looks (therefore, providing three sets of pairwise comparison judgements). ...
... These pairwise comparison judgements are then used to elicit preference vectors with the help of some elicitation technique. Although there are many techniques for elicitation, the most widely used techniques are Right Eigenvector (REV) (Saaty, 1980) and Row Geometric Mean (RGM) (Crawford, 1987). These elicited vectors are then used to construct a decision table as shown at the bottom right of this figure ( Fig. 2). ...
... Let us show how our approach works in practice by using the classic example of school selection proposed in Saaty (1980). The parents have to decide the high school for their son. ...
Inconsistency in pairwise comparison judgements is often perceived as an unwanted phenomenon and researchers have proposed a number of techniques to either reduce it or to correct it. We take a viewpoint that this inconsistency unleashes different mindsets of the decision maker(s) that should be taken into account when generating recommendations as decision support. With this aim we consider the spanning trees analysis which is a recently emerging idea for use with the pairwise comparison approach that represents the plurality of mindsets (in terms of a plurality of vectors corresponding to different spanning trees). Until now, the multiplicity of the vectors supplied by the spanning trees approach have been amalgamated into a single preference vector, losing the information about the plurality of mindsets. To preserve this information, we propose a novel methodology taking an approach similar to Stochastic Multi-criteria Acceptability Analysis. Considering all the rankings of alternatives corresponding to the different mindsets, our methodology gives the probability that an alternative attains a given ranking position as well as the probability that an alternative is preferred to another one. Since the exponential number of spanning trees makes their enumeration prohibitive, we propose computing approximate probabilities using statistical sampling of the spanning trees. Our approach is also appealing because it can be applied also to incomplete sets of pairwise comparisons. We demonstrate its usefulness with a didactic example as well as with an application to a real-life case of selecting a Telecom backbone infrastructure for rural areas.
... Some techniques establish a ranking of criteria, others identify the best alternative, and others differentiate between acceptable and unacceptable alternatives (Linkov and Ramadan, 2004;Vaidya and Kumar, 2006). Specifically, we addressed the problem by applying the analytic hierarchy process (AHP) tool for decision making, proposed by Saaty for the first time in 1980 but continually updated (Saaty, 1980(Saaty, , 2013(Saaty, , 2016. One of the concrete advantages of the method is that it allows a criteria prioritisation, even for subjective criteria. ...
... Each one of the experts has worked with corresponding questionnaires in his/her specialized area. The results of the questionnaires constituted matrices of comparison by means of the scale of Saaty (1980Saaty ( , 2013Saaty ( , 2016. As functions of the preference of an element shown in a row of the matrix relative to that shown in a column, numeric values are given to the corresponding elements of the matrix: ...
... The global normalized weights (W G ) for each of the 88 criteria of the third level were calculated as where w i is the local normalized weight of the criterion of the first level or main area, w j is the normalized weight of the criterion of the second level and w k is the normalized weight of the criterion of third level. The local normalized weights w i , w j and w k were calculated according to the AHP method described by Saaty (1980Saaty ( , 2013Saaty ( , 2016. As a starting point, the experts considered that the five main areas had equal importance, so that all of the criteria of the first level had a local normalized weight (w i ) of 0.2. ...
Adopting a strategic approach to risk management can maximize competitiveness and profitability. Total Safety and Productivity approaches offer managers a set of methods and tools to apply a Total Safety Management (TSM) philosophy to achieve this. The capability to anticipate, assess and plan for risks associated with future operations is a critical success factor, for enterprises of all types and sizes. The ability to risk assess actual operations with an easy to apply, resilient methodology can offer significant benefits in terms of the capacity to improve safety and performance.
This book describes approaches that can be used alone or jointly to improve safety management in any organization. The methods are based on academic best practice and have been developed by leading experts, but are presented here in a practical way for application in industry by non-experts. The book outlines a professional approach to risk and safety management, which requires goal setting, planning and the measurement of performance, and encourages a safety management system that is woven holistically into the fabric of an organization so that it becomes part of the culture, the way people do their jobs, and helps ensure that issues are correctly prioritized and managed as they emerge.
This book is essential reading for professionals, at both expert and non-expert level, who are interested in applying the TSM philosophy within their organization.
... Para realização do estudo é utilizado o método AHP. De acordo com Saaty (1980), o AHP consiste em três princípios que incluem: a estruturação hierárquica, a análise de prioridades e a verificação da consistência dos resultados. Este processo é composto de três etapas. ...
... Após o preenchimento das matrizes, os especialistas encaminhavam as matrizes respondidas para o cálculo do grau de importância de cada critério. Este cálculo foi realizado de acordo com o método AHP proposto por Saaty (1980). Para a aplicação do AHP no contexto de uma decisão em grupo, em que os indivíduos atuam separadamente, como ocorre nesse estudo, é necessária a utilização da média geométrica dos elementos (COSTA; BELDERRAIN, 2009). ...
Os Resíduos de Construção Civil (RCC) representam a maior parte dos resíduos produzidos pelos municípios brasileiros. Por esta razão, é necessária a criação de ferramentas que busquem monitorar e avaliar a Gestão de Resíduos de Construção Civil (GRCC). Os indicadores de sustentabilidade são ferramentas capazes de auxiliar os gestores a garantirem a eficácia da gestão. O objetivo deste trabalho é listar e identificar os indicadores mais relevantes para a GRCC municipal. Para tanto, foi utilizado o método AHP de análise multicritério e consultado um grupo de 17 especialistas. Os indicadores foram agrupados em: Grupo Operacional, Grupo Ambiental, Grupo Político-econômico, Grupo Educacional e Grupo Social. Em cada grupo, estão reunidos indicadores que avaliam aspectos da gestão considerados pela Política Nacional de Resíduos Sólidos. Os resultados mostram que os especialistas consideram os indicadores do Grupo Político-econômico os mais
relevantes para avaliar a GRCC.
... AHP proves to be a practical approach for assessing the models with complex interdependent factors and provides a rigorous basis for addressing the problems involving both quantitative and qualitative factors [17] . AHP is a simple yet powerful tool that was first developed within the management science field over 20 years ago [18] . The relative weights of the KSFs obtained in the second phase are used as inputs for the third phase. ...
... After the pair-wise comparison process is completed, and an initial decision matrix is achieved, the initial matrix is normalized. As shown in Figure 3, in this study, overall CR is 0.07, which fell within the acceptable level of 0.10, as recommended by Saaty [18] . This shows that the survey respondents have assigned their weights consistently after examining the priorities of success factors of commercialization for new technology products As shown in Table 2, the criterion group of technology has the highest rank, weighing 53,9%. ...
... The AHP approach treats the problem of decision making as a hierarchy of elements important for decision making [7,8,9]. At the top is the goal, the criteria are at the next level, and alternatives at the bottom level. ...
... The goal of the developed model is to increase revenues that could be directed to the sustainable development of transport in the Republic of Srpska. The comparison of criteria, i.e. the definition of their relative importance, was performed on the basis of the fundamental Saaty scale [9], with grades ranging from 1 to 9 (Table 1). 1,00 ...
Transport system has multiple interactions and multidimensional effects on the environment, by way of, amongst other, land acquisition and urban pollution; on economic development with regard to the GDP growth; as well as on social equity in terms of access, quality of life and health of population. This paper considers the possibility of introducing toll collection in the Republic of Srpska. The goal of the developed model is to increase revenue, which could be directed to the sustainable development of transport in the Republic of Srpska. The selection of a toll collection system has been made taking account of: economic, traffic, technical, organizational and exploitation criteria. Multiple-criteria approach has been applied together with the Analytic Hierarchy Process.
... The analytic hierarchy process-based multicriteria decision analysis (MCDA-AHP) [29] is often applied for the comparison of energy scenarios or alternatives, as reported by several international studies [30][31][32][33][34][35][36]21]. In our previous work, we have also used MCDA-AHP for similar problems [11,37,38]. ...
... The analytic hierarchy process-based multicriteria decision analysis (MCDA-AHP) [29] is often applied for the comparison of energy scenarios or alternatives, as reported by several international studies [21,[30][31][32][33][34][35][36]. In our previous work, we have also used MCDA-AHP for similar problems [11,37,38]. ...
Decision support techniques have a key role in investment and strategic decisions in the energy sector. As complex decision-making problems involve the simultaneous consideration of an extensive set of different factors, it is an essential part of the methodology to define, structure, and integrate the criteria. The main purpose of the study was to develop a system of criteria and weights that are suitable for general application in the energy sector and can best describe the decision-making mechanisms present in society and various social groups. When developing the system of criteria, we moved away from the hierarchical approach related to the three pillars of sustainability; therefore, a wide range of notions were assessed based on a population representative survey data collected in Hungary. We used algebraic methods to explore the internal structure of the set of criteria that had been previously defined by means of social sciences, while the importance weights were specified by applying the method of analytic network process. Furthermore, the ranking of heating and electricity generation alternatives were determined.
... Briefly, it entails a function in a certain number of decision variables, which are combined with some decision criteria and hence constitute of formal algebraic expression. Unfortunately these models may be applied in presence of simple cases, under restrictive simplifying hypotheses that greatly reduce their applicability AHP (Saaty, 1980) embodies a powerful and flexible multi-criteria decision-making tool for complex problems where both quantitative and qualitative aspects need to be considered. This represents, indeed, the most important characteristic and the benefit of such a tool. ...
... Used if more precision is needed Evaluate the correctness and the consistency of the given paid wise comparisons, by means of an inconsistency ratio (IR) [24]. The judgments can be considered acceptable if any only if IR # 0.1. ...
... 3) Determination of the relevancies of the assessment criteria for municipal residential buildings (AHP, Analytic Hierarchy Process) by using pairwise comparison matrices completed by experts [11]. This method was chosen because the relevancy of the criterion revealed the expert's/specialist's opinion on the importance of the criterion when selecting the best alternative from the list of available options. ...
... Only the questionnaires that have been completed correctly by each group assessed 11 13 10 Verification of the coordination of expert opinion and calculation of the mean of the relevance value of criteria chosen by the expert groups Development of the system of assessment criteria for residential buildings based on the calculated relevancies 11 municipal buildings (total -106 requirements), pairwise comparison method has been used to select and rank ten each group requirements: 1) compliance with regulatory documentation; 2) requirements on municipal functions; 3) public administration requirements. An expert assessment has revealed that the most relevant indicator pointing to the legal compliance of municipal housing is meeting the essential requirements applicable to buildings and low heating costs, while the decision-making is least affected by the access to buildings and the number of parking places. ...
... In addition to the techniques mentioned above, the AHP and the Analytic Network Process (ANP) represented very promising approaches of the MCDA method, where the aggregation of the selected criteria is based on a social science survey. The ability to address and involve society in decision making made the AHP and ANP methods prevalent in the energy sector, too [9,[16][17][18]. However, their application raised new problems, similar to all newly introduced tools. ...
Energy strategies and decision-making studies rely heavily on a system of criteria and their weights of importance, typically determined through stakeholder involvement or surveys. However, the methodology presented in this study considers a reverse approach, as the importance weights are computed based on historical data of each European country’s prevailing decisions on pre-defined aspects. An in-house-developed model was applied to analyze data from the ENTSO-E database for the determination of optimal criteria weights with combination of a linear programming task and Monte Carlo simulations. Applying the new model, the importance weights of seven selected criteria could be calculated for all European countries. The Eastern European region demonstrated exceptional sensitivity towards investment costs, while countries relying heavily on renewable or nuclear energy sources, such as Denmark, Greece, Norway, Slovenia, Spain, and the United Kingdom, exhibited a dominant influence of environmental factors. Moreover, it was observed that the flexibility criterion aligned well with the installed generation capacities. However, the geopolitical factor and the risk of accidents criteria introduced nuances to the overall rating, indicating a somewhat reduced dependence on production data.
... We will focus in the following on the AHP method (Analytic Hierarchy Process) developed in 1980 by Saaty (1980). AHP is recommended to solve complex problems with a multi-criteria decision. ...
... The second step is the analytical hierarchy process (AHP), where the basic idea is to build a judgment matrix from the scalar values obtained by comparing the importance between two adjacent indicators in the sequence, so as to obtain the weights of each evaluation indicator of AHP. This paper uses a 1-9 scale to construct the judgment matrix of each layer [53]. ...
Understanding the causes of poverty and identifying the transformation characteristics of poverty is the basis for achieving poverty eradication. In order to clarify the availability of construction land for poverty assessment, this paper explores the spatio-temporal synergy between urban built-up areas and poverty transformation in Tibet. The following conclusions are drawn: (1) the built-up areas in Tibetan counties have been growing from 2013 to 2019; (2) the proportion of counties with very low and low levels of relative poverty have decreased significantly, and the overall spatial characteristics of poverty are “high in the center and low in the surroundings”; (3) the overall coupling-coordination level between the built-up areas and the relative poverty level is gradually improving from the initial antagonism, and the relative-poverty index shows a significant negative correlation with coupling coordination (correlation coefficient of −0.63); and (4) the built-up area has a strong explanatory power for the spatial distribution of regional relative-poverty transfer compared to temperature, precipitation, elevation, and slope. The results of the study prove that the built-up area cannot be directly used as an indicator factor when constructing the multidimensional relative-poverty model and, instead, should use urban built-up areas by region to participate in poverty-estimation models based on regional economic development.
... where is the consistency ratio (CR is utilized to specify the value of likelihood), is the consistency index (CI relies on the order of the matrix specified by Saaty [70]), and is the random index (random inconsistency) ( Table 3). CI is measured with the following equation (Equation (7)): ...
Forest fires are among the most major causes of global ecosystem degradation. The integration of spatial information from various sources using statistical analyses in the GIS environment is an original tool in managing the spread of forest fires, which is one of the most significant natural hazards in the western region of Syria. Moreover, the western region of Syria is characterized by a significant lack of data to assess forest fire susceptibility as one of the most significant consequences of the current war. This study aimed to conduct a performance comparison of frequency ratio (FR) and analytic hierarchy process (AHP) techniques in delineating the spatial distribution of forest fire susceptibility in the Al-Draikich region, located in the western region of Syria. An inventory map of historical forest fire events was produced by spatially digitizing 32 fire incidents during the summers of 2019, 2020, and 2021. The forest fire events were divided into a training dataset with 70% (22 events) and a test dataset with 30% (10 events). Subsequently, FR and AHP techniques were used to associate the training data set with the 13 driving factors: slope, aspect, curvature, elevation, Normalized Difference Vegetation Index (NDVI), Normalized Difference Moisture Index (NDMI), Topographic Wetness Index (TWI), rainfall, temperature, wind speed, TWI, and distance to settlements, rivers and roads. The accuracy of the maps resulting from the modeling process was checked using the validation dataset and receiver operating characteristics (ROC) curves with the area under the curve (AUC). The FR method with AUC = 0.864 achieved the highest value compared to the AHP method with AUC = 0.838. The outcomes of this assessment provide constructive spatial insights for adopting forest management strategies in the study area, especially in light of the consequences of the current war.
... When choosing and buying dairy products, a complex decision is made between the consumer and the product. The complexity of the decision-making process at the time of purchase reflects the importance of each milk package to consumers (Saaty, 1980). Then, Visual criteria in this study are the font style, product form, image and background color, and the purpose of the performance criteria is easy portability and product recyclability. ...
... When choosing and buying dairy products, a complex decision is made between the consumer and the product. The complexity of the decision-making process at the time of purchase reflects the importance of each milk package to consumers (Saaty, 1980). Then, Visual criteria in this study are the font style, product form, image and background color, and the purpose of the performance criteria is easy portability and product recyclability. ...
Manuscript type: Research paper
Research Aims: This study seeks to investigate the effect of visual and functional criteria on
packaging and consumer expectations towards the packaging elements of dairy products for
children.
Design/methodology/approach: For this purpose a sample containing 334 children between
7- 12 years were used. Sampling method was random sampling and measuring tool was questionnaire.
In order to data analysis and hypothesis testing, structured equations test by means
of “Lisrel software” was used and the research results show that recyclability of product, easy
to carry, packaging (product) form and illustrations on packaging variables haven’t positive
and significant effect on consumer’s expectations toward packaging elements of product.
Research Findings: On the other hand packaging (background) color and font style variables
have positive and significant effect on consumer’s expectations toward packaging elements of
product. Thus, according to the results visual criteria have more effective role on packaging
than functional criteria.
Theoretical Contribution/Originality: As the general rule of all affecting factors in stimulating
Visual and Functional Criteria of Packaging of customers, this is a rare study which investigates
and provides insights to clarify the exact role of the factors in the field.
Practitioner/Policy Implication: Scrutinizing the motivators of Visual and Functional Criteria
of Packaging and their interrelationships would help professionals as well as scholars to
understand its determinants, which will lead to more insightful decisions. Further, this understanding
may be useful in shaping marketing policies and strategies for Iranian and the other
firms al around the world.
Research limitation/Implications: Lack of cooperation of some respondents; As well as the
limited results to the respondents’ perceptions of the questionnaire questions.
... Some techniques used to rank the requirements and to choose the most appropriate CA for an information system include the cost-value approach (CVA) [Karlsson and Ryan 1997], the analytic hierarchy process (AHP), numerical assignment, the 100-dollar test, the top-ten requirements, binary search tree, and bubble sort [van Lamsweerde 2009, Karlsson et al. 1998]. Among these techniques, AHP assists in complex decision-making, and it has been developed to analyze variables that are difficult to compare [Saaty 1980]. While AHP provides a hierarchical classification of requirements (e.g., ranking the cost in descending order), CVA implements a two-dimension approach to display the requirements' value against their cost and value [Karlsson and Ryan 1997]. ...
Software engineers make use of several computational architectures (CA) to host an application, such as desktop, web, and cloud computing architectures. As the requirements vary according to the desired CA, developers may face two problems: determining which requirement better fulfills a CA and determining which CA fulfills a given set of requirements. This paper presents a new approach based on the Cost-Value Approach (CVA). We have slightly modified the CVA method (SCVA method) and also developed a new method for choosing the most appropriate CA (MMACA method). Our results provide a set of requirements ordered by priority for each CA. Finally, we discuss the current and most appropriate CA for a real project solution.
... Analytic Hierarchy Process (AHP) is a better method to determine the weight. It is a multi-objective and multi-criteria decision-making method that divides the factors in a complex problem into interrelated and ordered levels; it is an effective method combining quantitative analysis with qualitative analysis [1]. In this paper, the researcher constructs the model in strict accordance with the procedure prescribed by AHP, and follows the scientific, systematic and operability principles of index selection. ...
In order to develop rural eco-tourism better, it is very important to establish a suitable evaluation index system of tourism resources. This study constructs an evaluation indicator system of rural ecotourism resources in Shanghai from three aspects: Resource values, ecological environment and development conditions, which includes 18 indexes. Using AHP to determine the weight, in the comprehensive level of evaluation, Resource values (B1)> Ecological environment(B2) > Development conditions(B3). Among the most important indicators are: Recreational value (C1), Pollution control capability (C8), Farming experience value (C7), Environmental hygiene (C9), Convenience of transportation (C14), Ecological value (C4) and Life experience value (C6). By using this evaluation model to grade the rural ecotourism resources in Shanghai through questionnaire survey, the result is that the rural ecotourism resources in Shanghai are quite good. With the development of the construction of the Beautiful Country, the value of rural eco-tourism resources in Shanghai has been continuously explored and the eco-environmental quality is assessed higher, which provides an important guarantee for the development of rural eco-tourism in Shanghai. In addition, cultural values and health value need to be tapped in depth, and efforts should be made to increase the publicity and communication among local residents in rural tourist destinations. While optimizing the construction of tourism facilities, we must constantly improve the level of service management, so as to improve the service quality of rural ecotourism.
... Pairwise comparisons are a vital part of the prioritisation procedure in the Analytic Hierarchy Process (AHP), which provides a comprehensive and rational framework for structuring a decision problem (Saaty, 1980). In the AHP, the pairwise judgements are structured in pairwise comparison matrices (PCM), and some prioritisation procedures are applied to derive a corresponding priority vector. ...
... On the demand side, we consider QoS as a single normalized parameter that is a function aggregating various parameters such as download speeds, upload speeds, data limits, performance at peak hours and latency. A single value of QoS representing an aggregate of many different metrics is also seen in auction theory [34] and domains such as cloud computing [35,36], and can be achieved using the analytic hierarchy process [37]. ...
The telecommunications industry has evolved from voice-centric to provisioning of broadband data services. As witnessed in countries around the world, the industry has an oligopoly market structure with a few operators providing services. The services offered by the operators differ in both price and quality of service. On the other hand, consumers differ in their preferences over price and quality, with some displaying sensitivity towards price and others towards quality. In this paper, we provide the standard microeconomic framework of supply and demand for telecom services and derive equilibria under varying supply and demand conditions. In particular, we analyze the strategies of new entrants vis-à-vis incumbents in offering service plans over varying price and quality dimensions. We also analyze the equilibria for varying elasticities of demand of consumers. We then validate the analytical results by simulation using an agent based model with operator and consumer agents. Our results show that new entrants ought to target relatively elastic consumers as their market entry strategy, by offering a combination of low price, high-quality service plans to gain market share. On the other hand, incumbent operators ought to continue to target relatively inelastic consumers who have loyalty towards them due to larger network effects and associated higher switching costs. Our simulation results also confirm the analytical results. Telecom regulators can use the study results in assessing and regulating (i) market power dynamics of incumbents and new entrants; (ii) tariff plans offered by operators for possible predatory pricing; and (iii) quality of service to meet threshold minimum quality of standard levels.
... The analytical hierarchical process (AHP) [108] is a widely used method for decision support in which the decision maker provides pairwise information about the intensity of the different criteria, which are mapped to a numerical scale, determining an evaluation matrix. A weighting vector is then computed from the principal eigenvector of the matrix. ...
Preference elicitation is an important component in many AI applications, including decision support and recommender systems. Such systems must assess user preferences, based on interactions with their users, and make recommendations using (possibly incomplete and imprecise) beliefs about those preferences. Mechanisms for explicit preference elicitation—asking users to answer direct queries about their preferences—can be of great value; but due to the cognitive and time cost imposed on users, it is important to minimize the number of queries by asking those that have high (expected) value of information.
An alternative approach is to simply make recommendations and have users provide feedback (e.g., accept a recommendation or critique it in some way) and use this more indirect feedback to gradually improve the quality of the recommendations. Due to inherent uncertainty about a user's true preferences, often a set of recommendations is presented to the user at each stage. Conceptually, a set of recommendations can also be viewed as choice query, in which the user indicates which option is most preferred from that set.
Because of the potential tension between making a good set recommendation and asking an informative choice query, we explore the connection between the two. We consider two different models of preference uncertainty and optimization: (a) a Bayesian framework in which a posterior over user utility functions is maintained, optimal recommendations are assessed using expected utility, and queries are assessed using expected value of information; and (b) a minimax-regret framework in which user utility uncertainty is strict (represented by a polytope), recommendations are made using the minimax-regret robustness criterion, and queries are assessed using worst-case regret reduction. We show that, somewhat surprisingly, in both cases, there is no tradeoff to be made between good recommendations and good queries: we prove that the optimal recommendation set of size k is also an optimal choice query of size k. We also examine the case where user responses to choice queries are error prone (using both constant and mixed multinomial logit noise models) showing the results are robust to this form of noise.
In both frameworks, our theoretical results have practical consequences for the design of interactive recommenders. Our results also allow us to design efficient algorithms to compute optimal query/recommendation sets. We develop several such algorithms (both exact and approximate) for both settings and provide empirical validation of their performance.
... Membuat matriks perbandingan ber-pasangan untuk membandingkan elemenelemen secara berpasangan sesuai dengan kriteria yang diberikan. Perbandingan berpasangan menurut Saaty (1980) bisa diukur menggunakan tabel 1: ...
Pemilihan dosen berprestasi di Universitas Islam Balitar berkaitan dengan adanya pemilihan dosen berprestasi yang diadakan oleh Kopertis Wilayah VII, sehingga universitas akan ikut berpartisipasi untuk mengirim perwakilan dosen ke tingkat Kopertis. Kriteria yang digunakan dalam pemilihan dosen berprestasi adalah kriteria prestasi unggul dan karya tridarma. Subkriteria untuk prestasi unggul adalah penelitian, pendidikan dan pengabdian. Subkriteria untuk karya tridarma adalah penelitian, pendidikan, pengabdian dan penunjang lainnya. Sistem pendukung keputusan pemilihan dosen berprestasi ini menggunakan metode Analytical Hierarchy Process (AHP) yang dilakukan dengan membuat nilai matriks berpasangan untuk masing-masing kriteria. Nilai dari matriks berpasangan hasilnya harus konsisten. Data penilaian dosen akan dihitung dengan nilai matriks berpasangan dan hasil dari perhitungan tersebut akan muncul berbentuk rating nilai. Rating nilai dosen yang tertinggi, berhak untuk menjadi dosen berprestasi di Universitas Islam Balitar.
... It is usually achieved through a weighted sum approach based on a number of alternatives (Ananda & Herath, 2009;Köksalan et al., 2011;Mansourian et al., 2011;Mosadeghi et al., 2015;Ullah & Mansourian, 2015). There are a variety of techniques for weighting the criteria such as Technique for Order of Preference by Similarity to Ideal Solution (TOP-SIS) (Hwang & Yoon, 1981) and the Analytic Hierarchy Process (AHP) (Saaty, 1980). Experts' opinions influence the weighting process very much, which may result in bias in making a decision. ...
Land-use planning, which requires finding a balance among different conflicting social, economic and environment factors, is a complex task needed everywhere, including Africa. One example is the city of Zanzibar in Tanzania, which is under special consideration for land-use revision. From one side, the city has high potentials for tourist industry and at the other side there are major challenges with the city structure and poor accessibilities. In order to prepare a proper land-use plan for the city, a variety of influencing conflicting factors needs to be considered and satisfied. This can be regarded as a common problem in many African cities, which are under development. This paper aims to address the problem by proposing and demonstrating the use of Geographical Information System (GIS) and multi-objective optimization for land-use planning, in Zanzibar as a case study. The measures which have been taken by Zanzibar government to address the development challenges through the Zanzibar Strategy for Growth and Reduction of Poverty (ZSGRP) were identified by studying related documents and interviewing experts. Based on these, two objective functions were developed for land-use planning. Optimum base land-use plans were developed and mapped by optimizing the objective functions using the NSGA-II algorithm. The results show that the proposed approach and outputs can considerably facilitate land-use planning in Zanzibar. Similar approaches are highly recommended for other cities in Africa which are under development.
... The Analytic Hierarchy Process (AHP), introduced by Thomas Saaty, is a structured technique for organizing and analyzing complex decisions, based on mathematics and psychology [16]. It provides a comprehensive and rational framework for structuring a decision problem, for representing and quantifying its elements, for relating those elements to overall goals, and for evaluating alternative solutions. ...
In engineering design, the selection of the optimal design solution represents a critical phase for the development of successful products. In this paper, we present ELIGERE, an open source decision support system targeted at engineering design applications. It allows to rank multiple design solutions with respect to different evaluation criteria according to the evaluations provided by a group of experts. ELIGERE is composed by three main modules: (1) a distributed web application, for generation and participation to the decision making session; (2) a mathematical engine, based on the fuzzy analytical hierarchy process, to quantify the results of the decision making session according to the evaluation of the experts; (3) a relational database, to collect and store data. The most important contribution of this paper is introducing a practical and effective software tool that facilitates decision-making analysis based on the fuzzy analytical hierarchy process, thereby allowing better-informed choices on concept selection, as it has been designed with a specific focus on the engineering field. In this paper we describe the key concepts of ELIGERE and its modalities of use in several real use cases. Finally, we compare ELIGERE with the widely used general purpose decision support software based on the fuzzy analytical hierarchy process.
Rural population in developing nation is having limited access to the clean and modern energy sources. Rural poor in India are mostly dependent on electricity, fire wood, dung, and biomass for their domestic energy need. Due to the dependence on conventional energy sources pollution and rural health are the issue of concern which directly affect on the national productivity. Ministry of New and Renewable Energy of the Government of India giving stress to intensify the energy supply and modern sources of energy to rural area up to normal consumption level through renewable energy sources The aim of the present study is to determine the best renewable energy scenario for sustainable development of rural area. For this aim, author used both quantitative and qualitative analysis technique to determine the best energy scenario for application. For quantitative analysis multi objective goal programming model is used and the result obtained by it validated with multi-attribute decision making approach. The present work specifically focused on Analytic Hierarchy Process (AHP) methodology. In the proposed method, the weights of the selection criteria are determined by pair-wise comparison matrices of the AHP. Results indicate that Cost Employment Generation Scenario (CEGS) is the most appropriate renewable energy option.
All rights reserved. Printed in the United States of America. No part of this publication may be reproduced, distributed, or transmitted, in any form or by any means, or stored in a data base or retrieval system, without the prior written permission of the publisher. The content and reliability of the articles are the responsibility of the authors. When using and borrowing materials reference to the publication is required. Collection of scientific articles published is the scientific and practical publication, which contains scientific articles of students, graduate students, Candidates and Doctors of Sciences, research workers and practitioners from Europe and Ukraine. The articles contain the study, reflecting the processes and changes in the structure of modern science.
The objective of this work is to establish a set of procedures by applying computational tools to find optimal key parameters for the preliminary design of an expendable multistage launch vehicle starting from a specific set of mission requirements. In order to achieve this objective, the decomposition of the problem is made through an evaluation of the main disciplines related to the preliminary design of launch vehicles. Then, through the application of multidisciplinary design optimization methodologies, two solution methods are implemented in this work: the Multiple Subarc Gradient Restoration Algorithm and the Genetic Algorithm. These algorithms solve, respectively, the optimal control problem associated with the flight trajectory and propulsive curve optimization and the optimization problem of solid rocket motors. As an illustration of the method, for the problem proposed, while MSGRA achieved a fast optimization of the trajectory and the thrust profile, GA evaluated a total of 12,000 rocket motor configurations with 1721 Pareto designs achieved. Finally, an extensive analysis is made to the solutions obtained by these algorithms, and a multicriteria decision tool was applied to obtain a feasible two-stage launch vehicle.
Background
It is widely accepted that the simulators are important technological instruments which can be utilized as an effective assessment tool in various domains Developing technologies allow the functionality levels of simulators to increase behavioural realism. For this reason, students in higher educations are involved in various useful practices using simulators.
Purpose
In this respect, simulators can also provide great opportunities to conduct analysis through human error on which this study conceptualized.
Model
In this context, this study proposes a human error evaluation approach through simulator technology whilst taking advantage of the SOHRA (Shipboard Operation Human Reliability Analysis) method. As a case study, the proposed approach was applied to a simulator environment with the involvement of marine engineering students. Throughout this case, the students were challenged with various error producing conditions (EPCs) while their performances were observed.
Results
The attendees were achieved good practice when confronted with EPC23 (unreliable instruments), EPC17 (inadequate checking), and EPC5 (spatial & functional incompatibility). However, the points open for improvement are found on EPC2 (time shortage), EPC24 (absolute judgments required), EPC18 (objectives conflict) and EPC9 (technical unlearning).
Conclusion
This framework can be utilized in simulator-based training activities to increase operational awareness of marine engineering students. The recent developments in simulator technology can boost the effectiveness of the proposed framework.
This research aimed to (1) assess the risk for Benzene ship loading worker, (2) find out the factors be related with the risk level for Benzene ship loading worker and (3) choose the most factor effecting risk level of working with Benzene among ship loading worker by apply Analytical Hierarchy Process (AHP), which the method was demonstrated decision making process. The participants were 111 ship loading worker at tank farm in Rayong were selected by purposive sampling. The data were collected by an interview the worker and fill in the questionnaire. The outcome of this research were found risk level of Benzene ship loading worker was high risk level as 64 percentage, the factors significantly associated with the high risk level were using half mask respirator, using cotton glove, using leather glove, using nitrile glove, using neoprene glove, work experience, duration of benzene exposure, using full face respirator, using Self Contained Breathing Apparatus (SCBA) and work station (p-value<0.05). Only three influenced variables were work experience, duration of benzene exposure and work station effecting to risk level of benzene exposure among ship loading workers (p-value<0.05). The best choice for selecting to make a safety project to reduce the risk of benzene exposure was duration of benzene exposure.
Protected areas are fundamental in conservation, but their intactness is increasingly threatened by the effects of climate and land-cover changes. Here, a methodological procedure is proposed able to determine the representative climatic conditions of a protected area in central Spain (Guadarrama National Park) pinpointing the natural areas that will host future analogous conditions, but also assessing the effects of land-cover changes on the connectivity of these areas. Future conditions provided by two 2050 IPCC climate change scenarios and land-cover change simulations were jointly used for this purpose. According to the results obtained, climate change will produce notable effects, displacing its representative climatic conditions as well as modifying the land cover in the neighbouring localities. Three areas appear as fundamental for the future maintenance of this reserve: two within the Iberian Central System (Gredos Mountains and Ayllón Mountains) and one in the Iberian System (Urbión Mountains). The proposed approach can be implemented in any protected area to examine its capacity to represent in the future the environmental conditions for which it was created.
Cloud computing is a significant paradigm shift in information technology (IT) service offerings that has been receiving enormous attention in academic and IT industry. Recent years has seen exponential growth in cloud use adoption, where many organizations are moving their IT resources into cloud due to flexibility and low-cost. However, on account of rapid innovation and growth in cloud technologies and service providers, selecting the right cloud services, provider and strategy is becoming increasing a common challenge to organization during cloud adoption. In an attempt to address this challenge, we propose application of Delphi Analytic Hierarchy Process (DAHP) method in selecting cloud deployment model. There are several cloud deployment models and organizations must identify the right model that best suits their business needs. The proposed approach facilitates a collaborative decision making process, consisting a number of decision makers whom, with consensus facilitated by the DAHP process, identifies feasible approaches, decision making factors and ultimate selection of a cloud deployment model alternative that is based on organizational business needs and capabilities. The DAHP process is illustrated by a means of a case study. The DAHP result analysis, as was illustrated in the case study, helps in explaining and justifying the choice selected as the best cloud deployment model.
Визначено, що в сучасних умовах актуалізуються питання встановлення балансу між можливістю населення використовувати інформаційні ресурси та водночас збереженням інформаційного суверенітету держави внаслідок впливу зовнішніх чинників. Необхідність гарантування інформаційної безпеки зумовлена насамперед загрозами інформаційній сфері, які можуть негативно впливати на забезпечення національних інтересів і провокувати розвиток інформаційної асиметрії в національному господарстві. Інформаційна безпека держави, з одного боку, характеризується мірою захищеності суспільства та стійкості основних сфер життєдіяльності (державне управління, економіка, наука тощо) стосовно небезпечних (дестабілізуючих) інформаційних впливів, з другого – визначається також здатністю нейтралізувати такі негативні впливи. Важливою складовою забезпечення функціонування інформаційної сфери є ідентифікація ключових факторів, котрі стримують або стимулюють її розвиток. Завдяки узагальненню інформації щодо пріоритетності впливу сукупності виокремлених чинників шляхом застосування методу парних порівнянь здійснено їх ієрархічне впорядкування та побудовано відповідні моделі. З’ясовано, що на функціонування інформаційної сфери насамперед впливають платоспроможність населення (стримуючий фактор) і динаміка змін інформаційних потреб суспільства (стимулюючий фактор). Отримані результати є підґрунтям для вдосконалення державного управління інформаційною сферою в Україні.
Aims
To make the evaluation more scientific, structured and systematic, this study aims to develop an evaluation index system for nurses training and to explore clinical effect of system.
Design
The evaluation index system of nurses’ post‐training was constructed using the Delphi method.
Methods
Introducing the system, we used the pre‐work training of new nurses as an example for discussing the specific implementation scheme of the system. Twenty‐five tertiary and first‐class general hospitals in 14 provinces and municipalities were evaluated on the spot, and the application effect of the system was evaluated comprehensively.
Results
The index system consisted of three first‐grade indexes, seven second‐grade indexes and 23 third‐grade indexes. There were three levels in teaching and training ability, and the distance had statistical significance.
The main purpose of the present study is to compare the results of the integrated models, the weights of evidence (WoE), analytical hierarchical process (AHP) and logistic regression (LR) models combine with a Flow-R model for landslide susceptibility assessment in Ha Giang city, Vietnam and the surrounding areas. First, three landslide susceptibility index (LSI) maps were calculated using thirteen landslide conditioning factor maps. Then, a runout map was generated by Flow-R model using the digital elevation model and the slope map of the study area. Secondly, the success rate curve, prediction rate curve and area under the curves (AUC) were calculated to assess prediction capability. The final landslide susceptibility maps were produced by the integration of the LSI maps with the runout map that was extracted from FlowR model. The validation results showed that the AUC of LSI maps in the integrated models, AHP-FlowR, WoE-FlowR and LR-FlowR, were 82.89%, 88.15% and 86.53% with prediction accuracies of 80.41%, 84.94% and 85.71%, respectively. The combined models of WoE-FlowR (88.15%) and LR-FlowR (86.53%) have shown the highest prediction capability. In general, the integrated models provide reasonable results that may be aided in prevention planning and land use planning purposes.
Conducting flood susceptibility assessments is critical for the identification of flood hazard zones and the mitigation of the detrimental impacts of floods in the future through improved flood management measures. The significance of this study is that we create ensemble methods using the per-pixel approaches of frequency ratio (FR), analytical hierarchical process (AHP), and evidence belief function (EBF) used for weightings with the object-based ‘geons’ approach used for aggregation to create a flood susceptibility map for the East Rapti Basin in Nepal. We selected eight flood conditioning factors considered to be relevant in the study area. The flood inventory data for the East Rapti basin was derived from past flood inventory datasets held in the regional database system by the International Centre for Integrated Mountain Development (ICIMOD). The flood inventory was classified into training and validation datasets based on the widely used split ratio of 70/30. The Receiver Operating Characteristic (ROC) was used to determine the accuracy of the flood susceptibility maps. The AUC results indicated that the combined per-pixel and object-based geon approaches yielded better results than the per-pixel approaches alone. Our results showed that the object-based geon approach creates meaningful regional units that are beneficial for future planning.
The traditional risk evaluation of coal spontaneous combustion in goafs in China is unilateral and inaccurate, which can be attributed to the fact that only the change in coal properties is considered and the external environment of coal is ignored. According to latest research, the factors affecting coal spontaneous combustion in goafs is determined by the systems-theoretic accident model and processes, from which a risk index system is established. Then, a comprehensive risk evaluation model for coal spontaneous combustion in goafs is constructed with the analytic hierarchy process, unascertained measurement theory and combination weighting method, which divides the risk of coal spontaneous combustion into four levels. The model is tested in three goafs in different coal mines. Findings show that the model is objective and valid and can be applied to the risk evaluation of coal spontaneous combustion in goafs in coal mines.
This thesis aims at assessing the performance and efficiency of the English Premier League (EPL) football clubs vis-à-vis ranking and the efficient use of sports resources to validate whether national champions are the best football teams. The study seeks to identify the Football Club(s) that could be regarded as most efficient using a mixed methodological approach combining Data Envelopment Analysis (DEA) with Naturalistic Approach (NA). It investigates the extent to which the current EPL ranking evaluates efficient performance and factors responsible for such outcomes while examining how the current method of assessing teams’ performance could be improved.
The research approach is rooted in both qualitative and quantitative methods to include case study research as suggested by Substance(2010). Data Envelopment Analysis (DEA) is combined with the Naturalistic Approach (NA) using NVivo text analyses from data obtained through a semi-structured questionnaire and mini-interview of football stakeholders to assess the performance and efficiency of EPL football clubs for 12 seasons (2004/05 and 2015/16). Therefore, 240 clubs were observed with a total of 4,560 games jointly produced. The concerns of the nexus of football stakeholders and how they perceive clubs’ performance expressed in this study led to the chosen methodological framework and the fact that the study straddles among multiple disciplines called for the use of appropriate theories like; Stakeholder theory; Efficiency theory; Theory of Performance and so on.
Like previous studies in sports literature, this study adopts similar variables but differs in the introduction of a discretionary variable Games’ Rate of Attraction (GROA). The use of more extensive data spanning 12 EPL seasons and the methodological approach differentiates this work from the previous studies.
The study found that efficiency is not the absolute privilege of League Champions and football giants, only Leicester Football Club out of 12 EPL Champions was efficient and only Aston Villa Football Club – a relatively smaller club was found to be efficient in all DEA models. The
study also confirms the submission of Zambom-Ferraresi et al., (2015) that maintaining efficiency among football clubs over a period is indeed a big problem. Only Aston Villa Football Club out of 37 football clubs investigated over 12 seasons of EPL could maintain efficiency. Thus, identified Aston Villa FC as the most efficient football club on EPL during the period investigated. The study submitted that wastage use of sports resources (Man, Machine, and Money) was the major source of inefficiency among EPL football clubs and that the existence of comparative imbalance among EPL football clubs through investment in Players, Coaches and Stadia among others affect clubs’ efficiencies. It equally expressed the concerns of the nexus of football stakeholders in the decision-making process and submitted that for holistic performance evaluation, the impact of the game of the society (Social Objective) should be incorporated in the already established financial and sportive objectives of a football club as in Substance, (2010).
For better policy implementations, this study recommends the concept of efficient use of sports resources relative to sports outcomes for more insight into football managerial strategies given the present commercialization, business orientation, and social developments of football management as against the traditional entertainments. More importantly, it opined that cost elements be incorporated into the current EPL performance evaluation system if it were to present a holistic performance status of the competing football clubs for better ranking purposes.
Keywords: Performance, Efficiency, Input/output orientations, Football
Monitoring and managing the rapid growth of cities, especially in developing countries, highlights the need for appropriate spatio‐temporal models to predict urban growth. The parameters affecting the spatio‐temporal analysis of urban growth play a key role in the prediction results. This study proposes an urban growth simulation model by integrating local subjective–objective weights and decision risk values (ORness) into a CA–Markov model. This involves the use of ordered weighting averaging as one of the multicriteria decision analysis methods to combine the weights and degree of risk for generating a variety of risk‐averse and/or risk‐taking urban growth prediction scenarios. The proposed model has been applied to predict the physical growth of Babol city, located in Mazandaran, Iran. The results indicate that the degrees of ORness = 0.3 and ORness = 0.9 yield better prediction results in the case of using the local and global weighting strategies, respectively. Furthermore, the overall accuracy of local and global weighting strategies at different degrees of risk was 87.6 and 86.8, respectively. This implies that the use of local subjective–objective weights leads to more accurate results than the global weights for simulating urban growth.
Software risk management is a proactive decision‐making practice with processes, methods, and tools for managing risks in a software project. Many existing techniques for software project risk management are textual documentation with varying perspectives that are nonreusable and cannot be shared. In this paper, a life‐cycle approach to ontology‐based risk management framework for software projects is presented. A dataset from literature, domain experts, and practitioners is used. The identified risks are refined by 19 software experts; risks are conceptualized, modeled, and developed using Protégé. The risks are qualitatively analyzed and prioritized, and aversion methods are provided. The framework is adopted in real‐life software projects. Precision recall and F‐measure metrics are used to validate the performance of the extraction tool while performance and perception evaluation are carried out using the performance appraisal form and technology acceptance model, respectively. Mean scores from performance and perception evaluation are compared with evaluation concept scale. Results showed that cost is reduced, high‐quality projects are delivered on time, and software developers found this framework a potent tool needed for their day‐to‐day activities in software development.
The paper deals with the possible comparative analysis methods of the cryptographic primitives' properties. Methods of comparative analysis-analytic hierarchy process and variations of weight indices methods are investigated and analyzed. Conclusions are made and recommendations on the use of the cryptographic primitives' estimation methods are provided. Also the paper is devoted to the comparative analysis of candidates for the post-quantum key encapsulation standard according to the determined estimation technique. During the analysis, the technique of comparing cryptographic algorithms on the basis of expert estimations using the combination of conditional and unconditional criteria by the analytic hierarchy process was used.
In this paper, we propose two new methods to solve the problem of incomplete reciprocal fuzzy preference relations. Sometimes decision-maker(s) might not be able to provide complete information about their preferences on the alternatives. In general, an incomplete preference relation can be completed if at least a set of n−1 nonleading diagonal preference values are known and each one of the alternatives is compared directly or indirectly at least once. However, this is not always the case. Sometimes, the decision-maker(s) might not be able to provide any information with regards to at least one of the alternatives, which is called the ignorance situation. We propose two new methods based on additive consistency for solving these two problems in a multi-attributes/group decision-making environment. The first method is based on a system of equations, which is suitable for estimating missing information in the general case. The second method, which is an extension of the system of equations, utilizes a goal programming model to address the ignorance situations. Our validation of these two methods shows that the proposed methods generate a high consistency level irrespective of the nature of the problem under study. The proposed methods outperform other comparable methods without a need to modify or change the original decision-maker(s) preferences.
Aim Decision‐support models have considerable potential for guiding management strategies when problems are complex. The robustness of such decision‐making processes is rarely evaluated, and the influence of decision criteria (or factors) in management decisions is seldom considered. We present a framework for a spatially‐explicit sensitivity analysis by using a scheme developed to provide objective guidelines, in the form of static priority maps, for managing woody invasive alien plants (IAPs).
Location The Cape Floristic Region, South Africa.
Methods The model included seven factors related to management history, fire risk, and the age, identity, density and spread of IAPs. Each factor had a weight associated that reflected its relative importance in prioritizing areas for clearing. We changed these factor weights using three approaches of sensitivity analysis and assessed the effect of these changes on the spatial structure of the resulting priority maps in three different management regions.
Results Different outcomes arose depending on the importance given to different factors. Priority maps were most sensitive to the fire‐related factors, suggesting that fire is both a crucial driver of invasion in fynbos and an overriding determinant of management options. The factor ‘area burnt recently’ provided crucial information for the effective clearing of IAPs. The sensitivity of the model to changes in other factors was more context specific: levels of sensitivity were highly dependent on different features of the landscape, especially the spatial heterogeneity of particular factors.
Main conclusions By clarifying the importance of factors in shaping priority maps, the sensitivity analysis framework enabled us to identify the necessary factors to produce outcomes matching a pre‐selected management strategy. This is important for cost‐efficient management, as acquisition and curation of data is expensive. This spatially‐explicit sensitivity analysis is, thus, recommended to evaluate the robustness and generality of selected management strategies, and validate the assumptions derived from decision‐making protocols.
Interdisciplinary Studies and cooperations are necessary for practical work as well as studies in geodesy. Responsibility is a function of power, impact and knowledge. The more strategically central one's position is in terms of power, influence and knowledge, the higher one’s responsibility is. This is an idea which can be worked out in more detail by using interdisciplinary approaches and distributive models on different levels.- Social traps, Prisoners’ Dilemma situations etc. as pertaining to land, soil, and environment as well as some examples from geodesics and the study of the usage of nature systems like lakes and flood plain areas are discussed regarding responsibility and distribution problems. “Naturalists’ Dilemmas” (or “Enjoyers’ Dilemmas”) are sketched and potentially solved by proposing a viable distribution strategy.
ResearchGate has not been able to resolve any references for this publication.