... Chhetri et al. [39] JADE framework & WS2JADE toolkit √ ---Yan et al. [44] JADE framework & WS2JADE toolkit √ ---Brandic et al. [16] Not simulated/implemented ----Song and Zhang [14] Not mentioned -√ √ Average joint utilities, Success rate Sim [31] Not simulated/implemented ----Sim [2] JADE framework -√ √ Average joint utilities, Negotiation speed, Success rate Dastjerdi and Buyya [40] CloudSim toolkit -√ √ Average consumer profit, Average provider profit Siebenhaar et al. [38] Not mentioned -√ √ Average utility of consumers, Average utility of providers, Success rate Zheng et al. [30] NetBeans IDE 6.9.1 & JDK 6u21 -√ -A v e r a g e utility of consumers, Average utility of providers, Average joint utilities, Success rate Son and Sim [23] JADE framework -√ -A v e r a g e joint utilities, Negotiation speed, Success rate Alsrheed et al. [52] Not mentioned -√ -A v e r a g e joint utilities Zheng et al. [53] Not mentioned -√ -A v e r a g e utility of consumers, Average utility of providers, Average joint utilities, Success rate Wu et al. [54] Not mentioned -√ √ Average consumer satisfaction levels, Average provider profit, Negotiation speed, Success rate Najjar et al. [47] GENIUS platform -√ -A v e r a g e utility of users, Total cost paid to rent resources Shojaiemehr and Rafsanjani [55] Not mentioned √ √ √ Average utility of buyers, Negotiation speed Messina et al. [56] Not simulated/implemented ----Yaqub et al. [57] Repast simulation tool -√ √ Average utility of consumers, Average utility of providers, Average joint utilities, Pareto-optimal bids Zheng et al. [29] NetBeans IDE 7.2.1 & JDK 7u13 -√ -A v e r a g e joint utilities, Negotiation speed, Success rate Chen et al. [58] Not mentioned √ -√ Average joint utilities, Average utility of consumers, Average utility of providers Parhi et al. [21] JADE framework, Jena SemWeb library, Protégé ontology editor √ ---Ishikawa and Fukuta [59] Not mentioned √ ---Omezzine et al. [60] Not simulated/implemented ----Son and Sim [46] JADE framework -√ √ Average joint utilities, Negotiation speed, Computational load Shojaiemehr and Rafsanjani [49] MATLAB software √ -√ Average utility of buyers, Average of equality Ranaldo and Zimeo [50] Not mentioned -√ √ Average utility of consumers, Price of services tained in Table 3 . As shown in the figure, the most important metrics are the average utility of consumers/buyers/users, average joint utility, success rate, average utility of providers, and negotiation speed. ...