ArticlePDF Available

Applying Big Data in Water Treatment Industry: A New Era of Advance

Authors:

Abstract and Figures

It is well-known that water is an invaluable natural resource and it is also obvious that demand is always going to augment and shortages become more frequent. On the other hand, the development of Big Data (BD), machine learning and artificial intelligence, is beginning to offer realistic opportunities to operate water treatment systems in more efficient manners. In fact, BD concerns all the data we now possess and transform it into knowledge that we may directly employ to manage treatment facilities in a better fashion. The right data, analytics, and decision framework may pilot water utilities to a well-optimized efficiency. Indeed, possessing too much data but not sufficiently comprehensible or ready for use, fine-tuning data collection and funneling it into an integrated data management system may be the manner to become more enterprising and make better decisions. However, employing BD in water treatment remains at its first initiating steps. As a future trend, pooling data and using analytical tools to predict where we should be heading to become more proactive will be a great stage towards the water industry advance.
Content may be subject to copyright.
A preview of the PDF is not available
... Rights reserved. Ghernaout et al. (2018) Review big data applications in WTPs along with useful water utility applications and methodologies for improved process monitoring and control ...
... The need for AI and IoT has been realized for improved, real-time water quality management (Dogo et al. 2019;IWA 2019;UK 2020). The coupled application of IoTs and AI & SC techniques is not yet common for digitalization in the water quality sector. Figure 6 highlights a huge knowledge gap in applying AI & SC in DWSs (Alshattnawi 2017;Ghernaout et al. 2018). Until now, only limited water quality and environmental parameters have been explored, and the application of real-time AI & SC techniques has not been common. ...
... The cost element considering different DWS processes may not be included in the developed AI & SC models in Level II. Reliable model development requires big data with a constant stream of data to capture spatiotemporal variations in water quality (Ghernaout et al. 2018), which requires a cloud-based database for data capture and storage. The type of inter-utility cloud database that is required still may not be realized in this phase. ...
Article
Full-text available
Water quality deterioration in drinking water systems (i.e., system failure) causing serious outbreaks have frequently been happening around the world. These failures can be predicted through a real-time drinking water quality monitoring system for timely actions. Although Supervisory Control and Data Acquisition (SCADA) has been commonly used for this purpose, this system suffers considerable limitations, such as the scalability of sensors, lack of predictive ability, and increased burden on operators overwhelmed by superfluous notifications. Proficient artificial intelligence & soft computing (AI & SC) techniques and cloud Internet of Things (IoT) may significantly reduce the reliance on operators and eventually improve system operations. This study critically reviewed the literature published from 2000 to 2020 to evaluate AI & SC applications’ trends in drinking water quality management while developing a roadmap for autonomous digital water quality management. The investigation reveals that AI & SC were primarily used for assessing drinking and surface water quality. These techniques were largely applied to effectively predict, evaluate, and control water quality. AI & SC were also used to model physicochemical (basic and complex) and microbiological parameters. The most commonly applied AI & SC techniques are the multilayer perceptron-based artificial neural network, general regression neural network, support vector machine, Bayesian networks, and the adaptive neuro-fuzzy inference system. Additional articles published after 2020 were also reviewed to compare with the measures proposed in the roadmap. This roadmap guides water utilities, policy-makers, and regulators to achieve reliable water quality in a smart and efficient manner. Graphical abstract
... Furthermore, remote sensing and satellite-based monitoring are critical in assessing vast bodies of water and finding long-term changes. Despite significant advances in water quality monitoring, problems remain in data administration, data integration from disparate sources, calibration, and maintaining measurement precision and dependability [3]. Emerging technologies, on the other hand, such as artificial intelligence, machine learning, and advanced sensor networks, have the potential to revolutionize water quality monitoring by overcoming some of these challenges and improving data-driven decision making. ...
Article
Full-text available
With the increased use of automated systems, the Internet of Things (IoT), and sensors for real-time water quality monitoring, there is a greater requirement for the timely detection of unexpected values. Technical faults can introduce anomalies, and a large incoming data rate might make the manual detection of erroneous data difficult. This research introduces and applies a pioneering technology, Multivariate Multiple Convolutional Networks with Long Short-Term Memory (MCN-LSTM), to real-time water quality monitoring. MCN-LSTM is a cutting-edge deep learning technology designed to address the difficulty of detecting anomalies in complicated time series data, particularly in monitoring water quality in a real-world setting. The growing reliance on automated systems, the Internet of Things (IoT), and sensor networks for continuous water quality monitoring is driving the development and deployment of the MCN-LSTM approach. As these technologies become more widely used, the rapid and precise identification of unexpected or aberrant data points becomes critical. Technical difficulties, inherent noise, and a high data influx pose significant hurdles to manual anomaly detection processes. The MCN-LSTM technique takes advantage of deep learning by integrating Multiple Convolutional Networks and Long Short-Term Memory networks. This combination of approaches offers efficient and effective anomaly detection in multivariate time series data, allowing for identifying and flagging unexpected patterns or values that may signal water quality issues. Water quality data anomalies can have far-reaching repercussions, influencing future analyses and leading to incorrect judgments. Anomaly identification must be precise to avoid inaccurate findings and ensure the integrity of water quality tests. Extensive tests were carried out to validate the MCN-LSTM technique utilizing real-world information obtained from sensors installed in water quality monitoring scenarios. The results of these studies proved MCN-LSTM’s outstanding efficacy, with an impressive accuracy rate of 92.3%. This high level of precision demonstrates the technique’s capacity to discriminate between normal and abnormal data instances in real time. The MCN-LSTM technique is a big step forward in water quality monitoring. It can improve decision-making processes and reduce adverse outcomes caused by undetected abnormalities. This unique technique has significant promise for defending human health and maintaining the environment in an era of increased reliance on automated monitoring systems and IoT technology by contributing to the safety and sustainability of water supplies.
... In some preliminary trials, ML algorithms were trained to predict the treated water quality founded on the coagulant injection or assess the coagulant injection to attain the wanted effluent quality [215]. Also, ML algorithms can be trained with various monitoring data [216] [217] [218] to ameliorate the forecasts for HABs and estimate the threat to water utilities and the general public [219] [220] [221]. Until now, employing ML to explore the coagulation elimination of algae has been rare [222]. ...
Article
Full-text available
At the global level, the augmenting presence of harmful algae blooms constitutes important dares to water treatment plants (WTPs). In WTPs, coagulation remains the primary process of the applied procedure to treat algae-contaminated water. Such a chemical process influences the following techniques; thus, regulating coagulation parameters to eliminate algae at the maximum degree without provoking cell deterioration is more than crucial. This work aims to review coagulation-founded methods for algae elimination. First, investigations concentrating on algae elimination using the chemical process are discussed. The introduction presents the widespread algae encountered in the water treatment field. Then, habitually utilized experimental techniques and emerging methods in coagulation investigations are summarized with typical findings. Next, the newest expansions in improved algae elimination, launched by electrochemically and ultrasonically-enhanced coagulation, are discussed. Workable thoughts for applying coagulation to eliminate algae in WTPs are also debated. The paper finishes by defining restrictions and dares related to the present literature and suggesting trends for subsequent studies. The charge neutralization mechanism efficiently removes solubilized microcystins (MCs), and enhanced coagulation configuration is also found to be more efficient for their removal. However, considerations should be taken to avert that the acid introduction has no unwanted effect in killing algae treatment to avoid the solubilized MCs level elevation. If such techniques are well-optimized and controlled, both algae and solubilized MCs could be efficaciously removed by ultrasound-enhanced coagulation and electrocoagulation/electrooxidation.
... The combination of automatic and manual collection of water quality index data makes the data a certain scale, which has laid the foundation and provides the possibility for the use of big data analysis method to study the water quality and influencing factors of Xiang River. However, most of the research in China and abroad is still about big data concept exploration and application analysis [2][3][4][5]. The analysis and evaluation of environmental policy effects are mainly focused on qualitative analysis [6][7][8][9] and theoretical model analysis [10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25][26][27][28][29], where theoretical models are commonly used in econometric models [10][11][12][13][14], Bayesian models [16][17][18][19], Poisson regression model [20][21][22][23], panel data analysis models [24][25][26][27] and game theory models [29]. ...
Article
Full-text available
Water pollution prevention and control of the Xiang River has become an issue of great concern to China's central and local governments. To further analyze the effects of central and local governmental policies on water pollution prevention and control for the Xiang River, this study performs a big data analysis of 16 water quality parameters from 42 sections of the mainstream and major tributaries of the Xiang River, Hunan Province, China from 2005 to 2016. This study uses an evidential reasoning-based integrated assessment of water quality and principal component analysis, identifying the spatiotemporal changes in the primary pollutants of the Xiang River and exploring the correlations between potentially relevant factors. The analysis showed that a series of environmental protection policies implemented by Hunan Province since 2008 have had a significant and targeted impact on annual water quality pollutants in the mainstream and tributaries. In addition, regional industrial structures and management policies also have had a significant impact on regional water quality. The results showed that, when examining the changes in water quality and the effects of pollution control policies, a big data analysis of water quality monitoring results can accurately reveal the detailed relationships between management policies and water quality changes in the Xiang River. Compared with policy impact evaluation methods primarily based on econometric models, such a big data analysis has its own advantages and disadvantages, effectively complementing the traditional methods of policy impact evaluations. Policy impact evaluations based on big data analysis can further improve the level of refined management by governments and provide a more specific and targeted reference for improving water pollution management policies for the Xiang River.
... Furthermore, utilizing the collected data (i.e., big data) can forge new paths for monitoring the environment [43,44] and ensuring sustainable development in the years to come [45,46]. In recent years, water research and industry have been utilizing big data to support groundwater management [47], map groundwater potential [48,49], enhance water system models [50], increase water treatment systems efficiency [51], and the accuracy of estimating water quality [44]. However, the collected data needs to be processed appropriately to generate knowledge, creating a need for sophisticated data management tools and software that can efficiently manage and extract information from the data [52]. ...
Article
Full-text available
This article aims to present the structure and the workflow of a new software DeMa (Decision Support Software and Database for Wellfield Management), to support wellfield managers in their decision-making processes. There is a recognized need to improve the management of groundwater resources, especially with the increased demand for fresh water in arid and semi-arid regions. DeMa differentiates from other available software, by combining data collected for the well’s maintenance, operation, design, installations, and cost data with the collected hydrological field measurements. Additionally, DeMa links the different information and provides an effective graphical representation of the data. We applied the software to the Wadi Al Arab wellfield case study to support wellfield managers in the decision-making process of three typical problems: identification of missing data and information concerning the wells, identification of maintenance needs for a well, and identification of a suitable location for a new well. In the application to the Wadi Al Arab wellfield (Jordan), we collected data and documents from the Yarmouk Water Company (YWC), the Jordan Ministry of Water and Irrigation (MWI), and private drilling companies. The software application highlights the beneficial effects of the digitalization of water resources management by improving data availability and management and achieving data and research-based decisions on the wellfield.
... These measures can improve regional water endowment. In addition, the technological advancement triggered by increasing WUTE has created new industries, such as the water treatment industry and irrigation industry (Azad et al., 2015;Ghernaout et al., 2018), thereby contributing to the increase in employment (Licht and Peters, 2013). Therefore, increasing WUTE can promote employment and ultimately increase income. ...
Article
Improvements in water-use technical efficiency can alleviate water scarcity, which may help alleviate poverty caused by it. Therefore, it is necessary to understand the complex relationship between water-use technical efficiency, income, and even poverty. This article explores the spatial spillover effect of water-use technical efficiency on income through the case of China’s South-North Water Transfer Project. It also critically examines the role of industrial development and employment in the impact of water-use technical efficiency on income. The findings demonstrate that increasing water-use technical efficiency can increase income, bringing “water blessings.” Moreover, increasing water-use technical efficiency also improves the income of adjacent regions through spatial spillovers. In addition, increasing water-use technical efficiency promotes industrial development, thereby increasing income through the positive moderation of government expenditure. Finally, increasing water-use technical efficiency also promotes employment and then increases income; however, increasing population size weakens WUTE’s impact on employment. Beyond the current understanding of the relationship between water-use technical efficiency and income, this article provides another empirical study that contributes to profoundly understanding the spatial effect and internal mechanism of this relationship.
... The importance of water treatment is also discussed in [77]. The authors concluded that the development process for a solution that aims to improve the water sector is more complex than others due to a multitude of factors, the amount of data that can be collected from various sensors (quality sensors, water flow sensors, environment sensors) become hard to be parsed and analyzed; however, once the system is improved and developed, there is a consistent additional value that will be added in the water management workflows, decision making and water treatment processes. ...
Article
Full-text available
Water supply systems are essential for a modern society. This article presents an overview of the latest research related to information and communication technology systems for water resource monitoring, control and management. The main objective of our review is to show how emerging technologies offer support for smart administration of water infrastructures. The paper covers research results related to smart cities, smart water monitoring, big data, data analysis and decision support. Our evaluation reveals that there are many possible solutions generated through combinations of advanced methods. Emerging technologies open new possibilities for including new functionalities such as social involvement in water resource management. This review offers support for researchers in the area of water monitoring and management to identify useful models and technologies for designing better solutions.
Chapter
Every day, the need for clean water for home and industrial use increases dramatically. Therefore, treatment with renewable resources is the most cost-effective option for assuring a clean drinking water supply in the next years. Varahamihira outlined a simple method for extracting potable water from a contaminated water source as early as 550 A.D., which included using various plant materials, solar heating, eration, and the quenching of water with fire-heated stones, gold, silver, iron, or sand, among others. With the growth of civilization, the fundamental science behind therapeutic approaches has not changed. Nevertheless, it is essential to identify new, more robust technologies for purifying water at a lower price, with less energy consumption, limited use of dangerous chemicals, and without adverse environmental impact. The common water treatment technologies for clean waters are disinfection, decontamination, desalination, and reuse. This chapter examines the most recent methods for disinfection, decontamination, desalination of brackish and seawater, and reuse of waste and effluent water treatment. The current and future perspectives and the most up-to-date information on the problems and implementation techniques for the long-term usage of water treatment technology are explored in detail.
Chapter
In order to improve the landscape design effect, this paper combines intelligent grey space algorithm to improve the design algorithm, and uses Mean-shift algorithm to smooth the multi-focus image. Moreover, this paper considers the spatial information of multi-focus images as well as the grey information of the image, which effectively removes the image noise and retains more grey texture information, thus achieving a better smoothing effect. In addition, this paper uses the maximum inter-class difference algorithm as the grey histogram fitting function of multi-focus images, and completes the recognition of grey overlapping areas of multi-focus images. Finally, this paper uses DEM model to design the terrain, which can not only simulate the terrain of the site, but also complete the site analysis, site leveling and site reconstruction. Through experimental analysis, we can see that the grey space design form proposed in this paper has a good effect in landscape design, and the design scheme proposed in this paper can meet the actual design needs.
Article
The grand challenge of accessing fresh water and sanitation is a global concern. The intensity of challenge depends on the geographical location as well as the level of socio-economic development of individual countries. The present paper first reviews the key water-related global trends and examines the global agenda on water issues. Next the focus is turned on Russia. Despite of being one of the water-rich countries in the world, Russia faces a number of substantial administrative and structural issues in the water sector. Therefore, it is crucial to develop a long-term strategy for the management of this infinite, but strategic resource. The present paper develops long-term scenarios and strategies for the Russian water sector towards the year 2030. The study draws upon an earlier horizon scanning activity that identified a set of global trends and uncertainties related to water sector. This horizon scanning work is extended into alternative futures for the Russian water sector by using a combination of Foresight methods including scenario analysis, data mining, and various expert methods. Scenarios developed are characterized by a set of qualitative and quantitative factors and indicators of future developments in three key domains for the water sector: (i) the sustainability of water systems; (ii) water use by households and industry; and (iii) new water products and services. Scenarios present four alternative trajectories for the water sector that may also be applied for certain countries whose water sector is comparable with the Russia. Among the scenarios developed in the study, it is concluded that the most probable ones are Problem conservation and Losses and accidents. However, there is a possibility to revert these scenarios into more desirable trajectories, which are presented in other scenarios. For instance, a variety of new clean water technologies may be widely applied to achieve the Nearly perfect future (visionary) scenario.
Article
The growing gap between users and the Big Data analytics requires innovative tools that address the challenges faced by big data volume, variety, and velocity. Therefore, it becomes computationally inefficient to analyze and select features from such massive volume of data. Moreover, advancements in the field of Big Data application and data science poses additional challenges, where a selection of appropriate features and High-Performance Computing (HPC) solution has become a key issue and has attracted attention in recent years. Therefore, keeping in view the needs above, there is a requirement for a system that can efficiently select features and analyze a stream of Big Data within their requirements. Hence, this paper presents a system architecture that selects features by using Artificial Bee Colony (ABC). Moreover, a Kalman filter is used in Hadoop ecosystem that is used for removal of noise. Furthermore, traditional MapReduce with ABC is used that enhance the processing efficiency. Moreover, a complete four-tier architecture is also proposed that efficiently aggregate the data, eliminate unnecessary data, and analyze the data by the proposed Hadoop-based ABC algorithm. To check the efficiency of the proposed algorithms exploited in the proposed system architecture, we have implemented our proposed system using Hadoop and MapReduce with the ABC algorithm. ABC algorithm is used to select features, whereas, MapReduce is supported by a parallel algorithm that efficiently processes a huge volume of data sets. The system is implemented using MapReduce tool at the top of the Hadoop parallel nodes with near real-time. Moreover, the proposed system is compared with Swarm approaches and is evaluated regarding efficiency, accuracy and throughput by using ten different data sets. The results show that the proposed system is more scalable and efficient in selecting features.
Article
The large mediatic coverage of recent massive wildfires across the world has emphasized the vulnerability of freshwater resources. The extensive hydrogeomorphic effects from a wildfire can impair the ability of watersheds to provide safe drinking water to downstream communities and high-quality water to maintain riverine ecosystem health. Safeguarding water use for human activities and ecosystems is required for sustainable development; however, no global assessment of wildfire impacts on water supply is currently available. Here, we provide the first global evaluation of wildfire risks to water security, in the form of a spatially explicit index. We adapted the Driving forces-Pressure-State-Impact-Response risk analysis framework to select a comprehensive set of indicators of fire activity and water availability, which we then aggregated to a single index of wildfire-water risk using a simple additive weighted model. Our results show that water security in many regions of the world is potentially vulnerable, regardless of socio-economic status. However, in developing countries, a critical component of the risk is the lack of socio-economic capability to respond to disasters. Our work highlights the importance of addressing wildfire-induced risks in the development of water security policies; the geographic differences in the components of the overall risk could help adapting those policies to different regional contexts.
Article
Water resources data is usually featured by huge volume, multi-variable as well as multi-dimension, which leads to deficiency in terms of data integrity, rationality and efficacy in water resources management and allocation. In order to reduce the amount of data collected in the Internet of things, to improve the processing speed for water resources data, a constrained single objective optimization problem is transformed into a multi-objective optimization problem with sparse degree as the optimization objective in compressed sensing reconstruction, and then a sparse reconstruction method based on hybrid multi-objective optimization is proposed. The algorithm is designed based on the multi objective optimization problem, and the algorithm is easy to implement and adjust. Application results show that the proposed multi-objective particle swarm optimization-Genetic algorithm (MOPSOGA) is than traditional gradient projection sparse reconstruction algorithm (GPSR-BB) algorithm iterations decreased 43.9%. The success rate of reconstruction is higher than that of the traditional algorithm of 0.16; it's with a better reconstruction performance.
Article
The ability to make credible simulations of open engineered biological systems is an important step towards the application of scientific knowledge to solve real-world problems in this challenging, complex engineering domain. An important application of this type of knowledge is in the design and management of wastewater treatment systems. One of the crucial aspects of an engineering biology approach to wastewater treatment study is the ability to run a simulation of complex biological communities. However, the simulation of open biological systems is challenging because they often involve a large number of bacteria that ranges from order 10¹² (a baby's microbiome) to 10¹⁸ (a wastewater treatment plant) individual particles, and are physically complex. Since the models are computationally expensive, and due to computing constraints, the consideration of only a limited set of scenarios is often possible. A simplified approach to this problem is to use a statistical approximation of the simulation ensembles derived from the complex models at a fine scale which will help in reducing the computational burden. Our aim in this paper is to build a cheaper surrogate of an individual-based (IB) model simulation of microbial communities. The paper focuses on how to use an emulator as an effective tool for studying and incorporating microscale processes in a computationally efficient way into macroscale models. The main issue we address is a strategy for emulating high-level summaries from the IB model simulation data. We use a Gaussian process regression model for the emulation. Under cross-validation, the percentage of variance explained for the univariate emulator ranges from 83–99% and 87–99% for the multivariate emulators, and for both biofilms and floc. Our emulators show an approximately 220-fold increase in computational efficiency. The sensitivity analyses indicated that substrate nutrient concentration for nitrate, carbon, nitrite and oxygen as well as the maximum growth rate for heterotrophic bacteria are the most important parameters for the predictions. We observe that the performance of the single step emulator depends hugely on the initial conditions and sample size taken for the normal approximation. We believe that the development of an emulator for an IB model is of strategic importance for using microscale understanding to enable macroscale problem solving.
Article
Hydroclimatological and anthropogenic factors are key drivers of waterborne disease transmission. Information on human settlements and host mobility on waterways along which pathogens and hosts disperse, and relevant hydroclimatological processes, can be acquired remotely and included in spatially explicit mathematical models of disease transmission. In the case of epidemic cholera, such models allowed the description of complex disease patterns and provided insight into the course of ongoing epidemics. The inclusion of spatial information in models of disease transmission can aid in emergency management and the assessment of alternative interventions. Here, we review the study of drivers of transmission via spatially explicit approaches and argue that, because many parasitic waterborne diseases share the same drivers as cholera, similar principles may apply.
Article
A simple electrochemical sensor for the in-line monitoring of residual chlorine in tap water has been proposed. In this study, potentiometric sensors using either Pt, Al or stainless steel working electrodes were fabricated. Both Pt and stainless steel electrodes exhibited high performance. As an example, a 200 mV response was obtained from SUS304 stainless steel electrode exposed to 1 mg/L residual chlorine concentration within about 4 min. The effects of pH and dissolved oxygen concentration as environmental factors were evaluated, and Pt and SUS316 electrodes showed the same variation with changes in these parameters. The data suggest that the appropriate pairing of electrode materials could allow the fabrication of all-solid-state sensor devices with the advantages of compactness, low power consumption, low cost and robustness.
Article
Opinion polls show that the European Union citizens are increasingly concerned about the impact of environmental factors on their health. In order to respond and provide solid scientific evidence for the numerous policies related to the protection of human health and the environment managed at the Union level, the European Union made a substantial investment in research and innovation in the past two decades through its Framework Programmes for Research and Technological Development, including the current programme, Horizon 2020, which started in 2014. This policy review paper analysed the portfolio of forty collaborative projects relevant to environment and health, which received a total amount of around 228 million euros from the EU. It gives details on their contents and general scientific trends observed, the profiles of the participating countries and institutions, and the potential policy implications of the results obtained. The increasing knowledge base is needed to make informed policy decisions in Europe and beyond, and should be useful to many stakeholders including the scientific community and regulatory authorities.
Article
Innovation and Technology go hand in hand within the petroleum and petrochemical industry. Oil price volatility, geopolitics, and economic uncertainty, all contribute towards the continued need to innovate and technologically advance if petroleum and petrochemical companies are to survive in this highly competitive industry. This review paper looks at identifying the importance of innovation and technology in the petroleum and petrochemical industry by referring to evidence in the public domain. Thereafter, the focus shifts towards identifying both quantifiable and non-quantifiable impacts of technology and innovation within the petroleum and petrochemical industry.