ATTEST
Advanced Tools Towards cost-efficient decarbonisation of future reliable Energy SysTems Power and Energy Systems
Description
Over three years, the ATTEST team – led by INESC TEC - studied and developed solutions for the planning and operation of energy transmission and distribution network infrastructures. The objective of the ATTEST project was to develop and operationalize a modular open source toolbox comprising a suite of innovative tools to support TSOs / DSOs operating, maintaining and planning the energy systems of 2030 and beyond in an optimised and coordinated manner, considering technical, economic and environmental aspects.
The consortium, from six EU countries, that has been assembled to deliver ATTEST consisted of five highly experienced research organisations in the energy systems area, two utilities that manage and operate the transmission system and the distribution system in Croatia, and two industry partners that specialise in the development of advanced ICT solutions and SCADA systems.The development of this broad spectrum of energy-related ICT tools and the utilization of next generation algorithms, demonstrated in a real world environment has not been attempted before.
The outputs from the ATTEST project enabled accelerated dissemination, by a wide range of research institutions, within and outside of the project consortium, of the tools that will help TSOs and DSOs to better manage their networks.
The demonstration of the results of the project is valuable for the scientific community and EU energy industry and attest to the relevance of the solutions developed.
Scientific Advances
The primary ambition of the ATTEST project was to develop and operationalize an open-source toolbox for both TSOs and DSOs in order to address the challenges foreseen for the energy system of 2030 and beyond. The project solutions were based on novel algorithms and innovative models that will be extensively tested through simulation while some features will also be validated in a real demo in Croatia comprising both the transmission and distribution grids. The proposed tools addressed the different aspects of both TSO and DSO activity, namely network planning, network operation and asset management. Furthermore, the issue of TSO/DSO coordination will be tackled by exploiting an advanced ICT platform that was defined and set up during the course of the ATTEST project. The principal fields of research where ATTEST contributed to advance the current state of the art were:
-Network planning tools: The ATTEST project faced the development of sophisticated adaptive distribution and transmission network planning tools, which consider traditional asset-based solutions (e.g., line and substation reinforcements) and flexible network support services procured by TSOs and DSOs and the relevant synergies and conflicts. The proposed tools, developed with bespoke simulation-based optimization algorithms, can develop path-dependent investment strategies that adapt to uncertain future scenarios. In addition, the high computational efficiency of the proposed optimization algorithms allowed the tools to consider a wide range of potentially conflicting or synergistic network services. The new planning algorithms took a novel perspective on network planning, which shifted from meeting security constraints to also support the business case of smart customers who can use their flexibility to provide valuable services in DSO and TSO markets. The sophisticated business models were evaluated based on a cost benefit analysis framework informed by advanced mathematical models, which evaluated the impacts of the new planning practices on customers, distribution and transmission network operators.
-Network operation tools: The ATTEST project conceptual novelty and ambition was to design a tractable methodology to address in an integrated way several interrelated features, needs, and challenges of the energy systems of the future that have been studied so far separately. To this end, as a single method to solve the huge mathematical complexity of the integrated system operation problem does not exist, the ATTEST project proposed a new methodology, based on a set of advanced tools, which interact to each other to solve the problem with reasonable precision and speed. To reduce the paramount computational complexity, the proposed methodology first decomposed the problem into two more tractable tools (i.e. SCOPF for the transmission system and OPF for distribution systems) which interact to each other according to the proposed TSO/DSO cooperation mechanism. Each tool embedded several key novel aspects highlighted hereafter. At the transmission level, the ATTEST project leveraged the state of the art deterministic SCOPF tool to stochastic multi-temporal SCOPF under forecast uncertainty, resorting to nested decomposition of temporal and uncertainty scenarios as well as security (i.e. contingencies) in a predictor-corrector fashion. Further, the security problem size was reduced in two complementary ways: (i) the efficient identification of critical constraints (e.g. set of harmful combinations of contingencies and uncertainty sampled scenarios) and (ii) the development of an approximated convex reduced model of the post-contingency states. The SCOPF models also the real time remedial actions by stochastic model predictive control, relying on a new linear model to guarantee tractability and scalability. Finally, the dynamic security assessment tool used in real-time operation exhibits innovative features such as the reliable identification of events via convolutional neural networks, dynamic model of active distribution grids, and the use of machine learning techniques to derive frequency stability constraints to be embedded in the SCOPF problem. At the distribution level, the deterministic multi-temporal OPF is leveraged to address forecast uncertainty and interaction with the TSO. A major innovation relates to the two-level decomposition algorithm applied to the proposed multi-period and multi-scenario OPF operation problem, which iterates between a master problem modelling time periods and slave problems modelling uncertainty scenarios. Then, the real time control actions were obtained via a tractable linear stochastic model predictive control model. Finally, the state estimation tool combined neural-network-based topology identification, data driven calibration and an algorithm to generate reliably and efficiently the lack of information (i.e. pseudo-measurements) taking also advantage of new sources of data (e.g. smart meters, PMUs, etc.). The SCOPF and OPF problems were formulated to incorporate in a mathematically advantageous way the model of all the mentioned indispensable features, contributing to guarantee the tractability of the methodology.
-Asset management tools: The ATTEST project contributed to develop some aspects in the area of asset management in the coming electricity grids where digitalization will be a key piece. The most relevant are the following: Contribution to the digitalization of the asset management process including the possibility to focus the analysis on different perspectives of the life, operation, maintenance of the assets, guiding the process of taking decisions; Integrated approach for taking decisions in asset management based on indicators that are comparable even when they come from different sources of information and experience: operation, maintenance, costs; Definition of a set of better, more descriptive and widely usable life indicators based on knowledge discovered from methods and algorithms applied to the information available; Flexible extension to assets without information by reutilization of information already included in the ICT platform about similar assets as a first approach to their analysis; Smart continuous updating of the life indicators according to the new information arriving about the life of the assets; Equipment lifecycle models suitable to be integrated with the optimization tools for expansion and operational planning.
-TSO/DSO coordination mechanisms: The ATTEST project developed a novel set of mechanisms to foster coordination between TSOs and DSOs from long-term planning to real-time operation. These TSO/DSO coordination mechanisms promotes a more cost-efficient and reliable utilization of DER located in transmission and distribution networks since the coordination mechanisms were considered during the development of both network planning and operation tools.
-ICT platform for TSO/DSO coordination: The ICT platform proposed in ATTEST project connects the existing and new TSO and DSO databases, handling and accessing data coming not only from traditional, large scale, heterogeneous and distributed sources and network devices, but also effect of the increasingly pervasive digitalization (e.g. sensors on windmills, smart appliances and vehicles to enhance electricity system’s flexibility, improved weather forecasts). Both standard and custom formats of data were tackled. The architecture, based on loosely coupled services, is modular and adaptive, supporting secure interoperability and enabling the integration of legacy tools provided by partners and technologies developed during the project. The platform is based on open source technologies and standards and allows to scale up, if and when necessary (e.g. to support the challenges of efficiently using streaming data coming from sensors), exploiting distributed and edge computing. The interface framework was designed to be pluggable, combining different visualization tools, and enabling to display data and results of computations and analysis carried out by the project tools. The user interface was decoupled from backend platform and modules, increasing flexibility and allowing personalization. The operators in the control room interact with a customizable dashboard, composed of widgets from a library of visualization components. The project also carried research on providing multimodal, state-of-the-art interaction with the interface, and an innovative and immersive user experience.
Impact
The work developed in ATTEST resulted in an advanced set of tools that will enable an optimised operation and planning of future power systems. The tools developed are the following:
- Optimization tool for distribution network planning
- Optimization tool for transmission network planning
- Optimization tool for planning tso/dso shared technologies
- Tool for ancillary services procurement in day-ahead operation planning for the distribution network
- Tool for ancillary services activation in real-time operation of the distribution network
- Tool for state estimation of distribution networks
- Tool for ancillary services procurement in day-ahead operation planning for the transmission network
- Tool for ancillary services activation in real-time operation of the transmission network
- Tool for on-line dynamic security assessment
- Tool for the characterization of the condition of assets
- Tool for the definition of condition indicators based on heterogeneous information sources
- Tool for the definition of smart asset management strategies
- Day-ahead and real-time optimization tools to support mes aggregators
- Market simulator
All the tools were integrated in a single multi-purpose ICT platform, which was demonstrated in real world conditions, in Croatia, with the assistance of the local DSO and TSO.
The consortium, from six EU countries, that has been assembled to deliver ATTEST consisted of five highly experienced research organisations in the energy systems area, two utilities that manage and operate the transmission system and the distribution system in Croatia, and two industry partners that specialise in the development of advanced ICT solutions and SCADA systems.The development of this broad spectrum of energy-related ICT tools and the utilization of next generation algorithms, demonstrated in a real world environment has not been attempted before.
The outputs from the ATTEST project enabled accelerated dissemination, by a wide range of research institutions, within and outside of the project consortium, of the tools that will help TSOs and DSOs to better manage their networks.
The demonstration of the results of the project is valuable for the scientific community and EU energy industry and attest to the relevance of the solutions developed.
Scientific Advances
The primary ambition of the ATTEST project was to develop and operationalize an open-source toolbox for both TSOs and DSOs in order to address the challenges foreseen for the energy system of 2030 and beyond. The project solutions were based on novel algorithms and innovative models that will be extensively tested through simulation while some features will also be validated in a real demo in Croatia comprising both the transmission and distribution grids. The proposed tools addressed the different aspects of both TSO and DSO activity, namely network planning, network operation and asset management. Furthermore, the issue of TSO/DSO coordination will be tackled by exploiting an advanced ICT platform that was defined and set up during the course of the ATTEST project. The principal fields of research where ATTEST contributed to advance the current state of the art were:
-Network planning tools: The ATTEST project faced the development of sophisticated adaptive distribution and transmission network planning tools, which consider traditional asset-based solutions (e.g., line and substation reinforcements) and flexible network support services procured by TSOs and DSOs and the relevant synergies and conflicts. The proposed tools, developed with bespoke simulation-based optimization algorithms, can develop path-dependent investment strategies that adapt to uncertain future scenarios. In addition, the high computational efficiency of the proposed optimization algorithms allowed the tools to consider a wide range of potentially conflicting or synergistic network services. The new planning algorithms took a novel perspective on network planning, which shifted from meeting security constraints to also support the business case of smart customers who can use their flexibility to provide valuable services in DSO and TSO markets. The sophisticated business models were evaluated based on a cost benefit analysis framework informed by advanced mathematical models, which evaluated the impacts of the new planning practices on customers, distribution and transmission network operators.
-Network operation tools: The ATTEST project conceptual novelty and ambition was to design a tractable methodology to address in an integrated way several interrelated features, needs, and challenges of the energy systems of the future that have been studied so far separately. To this end, as a single method to solve the huge mathematical complexity of the integrated system operation problem does not exist, the ATTEST project proposed a new methodology, based on a set of advanced tools, which interact to each other to solve the problem with reasonable precision and speed. To reduce the paramount computational complexity, the proposed methodology first decomposed the problem into two more tractable tools (i.e. SCOPF for the transmission system and OPF for distribution systems) which interact to each other according to the proposed TSO/DSO cooperation mechanism. Each tool embedded several key novel aspects highlighted hereafter. At the transmission level, the ATTEST project leveraged the state of the art deterministic SCOPF tool to stochastic multi-temporal SCOPF under forecast uncertainty, resorting to nested decomposition of temporal and uncertainty scenarios as well as security (i.e. contingencies) in a predictor-corrector fashion. Further, the security problem size was reduced in two complementary ways: (i) the efficient identification of critical constraints (e.g. set of harmful combinations of contingencies and uncertainty sampled scenarios) and (ii) the development of an approximated convex reduced model of the post-contingency states. The SCOPF models also the real time remedial actions by stochastic model predictive control, relying on a new linear model to guarantee tractability and scalability. Finally, the dynamic security assessment tool used in real-time operation exhibits innovative features such as the reliable identification of events via convolutional neural networks, dynamic model of active distribution grids, and the use of machine learning techniques to derive frequency stability constraints to be embedded in the SCOPF problem. At the distribution level, the deterministic multi-temporal OPF is leveraged to address forecast uncertainty and interaction with the TSO. A major innovation relates to the two-level decomposition algorithm applied to the proposed multi-period and multi-scenario OPF operation problem, which iterates between a master problem modelling time periods and slave problems modelling uncertainty scenarios. Then, the real time control actions were obtained via a tractable linear stochastic model predictive control model. Finally, the state estimation tool combined neural-network-based topology identification, data driven calibration and an algorithm to generate reliably and efficiently the lack of information (i.e. pseudo-measurements) taking also advantage of new sources of data (e.g. smart meters, PMUs, etc.). The SCOPF and OPF problems were formulated to incorporate in a mathematically advantageous way the model of all the mentioned indispensable features, contributing to guarantee the tractability of the methodology.
-Asset management tools: The ATTEST project contributed to develop some aspects in the area of asset management in the coming electricity grids where digitalization will be a key piece. The most relevant are the following: Contribution to the digitalization of the asset management process including the possibility to focus the analysis on different perspectives of the life, operation, maintenance of the assets, guiding the process of taking decisions; Integrated approach for taking decisions in asset management based on indicators that are comparable even when they come from different sources of information and experience: operation, maintenance, costs; Definition of a set of better, more descriptive and widely usable life indicators based on knowledge discovered from methods and algorithms applied to the information available; Flexible extension to assets without information by reutilization of information already included in the ICT platform about similar assets as a first approach to their analysis; Smart continuous updating of the life indicators according to the new information arriving about the life of the assets; Equipment lifecycle models suitable to be integrated with the optimization tools for expansion and operational planning.
-TSO/DSO coordination mechanisms: The ATTEST project developed a novel set of mechanisms to foster coordination between TSOs and DSOs from long-term planning to real-time operation. These TSO/DSO coordination mechanisms promotes a more cost-efficient and reliable utilization of DER located in transmission and distribution networks since the coordination mechanisms were considered during the development of both network planning and operation tools.
-ICT platform for TSO/DSO coordination: The ICT platform proposed in ATTEST project connects the existing and new TSO and DSO databases, handling and accessing data coming not only from traditional, large scale, heterogeneous and distributed sources and network devices, but also effect of the increasingly pervasive digitalization (e.g. sensors on windmills, smart appliances and vehicles to enhance electricity system’s flexibility, improved weather forecasts). Both standard and custom formats of data were tackled. The architecture, based on loosely coupled services, is modular and adaptive, supporting secure interoperability and enabling the integration of legacy tools provided by partners and technologies developed during the project. The platform is based on open source technologies and standards and allows to scale up, if and when necessary (e.g. to support the challenges of efficiently using streaming data coming from sensors), exploiting distributed and edge computing. The interface framework was designed to be pluggable, combining different visualization tools, and enabling to display data and results of computations and analysis carried out by the project tools. The user interface was decoupled from backend platform and modules, increasing flexibility and allowing personalization. The operators in the control room interact with a customizable dashboard, composed of widgets from a library of visualization components. The project also carried research on providing multimodal, state-of-the-art interaction with the interface, and an innovative and immersive user experience.
Impact
The work developed in ATTEST resulted in an advanced set of tools that will enable an optimised operation and planning of future power systems. The tools developed are the following:
- Optimization tool for distribution network planning
- Optimization tool for transmission network planning
- Optimization tool for planning tso/dso shared technologies
- Tool for ancillary services procurement in day-ahead operation planning for the distribution network
- Tool for ancillary services activation in real-time operation of the distribution network
- Tool for state estimation of distribution networks
- Tool for ancillary services procurement in day-ahead operation planning for the transmission network
- Tool for ancillary services activation in real-time operation of the transmission network
- Tool for on-line dynamic security assessment
- Tool for the characterization of the condition of assets
- Tool for the definition of condition indicators based on heterogeneous information sources
- Tool for the definition of smart asset management strategies
- Day-ahead and real-time optimization tools to support mes aggregators
- Market simulator
All the tools were integrated in a single multi-purpose ICT platform, which was demonstrated in real world conditions, in Croatia, with the assistance of the local DSO and TSO.
