SDN for End-to-end Networked Science at the Exascale (SENSE)

UMD/MAX is participating in the DOE Office of Science funded SENSE project which is led by the Lawrence Berkeley National Lab, and includes collaboration with Argonne National Lab, Fermi National Lab, and Caltech. Starting the summer of 2016, this project is focused on research and development in the area of end-to-end multi-domain SDN based infrastructures with intelligence supported abstract services for use by domain science users and workflow agents.

Traditionally, WAN and campus networks and services have evolved independently from each other. For example, MPLS traffic engineered and VPN technologies have been targeted towards the WAN, while the LAN (or last mile) implementations have not incorporated that functionality. These restrictions have resulted in dissonance in services offered in the WAN vs. the LAN. While OSCARS/NSI virtual circuits are widely deployed in the WAN, they typically only run from site boundary to site boundary, and require painful phone calls, manual configuration, and resource allocation decisions for last mile extension. Such inconsistencies in campus infrastructures, all the way from the campus edge to the data-transfer hosts, often lead to unpredictable application performance. New architectures such as the Science DMZ have been successful in simplifying the variance, but the Science DMZ is not designed or able to solve the end-to-end orchestration problem. With the advent of SDN, the R&E community has an opportunity to genuinely orchestrate end-to-end services – and not just from a network perspective, but also from an end- host perspective. In addition, with SDN, the opportunity exists to create a broader set of custom intelligent services that are targeted towards specific science application use-cases. This proposal describes an advanced deployment of SDN equipment and creation of a comprehensive SDN software platform that will help bring together the missing end-to-end story.

In order to capture and address the variety of end-site network requirements, policy variations, security postures and applications, the SENSE project will be focus on advanced deployment of SDN-capable equipment at two National Labs – Argonne and Fermi, two Universities – Caltech and University of Maryland and two DOE User Facilities – ESnet and NERSC. The project recognizes the complex nature of end-to-end problem and proposes to focus its initial deployments on Science DMZ locations at each of the end-sites. In addition, the creation of a flexible network operating system platform, based on SDN principles, that can run within the execution environment of a DTN, Science DMZ, campus LAN and/or the WAN is addressed. The SENSE Network Operating System (SENOS) provides a base for implementing the workflows and protocols to implement end-to-end orchestration across multiple SDN domains. In addition, our approach takes on the challenge of building the right set of abstractions and feedback mechanisms for the application to interact with the network. We explore the expression of intelligent network services as abstract Intents. Expressing the application requirements as ‘Intents’ ensures that the applications can specify what they need to accomplish, leaving the how to the intelligence in the network and availability of resources.