Main Page

From Concerted Flows: Infrastructure for Terabit/s Data Transfer
Jump to: navigation, search

Contents

Concerted Flows: Infrastructure for Terabit/s Networks

Traditional data transfer protocols fail to scale to high-speed networks as well as end-systems, and do not effectively satisfy the diverse needs of applications. The Concerted Flows project will design a protocol composition framework capable of combining a variety of protocol elements to achieve efficient transport based on application needs and network conditions. This project will also build a knowledge base capturing the data transfer patterns of several DOE applications.

Duration

Sep 2011 - Aug 2014

Milestones

Year 1

Year 2

  • Develop application data transfer benchmark kernel for FLASH analysis
  • Instrument and profile ENZO data transfers
  • Design data transfer benchmarking utility using the application kernels and Concerted Flows API
  • Design Flow coordination and multi-pathing heuristics for parallel data movement
  • Develop Concerted Flows using TCP, UDP and RDMA semantics.
  • Refine Concerted Flows API
  • Evaluate Concerted Flows on LAN testbed

Year 3

  • Develop application data transfer benchmark kernel for APS transfers
  • Develop application data transfer benchmark kernel for ENZO data transfers
  • Develop parallel data transfer benchmarking utility using Concerted Flows and application kernels
  • Investigate hybrid programming models for end-system aware data transport
  • Interface with perfSONAR
  • Refine Concerted Flows API
  • Evaluate Concerted Flows and benchmarking utility on LAN testbed
Personal tools