UDT is a reliable UDP based application level data transport protocol for distributed data intensive applications over wide area high-speed networks. UDT uses UDP to transfer bulk data with its own reliability control and congestion control mechanisms. The new protocol can transfer data at a much higher speed than TCP does. UDT also supports very effective firewall traversing with built-in technologies such as hole punching and rendezvous connection. The UDT protocol has been used in many research and commercial projects, including mission-critical defense and financial systems.
UDT is open source software available under the BSD license.
Sector/Sphere supports distributed data storage, distribution, and processing over large clusters of commodity computers. Sector is a high performance, scalable, and secure distributed file system. Sphere is a high performance parallel data processing engine that can process Sector data files with very simple programming interfaces. Sector/Sphere can be broadly compared to Google's GFS/MapReduce stack, but differs in several key design choices and provides better performance.
Compared to other GFS/MapReduce style systems such as Hadoop, Sector supports deployment across multiple data centers connected by high speed wide area networks, which benefits users with data at geographically distributed locations. On the other hand, the Sphere UDF model is more flexible than the MapReduce framework and supports better data locality for multiple input datasets and combinative/iterative operations.
Sector is open source software available under the BSD license.