EMC/Isilon OneFS 5.5.7.x Source Code (from SVN)

Seeing the challenges with traditional storage architectures, and the pace at which file-based data was increasing, the founders of Isilon Systems developed a revolutionary new storage architecture—the OneFS® Operating System. The fundamental difference of EMC® Isilon® storage is that it uses intelligent software to scale data across vast quantities of commodity hardware, enabling explosive growth in performance and capacity. The three layers of the traditional storage model—file system, volume manager, and data protection—have evolved over time to suit the needs of small-scale storage architectures, but introduce significant complexity and are not well adapted to petabyte-scale systems. OneFS replaces all of these, providing a unifying clustered file system with built-in scalable data protection, and obviating the need for volume management. OneFS is a fundamental building block for scale-out infrastructures, allowing for massive scale and tremendous efficiency.

Crucially, OneFS is designed to scale not just in terms of machines, but also in human terms—allowing large-scale systems to be managed with a fraction of the personnel required for traditional storage systems. OneFS eliminates complexity and incorporates self-healing and self-managing functionality that dramatically reduces the burden of storage management. OneFS also incorporates parallelism at a very deep-level of the OS, such that virtually every key system service is distributed across multiple units of hardware. This allows OneFS to scale in virtually every dimension as the infrastructure is expanded, ensuring that what works today, will continue to work as the dataset grows.

OneFS is a fully symmetric file system with no single point of failure — taking advantage of clustering not just to scale performance and capacity, but also to allow for any-to-any failover and multiple levels of redundancy that go far beyond the capabilities of RAID. The trend for disk subsystems has been slowly-increasing performance while rapidly-increasing storage densities. OneFS responds to this reality by scaling the amount of redundancy as well as the speed of failure repair. This allows OneFS to grow to multi-petabyte scale while providing greater reliability than small, traditional storage systems.

Isilon scale-out NAS hardware provides the appliance on which OneFS executes. Hardware components are best-of-breed, but commodity-based — ensuring that Isilon hardware benefits from commodity hardware’s ever-improving cost and efficiency curves. OneFS allows hardware to be incorporated or removed from the cluster at will and at any time, abstracting the data and applications away from the hardware. Data is given infinite longevity, protected from the vicissitudes of evolving hardware generations. The cost and pain of data migrations and hardware refreshes are eliminated.

OneFS is ideally suited for file-based and unstructured “Big Data” applications in enterprise environments including large-scale home directories, file shares, archives, virtualization and business analytics. As such, OneFS is widely used in many data- intensive industries today, including energy, financial services, Internet and hosting services, business intelligence, engineering, manufacturing, media & entertainment, bioinformatics, scientific research and other high performance computing environments.

* EMC Isilon OneFS overview
OneFS combines the three layers of traditional storage architectures—file system, volume manager, and data protection—into one unified software layer, creating a single intelligent distributed file system that runs on an Isilon storage cluster.

This is the core innovation that directly enables enterprises to successfully utilize the scale-out NAS in their environments today. It adheres to the key principles of scale- out; intelligent software, commodity hardware and distributed architecture. OneFS is not only the operating system but also the underlying file system that drives and stores data in the Isilon scale-out NAS cluster.

http://www.emc.com/storage/i...n-onefs-operating-system.htm

http://www.emc.com/collatera...t/h10717-isilon-onefs-ds.pdf

http://www.emc.com/collatera...fs-technical-overview-wp.pdf

http://www.emc.com/collatera...s-overview-wp_20June2014.pdf