Lustre (file system)
 |
|
| Initial release | December 16, 2003 |
|---|---|
| Stable release |
2.5.3 (last public Intel maintenance release),
2.9.0 (latest major release) / December 7, 2016 |
| Preview release |
2.9.50 / December 7, 2016
|
| Written in | C |
| Operating system | Linux kernel |
| Type | Distributed file system |
| License | GPL v2 |
| Website | lustre |
 |
|
| Private | |
| Founded | 2001 |
| Founder | Peter J. Braam |
| Headquarters | Boulder, Colorado |
|
Key people
|
Phil Schwan, Eric Barton, Andreas Dilger |
| Products | Lustre file system |
| Website | www |
| Introduced | December, 2003 with Linux |
|---|---|
| Structures | |
| Directory contents | Hash, Interleaved Hash with DNE in 2.7+ |
| Limits | |
| Min. volume size | 32 MB |
| Max. volume size | 100 PB (production), over 16 EB (theoretical) |
| Max. file size | 3.2 PB (ext4), 16 EB (ZFS) |
| File size granularity | 4 KB |
| Max. number of files | Per Metadata Target (MDT): 4 billion files (ldiskfs backend), 256 trillion files (ZFS backend), up to 128 MDTs per filesystem |
| Max. filename length | 255 bytes |
| Max. dirname length | 255 bytes |
| Max. directory depth | 4096 bytes |
| Allowed characters in filenames | All bytes except NUL ('\0') and '/' and the special file names "." and ".." |
| Features | |
| Dates recorded | modification (mtime), attribute modification (ctime), access (atime), delete (dtime), create (crtime) |
| Date range | 2^34 bits (ext4), 2^64 bits (ZFS) |
| Date resolution | 1 s |
| Forks | n |
| Attributes | 32bitapi, acl, checksum, flock, lazystatfs, localflock, lruresize, noacl, nochecksum, noflock, nolazystatfs, nolruresize, nouser_fid2path, nouser_xattr, user_fid2path, user_xattr |
| File system permissions | POSIX, POSIX.1e ACL, SELinux |
| Transparent compression | y (ZFS) |
| Transparent encryption | n |
| Data deduplication | y (ZFS) |
| Copy-on-write | y (ZFS) |
| Other | |
| Supported operating systems | Linux kernel |
2.9.0 (latest major release)
Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. The name Lustre is a portmanteau word derived from Linux and cluster. Lustre file system software is available under the GNU General Public License (version 2 only) and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site clusters.
Because Lustre file systems have high performance capabilities and open licensing, it is often used in supercomputers. Since June 2005, it has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world, including the world's No. 2 and No. 3 ranked TOP500 supercomputers in 2014, Titan and Sequoia.
Lustre file systems are scalable and can be part of multiple computer clusters with tens of thousands of client nodes, tens of petabytes (PB) of storage on hundreds of servers, and more than a terabyte per second (TB/s) of aggregate I/O throughput. This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance.
The Lustre file system architecture was started as a research project in 1999 by Peter J. Braam, who was on the staff of Carnegie Mellon University (CMU) at the time. Braam went on to found his own company Cluster File Systems in 2001, starting from work on the InterMezzo file system in the Coda project at CMU. Lustre was developed under the Accelerated Strategic Computing Initiative Path Forward project funded by the United States Department of Energy, which included Hewlett-Packard and Intel. In September 2007, Sun Microsystems acquired the assets of Cluster File Systems Inc. including its intellectual property. Sun included Lustre with its high-performance computing hardware offerings, with the intent to bring Lustre technologies to Sun's ZFS file system and the Solaris operating system. In November 2008, Braam left Sun Microsystems, and Eric Barton and Andreas Dilger took control of the project. In 2010 Oracle Corporation, by way of its acquisition of Sun, began to manage and release Lustre.
...
Wikipedia