DoD NSA
How to deal with a trillion files?
- At 256 bytes of metadata per file -> 256TB just for the file system metadata for one trillion files
- File System resiliency
- Backups? Forget it.
File Creation Rate is a challenge – 32,000 file per second for 1 year will generate 1 trillion files
How to search for any given file
How to search for any given piece of information inside all the files