SPEC and SPEC SFS are registered trademarks of the Standard Performance Evaluation Corporation
1Quick Start Guide 3
1.1Prerequisites 3
1.2Installing the SPEC SFS 2014 Benchmark 4
1.3Editing the configuration file on the Prime client 5
1.4Installing the license key 7
1.5Configuring the storage solution for testing 8
1.6Starting the benchmark 8
1.7Monitoring the benchmark execution 8
1.8Examining the results after the benchmark execution has completed 9
2Introduction 10
2.1What is the SPEC SFS 2014 Benchmark 10
2.2SPEC SFS 2014 Benchmark Overview 11
Benchmark Manager 12
Database (DATABASE) Benchmark 15
Software Build (SWBUILD) Benchmark 17
Video Data Acquisition (VDA) Benchmark 21
Virtual Desktop Infrastructure (VDI) Benchmark 23
3 Installing and Configuring the Benchmark Environment 27
3.1Setting up the Solution Under Test (SUT) 27
3.2Setting up the Load Generators 28
Configuring SPEC SFS 2014 Windows Clients for Auto-Startup 28
3.3Configuring the Required Benchmark Parameters 29
Other Variables in the RC File 30
4Running the Benchmark and Interpreting Results 32
4.1SFS Benchmark Directory Structure 32
4.2Pre-Compiled SPEC SFS 2014 Benchmark Binaries 32
4.3Using the SFS Manager 33
Example of SUT Validation 33
Example of a Benchmark Run 33
5Submission and Review Process 36
5.1Creating Reports 36
Creating the Submission Package 37
5.2Submitting Results 37
6FAQ 37
6.1SPEC SFS 2014 Benchmark Press Release 37
6.2Tuning the Solution 41
6.3Submission of Results 42
7Trademarks 42
8Research corner 43
8.1Custom changes to SfsManager to add new workloads. 43
8.2Custom workload objects 43
Export current workload definitions 43
Workload object attribute definitions 43
Edit workload definitions 46
Import workload definitions 46
Appendix A – Building SFS Benchmark Components 47
8.3Building the SPEC SFS 2014 benchmark for UNIX 47
8.4Building the SPEC SFS 2014 benchmark for Windows 47
Update Visual Studio Libraries/Includes 47
Open the Visual Studio solution file 47
Build the individual project files 47
Debugging with Visual Studio 48
Appendix B – Setting up password-less SSH 49
9Appendix C “Tunes for the load generators” 50
9.1Linux tunes 50
9.2 Windows tunes 50
The SPEC SFS 2014 benchmark is used to measure the maximum sustainable throughput that a storage solution can deliver. The benchmark is protocol independent. It will run over any version of NFS or SMB/CIFS, clustered file systems, object oriented file systems, local file systems, or any other POSIX compatible file system. Because this tool runs at the application system call level, it is file system type agnostic. This provides strong portability across operating systems, and storage solutions. The SPEC SFS 2014 benchmark already runs on Linux, Windows 7, Windows 8, Windows Server 2003, Windows Server 2008, Windows 2012, Mac OS X, BSD, Solaris, and AIX, and can be used to test any of the files-system types that these systems offer.