Reply to post:

On that things to think about category you are so itching to try and find fault with:

Percona Sysbench: MySQL TPC-C with help from Micron who isn't the fastest in that test. Audited by Percona among others to verify the accuracy and relevance of the test data.

FIO: Help with deployment by Jens (developer) while he worked for Fusion-io. Audited by many others in the space and we share workload parameters used in reviews. Open source workload generator...

MarkLogic NoSQL: Deployed with MarkLogic... no storage vendor attachment

SQL Server TPC-C: Worked with Microsoft Server and SQL Server teams to build and participate, using Benchmark Factory from Dell/Quest. Click the profile of choice you want to run, set the scale and click "run test".

VMmark: Worked with the developers of VMmark at VMware to deploy almost two years ago (well before VSAN or before we even worked with that team). One of the most audited benchmarks out there.

OpenLDAP: Worked work the developer of the software to deploy. No storage vendor attachment

Veeam backup test: Worked with Veeam to deploy. No storage vendor attachment

Its not a bad thing to ask for help. It helps to have an open mind. Before any new test gets added to our site we run the idea past most vendors we work with and industry insiders to check for relevance. When vendors can provide input and offer help, it builds trust in ways many don't seem to understand.