Test Labs are Expensive to Run/Maintain
Back in the 20th Century I wrote for PC Magazine and Network Computing when they could afford to pay well into six figures of dollars year on maintaining their labs. I also spent 25 years consulting to midmarket companies that regularly spent $50,000 a year on storage. None could afford a lab at all.
I run my lab on a shoestring getting donations of gear from vendors and buying other gear used from liquidators on eBay. The lab still costs over $50,000 a year to keep up and running. Rent on space for 5 racks worth of gear, $15,000 for air conditioning installation and electricians and of course a constant flow of new gear.
I'm currently running a 250 user VDI benchmark, that takes a half dozen servers with 96GB of RAM each.
Yes I do reviews for vendors, yes when it's turned out their product didn't work as expected the project was canceled. I count myself lucky that DeepStorage is small enough that I decide I generally like a product before I even pitch the vendor to test it.
You can believe everything a reputable analyst like those Chris mentioned, thanks Chris, tells you. You can't trust what you only think we say.
I've been lucky that my clients realize that "We'd really like to see feature X that's currently lacking in a future version" adds to the credibility when we say the product does Y and Z well.
- Howard