I have a long dirt road up by my house that cuts straight across town. Before kids, I used to tool around in a E36 BMW M3. I normally didn't pay much attention to speed limits, but that dirt road would always slow me down. I took other routes to avoid it, and even with the traffic lights and congestion, I still felt like I was making better time.
This got me thinking. When we were first selling SAN systems 10 years ago, there were a lot of facilities that were still using local storage (DAS). When convincing them to move to network storage there is always that push-back: "If I need drive maintenance today, one room is down. If I have to take the SAN offline, the facility is down". That is true. We try to plan for these events ahead of time, but some things are out of our control. Suffice it to say that there may eventually be some down time.
Then I thought of that dirt road. Of all the streets around the city, that road is never closed for repaving or line painting, or repair of any kind. One guy with a shovel can maintain it. So, the traffic never stops, but it will never be an efficient way to get across town. If you're using DAS with generic NAS for file transfer, you have a dirt road. Very reliable, but incapable of handling increased traffic. If you're a facility owner, you want increased traffic. So, build the superhighway, and deal with the fact that you may have to pull out a detour sign once in a while. Once you see how much work can get done on a high performance network, you'll never go back to that dirt road.