BLOGS: My COW Blog Adobe Blog Editing Technology After Effects Final Cut Entertainment

10Gb and SMB3 really rocks

COW Blogs : Steve Modica's Blog : 10Gb and SMB3 really rocks
We got RSS working on our 10Gb cards a few days ago. This is a feature that splits up data coming into the card into multiple queues. Then we can let different CPUS handle pulling in that data and passing it up the stack. We found what we figured we'd find: When we setup multiple streams, we see data in multiple queues. We see more cpus involved in the work, and things go a lot faster.

What surprised us was how great this made SAMBA. When we tested SMB3 with Yosemite, we were able to hit line rate (10Gb/sec) between two systems! This is due to SMB Multichannel. It's amazing. Soon, we should be able to extend this across adapters as well (we actually can, but not to the same share). This will let us do things like FC and iSCSI do today, but with a NAS. We'll be able to stripe bandwidth.

Steve


Posted by: Steve Modica on Jul 30, 2014 at 3:04:19 pmComments (6) storage, networking

Comments

Re: 10Gb and SMB3 really rocks
by Roy Pearson
Steve,

Any more thoughts on SMB3 and Yosemite? Do you now recommend using it over AFP?
Re: 10Gb and SMB3 really rocks
by Philipp Meier
That's exciting. Please keep us updated!

When you say "single port performance is very good" does that mean that bonding two ports together does not work well yet?

Planning to bond two 10gb ports from our Mac mini server to our switch. Our clients would connect via 1gb or a single 10gb connection to the switch. Some clients would be running 10.9 others 10.10.
Re: 10Gb and SMB3 really rocks
by Steve Modica
We're still working on this. The samba4 code does not support it yet. The multichannel code is still alpha (but it's in the tree and can be built). They are talking about release in spring. We're actually doing tests this week mac to mac now that Yosemite is out.

Single port performance is very good.

One of the reasons we were testing was because we implemented RSS (receive side scaling). This allows multiple receive rings. We wanted to see them all get used.

Steve Modica
CTO, Small Tree Communications
Re: 10Gb and SMB3 really rocks
by Philipp Meier
So just to confirm as long as both our Server and all of our clients are on OSX 10.10 with your latest 3.1.1 drivers we will automatically be taking advantage of SMB3 multichannel without having to do anything else? Just plug it in and go?

Do we still need to use your "proprierty" sysctl.conf file or does everything run out of the box with 10.10 and SMB 3 now?

I'm cautiously optimistic. Looking forward to your reply!
Re: 10Gb and SMB3 really rocks
by Steve Modica
We didn't do anything actually. We just started receiving and watching the 10Gb card queues. We were seeing traffic on all the RSS queues (we have RSS implemented in our drivers now). We're still investigating what makes that work. We did not have multiple ports going at the same time.

Steve Modica
CTO, Small Tree Communications
Re: 10Gb and SMB3 really rocks
by Philipp Meier
Hey Steve,

How did you enable multi channel in OSX 10.10? I was under the impression that Apple has not yet implemented this feature in OSX. Could you share details? How can we get RCC and multichannel running on network with your 10gb cards?
© 2019 CreativeCOW.net All Rights Reserved
[TOP]