1b3ba Jumbo frames on lagg0 - The FreeBSD Forums
The FreeBSD Forums  

Go Back   The FreeBSD Forums > Server & Networking > Networking

Networking Network related discussions (including general TCP/IP stuff, routing, etc).

Reply
 
Thread Tools Display Modes
  #1  
Old December 21st, 2011, 01:58
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default Jumbo frames on lagg0

I use link aggregation with CARP and I want to change the MTU on lagg0 to 9000. How to do that?
My rc.conf right now is this:
Code:
defaultrouter="192.168.1.1"
ifconfig_re0="up"
ifconfig_msk0="up"
cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto lacp laggport re0 laggport msk0 192.168.1.2/24"
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by DutchDaemon; December 22nd, 2011 at 05:52. Reason: [color] instead of [file]? Seriously?
Reply With Quote
  #2  
Old December 21st, 2011, 02:06
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

It's an interesting question. First place to look is lagg(4)... and there it is:
$ man lagg | less -p MTU
Reply With Quote
  #3  
Old December 21st, 2011, 02:34
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

From
Code:
man lagg | less -p MTU
Quote:
The MTU of the first interface to be added is used as the lagg MTU.
So
Code:
ifconfig_re0="up mtu 9000"
ifconfig_msk0="up"
cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto lacp laggport re0 laggport msk0 192.168.1.2/24"
But ifconfig lagg0 returns mtu 1500
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by DutchDaemon; December 22nd, 2011 at 05:53. Reason: Proper formatting: http://forums.freebsd.org/showthread.php?t=8816
Reply With Quote
  #4  
Old December 21st, 2011, 02:59
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

The sentence right after that says
Quote:
All additional interfaces are required to have exactly the same value.
So figure out the maximum value for both interfaces, and use the smaller value. But make sure they really work. My re0's maximum MTU is 6122.
Reply With Quote
  #5  
Old December 21st, 2011, 03:08
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

I am lost about maximum and minimum values. To understand. I must set on re0 and msk0 the maximum or the minimum MTU? This phrase I cannot understand what means:
Quote:
So figure out the maximum value for both interfaces, and use the smaller value.
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by DutchDaemon; December 22nd, 2011 at 05:54. Reason: Proper formatting: http://forums.freebsd.org/showthread.php?t=8816
Reply With Quote
  #6  
Old December 21st, 2011, 04:10
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

By testing actual values, figure out the biggest MTU re0 supports (6122 here). Then figure out the biggest MTU msk0 supports. Use the smaller value of those two for both. So if msk0 can have an MTU of 9000, they both should be set to 6122, the smaller of the two. If msk0 only supports jumbo frames up to 4096, use 4096 for both. If msk0 doesn't support jumbo frames at all, they both have to be 1500 (so don't set the MTU at all).

Last edited by DutchDaemon; December 22nd, 2011 at 05:54.
Reply With Quote
The Following User Says Thank You to wblock@ For This Useful Post:
sk8harddiefast (December 21st, 2011)
  #7  
Old December 21st, 2011, 04:14
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

Ok. I understood How can I find the highest limit of jumbo frames for my re0 and for my msk0? And set the minimum of them for both. Right?
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by DutchDaemon; December 22nd, 2011 at 05:55. Reason: STOP USING COLOR!
Reply With Quote
  #8  
Old December 21st, 2011, 04:25
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

Try to set a value with ifconfig(8). My re0 gives an error for values larger than 6122. msk(4) says it will take up to 9022, but that might vary depending on the card. em(4) says the maximum is 16114, but mine only handles 9216. Try it:
# ifconfig msk0 mtu 9022

If it works, the easiest way to change things is to set the new value in /etc/rc.conf and restart. Of course they both have to be the same for lagg(4), and the switch also has to support jumbo frames.
Reply With Quote
  #9  
Old December 21st, 2011, 04:33
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

Code:
ifconfig msk0 mtu 9022
ifconfig: ioctl (set mtu): Invalid argument
Quote:
My re0 gives an error for values larger than 6122
Code:
ifconfig re0 mtu 6123 
ifconfig: ioctl (set mtu): Invalid argument
ifconfig re0 mtu 6122
ifconfig: ioctl (set mtu): Invalid argument
Huston you have a problem here
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by sk8harddiefast; December 21st, 2011 at 04:40.
Reply With Quote
  #10  
Old December 21st, 2011, 06:15
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

Try much smaller values, like 4096.
Reply With Quote
  #11  
Old December 21st, 2011, 12:14
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

I tried even to set MTU on 2000. Even there I get the same answer :/
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by DutchDaemon; December 22nd, 2011 at 05:56.
Reply With Quote
  #12  
Old December 21st, 2011, 17:05
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

The change on re0 ought to work. Are you trying that as root?

Last edited by DutchDaemon; December 22nd, 2011 at 05:56.
Reply With Quote
  #13  
Old December 21st, 2011, 17:18
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

Even as root I get the same.
Code:
[ember@BSD|ZFS ~]$ su root
Password:
BSD|ZFS# ifconfig re0 mtu 6122
ifconfig: ioctl (set mtu): Invalid argument
BSD|ZFS# ifconfig re0 mtu 2000
ifconfig: ioctl (set mtu): Invalid argument
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416
Reply With Quote
  #14  
Old December 21st, 2011, 18:12
wblock@'s Avatar
wblock@ wblock@ is offline
Moderator
 
Join Date: Sep 2009
Location: Milky Way galaxy
Posts: 7,711
Thanks: 432
Thanked 1,757 Times in 1,456 Posts
Default

re(4) shows that only some Realtek chipsets support jumbo frames.
$ pciconf -lv | grep -A4 re0@
Reply With Quote
  #15  
Old December 21st, 2011, 19:02
sk8harddiefast's Avatar
sk8harddiefast sk8harddiefast is online now
Senior Member
 
Join Date: Mar 2010
Location: Athens, Greece
Posts: 1,722
Thanks: 215
Thanked 142 Times in 88 Posts
Default

Code:
pciconf -lv | grep -A4 re0@
re0@pci0:5:4:0:	class=0x020000 card=0x820d1043 chip=0x816710ec rev=0x10 hdr=0x00
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL-8110SC/8169SC Gigabit Ethernet'
    class      = network
    subclass   = ethernet
Quote:
The 8169, 8169S and 8110S also support jumbo frames, which can be configured via the interface MTU setting. The MTU is limited to 7422, since the chip cannot transmit larger frames
__________________
====================================
| -------> UNIX. Live Free Or Die! <-------- |
====================================
You can say: I can't do something because is difficult.
You must say: I tried a lot before say that I can't.
Never Give up.
http://unixsystems.dyndns.org/
I am not an BSD expert. But I really want to help.
Don't afraid to ask me anything. If I can I will help!

Nice wallpapers to make your desktop more hardcore :) ---> http://forums.freebsd.org/showthread.php?t=13416

Last edited by sk8harddiefast; December 22nd, 2011 at 00:08.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
VirtualBox and Bridging with lagg0 on host skeyby Installation and Maintenance of FreeBSD Ports or Packages 0 December 1st, 2011 16:10
Jumbo frames and windows mtu size Sylhouette Networking 4 November 9th, 2011 12:54
Bridge and manipulating frames espric Firewalls 2 October 7th, 2011 19:13
CARP + Jumbo Frames (can't set mtu) Pfarthing6 Networking 2 June 27th, 2011 19:05
Non tagged frames statistics Antti Networking 3 November 3rd, 2009 00:35


All times are GMT +1. The time now is 13:41.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2013, vBulletin Solutions, Inc.
The mark FreeBSD is a registered trademark of The FreeBSD Foundation and is used by The FreeBSD Project with the permission of The FreeBSD Foundation.
Web protection and acceleration provided by CloudFlare
0