Date: Wed, 29 Aug 2018 12:22:33 +0200 From: Marius Halden <marius.h@lden.org> To: Navdeep Parhar <np@FreeBSD.org> Cc: freebsd-net@freebsd.org Subject: Re: cxl nic not working after reboot Message-ID: <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> In-Reply-To: <20180829062843.GA25476@ox> References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Aug 29, 2018, at 08:28, Navdeep Parhar wrote:
> > > > Provide the output of these commands when the link isn't up:
> > > > # ifconfig -mvvv <interface>
> > > > # sysctl -n dev.t5nex.0.misc.devlog
>
> Can you provide the output from when the port is working?
Sure, the output from when it works follows.
--
Marius Halden
# ifconfig -mvvv cxl0
cxl0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=e800bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
capabilities=ecc7bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,TOE4,TOE6,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:42:cb:30
hwaddr 00:07:43:42:cb:30
inet 1.2.3.4 netmask 0xfffffffc broadcast 1.2.3.4
inet6 fe80::207:43ff:fe42:cb30%cxl0 prefixlen 64 scopeid 0x5
inet6 a:b:c:d::e prefixlen 126
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
media: Ethernet 1000baseSX <full-duplex,rxpause,txpause> (1000baseSX <full-duplex>)
status: active
supported media:
media 1000baseSX mediaopt full-duplex,rxpause,txpause
media 1000baseSX mediaopt full-duplex,rxpause
media 1000baseSX mediaopt full-duplex,txpause
media 1000baseSX mediaopt full-duplex
plugged: SFP/SFP+/SFP28 1000BASE-LX (LC)
vendor: Fiberworks PN: SFP-L80D-C49-U SN: FBSW491434 DATE: 2017-09-27
module temperature: 41.41 C Voltage: 3.26 Volts
RX: 0.27 mW (-5.53 dBm) TX: 1.62 mW (2.10 dBm)
SFF8472 DUMP (0xA0 0..127 range):
03 04 07 00 00 00 02 10 10 10 01 01 0D 00 50 FF
00 00 00 00 46 69 62 65 72 77 6F 72 6B 73 20 20
20 20 20 20 00 8A 34 BC 53 46 50 2D 4C 38 30 44
2D 43 34 39 2D 55 20 20 31 2E 30 20 05 D2 00 29
00 1A 00 00 46 42 53 57 34 39 31 34 33 34 20 20
20 20 20 20 31 37 30 39 32 37 20 20 68 90 01 B8
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
# sysctl dev.t5nex.0.misc.devlog
dev.t5nex.0.misc.devlog: Seq# Tstamp Level Facility Message
39 930246 INFO TM pktsched_cl_rl[0:9]: mode | unit | rate 0x010001 min 0 max 2000000 pktsize 1500
40 930246 NOTICE TM ch_cl_rate[0/9]: capped deficit_incr from required 20000 to 10000; rate 2000000 (eff 1000000) deficit_max 6144
41 931254 INFO TM pktsched_cl_rl[0:10]: mode | unit | rate 0x010001 min 0 max 2500000 pktsize 1500
42 931255 NOTICE TM ch_cl_rate[0/10]: capped deficit_incr from required 25000 to 10000; rate 2500000 (eff 1000000) deficit_max 6144
43 932261 INFO TM pktsched_cl_rl[0:11]: mode | unit | rate 0x010001 min 0 max 3000000 pktsize 1500
44 932261 NOTICE TM ch_cl_rate[0/11]: capped deficit_incr from required 30000 to 10000; rate 3000000 (eff 1000000) deficit_max 6144
45 933268 INFO TM pktsched_cl_rl[0:12]: mode | unit | rate 0x010001 min 0 max 3500000 pktsize 1500
46 933269 NOTICE TM ch_cl_rate[0/12]: capped deficit_incr from required 35000 to 10000; rate 3500000 (eff 1000000) deficit_max 6144
47 934275 INFO TM pktsched_cl_rl[0:13]: mode | unit | rate 0x010001 min 0 max 4000000 pktsize 1500
48 934276 NOTICE TM ch_cl_rate[0/13]: capped deficit_incr from required 40000 to 10000; rate 4000000 (eff 1000000) deficit_max 6144
49 935284 INFO TM pktsched_cl_rl[0:14]: mode | unit | rate 0x010001 min 0 max 5000000 pktsize 1500
50 935284 NOTICE TM ch_cl_rate[0/14]: capped deficit_incr from required 50000 to 10000; rate 5000000 (eff 1000000) deficit_max 6144
51 936290 INFO TM pktsched_cl_rl[0:15]: mode | unit | rate 0x010001 min 0 max 10000000 pktsize 1500
52 936291 NOTICE TM ch_cl_rate[0/15]: capped deficit_incr from required 100000 to 10000; rate 10000000 (eff 1000000) deficit_max 6144
53 937311 INFO TM pktsched_cl_rl[1:0]: mode | unit | rate 0x010001 min 0 max 100000 pktsize 1500
54 938318 INFO TM pktsched_cl_rl[1:1]: mode | unit | rate 0x010001 min 0 max 200000 pktsize 1500
55 939334 INFO TM pktsched_cl_rl[1:2]: mode | unit | rate 0x010001 min 0 max 400000 pktsize 1500
56 940349 INFO TM pktsched_cl_rl[1:3]: mode | unit | rate 0x010001 min 0 max 500000 pktsize 1500
57 941367 INFO TM pktsched_cl_rl[1:4]: mode | unit | rate 0x010001 min 0 max 800000 pktsize 1500
58 942379 INFO TM pktsched_cl_rl[1:5]: mode | unit | rate 0x010001 min 0 max 1000000 pktsize 1500
59 943386 INFO TM pktsched_cl_rl[1:6]: mode | unit | rate 0x010001 min 0 max 1200000 pktsize 1500
60 943387 NOTICE TM ch_cl_rate[1/6]: capped deficit_incr from required 12000 to 10000; rate 1200000 (eff 1000000) deficit_max 6144
61 944393 INFO TM pktsched_cl_rl[1:7]: mode | unit | rate 0x010001 min 0 max 1500000 pktsize 1500
62 944394 NOTICE TM ch_cl_rate[1/7]: capped deficit_incr from required 15000 to 10000; rate 1500000 (eff 1000000) deficit_max 6144
63 945419 INFO TM pktsched_cl_rl[1:8]: mode | unit | rate 0x010001 min 0 max 1800000 pktsize 1500
64 945420 NOTICE TM ch_cl_rate[1/8]: capped deficit_incr from required 18000 to 10000; rate 1800000 (eff 1000000) deficit_max 6144
65 946430 INFO TM pktsched_cl_rl[1:9]: mode | unit | rate 0x010001 min 0 max 2000000 pktsize 1500
66 946431 NOTICE TM ch_cl_rate[1/9]: capped deficit_incr from required 20000 to 10000; rate 2000000 (eff 1000000) deficit_max 6144
67 947458 INFO TM pktsched_cl_rl[1:10]: mode | unit | rate 0x010001 min 0 max 2500000 pktsize 1500
68 947459 NOTICE TM ch_cl_rate[1/10]: capped deficit_incr from required 25000 to 10000; rate 2500000 (eff 1000000) deficit_max 6144
69 948470 INFO TM pktsched_cl_rl[1:11]: mode | unit | rate 0x010001 min 0 max 3000000 pktsize 1500
70 948470 NOTICE TM ch_cl_rate[1/11]: capped deficit_incr from required 30000 to 10000; rate 3000000 (eff 1000000) deficit_max 6144
71 949492 INFO TM pktsched_cl_rl[1:12]: mode | unit | rate 0x010001 min 0 max 3500000 pktsize 1500
72 949493 NOTICE TM ch_cl_rate[1/12]: capped deficit_incr from required 35000 to 10000; rate 3500000 (eff 1000000) deficit_max 6144
73 950499 INFO TM pktsched_cl_rl[1:13]: mode | unit | rate 0x010001 min 0 max 4000000 pktsize 1500
74 950500 NOTICE TM ch_cl_rate[1/13]: capped deficit_incr from required 40000 to 10000; rate 4000000 (eff 1000000) deficit_max 6144
75 951503 INFO TM pktsched_cl_rl[1:14]: mode | unit | rate 0x010001 min 0 max 5000000 pktsize 1500
76 951504 NOTICE TM ch_cl_rate[1/14]: capped deficit_incr from required 50000 to 10000; rate 5000000 (eff 1000000) deficit_max 6144
77 952510 INFO TM pktsched_cl_rl[1:15]: mode | unit | rate 0x010001 min 0 max 10000000 pktsize 1500
78 952511 NOTICE TM ch_cl_rate[1/15]: capped deficit_incr from required 100000 to 10000; rate 10000000 (eff 1000000) deficit_max 6144
79 953519 INFO TM pktsched_cl_rl[2:0]: mode | unit | rate 0x010001 min 0 max 100000 pktsize 1500
80 954526 INFO TM pktsched_cl_rl[2:1]: mode | unit | rate 0x010001 min 0 max 200000 pktsize 1500
81 955534 INFO TM pktsched_cl_rl[2:2]: mode | unit | rate 0x010001 min 0 max 400000 pktsize 1500
82 956541 INFO TM pktsched_cl_rl[2:3]: mode | unit | rate 0x010001 min 0 max 500000 pktsize 1500
83 957545 INFO TM pktsched_cl_rl[2:4]: mode | unit | rate 0x010001 min 0 max 800000 pktsize 1500
84 958553 INFO TM pktsched_cl_rl[2:5]: mode | unit | rate 0x010001 min 0 max 1000000 pktsize 1500
85 959560 INFO TM pktsched_cl_rl[2:6]: mode | unit | rate 0x010001 min 0 max 1200000 pktsize 1500
86 959561 NOTICE TM ch_cl_rate[2/6]: capped deficit_incr from required 12000 to 10000; rate 1200000 (eff 1000000) deficit_max 6144
87 960567 INFO TM pktsched_cl_rl[2:7]: mode | unit | rate 0x010001 min 0 max 1500000 pktsize 1500
88 960568 NOTICE TM ch_cl_rate[2/7]: capped deficit_incr from required 15000 to 10000; rate 1500000 (eff 1000000) deficit_max 6144
89 961581 INFO TM pktsched_cl_rl[2:8]: mode | unit | rate 0x010001 min 0 max 1800000 pktsize 1500
90 961582 NOTICE TM ch_cl_rate[2/8]: capped deficit_incr from required 18000 to 10000; rate 1800000 (eff 1000000) deficit_max 6144
91 962591 INFO TM pktsched_cl_rl[2:9]: mode | unit | rate 0x010001 min 0 max 2000000 pktsize 1500
92 962592 NOTICE TM ch_cl_rate[2/9]: capped deficit_incr from required 20000 to 10000; rate 2000000 (eff 1000000) deficit_max 6144
93 963613 INFO TM pktsched_cl_rl[2:10]: mode | unit | rate 0x010001 min 0 max 2500000 pktsize 1500
94 963613 NOTICE TM ch_cl_rate[2/10]: capped deficit_incr from required 25000 to 10000; rate 2500000 (eff 1000000) deficit_max 6144
95 964618 INFO TM pktsched_cl_rl[2:11]: mode | unit | rate 0x010001 min 0 max 3000000 pktsize 1500
96 964619 NOTICE TM ch_cl_rate[2/11]: capped deficit_incr from required 30000 to 10000; rate 3000000 (eff 1000000) deficit_max 6144
97 965626 INFO TM pktsched_cl_rl[2:12]: mode | unit | rate 0x010001 min 0 max 3500000 pktsize 1500
98 965627 NOTICE TM ch_cl_rate[2/12]: capped deficit_incr from required 35000 to 10000; rate 3500000 (eff 1000000) deficit_max 6144
99 966632 INFO TM pktsched_cl_rl[2:13]: mode | unit | rate 0x010001 min 0 max 4000000 pktsize 1500
100 966633 NOTICE TM ch_cl_rate[2/13]: capped deficit_incr from required 40000 to 10000; rate 4000000 (eff 1000000) deficit_max 6144
101 967637 INFO TM pktsched_cl_rl[2:14]: mode | unit | rate 0x010001 min 0 max 5000000 pktsize 1500
102 967638 NOTICE TM ch_cl_rate[2/14]: capped deficit_incr from required 50000 to 10000; rate 5000000 (eff 1000000) deficit_max 6144
103 968643 INFO TM pktsched_cl_rl[2:15]: mode | unit | rate 0x010001 min 0 max 10000000 pktsize 1500
104 968644 NOTICE TM ch_cl_rate[2/15]: capped deficit_incr from required 100000 to 10000; rate 10000000 (eff 1000000) deficit_max 6144
105 969651 INFO TM pktsched_cl_rl[3:0]: mode | unit | rate 0x010001 min 0 max 100000 pktsize 1500
106 970656 INFO TM pktsched_cl_rl[3:1]: mode | unit | rate 0x010001 min 0 max 200000 pktsize 1500
107 971662 INFO TM pktsched_cl_rl[3:2]: mode | unit | rate 0x010001 min 0 max 400000 pktsize 1500
108 972676 INFO TM pktsched_cl_rl[3:3]: mode | unit | rate 0x010001 min 0 max 500000 pktsize 1500
109 973683 INFO TM pktsched_cl_rl[3:4]: mode | unit | rate 0x010001 min 0 max 800000 pktsize 1500
110 974696 INFO TM pktsched_cl_rl[3:5]: mode | unit | rate 0x010001 min 0 max 1000000 pktsize 1500
111 975701 INFO TM pktsched_cl_rl[3:6]: mode | unit | rate 0x010001 min 0 max 1200000 pktsize 1500
112 975702 NOTICE TM ch_cl_rate[3/6]: capped deficit_incr from required 12000 to 10000; rate 1200000 (eff 1000000) deficit_max 6144
113 976718 INFO TM pktsched_cl_rl[3:7]: mode | unit | rate 0x010001 min 0 max 1500000 pktsize 1500
114 976719 NOTICE TM ch_cl_rate[3/7]: capped deficit_incr from required 15000 to 10000; rate 1500000 (eff 1000000) deficit_max 6144
115 977724 INFO TM pktsched_cl_rl[3:8]: mode | unit | rate 0x010001 min 0 max 1800000 pktsize 1500
116 977724 NOTICE TM ch_cl_rate[3/8]: capped deficit_incr from required 18000 to 10000; rate 1800000 (eff 1000000) deficit_max 6144
117 978729 INFO TM pktsched_cl_rl[3:9]: mode | unit | rate 0x010001 min 0 max 2000000 pktsize 1500
118 978730 NOTICE TM ch_cl_rate[3/9]: capped deficit_incr from required 20000 to 10000; rate 2000000 (eff 1000000) deficit_max 6144
119 979741 INFO TM pktsched_cl_rl[3:10]: mode | unit | rate 0x010001 min 0 max 2500000 pktsize 1500
120 979742 NOTICE TM ch_cl_rate[3/10]: capped deficit_incr from required 25000 to 10000; rate 2500000 (eff 1000000) deficit_max 6144
121 980748 INFO TM pktsched_cl_rl[3:11]: mode | unit | rate 0x010001 min 0 max 3000000 pktsize 1500
122 980749 NOTICE TM ch_cl_rate[3/11]: capped deficit_incr from required 30000 to 10000; rate 3000000 (eff 1000000) deficit_max 6144
123 981752 INFO TM pktsched_cl_rl[3:12]: mode | unit | rate 0x010001 min 0 max 3500000 pktsize 1500
124 981753 NOTICE TM ch_cl_rate[3/12]: capped deficit_incr from required 35000 to 10000; rate 3500000 (eff 1000000) deficit_max 6144
125 982757 INFO TM pktsched_cl_rl[3:13]: mode | unit | rate 0x010001 min 0 max 4000000 pktsize 1500
126 982758 NOTICE TM ch_cl_rate[3/13]: capped deficit_incr from required 40000 to 10000; rate 4000000 (eff 1000000) deficit_max 6144
127 983764 INFO TM pktsched_cl_rl[3:14]: mode | unit | rate 0x010001 min 0 max 5000000 pktsize 1500
128 983765 NOTICE TM ch_cl_rate[3/14]: capped deficit_incr from required 50000 to 10000; rate 5000000 (eff 1000000) deficit_max 6144
129 984777 INFO TM pktsched_cl_rl[3:15]: mode | unit | rate 0x010001 min 0 max 10000000 pktsize 1500
130 984778 NOTICE TM ch_cl_rate[3/15]: capped deficit_incr from required 100000 to 10000; rate 10000000 (eff 1000000) deficit_max 6144
131 4187455 INFO PORT port_link_state_handler[0] powering up
132 4187465 INFO PORT port[0] update (flowcid 37976 rc 0)
133 4387456 INFO PORT port_link_state_handler[3] powering up
134 4387461 INFO PORT port[3] update (flowcid 37976 rc 0)
135 4687456 INFO PORT port_hss_sigdet[3]: hss_sigdet changed to 0x8
136 4787455 INFO PORT hw_mac_link_status[3] int_cause 0x1001c70, link_status 0x12
137 4787459 INFO PORT port[0] link up (1) (speed 0x2 acaps 0x70002 lpcaps 0x70000)
138 4787461 INFO PORT port[0] set PAUSE PARAMS: pppen 0 txpe 0x1 rxpe 0x1
139 4787466 INFO PORT port[0] update (flowcid 37976 rc 0)
140 4987456 INFO PORT port[3] link up (1) (speed 0x4 acaps 0x70004 lpcaps 0x70000)
141 4987458 INFO PORT port[3] set PAUSE PARAMS: pppen 0 txpe 0x1 rxpe 0x1
142 4987461 INFO PORT port[3] update (flowcid 37976 rc 0)
143 1101452970 INFO PORT port[0] link down (1) (lstatus 0)
144 1101452985 INFO PORT port_link_state_handler[0] powering down
145 1111851077 INFO PORT port_link_state_handler[0] powering up
146 1111851081 INFO PORT port[0] update (flowcid 37976 rc 0)
147 1112351080 INFO PORT port[0] link up (2) (speed 0x2 acaps 0x70002 lpcaps 0x70000)
148 1112351082 INFO PORT port[0] set PAUSE PARAMS: pppen 0 txpe 0x1 rxpe 0x1
149 1112351085 INFO PORT port[0] update (flowcid 37976 rc 0)
150 89576640597 INFO PORT cx4_cr_module_rx_los[0]: rx_los changed to 1
151 89576640600 INFO PORT port[0] link down (2) (lstatus 0xe)
152 89576640615 INFO PORT port[0] update (flowcid 37976 rc 0)
153 89578040605 INFO PORT port_link_state_handler[0] powering down
154 89578040607 INFO PORT port[0] update (flowcid 37976 rc 0)
155 89578040665 INFO PORT hw_mac_init_port[0], ptype 0x9, speed 0x2, lanes 0x1, fec 0x0
156 89578140604 INFO PORT port[0] update (flowcid 37976 rc 0)
157 89580543122 INFO PORT module[0]: gpio 11 vendor id 8a34bc, identifier 0x03, SFP28(byte 36/192) 0xff, SFP(byte 3/131) 0x00, 1G (byte 6) 0x02
158 89580543123 INFO PORT optical length(byte 15/142) 255, copper cable(byte 8/147) 0xff, length(byte 18/146) 0, module_type 0x02
159 89580543131 INFO PORT port_link_state_handler[0] powering up
160 89580543134 INFO PORT port[0] update (flowcid 37976 rc 0)
161 89580840611 INFO PORT cx4_cr_module_rx_los[0]: rx_los changed to 1
162 89580840615 INFO PORT port[0] update (flowcid 37976 rc 0)
163 89584740624 INFO PORT cx4_cr_module_rx_los[0]: rx_los changed to 0
164 89584940626 INFO PORT port[0] link up (3) (speed 0x2 acaps 0x70002 lpcaps 0)
165 89584940628 INFO PORT port[0] set PAUSE PARAMS: pppen 0 txpe 0 rxpe 0
166 89584940631 INFO PORT port[0] update (flowcid 37976 rc 0)
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1535538153.459716.1489861176.29777B66>