From: Sergey Senozhatsky on
On (07/26/10 16:34), Eric Dumazet wrote:
> > Sorry for the dealy - I've been away.
> > So, the bad news are that this is probably the last time I can test this bug. This laptop will
> > no longer be available. Sorry.
> >
> >
> > [ 2599.495508] pktgen 2.73: Packet Generator for packet performance testing.
> > [ 2630.016019] ------------[ cut here ]------------
> > [ 2630.016031] WARNING: at net/sched/sch_generic.c:258 dev_watchdog+0xc1/0x129()
> > [ 2630.016035] Hardware name: F3JC
> > [ 2630.016038] NETDEV WATCHDOG: eth0 (r8169): transmit queue 0 timed out
> > [ 2630.016041] Modules linked in: pktgen ipv6 arc4 ecb iwl3945 snd_hwdep iwlcore snd_seq_dummy snd_hda_codec_si3054 snd_hda_codec_realtek snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device mac80211 snd_pcm_oss snd_mixer_oss asus_laptop
> > snd_hda_intel sparse_keymap sdhci_pci sdhci mmc_core led_class cfg80211 snd_hda_codec snd_pcm snd_timer snd_page_alloc snd rng_core soundcore usb_storage sg psmouse evdev i2c_i801 serio_raw r8169 mii uhci_hcd ehci_hcd sd_mod sr_mod usbcore
> > cdrom ata_piix
> > [ 2630.016114] Pid: 4282, comm: kpktgend_0 Not tainted 2.6.35-rc6-dbg-git1-00136-g459ab2a-dirty #75
> > [ 2630.016118] Call Trace:
> > [ 2630.016125] [<c102e3ae>] warn_slowpath_common+0x65/0x7a
> > [ 2630.016131] [<c12695f3>] ? dev_watchdog+0xc1/0x129
> > [ 2630.016136] [<c102e427>] warn_slowpath_fmt+0x26/0x2a
> > [ 2630.016142] [<c12695f3>] dev_watchdog+0xc1/0x129
> > [ 2630.016149] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
> > [ 2630.016154] [<c103710c>] run_timer_softirq+0x18f/0x22b
> > [ 2630.016160] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
> > [ 2630.016165] [<c1269532>] ? dev_watchdog+0x0/0x129
> > [ 2630.016171] [<c1032c35>] __do_softirq+0x88/0x10c
> > [ 2630.016177] [<c1032ce8>] do_softirq+0x2f/0x47
> > [ 2630.016182] [<c1032fa5>] irq_exit+0x38/0x75
> > [ 2630.016187] [<c10159b8>] smp_apic_timer_interrupt+0x5f/0x6d
> > [ 2630.016195] [<f80555e4>] ? pktgen_xmit+0xda2/0xe6f [pktgen]
> > [ 2630.016202] [<c12c75a2>] apic_timer_interrupt+0x36/0x3c
> > [ 2630.016208] [<f80555e4>] ? pktgen_xmit+0xda2/0xe6f [pktgen]
> > [ 2630.016214] [<f80555e4>] ? pktgen_xmit+0xda2/0xe6f [pktgen]
> > [ 2630.016220] [<c104007b>] ? __kfifo_peek_n+0x13/0x2b
> > [ 2630.016226] [<c1032edd>] ? _local_bh_enable_ip+0x9d/0xb3
> > [ 2630.016231] [<c1032efb>] local_bh_enable_ip+0x8/0xa
> > [ 2630.016236] [<c12c6aaa>] _raw_spin_unlock_bh+0x2f/0x32
> > [ 2630.016242] [<f80555e4>] pktgen_xmit+0xda2/0xe6f [pktgen]
> > [ 2630.016253] [<f91707b8>] ? rtl8169_start_xmit+0x0/0x307 [r8169]
> > [ 2630.016261] [<c11800d8>] ? plist_add+0x85/0x87
> > [ 2630.016267] [<f80558ac>] ? pktgen_thread_worker+0x96/0x5c3 [pktgen]
> > [ 2630.016273] [<c1029096>] ? get_parent_ip+0xb/0x31
> > [ 2630.016279] [<c1029138>] ? sub_preempt_count+0x7c/0x89
> > [ 2630.016285] [<f8055986>] pktgen_thread_worker+0x170/0x5c3 [pktgen]
> > [ 2630.016290] [<c12c52bb>] ? schedule+0x535/0x545
> > [ 2630.016296] [<c103fd96>] ? autoremove_wake_function+0x0/0x2f
> > [ 2630.016301] [<c103fd96>] ? autoremove_wake_function+0x0/0x2f
> > [ 2630.016307] [<f8055816>] ? pktgen_thread_worker+0x0/0x5c3 [pktgen]
> > [ 2630.016313] [<c103faa6>] kthread+0x6a/0x6f
> > [ 2630.016318] [<c103fa3c>] ? kthread+0x0/0x6f
> > [ 2630.016324] [<c1002d82>] kernel_thread_helper+0x6/0x10
> > [ 2630.016328] ---[ end trace 0bdadff7f249bd0d ]---
> > [ 2630.032549] r8169 0000:02:00.0: eth0: link up
> >
> >
> > Sergey
>

Hello,

> r8169 driver misses a netif_carrier_off() call somewhere, probably when
> adapter is reset
>
> Sergey, do you run a pktgen only test (sending packets, and not
> receiving packets during the test), or a mixed workload ?
>

Only sending.

--
PGDEV=/proc/net/pktgen/eth0
echo "Configuring $PGDEV"
pgset "$COUNT"
pgset "$CLONE_SKB"
pgset "$PKT_SIZE"
pgset "$DELAY"
pgset "dst 192.168.x.x"
pgset "dst_mac x:x:x:x:x:x"

PGDEV=/proc/net/pktgen/pgctrl

echo "Running..."
pgset "start"
--


> r8169 is known to reset if the RX ring buffer is stressed too much.
>

Sergey
From: Eric Dumazet on
Le lundi 26 juillet 2010 à 17:57 +0300, Sergey Senozhatsky a écrit :

>
> Only sending.
>
> --
> PGDEV=/proc/net/pktgen/eth0
> echo "Configuring $PGDEV"
> pgset "$COUNT"
> pgset "$CLONE_SKB"
> pgset "$PKT_SIZE"
> pgset "$DELAY"
> pgset "dst 192.168.x.x"
> pgset "dst_mac x:x:x:x:x:x"
>
> PGDEV=/proc/net/pktgen/pgctrl
>
> echo "Running..."
> pgset "start"
> --
>
>

If you try with a DELAY=3000 (or 5000), what happens ?

Do you have TX pause enabled ? If yes, try to disable pauses.

# ethtool -a eth0
Pause parameters for eth0:
Autonegotiate: on
RX: on
TX: on

# ethtool -A eth0 rx off tx off
# ethtool -a eth0
Pause parameters for eth0:
Autonegotiate: on
RX: off
TX: off



--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
From: Sergey Senozhatsky on


DELAY 3000

[ 302.735684] pktgen 2.73: Packet Generator for packet performance testing.
[ 345.008016] ------------[ cut here ]------------
[ 345.008028] WARNING: at net/sched/sch_generic.c:258
dev_watchdog+0xc1/0x129()
[ 345.008032] Hardware name: F3JC
[ 345.008035] NETDEV WATCHDOG: eth0 (r8169): transmit queue 0 timed out
[ 345.008038] Modules linked in: pktgen ipv6 arc4 ecb iwl3945 snd_seq_dummy
iwlcore mac80211 snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device
sdhci_pci sdhci mmc_core asus_laptop sparse_keymap led_class cfg
snd_mixer_oss snd_hda_codec_si3054 snd_hda_codec_realtek sg rng_core psmouse
snd_hda_intel evdev snd_hda_codec snd_pcm snd_timer i2c_i801 snd_page_alloc
serio_raw snd soundcore r8169 mii uhci_hcd ehci_hcd sr_mod
ata_piix
[ 345.008109] Pid: 4013, comm: kpktgend_0 Not tainted
2.6.35-rc6-dbg-git1-00136-g459ab2a-dirty #75
[ 345.008113] Call Trace:
[ 345.008121] [<c102e3ae>] warn_slowpath_common+0x65/0x7a
[ 345.008127] [<c12695f3>] ? dev_watchdog+0xc1/0x129
[ 345.008132] [<c102e427>] warn_slowpath_fmt+0x26/0x2a
[ 345.008137] [<c12695f3>] dev_watchdog+0xc1/0x129
[ 345.008145] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
[ 345.008150] [<c103710c>] run_timer_softirq+0x18f/0x22b
[ 345.008155] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
[ 345.008161] [<c1269532>] ? dev_watchdog+0x0/0x129
[ 345.008167] [<c1032c35>] __do_softirq+0x88/0x10c
[ 345.008173] [<c1032ce8>] do_softirq+0x2f/0x47
[ 345.008180] [<f80555e4>] ? pktgen_xmit+0xda2/0xe6f [pktgen]
[ 345.008185] [<c1032ecb>] _local_bh_enable_ip+0x8b/0xb3
[ 345.008191] [<c1032efb>] local_bh_enable_ip+0x8/0xa
[ 345.008197] [<c12c6aaa>] _raw_spin_unlock_bh+0x2f/0x32
[ 345.008203] [<f80555e4>] pktgen_xmit+0xda2/0xe6f [pktgen]
[ 345.008213] [<f91707b8>] ? rtl8169_start_xmit+0x0/0x307 [r8169]
[ 345.008220] [<c12c007b>] ? early_init_amd+0x49/0xad
[ 345.008227] [<f80558ac>] ? pktgen_thread_worker+0x96/0x5c3 [pktgen]
[ 345.008233] [<c1029096>] ? get_parent_ip+0xb/0x31
[ 345.008239] [<c1029138>] ? sub_preempt_count+0x7c/0x89
[ 345.008245] [<f8055986>] pktgen_thread_worker+0x170/0x5c3 [pktgen]
[ 345.008250] [<c12c52bb>] ? schedule+0x535/0x545
[ 345.008256] [<c103fd96>] ? autoremove_wake_function+0x0/0x2f
[ 345.008262] [<c103fd96>] ? autoremove_wake_function+0x0/0x2f
[ 345.008268] [<f8055816>] ? pktgen_thread_worker+0x0/0x5c3 [pktgen]
[ 345.008273] [<c103faa6>] kthread+0x6a/0x6f
[ 345.008279] [<c103fa3c>] ? kthread+0x0/0x6f
[ 345.008284] [<c1002d82>] kernel_thread_helper+0x6/0x10
[ 345.008289] ---[ end trace 12f779451dc46abe ]---
[ 345.024502] r8169 0000:02:00.0: eth0: link up




DELAY 5000

[ 72.186395] pktgen 2.73: Packet Generator for packet performance testing.
[ 102.817029] ------------[ cut here ]------------
[ 102.817040] WARNING: at net/sched/sch_generic.c:258
dev_watchdog+0xc1/0x129()
[ 102.817044] Hardware name: F3JC
[ 102.817047] NETDEV WATCHDOG: eth0 (r8169): transmit queue 0 timed out
[ 102.817050] Modules linked in: pktgen ipv6 snd_seq_dummy snd_seq_oss
snd_seq_midi_event snd_seq snd_seq_device arc4 ecb snd_hwdep iwl3945
snd_hda_codec_si3054 snd_pcm_oss snd_mixer_oss iwlcore asus_laptop
sparse_keymap sdhci_pci sdhci snd_hda_codec_realtek mac80211 mmc_core
led_class cfg80211 snd_hda_intel psmouse snd_hda_codec rng_core i2c_i801
snd_pcm snd_timer snd_page_alloc evdev sg serio_raw snd soundcore r8169 mii
uhci_hcd ehci_hcd sr_mod usbcore cdrom sd_mod ata_piix
[ 102.817121] Pid: 0, comm: swapper Not tainted
2.6.35-rc6-dbg-git1-00136-g459ab2a-dirty #75
[ 102.817125] Call Trace:
[ 102.817133] [<c102e3ae>] warn_slowpath_common+0x65/0x7a
[ 102.817138] [<c12695f3>] ? dev_watchdog+0xc1/0x129
[ 102.817144] [<c102e427>] warn_slowpath_fmt+0x26/0x2a
[ 102.817149] [<c12695f3>] dev_watchdog+0xc1/0x129
[ 102.817156] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
[ 102.817162] [<c103710c>] run_timer_softirq+0x18f/0x22b
[ 102.817167] [<c10370b3>] ? run_timer_softirq+0x136/0x22b
[ 102.817173] [<c1269532>] ? dev_watchdog+0x0/0x129
[ 102.817179] [<c1032c35>] __do_softirq+0x88/0x10c
[ 102.817185] [<c1032ce8>] do_softirq+0x2f/0x47
[ 102.817190] [<c1032fa5>] irq_exit+0x38/0x75
[ 102.817195] [<c10159b8>] smp_apic_timer_interrupt+0x5f/0x6d
[ 102.817202] [<c12c75a2>] apic_timer_interrupt+0x36/0x3c
[ 102.817209] [<c104007b>] ? __kfifo_peek_n+0x13/0x2b
[ 102.817215] [<c11dd72e>] ? acpi_idle_enter_simple+0x117/0x14b
[ 102.817222] [<c1246a21>] cpuidle_idle_call+0x6a/0xa0
[ 102.817227] [<c100170d>] cpu_idle+0x89/0xbe
[ 102.817234] [<c12c2085>] start_secondary+0x1f4/0x1fb
[ 102.817239] ---[ end trace 6b1be7ded90fe937 ]---
[ 102.833500] r8169 0000:02:00.0: eth0: link up


As for ethtool -a/-A, I have an "Cannot get device pause settings: Operation not supported" error.


Sergey