Prev: BUG? boot failed with "crashkernel=256M@32M", but "crashkernel=256M@64M" can work
Next: USB: testusb: imported David Brownell's USB testing application
From: Borislav Petkov on 9 Apr 2010 13:50
From: Linus Torvalds <torvalds(a)linux-foundation.org>
Date: Fri, Apr 09, 2010 at 09:35:15AM -0700

> Can you try with _just_ my patch?

Yep, yours along with the SLUB debugging piece just survived one
hibernation cycle without a problem. Also, no SIGBUS-killed processes,
all seems fine. Will continue stressing it though...

Let me know what you want me to do next.

--
Regards/Gruss,
Boris.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
From: Borislav Petkov on 9 Apr 2010 15:20
From: Linus Torvalds <torvalds(a)linux-foundation.org>
Date: Fri, Apr 09, 2010 at 10:50:23AM -0700

> Continue stress-testing it. I don't think my patch on its own should fix
> the original problem, but at least we now know why you got those NULL
> anon_vma's.
>
> So what I _think_ will happen is that you'll be able to re-create the
> problem that started this all. But I'd like to verify that, just because
> I'm anal and I'd like these things to be tested independently.

Heh, that was easy. Third hibernate cycle is a charm^Wboom :)

> So assuming that the original problem happens again, if you can then apply
> Rik's patch, but add a
>
> dst->anon_vma = src->anon_vma;
>
> to just before the success case (the "return 0") in anon_vma_clone(),
> that would be good.

It looks like this way we mangle the anon_vma chains somehow. From
what I can see and if I'm not mistaken, we save the anon_vmas alright
but end up in what seems like an endless list_for_each_entry()
loop having grabbed anon_vma->lock in page_lock_anon_vma() and we
can't seem to yield it through page_unlock_anon_vma() at the end of
page_referenced_anon() so it has to be that code in between iterating
over each list entry...

I could be completely wrong though...


[ 373.683545] PM: Syncing filesystems ... done.
[ 373.950289] Freezing user space processes ... (elapsed 0.04 seconds) done.
[ 373.998878] Freezing remaining freezable tasks ... (elapsed 0.01 seconds) done.
[ 374.011121] PM: Preallocating image memory...
[ 439.161126] BUG: soft lockup - CPU#1 stuck for 61s! [hib.sh:3617]
[ 439.161315] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 439.162302] irq event stamp: 0
[ 439.162302] hardirqs last enabled at (0): [<(null)>] (null)
[ 439.162302] hardirqs last disabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 439.163297] softirqs last enabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 439.163297] softirqs last disabled at (0): [<(null)>] (null)
[ 439.163297] CPU 1
[ 439.163297] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 439.165297]
[ 439.165297] Pid: 3617, comm: hib.sh Tainted: G W 2.6.34-rc3-00413-g1028f7c-dirty #12 M3A78 PRO/System Product Name
[ 439.165297] RIP: 0010:[<ffffffff8118b731>] [<ffffffff8118b731>] delay_tsc+0x0/0xca
[ 439.165297] RSP: 0018:ffff8801f68b77f0 EFLAGS: 00000202
[ 439.166300] RAX: 0000000000000000 RBX: ffff8801f68b77f8 RCX: 000000000000f100
[ 439.166300] RDX: 0000000000000001 RSI: ffff8801f68b7848 RDI: 0000000000000001
[ 439.166300] RBP: ffffffff81002b4e R08: 0000000000000001 R09: 0000000000000000
[ 439.166300] R10: ffff88022c9a3ac8 R11: ffffffff00000012 R12: 000000000000f100
[ 439.166300] R13: 00000000cc444700 R14: 0000000000000001 R15: 0000000000000000
[ 439.166300] FS: 00007f8d00e676f0(0000) GS:ffff88000a200000(0000) knlGS:0000000000000000
[ 439.167296] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 439.167296] CR2: 00007fff93e8a9c0 CR3: 00000001f5397000 CR4: 00000000000006e0
[ 439.167296] DR0: 00000000000000a0 DR1: 0000000000000000 DR2: 0000000000000003
[ 439.167296] DR3: 00000000000000b0 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 439.167296] Process hib.sh (pid: 3617, threadinfo ffff8801f68b6000, task ffff88022a2e8000)
[ 439.167296] Stack:
[ 439.168297] ffffffff8118b72f ffff8801f68b7848 ffffffff8119a1ca ffff880214972868
[ 439.168297] <0> 0000000000000001 ffff880100000000 ffff880214972850 ffff880214972868
[ 439.168297] <0> ffff8801f68b7cf8 ffff8801f68b7b78 ffff8801f68b7a00 ffff8801f68b7878
[ 439.169298] Call Trace:
[ 439.169298] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 439.169298] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 439.169298] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 439.170299] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 439.170299] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 439.170299] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 439.170299] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 439.170299] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 439.170299] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 439.170299] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 439.171296] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 439.171296] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 439.171296] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 439.171296] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 439.171296] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 439.171296] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 439.171296] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 439.172298] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 439.172298] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 439.172298] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 439.172298] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 439.172298] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 439.172298] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 439.173296] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 439.173296] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 439.173296] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 439.173296] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 439.173296] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[ 439.173296] Code: ff c8 c9 c3 55 48 89 e5 0f 1f 44 00 00 48 c7 05 12 35 4e 00 31 b7 18 81 c9 c3 55 48 89 e5 0f 1f 44 00 00 ff 15 01 35 4e 00 c9 c3 <55> 48 89 e5 41 57 41 56 41 55 41 54 53 48 83 ec 08 0f 1f 44 00
[ 439.176296] Call Trace:
[ 439.177297] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 439.177297] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 439.177297] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 439.177297] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 439.177297] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 439.177297] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 439.177297] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 439.178295] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 439.178295] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 439.178295] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 439.178295] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 439.178295] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 439.178295] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 439.178295] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 439.179299] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 439.179299] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 439.179299] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 439.179299] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 439.179299] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 439.179299] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 439.180296] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 439.180296] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 439.180296] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 439.180296] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 439.180296] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 439.180296] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 439.180296] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 439.181297] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[ 504.659125] BUG: soft lockup - CPU#1 stuck for 61s! [hib.sh:3617]
[ 504.659126] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 504.660297] irq event stamp: 0
[ 504.660297] hardirqs last enabled at (0): [<(null)>] (null)
[ 504.660297] hardirqs last disabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 504.661298] softirqs last enabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 504.661298] softirqs last disabled at (0): [<(null)>] (null)
[ 504.661298] CPU 1
[ 504.661298] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 504.663297]
[ 504.663297] Pid: 3617, comm: hib.sh Tainted: G W 2.6.34-rc3-00413-g1028f7c-dirty #12 M3A78 PRO/System Product Name
[ 504.663297] RIP: 0010:[<ffffffff8118b775>] [<ffffffff8118b775>] delay_tsc+0x44/0xca
[ 504.663297] RSP: 0018:ffff8801f68b77b8 EFLAGS: 00000206
[ 504.663297] RAX: 00000000a4911fed RBX: ffff8801f68b77e8 RCX: 000000000000f100
[ 504.664326] RDX: 00000000000000f1 RSI: ffff8801f68b7848 RDI: 0000000000000001
[ 504.664326] RBP: ffffffff81002b4e R08: 0000000000000001 R09: 0000000000000000
[ 504.664326] R10: ffff88022c9a3ac8 R11: ffffffff00000012 R12: 0000000000000010
[ 504.664326] R13: ffff88000a200000 R14: ffff8801f68b6000 R15: ffff8801f68b7fd8
[ 504.664326] FS: 00007f8d00e676f0(0000) GS:ffff88000a200000(0000) knlGS:0000000000000000
[ 504.664326] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 504.665296] CR2: 00007fff93e8a9c0 CR3: 00000001f5397000 CR4: 00000000000006e0
[ 504.665296] DR0: 00000000000000a0 DR1: 0000000000000000 DR2: 0000000000000003
[ 504.665296] DR3: 00000000000000b0 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 504.665296] Process hib.sh (pid: 3617, threadinfo ffff8801f68b6000, task ffff88022a2e8000)
[ 504.665296] Stack:
[ 504.665296] 0000000000000001 ffff880214972850 ffff88022a2e8000 00000000b3450160
[ 504.666297] <0> ffff88022a2e83a8 000000005486e668 ffff8801f68b77f8 ffffffff8118b72f
[ 504.666297] <0> ffff8801f68b7848 ffffffff8119a1ca ffff880214972868 0000000000000001
[ 504.667298] Call Trace:
[ 504.667298] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 504.667298] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 504.667298] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 504.667298] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 504.668288] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 504.668298] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 504.668298] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 504.668298] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 504.668298] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 504.668298] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 504.668298] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 504.669296] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 504.669296] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 504.669296] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 504.669296] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 504.669296] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 504.669296] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 504.669296] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 504.670302] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 504.670302] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 504.670302] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 504.670302] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 504.670302] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 504.670302] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 504.670302] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 504.671297] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 504.671297] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 504.673315] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[ 504.674350] Code: bf 01 00 00 00 e8 f8 1d ea ff e8 9f f4 00 00 41 89 c5 0f ae f0 66 66 90 0f 31 89 c3 65 4c 8b 34 25 48 b5 00 00 0f ae f0 66 66 90 <0f> 31 41 89 c7 4c 89 f8 48 29 d8 4c 39 e0 73 49 bf 01 00 00 00
[ 504.677299] Call Trace:
[ 504.677299] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 504.677299] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 504.677299] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 504.677299] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 504.678287] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 504.678296] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 504.678296] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 504.678296] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 504.678296] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 504.678296] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 504.678296] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 504.679297] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 504.679297] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 504.679297] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 504.679297] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 504.679297] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 504.679297] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 504.679297] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 504.680303] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 504.680303] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 504.680303] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 504.680303] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 504.680303] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 504.680303] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 504.680303] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 504.681297] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 504.681297] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 504.681297] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[ 570.157125] BUG: soft lockup - CPU#1 stuck for 61s! [hib.sh:3617]
[ 570.157126] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 570.158283] irq event stamp: 0
[ 570.158283] hardirqs last enabled at (0): [<(null)>] (null)
[ 570.158283] hardirqs last disabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 570.159297] softirqs last enabled at (0): [<ffffffff8103655c>] copy_process+0x3c1/0x10cc
[ 570.159297] softirqs last disabled at (0): [<(null)>] (null)
[ 570.159297] CPU 1
[ 570.159297] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 serial_core edac_core pcspkr k10temp ohci_hcd
[ 570.161297]
[ 570.161297] Pid: 3617, comm: hib.sh Tainted: G W 2.6.34-rc3-00413-g1028f7c-dirty #12 M3A78 PRO/System Product Name
[ 570.161297] RIP: 0010:[<ffffffff8118b777>] [<ffffffff8118b777>] delay_tsc+0x46/0xca
[ 570.161297] RSP: 0018:ffff8801f68b77b8 EFLAGS: 00000206
[ 570.161297] RAX: 000000007cdde43c RBX: ffff8801f68b77e8 RCX: 000000000000f100
[ 570.162296] RDX: 000000000000011f RSI: ffff8801f68b7848 RDI: 0000000000000001
[ 570.162296] RBP: ffffffff81002b4e R08: 0000000000000001 R09: 0000000000000000
[ 570.162296] R10: ffff88022c9a3ac8 R11: ffffffff00000012 R12: 0000000000000010
[ 570.162296] R13: ffff88000a200000 R14: ffff8801f68b6000 R15: ffff8801f68b7fd8
[ 570.162296] FS: 00007f8d00e676f0(0000) GS:ffff88000a200000(0000) knlGS:0000000000000000
[ 570.162296] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 570.163296] CR2: 00007fff93e8a9c0 CR3: 00000001f5397000 CR4: 00000000000006e0
[ 570.163296] DR0: 00000000000000a0 DR1: 0000000000000000 DR2: 0000000000000003
[ 570.163296] DR3: 00000000000000b0 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 570.163296] Process hib.sh (pid: 3617, threadinfo ffff8801f68b6000, task ffff88022a2e8000)
[ 570.163296] Stack:
[ 570.163296] 0000000000000001 ffff880214972850 ffff88022a2e8000 00000000b3450160
[ 570.164335] <0> ffff88022a2e83a8 000000007f0025c7 ffff8801f68b77f8 ffffffff8118b72f
[ 570.164335] <0> ffff8801f68b7848 ffffffff8119a1ca ffff880214972868 0000000000000001
[ 570.165299] Call Trace:
[ 570.165299] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 570.165299] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 570.165299] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 570.165299] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 570.165299] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 570.166297] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 570.166297] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 570.166297] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 570.166297] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 570.166297] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 570.166297] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 570.167296] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 570.167296] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 570.167296] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 570.167296] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 570.167296] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 570.167296] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 570.167296] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 570.168286] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 570.168286] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 570.168286] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 570.168286] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 570.168286] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 570.168286] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 570.168286] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 570.169297] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 570.169297] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 570.169297] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[ 570.169297] Code: 00 00 00 e8 f8 1d ea ff e8 9f f4 00 00 41 89 c5 0f ae f0 66 66 90 0f 31 89 c3 65 4c 8b 34 25 48 b5 00 00 0f ae f0 66 66 90 0f 31 <41> 89 c7 4c 89 f8 48 29 d8 4c 39 e0 73 49 bf 01 00 00 00 e8 07
[ 570.172299] Call Trace:
[ 570.172299] [<ffffffff8118b72f>] ? __delay+0xf/0x11
[ 570.172299] [<ffffffff8119a1ca>] ? do_raw_spin_lock+0xd2/0x13c
[ 570.173297] [<ffffffff813f827b>] ? _raw_spin_lock+0x60/0x73
[ 570.173297] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 570.173297] [<ffffffff810c0a37>] ? page_lock_anon_vma+0x63/0xac
[ 570.173297] [<ffffffff810c09d4>] ? page_lock_anon_vma+0x0/0xac
[ 570.173297] [<ffffffff810c0c1d>] ? page_referenced+0x80/0x1dc
[ 570.173297] [<ffffffff810c0b22>] ? try_to_unmap_anon+0xa2/0xb4
[ 570.174329] [<ffffffff810ab7a6>] ? shrink_page_list+0x14a/0x477
[ 570.174329] [<ffffffff813f8d86>] ? _raw_spin_unlock_irq+0x30/0x58
[ 570.174329] [<ffffffff810abe2a>] ? shrink_inactive_list+0x357/0x5e5
[ 570.174329] [<ffffffff810ab64a>] ? shrink_active_list+0x232/0x244
[ 570.174329] [<ffffffff810ac3c4>] ? shrink_zone+0x30c/0x3d6
[ 570.174329] [<ffffffff810acf9f>] ? do_try_to_free_pages+0x176/0x27f
[ 570.174329] [<ffffffff810ad13d>] ? shrink_all_memory+0x95/0xc4
[ 570.175297] [<ffffffff810aa640>] ? isolate_pages_global+0x0/0x1f0
[ 570.175297] [<ffffffff81076e60>] ? count_data_pages+0x65/0x79
[ 570.175297] [<ffffffff810770c7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[ 570.175297] [<ffffffff813f5285>] ? printk+0x41/0x44
[ 570.175297] [<ffffffff81075a67>] ? hibernation_snapshot+0x36/0x1e1
[ 570.175297] [<ffffffff81075ce0>] ? hibernate+0xce/0x172
[ 570.175297] [<ffffffff81074a4d>] ? state_store+0x5c/0xd3
[ 570.176298] [<ffffffff81184f8f>] ? kobj_attr_store+0x17/0x19
[ 570.176298] [<ffffffff81125dd7>] ? sysfs_write_file+0x108/0x144
[ 570.176298] [<ffffffff810d575f>] ? vfs_write+0xb2/0x153
[ 570.176298] [<ffffffff81063bed>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 570.176298] [<ffffffff810d58c3>] ? sys_write+0x4a/0x71
[ 570.176298] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b


--
Regards/Gruss,
Boris.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
From: Borislav Petkov on 9 Apr 2010 17:50
From: Johannes Weiner <hannes(a)cmpxchg.org>
Date: Fri, Apr 09, 2010 at 10:43:28PM +0200

Hi Hannes :) ,

> ---
> Subject: mm: properly merge anon_vma_chains when merging vmas
>
> Merging can happen when two VMAs were split from one root VMA or
> a mergeable VMA was instantiated and reused a nearby VMA's anon_vma.
>
> In both cases, none of the VMAs can grow any more anon_vmas and forked
> VMAs can no longer get merged due to differing primary anon_vmas for
> their private COW-broken pages.
>
> In the split case, the anon_vma_chains are equal and we can just drop
> the one of the VMA that is going away.
>
> In the other case, the VMA that was instantiated later has only one
> anon_vma on its chain: the primary anon_vma of its merge partner (due
> to anon_vma_prepare()).
>
> If the VMA that came later is going away, its anon_vma_chain is a
> subset of the one that is staying, so it can be dropped like in the
> split case.
>
> Only if the VMA that came first is going away, its potential parent
> anon_vmas need to be migrated to the VMA that is staying.
>
> Signed-off-by: Johannes Weiner <hannes(a)cmpxchg.org>
> ---
>
> It compiles and boots but I have not really excercised this code.
> Boris, could you give it a spin? Thanks!

ok, I got this ontop of mainline (no other patches from this thread)
but unfortunately it breaks at the same spot while under heavy page
reclaiming when trying to hibernate while booting 3 guests.

[ 322.171120] PM: Preallocating image memory...
[ 322.477374] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 322.477376] IP: [<ffffffff810c0c87>] page_referenced+0xee/0x1dc
[ 322.477376] PGD 2014e8067 PUD 221b4e067 PMD 0
[ 322.477376] Oops: 0000 [#1] PREEMPT SMP
[ 322.477376] last sysfs file: /sys/devices/system/cpu/cpu3/cpufreq/scaling_cur_freq
[ 322.477376] CPU 3
[ 322.477376] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 pcspkr serial_core k10temp ohci_hcd edac_core
[ 322.477376]
[ 322.477376] Pid: 2750, comm: hib.sh Tainted: G W 2.6.34-rc3-00411-ga7247b6 #13 M3A78 PRO/System Product Name
[ 322.477376] RIP: 0010:[<ffffffff810c0c87>] [<ffffffff810c0c87>] page_referenced+0xee/0x1dc
[ 322.477376] RSP: 0018:ffff88020936d8b8 EFLAGS: 00010283
[ 322.477376] RAX: ffff88022de91af0 RBX: ffffea0006dcb488 RCX: 0000000000000000
[ 322.477376] RDX: ffff88020936dcf8 RSI: ffff88022de91ac8 RDI: ffff88022ced0000
[ 322.477376] RBP: ffff88020936d938 R08: 0000000000000002 R09: 0000000000000000
[ 322.477376] R10: 0000000000000246 R11: 0000000000000003 R12: 0000000000000000
[ 322.477376] R13: ffffffffffffffe0 R14: ffff88022de91ab0 R15: ffff88020936da00
[ 322.477376] FS: 00007f286493e6f0(0000) GS:ffff88000a600000(0000) knlGS:0000000000000000
[ 322.477376] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 322.477376] CR2: 0000000000000000 CR3: 00000001f8354000 CR4: 00000000000006e0
[ 322.477376] DR0: 0000000000000090 DR1: 00000000000000a4 DR2: 00000000000000ff
[ 322.477376] DR3: 000000000000000f DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 322.477376] Process hib.sh (pid: 2750, threadinfo ffff88020936c000, task ffff88022ced0000)
[ 322.477376] Stack:
[ 322.477376] ffff88022de91af0 00000000813f8eec ffffffff8165ce28 000000000000002e
[ 322.477376] <0> ffff88020936d8f8 ffffffff810c60bc ffffea0006dcb450 ffffea0006dcb450
[ 322.477376] <0> ffff88020936d938 00000002810ab29d 0000000006f316b0 ffffea0006dcb4b0
[ 322.477376] Call Trace:
[ 322.477376] [<ffffffff810c60bc>] ? swapcache_free+0x37/0x3c
[ 322.477376] [<ffffffff810ab7c2>] shrink_page_list+0x14a/0x477
[ 322.477376] [<ffffffff810abe46>] shrink_inactive_list+0x357/0x5e5
[ 322.477376] [<ffffffff810ab666>] ? shrink_active_list+0x232/0x244
[ 322.477376] [<ffffffff810ac3e0>] shrink_zone+0x30c/0x3d6
[ 322.477376] [<ffffffff810acfbb>] do_try_to_free_pages+0x176/0x27f
[ 322.477376] [<ffffffff810ad159>] shrink_all_memory+0x95/0xc4
[ 322.477376] [<ffffffff810aa65c>] ? isolate_pages_global+0x0/0x1f0
[ 322.477376] [<ffffffff81076e7c>] ? count_data_pages+0x65/0x79
[ 322.477376] [<ffffffff810770e3>] hibernate_preallocate_memory+0x1aa/0x2cb
[ 322.477376] [<ffffffff813f5325>] ? printk+0x41/0x44
[ 322.477376] [<ffffffff81075a83>] hibernation_snapshot+0x36/0x1e1
[ 322.477376] [<ffffffff81075cfc>] hibernate+0xce/0x172
[ 322.477376] [<ffffffff81074a69>] state_store+0x5c/0xd3
[ 322.477376] [<ffffffff81185043>] kobj_attr_store+0x17/0x19
[ 322.477376] [<ffffffff81125e87>] sysfs_write_file+0x108/0x144
[ 322.477376] [<ffffffff810d580f>] vfs_write+0xb2/0x153
[ 322.477376] [<ffffffff81063c09>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 322.477376] [<ffffffff810d5973>] sys_write+0x4a/0x71
[ 322.477376] [<ffffffff810021db>] system_call_fastpath+0x16/0x1b
[ 322.477376] Code: 3b 56 10 73 1e 48 83 fa f2 74 18 48 8d 4d cc 4d 89 f8 48 89 df e8 77 f2 ff ff 41 01 c4 83 7d cc 00 74 19 4d 8b 6d 20 49 83 ed 20 <49> 8b 45 20 0f 18 08 49 8d 45 20 48 39 45 80 75 aa 4c 89 f7 e8
[ 322.477376] RIP [<ffffffff810c0c87>] page_referenced+0xee/0x1dc
[ 322.477376] RSP <ffff88020936d8b8>
[ 322.477376] CR2: 0000000000000000
[ 322.491359] ---[ end trace 520a5274d8859b71 ]---
[ 322.491509] note: hib.sh[2750] exited with preempt_count 2
[ 322.491663] BUG: scheduling while atomic: hib.sh/2750/0x10000003
[ 322.491810] INFO: lockdep is turned off.
[ 322.491956] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 pcspkr serial_core k10temp ohci_hcd edac_core
[ 322.493364] Pid: 2750, comm: hib.sh Tainted: G D W 2.6.34-rc3-00411-ga7247b6 #13
[ 322.493622] Call Trace:
[ 322.493768] [<ffffffff8106311f>] ? __debug_show_held_locks+0x1b/0x24
[ 322.493919] [<ffffffff8102d3d0>] __schedule_bug+0x72/0x77
[ 322.494070] [<ffffffff813f572e>] schedule+0xd9/0x730
[ 322.494223] [<ffffffff8103023c>] __cond_resched+0x18/0x24
[ 322.494378] [<ffffffff813f5e52>] _cond_resched+0x2c/0x37
[ 322.494527] [<ffffffff810b7da5>] unmap_vmas+0x6ce/0x893
[ 322.494678] [<ffffffff813f8e86>] ? _raw_spin_unlock_irqrestore+0x38/0x69
[ 322.494829] [<ffffffff810bc457>] exit_mmap+0xd7/0x182
[ 322.494978] [<ffffffff81035969>] mmput+0x48/0xb9
[ 322.495131] [<ffffffff81039c39>] exit_mm+0x110/0x11d
[ 322.495280] [<ffffffff8103b67b>] do_exit+0x1c5/0x691
[ 322.495521] [<ffffffff81038d25>] ? kmsg_dump+0x13b/0x155
[ 322.495668] [<ffffffff810060db>] ? oops_end+0x47/0x93
[ 322.495816] [<ffffffff81006122>] oops_end+0x8e/0x93
[ 322.495964] [<ffffffff8101ed95>] no_context+0x1fc/0x20b
[ 322.496118] [<ffffffff8101ef30>] __bad_area_nosemaphore+0x18c/0x1af
[ 322.496267] [<ffffffff8101f16b>] ? do_page_fault+0xa8/0x32d
[ 322.496484] [<ffffffff8101ef66>] bad_area_nosemaphore+0x13/0x15
[ 322.496630] [<ffffffff8101f236>] do_page_fault+0x173/0x32d
[ 322.496780] [<ffffffff813f96e3>] ? error_sti+0x5/0x6
[ 322.496928] [<ffffffff81062bc7>] ? trace_hardirqs_off_caller+0x1f/0xa9
[ 322.497082] [<ffffffff813f80d2>] ? trace_hardirqs_off_thunk+0x3a/0x3c
[ 322.497232] [<ffffffff813f94ff>] page_fault+0x1f/0x30
[ 322.497392] [<ffffffff810c0c87>] ? page_referenced+0xee/0x1dc
[ 322.497541] [<ffffffff810c0c19>] ? page_referenced+0x80/0x1dc
[ 322.497690] [<ffffffff810c60bc>] ? swapcache_free+0x37/0x3c
[ 322.497839] [<ffffffff810ab7c2>] shrink_page_list+0x14a/0x477
[ 322.497989] [<ffffffff810abe46>] shrink_inactive_list+0x357/0x5e5
[ 322.498141] [<ffffffff810ab666>] ? shrink_active_list+0x232/0x244
[ 322.498291] [<ffffffff810ac3e0>] shrink_zone+0x30c/0x3d6
[ 322.498444] [<ffffffff810acfbb>] do_try_to_free_pages+0x176/0x27f
[ 322.498594] [<ffffffff810ad159>] shrink_all_memory+0x95/0xc4
[ 322.498743] [<ffffffff810aa65c>] ? isolate_pages_global+0x0/0x1f0
[ 322.498892] [<ffffffff81076e7c>] ? count_data_pages+0x65/0x79
[ 322.499046] [<ffffffff810770e3>] hibernate_preallocate_memory+0x1aa/0x2cb
[ 322.499195] [<ffffffff813f5325>] ? printk+0x41/0x44
[ 322.499344] [<ffffffff81075a83>] hibernation_snapshot+0x36/0x1e1
[ 322.499498] [<ffffffff81075cfc>] hibernate+0xce/0x172
[ 322.499647] [<ffffffff81074a69>] state_store+0x5c/0xd3
[ 322.499795] [<ffffffff81185043>] kobj_attr_store+0x17/0x19
[ 322.499944] [<ffffffff81125e87>] sysfs_write_file+0x108/0x144
[ 322.500097] [<ffffffff810d580f>] vfs_write+0xb2/0x153
[ 322.500246] [<ffffffff81063c09>] ? trace_hardirqs_on_caller+0x1f/0x14b
[ 322.500399] [<ffffffff810d5973>] sys_write+0x4a/0x71
[ 322.500547] [<ffffffff810021db>] system_call_fastpath+0x16/0x1b

--
Regards/Gruss,
Boris.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
From: Borislav Petkov on 10 Apr 2010 03:30
From: Linus Torvalds <torvalds(a)linux-foundation.org>
Date: Fri, Apr 09, 2010 at 05:32:36PM -0700

> Exactly. This is the "let's limit things a bit to keep them much simpler.

You gotta love that rule :)

> > Let's hope it fixes Boris's issue.
>
> I'm going to just guess that it won't, and that Boris' issue was actually
> due to something else entirely, and we've all been staring at totally the
> wrong code.
>
> But we can hope.

Now why would you go and jinx it like that... :)

Hibernation runs back-to-back:

1. light system load after boot... ok
2. 3 kvm guests, 3Gb mem free of 8Gb total acc. to /proc/meminfo... ok [ this was the fireproof way to trigger the bug, btw]
3. kvm guests down, firefox loading a 4Mb html page... ok
4. start ubuntu guest, firefox keeps loading the 4Mb html page after previous resume... ok
5. ubuntu guest booting done, firefox done, play video... ok
6. video broken after resume due to:

[AO_ALSA] Pcm in suspend mode, trying to resume. 212% 2% 1.7% 1 0
[AO_ALSA] alsa-lib: pcm_hw.c:709:(snd_pcm_hw_resume) SNDRV_PCM_IOCTL_RESUME failed: Function not implemented

i.e., unrelated... still ok

7. ubuntu guest downloading a 100Mb file causing allocation of a bunch of anon memory in the host... ok
8. all guests off, firefox off, back to light load... ok

No oopsies or problems in dmesg except the old lockdep sysfs warning.

I will keep running that kernel in the next couple of days and keep you
informed in case this is the fix we're gonna use.

--
Regards/Gruss,
Boris.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
From: Borislav Petkov on 10 Apr 2010 09:50
From: Borislav Petkov <bp(a)alien8.de>
Date: Sat, Apr 10, 2010 at 09:27:14AM +0200

> Now why would you go and jinx it like that... :)
>
> Hibernation runs back-to-back:
>
> 1. light system load after boot... ok
> 2. 3 kvm guests, 3Gb mem free of 8Gb total acc. to /proc/meminfo... ok [ this was the fireproof way to trigger the bug, btw]
> 3. kvm guests down, firefox loading a 4Mb html page... ok
> 4. start ubuntu guest, firefox keeps loading the 4Mb html page after previous resume... ok
> 5. ubuntu guest booting done, firefox done, play video... ok
> 6. video broken after resume due to:
>
> [AO_ALSA] Pcm in suspend mode, trying to resume. 212% 2% 1.7% 1 0
> [AO_ALSA] alsa-lib: pcm_hw.c:709:(snd_pcm_hw_resume) SNDRV_PCM_IOCTL_RESUME failed: Function not implemented
>
> i.e., unrelated... still ok
>
> 7. ubuntu guest downloading a 100Mb file causing allocation of a bunch of anon memory in the host... ok
> 8. all guests off, firefox off, back to light load... ok
>
> No oopsies or problems in dmesg except the old lockdep sysfs warning.
>
> I will keep running that kernel in the next couple of days and keep you
> informed in case this is the fix we're gonna use.

Yep, you jinxed it :)

This time we got stuck on the anon_vma->lock (yep, we've seen that
oopsie before). So, it might be that we _really_ are staring at the
wrong code... Back to square one.


[18969.797126] BUG: soft lockup - CPU#1 stuck for 61s! [hib.sh:5605]
[18969.797126] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 ohci_hcd pcspkr serial_core k10temp edac_core
[18969.798029] irq event stamp: 0
[18969.798029] hardirqs last enabled at (0): [<(null)>] (null)
[18969.798029] hardirqs last disabled at (0): [<ffffffff8103657c>] copy_process+0x3c1/0x10cc
[18969.798029] softirqs last enabled at (0): [<ffffffff8103657c>] copy_process+0x3c1/0x10cc
[18969.798029] softirqs last disabled at (0): [<(null)>] (null)
[18969.798029] CPU 1
[18969.798029] Modules linked in: powernow_k8 cpufreq_ondemand cpufreq_powersave cpufreq_userspace freq_table cpufreq_conservative binfmt_misc kvm_amd kvm ipv6 vfat fat dm_crypt dm_mod 8250_pnp 8250 ohci_hcd pcspkr serial_core k10temp edac_core
[18969.798029]
[18969.798029] Pid: 5605, comm: hib.sh Not tainted 2.6.34-rc3-00501-gefb57c0 #1 M3A78 PRO/System Product Name
[18969.798029] RIP: 0010:[<ffffffff8118b7f4>] [<ffffffff8118b7f4>] delay_tsc+0x33/0xca
[18969.798029] RSP: 0018:ffff8801aebdf7b8 EFLAGS: 00000206
[18969.798029] RAX: 00000000fc6fc9e8 RBX: ffff8801aebdf7e8 RCX: 0000000000001200
[18969.798029] RDX: 0000000000002806 RSI: ffff8801aebdf848 RDI: 0000000000000001
[18969.798029] RBP: ffffffff81002b4e R08: 0000000000000001 R09: 0000000000000000
[18969.798029] R10: ffff8801aebdf8a8 R11: 0000000000000001 R12: 0000000000000014
[18969.798029] R13: ffff88000a200000 R14: ffff8801aebde000 R15: ffff8801aebdffd8
[18969.798029] FS: 00007f2c86c656f0(0000) GS:ffff88000a200000(0000) knlGS:0000000000000000
[18969.798029] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[18969.798029] CR2: 00007fd515101870 CR3: 000000022bd9a000 CR4: 00000000000006e0
[18969.798029] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[18969.798029] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[18969.798029] Process hib.sh (pid: 5605, threadinfo ffff8801aebde000, task ffff88022e194b80)
[18969.798029] Stack:
[18969.798029] 0000000000000001 ffff88022d2db720 ffff88022e194b80 00000000b3477260
[18969.798029] <0> ffff88022e194f28 000000002a5200c6 ffff8801aebdf7f8 ffffffff8118b7bf
[18969.798029] <0> ffff8801aebdf848 ffffffff8119a296 ffff88022d2db738 0000000000000001
[18969.798029] Call Trace:
[18969.798029] [<ffffffff8118b7bf>] ? __delay+0xf/0x11
[18969.798029] [<ffffffff8119a296>] ? do_raw_spin_lock+0xd2/0x13c
[18969.798029] [<ffffffff813f843b>] ? _raw_spin_lock+0x60/0x73
[18969.798029] [<ffffffff810c0ae3>] ? page_lock_anon_vma+0x63/0xac
[18969.798029] [<ffffffff810c0ae3>] ? page_lock_anon_vma+0x63/0xac
[18969.798029] [<ffffffff810c0a80>] ? page_lock_anon_vma+0x0/0xac
[18969.798029] [<ffffffff810c0cc9>] ? page_referenced+0x80/0x1dc
[18969.798029] [<ffffffff810c60a0>] ? swapcache_free+0x37/0x3c
[18969.798029] [<ffffffff810ab7e6>] ? shrink_page_list+0x14a/0x477
[18969.798029] [<ffffffff810abe6a>] ? shrink_inactive_list+0x357/0x5e5
[18969.798029] [<ffffffff810ab68a>] ? shrink_active_list+0x232/0x244
[18969.798029] [<ffffffff810ac404>] ? shrink_zone+0x30c/0x3d6
[18969.798029] [<ffffffff810acfdf>] ? do_try_to_free_pages+0x176/0x27f
[18969.798029] [<ffffffff810ad17d>] ? shrink_all_memory+0x95/0xc4
[18969.798029] [<ffffffff810aa680>] ? isolate_pages_global+0x0/0x1f0
[18969.798029] [<ffffffff81076e80>] ? count_data_pages+0x65/0x79
[18969.798029] [<ffffffff810770e7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[18969.798029] [<ffffffff813f5445>] ? printk+0x41/0x44
[18969.798029] [<ffffffff81075a87>] ? hibernation_snapshot+0x36/0x1e1
[18969.798029] [<ffffffff81075d00>] ? hibernate+0xce/0x172
[18969.798029] [<ffffffff81074a6d>] ? state_store+0x5c/0xd3
[18969.798029] [<ffffffff8118504b>] ? kobj_attr_store+0x17/0x19
[18969.798029] [<ffffffff81125e8b>] ? sysfs_write_file+0x108/0x144
[18969.798029] [<ffffffff810d5807>] ? vfs_write+0xb2/0x153
[18969.798029] [<ffffffff81063c0d>] ? trace_hardirqs_on_caller+0x1f/0x14b
[18969.798029] [<ffffffff810d596b>] ? sys_write+0x4a/0x71
[18969.798029] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[18969.798029] Code: 41 55 41 54 53 48 83 ec 08 0f 1f 44 00 00 49 89 fc bf 01 00 00 00 e8 88 1d ea ff e8 db f4 00 00 41 89 c5 0f ae f0 66 66 90 0f 31 <89> c3 65 4c 8b 34 25 48 b5 00 00 0f ae f0 66 66 90 0f 31 41 89
[18969.798029] Call Trace:
[18969.798029] [<ffffffff8118b7bf>] ? __delay+0xf/0x11
[18969.798029] [<ffffffff8119a296>] ? do_raw_spin_lock+0xd2/0x13c
[18969.798029] [<ffffffff813f843b>] ? _raw_spin_lock+0x60/0x73
[18969.798029] [<ffffffff810c0ae3>] ? page_lock_anon_vma+0x63/0xac
[18969.798029] [<ffffffff810c0ae3>] ? page_lock_anon_vma+0x63/0xac
[18969.798029] [<ffffffff810c0a80>] ? page_lock_anon_vma+0x0/0xac
[18969.798029] [<ffffffff810c0cc9>] ? page_referenced+0x80/0x1dc
[18969.798029] [<ffffffff810c60a0>] ? swapcache_free+0x37/0x3c
[18969.798029] [<ffffffff810ab7e6>] ? shrink_page_list+0x14a/0x477
[18969.798029] [<ffffffff810abe6a>] ? shrink_inactive_list+0x357/0x5e5
[18969.798029] [<ffffffff810ab68a>] ? shrink_active_list+0x232/0x244
[18969.798029] [<ffffffff810ac404>] ? shrink_zone+0x30c/0x3d6
[18969.798029] [<ffffffff810acfdf>] ? do_try_to_free_pages+0x176/0x27f
[18969.798029] [<ffffffff810ad17d>] ? shrink_all_memory+0x95/0xc4
[18969.798029] [<ffffffff810aa680>] ? isolate_pages_global+0x0/0x1f0
[18969.798029] [<ffffffff81076e80>] ? count_data_pages+0x65/0x79
[18969.798029] [<ffffffff810770e7>] ? hibernate_preallocate_memory+0x1aa/0x2cb
[18969.798029] [<ffffffff813f5445>] ? printk+0x41/0x44
[18969.798029] [<ffffffff81075a87>] ? hibernation_snapshot+0x36/0x1e1
[18969.798029] [<ffffffff81075d00>] ? hibernate+0xce/0x172
[18969.798029] [<ffffffff81074a6d>] ? state_store+0x5c/0xd3
[18969.798029] [<ffffffff8118504b>] ? kobj_attr_store+0x17/0x19
[18969.798029] [<ffffffff81125e8b>] ? sysfs_write_file+0x108/0x144
[18969.798029] [<ffffffff810d5807>] ? vfs_write+0xb2/0x153
[18969.798029] [<ffffffff81063c0d>] ? trace_hardirqs_on_caller+0x1f/0x14b
[18969.798029] [<ffffffff810d596b>] ? sys_write+0x4a/0x71
[18969.798029] [<ffffffff810021db>] ? system_call_fastpath+0x16/0x1b
[19005.426655] SysRq : HELP : loglevel(0-9) reBoot Crash show-all-locks(D) terminate-all-tasks(E) memory-full-oom-kill(F) kill-all-tasks(I) thaw-filesystems(J) saK show-backtrace-all-active-cpus(L) show-memory-usage(M) nice-all-RT-tasks(N) powerOff show-registers(P) show-all-timers(Q) unRaw Sync show-task-states(T) Unmount show-blocked-tasks(W) dump-ftrace-buffer(Z)
[19005.663484] SysRq : HELP : loglevel(0-9) reBoot Crash show-all-locks(D) terminate-all-tasks(E) memory-full-oom-kill(F) kill-all-tasks(I) thaw-filesystems(J) saK show-backtrace-all-active-cpus(L) show-memory-usage(M) nice-all-RT-tasks(N) powerOff show-registers(P) show-all-timers(Q) unRaw Sync show-task-states(T) Unmount show-blocked-tasks(W) dump-ftrace-buffer(Z)
[19007.018563] SysRq : Emergency Sync
[19007.018969] Emergency Sync complete
[19007.582218] SysRq : Emergency Remount R/O
[19008.251934] SysRq : Power Off
[19010.076146] SysRq : Resetting


--
Regards/Gruss,
Boris.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo(a)vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
First  |  Prev  |  Next  |  Last
Pages: 1 2 3 4 5 6
Prev: BUG? boot failed with "crashkernel=256M@32M", but "crashkernel=256M@64M" can work
Next: USB: testusb: imported David Brownell's USB testing application