Crash répétitif Serveur Ubuntu

[nuranto]

Bonjour,

Voila, j'ai un serveur en prod qui plante à intervalles plus ou moins réguliers (entre 1 à 2 semaines)...

Je ne trouve pas l'erreur, et j'avoue que ca me frustre pas mal..

Peut-être qu'en mettant les logs ici, certains d'entre vous y verront un problème évident ?

uname -r
2.6.27.10-grsec-xxxx-grs-ipv4-64

cat /var/log/messages

Dec 9 02:05:06 ns361175 nagios2: SERVICE ALERT: localhost;Current Load;WARNING;SOFT;1;WARNING - load average: 5.86, 4.77, 3.55
Dec 9 02:06:06 ns361175 nagios2: SERVICE ALERT: localhost;Current Load;WARNING;SOFT;2;WARNING - load average: 5.21, 4.82, 3.64
Dec 9 02:07:06 ns361175 nagios2: SERVICE ALERT: localhost;Current Load;WARNING;SOFT;3;WARNING - load average: 4.85, 4.80, 3.71
Dec 9 02:08:06 ns361175 nagios2: SERVICE ALERT: localhost;Current Load;WARNING;HARD;4;WARNING - load average: 4.60, 4.73, 3.75
Dec 9 02:08:06 ns361175 nagios2: SERVICE NOTIFICATION: root;localhost;Current Load;WARNING;notify-by-email;WARNING - load average: 4.60, 4.73, 3.75
Dec 9 02:23:06 ns361175 nagios2: SERVICE ALERT: localhost;Current Load;OK;HARD;4;OK - load average: 0.43, 1.14, 2.34
Dec 9 02:23:06 ns361175 nagios2: SERVICE NOTIFICATION: root;localhost;Current Load;OK;notify-by-email;OK - load average: 0.43, 1.14, 2.34

......

Dec 10 02:10:13 ns361175 nagios2: SERVICE ALERT: localhost;Disk Space;CRITICAL;SOFT;1;(Service Check Timed Out)
Dec 10 02:10:43 ns361175 nagios2: SERVICE ALERT: localhost;Disk Space;OK;SOFT;2;DISK OK - free space: / 1970 MB (41% inode=87%): /var/run 994 MB (99% inode=99%): /var/lock 994 MB (100% inode=99%): /dev 994 MB (99% inode=98%): /dev/shm 994 MB (100% inode=99%): /home 419832 MB (95% inode=98%):
Dec 10 02:16:38 ns361175 nagios2: Warning: Host check command '/usr/lib/nagios/plugins/check_ping -H 127.0.0.1 -w 5000,100% -c 5000,100% -p 1' for host 'localhost' timed out after 30 seconds
Dec 10 02:16:57 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;1;(No Information Returned From Host Check)
Dec 10 02:19:08 ns361175 nagios2: Warning: Host check command '/usr/lib/nagios/plugins/check_ping -H 127.0.0.1 -w 5000,100% -c 5000,100% -p 1' for host 'localhost' timed out after 30 seconds
Dec 10 02:19:14 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;2;(No Information Returned From Host Check)
Dec 10 02:26:14 ns361175 nagios2: Warning: Host check command '/usr/lib/nagios/plugins/check_ping -H 127.0.0.1 -w 5000,100% -c 5000,100% -p 1' for host 'localhost' timed out after 30 seconds
Dec 10 02:26:14 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;3;(No Information Returned From Host Check)
Dec 10 02:26:14 ns361175 nagios2: HOST ALERT: localhost;UP;SOFT;4;PING OK - Packet loss = 0%, RTA = 0.05 ms
Dec 10 02:26:14 ns361175 nagios2: SERVICE ALERT: localhost;HTTP;CRITICAL;SOFT;1;(Service Check Timed Out)
Dec 10 02:26:14 ns361175 nagios2: Warning: The check of service 'SSH' on host 'localhost' looks like it was orphaned (results never came back). I'm scheduling an immediate check of the service...
Dec 10 02:26:14 ns361175 nagios2: SERVICE ALERT: localhost;SSH;CRITICAL;SOFT;1;(Service Check Timed Out)
Dec 10 02:26:23 ns361175 kernel: qmgr invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
Dec 10 02:26:27 ns361175 kernel: Pid: 3432, comm: qmgr Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:26:28 ns361175 kernel:
Dec 10 02:26:28 ns361175 kernel: Call Trace:
Dec 10 02:26:28 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:26:28 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:26:29 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:26:30 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:26:30 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:26:31 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:26:31 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:26:31 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:26:31 ns361175 kernel: [<ffffffff802bb6bc>] path_walk+0xbc/0xd0
Dec 10 02:26:31 ns361175 nagios2: SERVICE ALERT: localhost;SSH;OK;SOFT;2;SSH OK - OpenSSH_4.7p1 Debian-8ubuntu1 (protocol 2.0)
Dec 10 02:26:31 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:26:31 ns361175 kernel: [<ffffffff802bd240>] do_filp_open+0x750/0xaa0
Dec 10 02:26:31 ns361175 kernel: [<ffffffff802b3734>] cp_new_stat+0xe4/0x100
Dec 10 02:26:31 ns361175 kernel: [<ffffffff802b39ce>] sys_newfstat+0x2e/0x50
Dec 10 02:26:31 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:26:31 ns361175 kernel:
Dec 10 02:26:31 ns361175 nagios2: SERVICE ALERT: localhost;HTTP;CRITICAL;SOFT;2;CRITICAL - Socket timeout after 10 seconds
Dec 10 02:26:31 ns361175 kernel: Mem-Info:
Dec 10 02:26:31 ns361175 kernel: DMA per-cpu:
Dec 10 02:26:31 ns361175 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Dec 10 02:26:31 ns361175 kernel: CPU 1: hi: 0, btch: 1 usd: 0
Dec 10 02:26:31 ns361175 kernel: DMA32 per-cpu:
Dec 10 02:26:31 ns361175 kernel: CPU 0: hi: 186, btch: 31 usd: 164
Dec 10 02:26:31 ns361175 kernel: CPU 1: hi: 186, btch: 31 usd: 166
Dec 10 02:26:31 ns361175 kernel: Active:169053 inactive:302834 dirty:0 writeback:0 unstable:0
Dec 10 02:26:31 ns361175 kernel: free:2401 slab:12084 mapped:19 pagetables:15803 bounce:0
Dec 10 02:26:31 ns361175 kernel: DMA free:3988kB min:8kB low:8kB high:12kB active:0kB inactive:0kB present:3044kB pages_scanned:0 all_unreclaimable? yes
Dec 10 02:26:31 ns361175 kernel: lowmem_reserve[]: 0 1988 1988 1988
Dec 10 02:26:31 ns361175 kernel: DMA32 free:5616kB min:5700kB low:7124kB high:8548kB active:676212kB inactive:1211336kB present:2036364kB pages_scanned:11427152 all_unreclaimable? no
Dec 10 02:26:31 ns361175 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 02:26:31 ns361175 kernel: DMA: 5*4kB 6*8kB 3*16kB 3*32kB 5*64kB 3*128kB 2*256kB 1*512kB 2*1024kB 0*2048kB 0*4096kB = 3988kB
Dec 10 02:26:31 ns361175 kernel: DMA32: 100*4kB 0*8kB 0*16kB 3*32kB 6*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5616kB
Dec 10 02:26:31 ns361175 kernel: 1957 total pagecache pages
Dec 10 02:26:31 ns361175 kernel: 0 pages in swap cache
Dec 10 02:26:31 ns361175 kernel: Swap cache stats: add 302920, delete 302920, find 17451/21461
Dec 10 02:26:31 ns361175 kernel: Free swap = 0kB
Dec 10 02:26:31 ns361175 kernel: Total swap = 1044208kB
Dec 10 02:26:31 ns361175 kernel: 521728 pages RAM
Dec 10 02:26:31 ns361175 kernel: 12542 pages reserved
Dec 10 02:26:31 ns361175 kernel: 78893 pages shared
Dec 10 02:26:31 ns361175 kernel: 502615 pages non-shared
Dec 10 02:27:45 ns361175 nagios2: SERVICE ALERT: localhost;HTTP;CRITICAL;SOFT;3;CRITICAL - Socket timeout after 10 seconds
Dec 10 02:29:48 ns361175 nagios2: SERVICE ALERT: localhost;HTTP;CRITICAL;HARD;4;CRITICAL - Socket timeout after 10 seconds
Dec 10 02:29:48 ns361175 nagios2: SERVICE NOTIFICATION: root;localhost;HTTP;CRITICAL;notify-by-email;CRITICAL - Socket timeout after 10 seconds
Dec 10 02:37:47 ns361175 nagios2: Warning: Host check command '/usr/lib/nagios/plugins/check_ping -H 127.0.0.1 -w 5000,100% -c 5000,100% -p 1' for host 'localhost' timed out after 30 seconds
Dec 10 02:37:47 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;1;(No Information Returned From Host Check)
Dec 10 02:39:41 ns361175 nagios2: Warning: Host check command '/usr/lib/nagios/plugins/check_ping -H 127.0.0.1 -w 5000,100% -c 5000,100% -p 1' for host 'localhost' timed out after 30 seconds
Dec 10 02:40:36 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;2;(No Information Returned From Host Check)
Dec 10 02:41:26 ns361175 kernel: php5 invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
Dec 10 02:41:26 ns361175 kernel: Pid: 6438, comm: php5 Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:41:26 ns361175 kernel:
Dec 10 02:41:26 ns361175 kernel: Call Trace:
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bb6bc>] path_walk+0xbc/0xd0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bcbac>] do_filp_open+0xbc/0xaa0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802b3734>] cp_new_stat+0xe4/0x100
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c8fb6>] expand_files+0x46/0x270
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c922a>] alloc_fd+0x4a/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:41:26 ns361175 kernel:
Dec 10 02:41:26 ns361175 kernel: Mem-Info:
Dec 10 02:41:26 ns361175 kernel: DMA per-cpu:
Dec 10 02:41:26 ns361175 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Dec 10 02:41:26 ns361175 kernel: CPU 1: hi: 0, btch: 1 usd: 0
Dec 10 02:41:26 ns361175 kernel: DMA32 per-cpu:
Dec 10 02:41:26 ns361175 kernel: CPU 0: hi: 186, btch: 31 usd: 177
Dec 10 02:41:26 ns361175 kernel: CPU 1: hi: 186, btch: 31 usd: 159
Dec 10 02:41:26 ns361175 kernel: Active:239230 inactive:227441 dirty:0 writeback:0 unstable:0
Dec 10 02:41:26 ns361175 kernel: free:2390 slab:12404 mapped:6 pagetables:19077 bounce:0
Dec 10 02:41:26 ns361175 kernel: DMA free:3988kB min:8kB low:8kB high:12kB active:0kB inactive:0kB present:3044kB pages_scanned:0 all_unreclaimable? yes
Dec 10 02:41:26 ns361175 kernel: lowmem_reserve[]: 0 1988 1988 1988
Dec 10 02:41:26 ns361175 kernel: DMA32 free:5572kB min:5700kB low:7124kB high:8548kB active:956920kB inactive:909764kB present:2036364kB pages_scanned:2948227 all_unreclaimable? yes
Dec 10 02:41:26 ns361175 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 02:41:26 ns361175 kernel: DMA: 5*4kB 6*8kB 3*16kB 3*32kB 5*64kB 3*128kB 2*256kB 1*512kB 2*1024kB 0*2048kB 0*4096kB = 3988kB
Dec 10 02:41:26 ns361175 kernel: DMA32: 59*4kB 13*8kB 1*16kB 3*32kB 6*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5572kB
Dec 10 02:41:26 ns361175 kernel: 1928 total pagecache pages
Dec 10 02:41:26 ns361175 kernel: 2 pages in swap cache
Dec 10 02:41:26 ns361175 kernel: Swap cache stats: add 339173, delete 339171, find 27235/33652
Dec 10 02:41:26 ns361175 kernel: Free swap = 0kB
Dec 10 02:41:26 ns361175 kernel: Total swap = 1044208kB
Dec 10 02:41:26 ns361175 kernel: 521728 pages RAM
Dec 10 02:41:26 ns361175 kernel: 12542 pages reserved
Dec 10 02:41:26 ns361175 kernel: 88345 pages shared
Dec 10 02:41:26 ns361175 kernel: 501382 pages non-shared
Dec 10 02:41:26 ns361175 kernel: php5 invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
Dec 10 02:41:26 ns361175 kernel: Pid: 6438, comm: php5 Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:41:26 ns361175 kernel:
Dec 10 02:41:26 ns361175 kernel: Call Trace:
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bb6bc>] path_walk+0xbc/0xd0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bcbac>] do_filp_open+0xbc/0xaa0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802b3734>] cp_new_stat+0xe4/0x100
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c8fb6>] expand_files+0x46/0x270
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c922a>] alloc_fd+0x4a/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:41:26 ns361175 kernel:
Dec 10 02:41:26 ns361175 kernel: Mem-Info:
Dec 10 02:41:26 ns361175 kernel: DMA per-cpu:
Dec 10 02:41:26 ns361175 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Dec 10 02:41:26 ns361175 kernel: CPU 1: hi: 0, btch: 1 usd: 0
Dec 10 02:41:26 ns361175 kernel: DMA32 per-cpu:
Dec 10 02:41:26 ns361175 kernel: CPU 0: hi: 186, btch: 31 usd: 8
Dec 10 02:41:26 ns361175 kernel: CPU 1: hi: 186, btch: 31 usd: 107
Dec 10 02:41:26 ns361175 kernel: Active:240257 inactive:226725 dirty:0 writeback:0 unstable:0
Dec 10 02:41:26 ns361175 kernel: free:2419 slab:12408 mapped:16 pagetables:19065 bounce:0
Dec 10 02:41:26 ns361175 kernel: DMA free:3988kB min:8kB low:8kB high:12kB active:0kB inactive:0kB present:3044kB pages_scanned:0 all_unreclaimable? yes
Dec 10 02:41:26 ns361175 kernel: lowmem_reserve[]: 0 1988 1988 1988
Dec 10 02:41:26 ns361175 kernel: DMA32 free:5688kB min:5700kB low:7124kB high:8548kB active:961028kB inactive:906900kB present:2036364kB pages_scanned:36816 all_unreclaimable? no
Dec 10 02:41:26 ns361175 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 02:41:26 ns361175 kernel: DMA: 5*4kB 6*8kB 3*16kB 3*32kB 5*64kB 3*128kB 2*256kB 1*512kB 2*1024kB 0*2048kB 0*4096kB = 3988kB
Dec 10 02:41:26 ns361175 kernel: DMA32: 59*4kB 13*8kB 1*16kB 3*32kB 6*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5572kB
Dec 10 02:41:26 ns361175 kernel: 2292 total pagecache pages
Dec 10 02:41:26 ns361175 kernel: 2 pages in swap cache
Dec 10 02:41:26 ns361175 kernel: Swap cache stats: add 339173, delete 339171, find 27235/33652
Dec 10 02:41:26 ns361175 kernel: Free swap = 0kB
Dec 10 02:41:26 ns361175 kernel: Total swap = 1044208kB
Dec 10 02:41:26 ns361175 kernel: 521728 pages RAM
Dec 10 02:41:26 ns361175 kernel: 12542 pages reserved
Dec 10 02:41:26 ns361175 kernel: 88294 pages shared
Dec 10 02:41:26 ns361175 kernel: 501661 pages non-shared
Dec 10 02:47:20 ns361175 kernel: apache2 invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=-17
Dec 10 02:47:20 ns361175 kernel: Pid: 6257, comm: apache2 Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:47:20 ns361175 kernel:
Dec 10 02:47:20 ns361175 kernel: Call Trace:
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802bc868>] user_path_at+0xa8/0xd0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802cb037>] mntput_no_expire+0x27/0x140
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80259954>] cap_set_effective+0x24/0x70
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802ae8ec>] sys_faccessat+0x21c/0x250
Dec 10 02:47:20 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:47:20 ns361175 kernel:
Dec 10 02:47:20 ns361175 kernel: Mem-Info:
Dec 10 02:47:20 ns361175 kernel: DMA per-cpu:
Dec 10 02:47:20 ns361175 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Dec 10 02:47:20 ns361175 kernel: CPU 1: hi: 0, btch: 1 usd: 0
Dec 10 02:47:20 ns361175 kernel: DMA32 per-cpu:
Dec 10 02:47:20 ns361175 kernel: CPU 0: hi: 186, btch: 31 usd: 165
Dec 10 02:47:20 ns361175 kernel: CPU 1: hi: 186, btch: 31 usd: 167
Dec 10 02:47:20 ns361175 kernel: Active:182970 inactive:283382 dirty:0 writeback:0 unstable:0
Dec 10 02:47:20 ns361175 kernel: free:2395 slab:12468 mapped:6 pagetables:19139 bounce:0
Dec 10 02:47:20 ns361175 kernel: DMA free:3988kB min:8kB low:8kB high:12kB active:0kB inactive:0kB present:3044kB pages_scanned:0 all_unreclaimable? yes
Dec 10 02:47:20 ns361175 kernel: lowmem_reserve[]: 0 1988 1988 1988
Dec 10 02:47:20 ns361175 kernel: DMA32 free:5592kB min:5700kB low:7124kB high:8548kB active:731880kB inactive:1133528kB present:2036364kB pages_scanned:8770152 all_unreclaimable? yes
Dec 10 02:47:20 ns361175 kernel: lowmem_reserve[]: 0 0 0 0
Dec 10 02:47:20 ns361175 kernel: DMA: 5*4kB 6*8kB 3*16kB 3*32kB 5*64kB 3*128kB 2*256kB 1*512kB 2*1024kB 0*2048kB 0*4096kB = 3988kB
Dec 10 02:47:20 ns361175 kernel: DMA32: 82*4kB 4*8kB 1*16kB 3*32kB 6*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5592kB
Dec 10 02:47:20 ns361175 kernel: 1935 total pagecache pages
Dec 10 02:47:20 ns361175 kernel: 1 pages in swap cache
Dec 10 02:47:20 ns361175 kernel: Swap cache stats: add 340184, delete 340183, find 27258/33798
Dec 10 02:47:20 ns361175 kernel: Free swap = 0kB
Dec 10 02:47:20 ns361175 kernel: Total swap = 1044208kB
Dec 10 02:47:20 ns361175 kernel: 521728 pages RAM
Dec 10 02:47:20 ns361175 kernel: 12542 pages reserved
Dec 10 02:47:20 ns361175 kernel: 88860 pages shared
Dec 10 02:47:20 ns361175 kernel: 501229 pages non-shared
Dec 10 02:47:20 ns361175 nagios2: HOST ALERT: localhost;DOWN;SOFT;3; ELF^B^A^A
Dec 10 02:47:33 ns361175 nagios2: HOST ALERT: localhost;UP;SOFT;4;PING OK - Packet loss = 0%, RTA = 0.06 ms
Dec 10 02:47:33 ns361175 nagios2: SERVICE ALERT: localhost;Total Processes;CRITICAL;SOFT;1;(Service Check Timed Out)

Je vois qu'il y a un problème d'espace disque sur la racine, et c'est probablement ce qui fait planter le serveur.
Par contre bien avant ca, j'ai des problème de charges... Vous avez une idée de comment trouver la fuite ?

[mberro]

Salut,
l'espace disque est un point critique qui peut être la cause de tes problèmes.
Installe un logiciel de surveillance de ton système, par exemple ftpupinfo, et vois les graphes au bout de quelques jours. Quelque chose te sautera peut être aux yeux.

[Mygale1978]

Salut,

Il semble y avoir des fuites mémoires sur ton système peut-être du à un composant buggés

Il y a un post ici où l'utilisateur à un problème similaire au tien.
https://bugs.launchpad.net/ubuntu/+s...e2/+bug/230878

Il faudrait essayer de voir dans un premier (si possible) de mettre à jour apache/php et voir si ça peut améliorer la situation.

Dec 10 02:41:26 ns361175 kernel: Pid: 6438, comm: php5 Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:41:26 ns361175 kernel:
Dec 10 02:41:26 ns361175 kernel: Call Trace:
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:41:26 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bb6bc>] path_walk+0xbc/0xd0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802bcbac>] do_filp_open+0xbc/0xaa0
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802b3734>] cp_new_stat+0xe4/0x100
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c8fb6>] expand_files+0x46/0x270
Dec 10 02:41:26 ns361175 kernel: [<ffffffff802c922a>] alloc_fd+0x4a/0x140
Dec 10 02:41:26 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:41:26 ns361175 kernel:

....

Dec 10 02:47:20 ns361175 kernel: Pid: 6257, comm: apache2 Not tainted 2.6.27.10-grsec-xxxx-grs-ipv4-64 #4
Dec 10 02:47:20 ns361175 kernel:
Dec 10 02:47:20 ns361175 kernel: Call Trace:
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80288865>] oom_kill_process+0xa5/0x260
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80288fcf>] select_bad_process+0xdf/0x110
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802890a4>] out_of_memory+0xa4/0x140
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028c319>] __alloc_pages_internal+0x4a9/0x4f0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028e2d5>] __do_page_cache_readahead+0xf5/0x250
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8028635c>] filemap_fault+0x35c/0x440
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8029554e>] __do_fault+0x6e/0x450
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802974d3>] handle_mm_fault+0x1b3/0x7c0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff8023b853>] do_page_fault+0x313/0x9d0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802bc868>] user_path_at+0xa8/0xd0
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802cb037>] mntput_no_expire+0x27/0x140
Dec 10 02:47:20 ns361175 kernel: [<ffffffff80259954>] cap_set_effective+0x24/0x70
Dec 10 02:47:20 ns361175 kernel: [<ffffffff802ae8ec>] sys_faccessat+0x21c/0x250
Dec 10 02:47:20 ns361175 kernel: [<ffffffff808a2199>] error_exit+0x0/0x51
Dec 10 02:47:20 ns361175 kernel: