星期四, 3月 22, 2018

iscsi remote XEN disk error

[228921.953996] RPC: Registered named UNIX socket transport module.
[228921.954004] RPC: Registered udp transport module.
[228921.954007] RPC: Registered tcp transport module.
[228921.954010] RPC: Registered tcp NFSv4.1 backchannel transport module.
[228922.038827] FS-Cache: Loaded
[228922.125006] NFS: Registering the id_resolver key type
[228922.125032] Key type id_resolver registered
[228922.125036] Key type id_legacy registered
[228922.125051] FS-Cache: Netfs 'nfs' registered for caching
[228922.183976] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[228959.252466] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[228959.252508] NFSD: starting 90-second grace period
[229422.086442] nfsd: last server has exited, flushing export cache
[229423.238267] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[229423.238275] NFSD: starting 90-second grace period
[644791.340714] type=1400 audit(1521595638.681:38): apparmor="DENIED" operation="capable" parent=1 profile="/usr/sbin/cupsd" pid=939 comm="cupsd" pid=939 comm="cupsd" capability=36  capname="block_suspend"
[693269.134953] end_request: I/O error, dev xvda, sector 4577992
[693269.135069] Buffer I/O error on device xvda1, logical block 571993
[693269.135173] lost page write due to I/O error on xvda1
[693269.135212] end_request: I/O error, dev xvda, sector 4578000
[693269.135340] end_request: I/O error, dev xvda, sector 4578088
[693269.135447] end_request: I/O error, dev xvda, sector 4578176
[693269.135546] end_request: I/O error, dev xvda, sector 2743800
[693269.135649] Buffer I/O error on device xvda1, logical block 342719
[693269.135673] EXT4-fs warning (device xvda1): ext4_end_bio:248: I/O error writing to inode 269809 (offset 0 size 4096 starting block 342976)
[693269.135675] end_request: I/O error, dev xvda, sector 2647096
[693269.135695] Buffer I/O error on device xvda1, logical block 330631
[693269.135717] EXT4-fs warning (device xvda1): ext4_end_bio:248: I/O error writing to inode 261941 (offset 0 size 4096 starting block 330888)
[693269.135719] end_request: I/O error, dev xvda, sector 2647104
[693269.135739] Buffer I/O error on device xvda1, logical block 330632
[693269.135762] EXT4-fs warning (device xvda1): ext4_end_bio:248: I/O error writing to inode 306132 (offset 0 size 4096 starting block 330889)
[693269.135777] JBD2: Detected IO errors while flushing file data on xvda1-8
[693269.135795] Aborting journal on device xvda1-8.
[693269.135822] EXT4-fs error (device xvda1) in ext4_reserve_inode_write:4482: Journal has aborted
[693269.135826] EXT4-fs (xvda1): delayed block allocation failed for inode 319553 at logical offset 0 with max blocks 1 with error -30
[693269.135827] EXT4-fs (xvda1): This should not happen!! Data will be lost
[693269.135827]
[693269.135830] EXT4-fs error (device xvda1) in ext4_da_writepages:2390: Journal has aborted
[693390.984082] end_request: I/O error, dev xvda, sector 4458496
[693390.984222] Buffer I/O error on device xvda1, logical block 557056
[693390.984327] lost page write due to I/O error on xvda1
[693390.984353] end_request: I/O error, dev xvda, sector 2048
[693390.984446] Buffer I/O error on device xvda1, logical block 0
[693390.984542] lost page write due to I/O error on xvda1
[693390.984603] JBD2: Error -5 detected when updating journal superblock for xvda1-8.
[693480.404213] INFO: task rs:main Q:Reg:983 blocked for more than 120 seconds.
[693480.404341] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[693480.404472] rs:main Q:Reg   D ffffffff8180cbe0     0   983      1 0x00000000
[693480.404481]  ffff8803df1db868 0000000000000086 0000000027326853 ffffffff81cd3800
[693480.404490]  ffff8803df1dbfd8 ffff8803df1dbfd8 ffff8803df1dbfd8 00000000000139c0
[693480.404497]  ffff8803e1fe0000 ffff8803df5cc500 ffff8803df1db838 ffff8803f7894258
[693480.404505] Call Trace:
[693480.404522]  [<ffffffff811b9210>] ? __wait_on_buffer+0x30/0x30
[693480.404532]  [<ffffffff8169bee9>] schedule+0x29/0x70
[693480.404539]  [<ffffffff8169bfbf>] io_schedule+0x8f/0xd0
[693480.404546]  [<ffffffff811b921e>] sleep_on_buffer+0xe/0x20
[693480.404553]  [<ffffffff8169a73a>] __wait_on_bit_lock+0x5a/0xc0
[693480.404560]  [<ffffffff811b9210>] ? __wait_on_buffer+0x30/0x30
[693480.404567]  [<ffffffff8169a81c>] out_of_line_wait_on_bit_lock+0x7c/0x90
[693480.404576]  [<ffffffff810785c0>] ? autoremove_wake_function+0x40/0x40
[693480.404583]  [<ffffffff811b9266>] __lock_buffer+0x36/0x40
[693480.404590]  [<ffffffff811ba845>] __sync_dirty_buffer+0xc5/0xd0
[693480.404597]  [<ffffffff811ba863>] sync_dirty_buffer+0x13/0x20
[693480.404608]  [<ffffffff81242ca8>] ext4_commit_super+0x1d8/0x230
[693480.404616]  [<ffffffff81242ef3>] save_error_info+0x23/0x30
[693480.404624]  [<ffffffff812443a6>] __ext4_abort+0x36/0x120
[693480.404632]  [<ffffffff8124459d>] ext4_journal_start_sb+0x10d/0x1d0
[693480.404640]  [<ffffffff812293e6>] ? ext4_dirty_inode+0x26/0x60
[693480.404649]  [<ffffffff81091239>] ? find_busiest_group+0x39/0x4a0
[693480.404655]  [<ffffffff812293e6>] ext4_dirty_inode+0x26/0x60
[693480.404666]  [<ffffffff811b0f80>] __mark_inode_dirty+0x40/0x2a0
[693480.404675]  [<ffffffff811a275a>] update_time.part.17+0x7a/0xc0
[693480.404682]  [<ffffffff811a27c5>] update_time+0x25/0x30
[693480.404688]  [<ffffffff811a286c>] file_update_time+0x9c/0x100
[693480.404699]  [<ffffffff81129948>] __generic_file_aio_write+0x1f8/0x440
[693480.404707]  [<ffffffff8169ce1e>] ? _raw_spin_lock+0xe/0x20
[693480.404714]  [<ffffffff81129c02>] generic_file_aio_write+0x72/0xe0
[693480.404725]  [<ffffffff8121e5cf>] ext4_file_write+0xbf/0x250
[693480.404736]  [<ffffffff810ae1e8>] ? futex_wait+0x108/0x210
[693480.404746]  [<ffffffff81187bea>] do_sync_write+0xda/0x120
[693480.404759]  [<ffffffff812f5088>] ? apparmor_file_permission+0x18/0x20
[693480.404768]  [<ffffffff812baccc>] ? security_file_permission+0x2c/0xb0
[693480.404775]  [<ffffffff81188191>] ? rw_verify_area+0x61/0xf0
[693480.404783]  [<ffffffff811884f3>] vfs_write+0xb3/0x180
[693480.404790]  [<ffffffff8118881a>] sys_write+0x4a/0x90
[693480.404800]  [<ffffffff816a5669>] system_call_fastpath+0x16/0x1b
[693512.454736] end_request: I/O error, dev xvda, sector 2048
[693512.454846] Buffer I/O error on device xvda1, logical block 0
[693512.454943] lost page write due to I/O error on xvda1
[693512.455014] EXT4-fs (xvda1): Remounting filesystem read-only
[693512.455058] EXT4-fs (xvda1): Remounting filesystem read-only
[693512.455223] EXT4-fs (xvda1): ext4_da_writepages: jbd2_start: 2048 pages, ino 319553; err -30
[693512.455485] EXT4-fs (xvda1): I/O error while writing superblock
[693512.455588] EXT4-fs error (device xvda1): ext4_journal_start_sb:371: Detected aborted journal

沒有留言: