blk_update_request: critical target error

Vyskocilo na me neco takoveho desiveho:

[259910.983537] sd 0:0:5:0: [sdf] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[259910.983559] sd 0:0:5:0: [sdf] tag#2 Sense Key : Illegal Request [current]
[259910.983564] sd 0:0:5:0: [sdf] tag#2 Add. Sense: Logical block address out of range
[259910.983571] sd 0:0:5:0: [sdf] tag#2 CDB: Write(16) 8a 00 00 00 00 00 98 1c b7 b8 00 00 00 08 00 00
[259910.983576] blk_update_request: critical target error, dev sdf, sector 2552018872
...
[293851.475082] sd 0:0:5:0: [sdf] tag#3 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[293851.475103] sd 0:0:5:0: [sdf] tag#3 Sense Key : Illegal Request [current]
[293851.475108] sd 0:0:5:0: [sdf] tag#3 Add. Sense: Logical block address out of range
[293851.475114] sd 0:0:5:0: [sdf] tag#3 CDB: Write(16) 8a 00 00 00 00 00 a8 14 2e 90 00 00 00 08 00 00
[293851.475119] blk_update_request: critical target error, dev sdf, sector 2819894928

grepoval jsem predchozi syslogy a predtim se zda nic takoveho nestalo a ted najednmou dvakrat s cca desetihodinovym odstupem. Disk je WDC_WD30EFRX visici na Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05) a je soucasti osmidiskoveho RAIDZ2, SMART vcetne long testu bez problemu.

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   181   180   021    Pre-fail  Always       -       5933
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       196
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   100   253   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   067   067   000    Old_age   Always       -       24554
 10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       157
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       138
193 Load_Cycle_Count        0x0032   192   192   000    Old_age   Always       -       24572
194 Temperature_Celsius     0x0022   115   110   000    Old_age   Always       -       35
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

zfs si sam spustil zpool scrub ktery dobehl s vysledkem

scrub repaired 0 in 10h37m with 0 errors on Sun Apr  9 11:01:26 2017

nicmene u tohoto disku je v zpoll status ve sloupci WRITE dvojka a take tohle

status: One or more devices has experienced an unrecoverable error.  An
        attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
        using 'zpool clear' or replace the device with 'zpool replace'.

Googleni "Add. Sense: Logical block address out of range" davalo vysledky akorat nejakych USB flesek a vypalovacek. Me to prijde spise jako softwarova chyba... Zatim se ridim pravidlem ze Stoparova pruvodce - nepropadam panice.

Vcera se stalo tohle:

[2193755.880065] sd 0:0:7:0: attempting task abort! scmd(ffff9b7f34788600)
[2193755.880073] sd 0:0:7:0: [sdh] tag#2 CDB: ATA command pass through(16) 85 06 20 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
[2193755.880077] scsi target0:0:7: handle(0x0010), sas_address(0x4433221107000000), phy(7)
[2193755.880079] scsi target0:0:7: enclosure_logical_id(0x500605b005a6c4f1), slot(4)
[2193755.955929] sd 0:0:7:0: task abort: SUCCESS scmd(ffff9b7f34788600)
[2196746.760056] sd 0:0:4:0: attempting task abort! scmd(ffff9b85be3ac180)
[2196746.760066] sd 0:0:4:0: [sde] tag#0 CDB: ATA command pass through(16) 85 06 20 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
[2196746.760070] scsi target0:0:4: handle(0x000d), sas_address(0x4433221104000000), phy(4)
[2196746.760073] scsi target0:0:4: enclosure_logical_id(0x500605b005a6c4f1), slot(7)
[2196746.818783] sd 0:0:4:0: task abort: SUCCESS scmd(ffff9b85be3ac180)
...
[2229452.463478] sd 0:0:7:0: [sdh] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.463500] sd 0:0:7:0: [sdh] tag#2 Sense Key : Hardware Error [current]
[2229452.463505] sd 0:0:7:0: [sdh] tag#2 Add. Sense: Internal target failure
[2229452.463512] sd 0:0:7:0: [sdh] tag#2 CDB: Synchronize Cache(10) 35 00 00 00 00 00 00 00 00 00
[2229452.463533] blk_update_request: critical target error, dev sdh, sector 0
[2229452.464852] sd 0:0:4:0: [sde] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.464866] sd 0:0:4:0: [sde] tag#1 Sense Key : Hardware Error [current]
[2229452.464871] sd 0:0:4:0: [sde] tag#1 Add. Sense: Internal target failure
[2229452.464876] sd 0:0:4:0: [sde] tag#1 CDB: Synchronize Cache(10) 35 00 00 00 00 00 00 00 00 00
[2229452.464883] blk_update_request: critical target error, dev sde, sector 0
[2229452.465924] sd 0:0:4:0: [sde] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.465937] sd 0:0:4:0: [sde] tag#1 Sense Key : Hardware Error [current]
[2229452.465943] sd 0:0:4:0: [sde] tag#1 Add. Sense: Internal target failure
[2229452.465948] sd 0:0:4:0: [sde] tag#1 CDB: Write(16) 8a 00 00 00 00 00 00 00 09 48 00 00 00 08 00 00
[2229452.465953] blk_update_request: critical target error, dev sde, sector 2376
[2229452.466000] sd 0:0:4:0: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466015] sd 0:0:4:0: [sde] tag#0 Sense Key : Hardware Error [current]
[2229452.466018] sd 0:0:4:0: [sde] tag#0 Add. Sense: Internal target failure
[2229452.466021] sd 0:0:4:0: [sde] tag#0 CDB: Write(16) 8a 00 00 00 00 00 00 00 0b 48 00 00 00 08 00 00
[2229452.466023] blk_update_request: critical target error, dev sde, sector 2888
[2229452.466091] sd 0:0:4:0: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466095] sd 0:0:4:0: [sde] tag#0 Sense Key : Hardware Error [current]
[2229452.466098] sd 0:0:4:0: [sde] tag#0 Add. Sense: Internal target failure
[2229452.466102] sd 0:0:4:0: [sde] tag#0 CDB: Read(16) 88 00 00 00 00 00 00 00 0a 10 00 00 00 10 00 00
[2229452.466104] blk_update_request: critical target error, dev sde, sector 2576
[2229452.466122] sd 0:0:4:0: [sde] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466125] sd 0:0:4:0: [sde] tag#1 Sense Key : Hardware Error [current]
[2229452.466127] sd 0:0:4:0: [sde] tag#1 Add. Sense: Internal target failure
[2229452.466130] sd 0:0:4:0: [sde] tag#1 CDB: Read(16) 88 00 00 00 00 01 5d 50 5c 10 00 00 00 10 00 00
[2229452.466131] blk_update_request: critical target error, dev sde, sector 5860514832
[2229452.466138] sd 0:0:4:0: [sde] tag#3 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466140] sd 0:0:4:0: [sde] tag#3 Sense Key : Hardware Error [current]
[2229452.466143] sd 0:0:4:0: [sde] tag#3 Add. Sense: Internal target failure
[2229452.466146] sd 0:0:4:0: [sde] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466147] sd 0:0:4:0: [sde] tag#3 CDB: Read(16) 88 00 00 00 00 01 5d 50 5e 10 00 00 00 10 00 00
[2229452.466149] blk_update_request: critical target error, dev sde, sector 5860515344
[2229452.466153] sd 0:0:4:0: [sde] tag#2 Sense Key : Hardware Error [current]
[2229452.466156] sd 0:0:4:0: [sde] tag#2 Add. Sense: Internal target failure
[2229452.466161] sd 0:0:4:0: [sde] tag#2 CDB: Write(16) 8a 00 00 00 00 01 5d 50 5d 48 00 00 00 08 00 00
[2229452.466163] blk_update_request: critical target error, dev sde, sector 5860515144
[2229452.466295] sd 0:0:4:0: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.466299] sd 0:0:4:0: [sde] tag#0 Sense Key : Hardware Error [current]
[2229452.466301] sd 0:0:4:0: [sde] tag#0 Add. Sense: Internal target failure
[2229452.466305] sd 0:0:4:0: [sde] tag#0 CDB: Write(16) 8a 00 00 00 00 01 5d 50 5f 48 00 00 00 08 00 00
[2229452.466307] blk_update_request: critical target error, dev sde, sector 5860515656
[2229452.467246] sd 0:0:7:0: [sdh] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2229452.467251] sd 0:0:7:0: [sdh] tag#0 Sense Key : Hardware Error [current]
[2229452.467255] sd 0:0:7:0: [sdh] tag#0 Add. Sense: Internal target failure
[2229452.467260] sd 0:0:7:0: [sdh] tag#0 CDB: Write(16) 8a 00 00 00 00 00 00 00 09 48 00 00 00 08 00 00
[2229452.467264] blk_update_request: critical target error, dev sdh, sector 2376

coz mi skoro rozbilo RAIDZ2. Po rebootu se radic uz ani nenadetekoval.

To jen takove varovani budoucim generacim, ze se to nema podcenovat a ze zalohovat se musi i raid6/raidz2 pac 1-2 disky nevadi ale polochciply radic to dokaze odrovnat i tak ;-)

Dotaz: blk_update_request: critical target error

Odpovědi