1000001101000/Debian_on_Buffalo

TS-XEL: "No init file at hdd0" on box; "hard resetting link" errors in console output

Closed this issue · 48 comments

Hi again, I hope you're well! It was nice being error free on the TS-XEL for awhile, but sadly some new issues arose that I could use help with.

Today, I noticed that my DLNA server was showing media files, but when I clicked any of them, I got an error. I went upstairs to check the box; it was on without any errors, though I heard what sounded like a HDD spinning and struggling to do so.

I shut it down and rebooted; then, it hung at the "no init file", so I decided to break out the UART/serial console cable again (grateful for that option; thanks again the tips previously!)

I got output in Putty and let the box do its thing as it booted up. When the "no init file" output appeared on the display, I looked t the Putty output and saw the following:

image

"hard resetting link" and the output around it appeared to show up in a loop in the output. From what I read, it could be bad contact with a specific drive. I'm guessing it could be a drive failing, too? If this looks familiar and if you have any suggestions, do let me know, and thanks again for all your help!

similar messages show up for all sorts of errors related to drives. loose connections can cause it but so can a failing drive or even some types of issue between the drive/controller firmware/drivers.

If this started happening on a device where nothing changed recently it probably means a drive is failing. It might be worth shutting down and pulling/reinserting all the drives to ensure there isn't a bad connection somehow.

it might be trying to show you a recovery shell that you can't see because of all the sata errors. you could try sending ctrl+alt+f2 to see if you can access via an alternate virtual terminal.... I don't actually know if that shell supports that or not but it's worth a try. otherwise the prompt usually says something like "enter root password for recovery shell", you could try blindly typing your root password and hitting enter. If you manage to get to a recovery shell you could comment whatever file system is failing to start etc.

Thank you for the reply! I'll try to reseat the drives and perhaps first use compressed air to blow out any dust/debris that may be in the connections.

Interesting about the recovery shell. I'll give that a spin if I continue to have issues. Will report back with results. Thank you!

Thinking of contingency plans in the meantime. I'd likely build a mid-tower with Linux or Windows to replace the TS, though I hope I can still squeeze a bit more life out of the TS. Still, I'm aware it's an older piece of kit and it won't last forever, but it's just such a formidable little tank!

Anyways, I have a fairly recent backup on a USB drive (lesson learned after losing some data in the past, as you know!) But if I can't get back into the TS box, it'd be nice to try to retrieve data from the 4 drives/raid array. Did you say if I wanted to do that, I'd have to hook up all 4 to a computer running Linux?

you could try sending ctrl+alt+f2 to see if you can access via an alternate virtual terminal

When would I do this command, btw? At any particular point during the serial connection output?

I isolated drive 1 as what seems to be the "problem drive". It was making a loud clicking noise the last time I tried a boot. IIRC, RAID 5 can handle 1 drive failure and continue to work?

Currently, the TS is going through its boot process and seems to be proceeding. Very interesting!

I now see this prompt.

image

And I'm now in emergency mode and can access fstab, etc. Not sure what to check for, but at least it's something!

I guess my raid5 will work in degraded mode, so I could potentially back up everything just to be safe and then check the health of the drives in the TS/replace as needed.

Nice!

I'm guessing the reason it didn't boot all the way is that the degraded array didn't start which prevented it from being mounted which in turn prevented boot because it isn't listed as optional in the fstab.

What I would probably do:

  1. edit /etc/fstab and comment out the RAID5 array temporarily
  2. reboot the device which should now succeed since it shouldn't care if that array starts or not.
  3. use mdadm --detail to figure out what's going on with the array
  4. replace the failed drive or otherwise deal with whatever the problem is.

Sounds like a good plan! I packed it in for the day, but will definitely follow suit on this tomorrow or shortly after.

If I replace a failed drive and rebuild the array, I shouldn't lose my files?

Thanks again!

Thinking of contingency plans in the meantime. I'd likely build a mid-tower with Linux or Windows to replace the TS, though I hope I can still squeeze a bit more life out of the TS. Still, I'm aware it's an older piece of kit and it won't last forever, but it's just such a formidable little tank!

Anyways, I have a fairly recent backup on a USB drive (lesson learned after losing some data in the past, as you know!) But if I can't get back into the TS box, it'd be nice to try to retrieve data from the 4 drives/raid array. Did you say if I wanted to do that, I'd have to hook up all 4 to a computer running Linux?

Sorry, just noticed the previous messages. Once you're in you should be able to force start the array which you could then access normally to retrieve any data etc. You could then replace the drive and re-sync etc.

Someone (possibly even me) should probably develop a better set of best practices for these devices. I can see why it might default to not starting a degraded RAID5....but for a device with no console that does way more harm than good. Same for non-optional filsystems though that depends heavily on what the filesystem does.

Fairly recently I repurposed some old PC parts into a sort of NAS/files server which has proved to be an interesting experiment for me. It's now my main storage system which backs itself up to some Terastations. I find they complement each other will since I can enable some more CPU intensive features on the PC/NAS and am getting surprisingly good backup performance by limiting the TS to just receiving those backups etc.

Sounds like a good plan! I packed it in for the day, but will definitely follow suit on this tomorrow or shortly after.

If I replace a failed drive and rebuild the array, I shouldn't lose my files?

Thanks again!

Like you said, RAID5 can handle a single drive failure. Re-syncing can take a long time and does stress the other drives, so if you don't have a full backup you should probably do that first once you get the array started and mounted again.

So, gave your suggestion a try and I was able to get the device to boot while bypassing the array. Yay! Great tip!

Here's the result of mdadm --detail on the array:

image

This is with all 4 drives nestled in the bays. I was expecting 3 active devices, not 2. Is this related to the array not starting up or is something else going on? Thanks again.

Here's the output for lsblk, too, in case it helps:

image

Hmm, that is worrying. The partitions on sda don’t appear to be active in their arrays, the question is: when did that happen?

could be something that happened while you were troubleshooting the sdd problems. If so you can probably force assemble your RAID5 and move forward.

If this happened a long time ago and you didn’t notice the the array might have been degraded for a long time until failing with the death of sdd. That might explain why it failed to boot the way it did. Hopefully not since that might not be recoverable.

First thing I would do is see what mdadm says about sda. Try: mdadm —examine /dev/sda6 that should tell you the state of that part of the array, you should be able to compare that to the output from for the other two

Thanks for writing and for the tips!

Here's what the command shows. I'm guessing I missed something.

image

guessing something about the command is mangled, maybe the double-hyphen. Here's output from one of my boxes (my disk isn't partitioned but it should otherwise be the same)

# mdadm --examine /dev/sda
/dev/sda:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 60497d:2e957a:fda249:022cc6
           Name : md99
  Creation Time : Tue Jan 18 19:57:30 2022
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7813776048 (3725.90 GiB 4000.65 GB)
     Array Size : 23441316864 (22355.38 GiB 24003.91 GB)
  Used Dev Size : 7813772288 (3725.90 GiB 4000.65 GB)
    Data Offset : 261120 sectors
   Super Offset : 8 sectors
   Unused Space : before=261040 sectors, after=3760 sectors
          State : clean
    Device UUID : 19ebc0:0d0e82:34210cfc:1a38fdc

Internal Bitmap : 8 sectors from superblock
    Update Time : Thu Dec  8 11:45:16 2022
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : 1366004 - correct
         Events : 103301

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)

D'oh! It was that, apologies. Here's the output:

marc@debian:~$ sudo mdadm --examine /dev/sda6
/dev/sda6:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 46c1d87e:e7b2970a:3edd105f:c51f08fe
           Name : TS-XEL02C:2
  Creation Time : Sat Sep 26 15:27:40 2020
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 1923497952 sectors (917.20 GiB 984.83 GB)
     Array Size : 2885245440 KiB (2.69 TiB 2.95 TB)
  Used Dev Size : 1923496960 sectors (917.19 GiB 984.83 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1968 sectors, after=992 sectors
          State : active
    Device UUID : 18ae8cf5:e463c0b7:824d70b5:b88498c3

Internal Bitmap : 8 sectors from superblock
    Update Time : Sat Nov 26 14:46:23 2022
       Checksum : e8dd79b4 - correct
         Events : 39140

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAAA ('A' == active, '.' == missing, 'R' == replacing)

Deja vu!

marc@debian:~$ sudo mdadm --assemble /dev/md2 /dev/sda6 /dev/sdb6 /dev/sdc6  --force
mdadm: forcing event count in /dev/sda6(1) from 39140 up to 39795
mdadm: Marking array /dev/md2 as 'clean'
mdadm: /dev/md2 has been started with 3 drives (out of 4).
marc@debian:~$ sudo mdadm --detail /dev/md1/
mdadm: cannot open /dev/md1/: Not a directory
marc@debian:~$ sudo mdadm --detail /dev/md2
/dev/md2:
           Version : 1.2
     Creation Time : Sat Sep 26 15:27:40 2020
        Raid Level : raid5
        Array Size : 2885245440 (2.69 TiB 2.95 TB)
     Used Dev Size : 961748480 (917.19 GiB 984.83 GB)
      Raid Devices : 4
     Total Devices : 3
       Persistence : Superblock is persistent

     Intent Bitmap : Internal

       Update Time : Sat Nov 26 14:46:23 2022
             State : clean, degraded
    Active Devices : 3
   Working Devices : 3
    Failed Devices : 0
     Spare Devices : 0

            Layout : left-symmetric
        Chunk Size : 512K

Consistency Policy : bitmap

              Name : TS-XEL02C:2
              UUID : 46c1d87e:e7b2970a:3edd105f:c51f08fe
            Events : 39795

    Number   Major   Minor   RaidDevice State
       -       0        0        0      removed
       1       8        6        1      active sync   /dev/sda6
       2       8       22        2      active sync   /dev/sdb6
       3       8       38        3      active sync   /dev/sdc6

Now I'm a little worried. sudo mdadm --detail /dev/md2 gives a "no such file or directory" error. I feel I should leave it for now, as I don't want to muck things up further.

mdadm --detail --scan will list all the arrays it knows about, it might have started as /dev/md127 or something like that.

If it's still active I'd recommend mounting it and backing up any data you care about before you worry about anything else.

Last login: Fri Dec  9 09:25:46 2022 from 192.168.50.125
marc@debian:~$ sudo mdadm --detail --scan
[sudo] password for marc:
ARRAY /dev/md0 metadata=0.90 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/10 metadata=1.2 name=TS-XEL-EM02C:10 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3
ARRAY /dev/md/1 metadata=1.2 name=TS-XEL-EM02C:1 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf
INACTIVE-ARRAY /dev/md2 metadata=1.2 name=TS-XEL02C:2 UUID=46c1d87e:e7b2970a:3edd105f:c51f08fe
marc@debian:~$ stopped /dev/md1
-bash: stopped: command not found
marc@debian:~$ sudo mdadm -S /dev/md2
mdadm: stopped /dev/md2
marc@debian:~$ sudo mdadm --assemble /dev/md2 /dev/sdb6 /dev/sdc6 /dev/sdd6 --force
mdadm: forcing event count in /dev/sdb6(1) from 39797 up to 39799
mdadm: /dev/md2 has been started with 3 drives (out of 4).
marc@debian:~$ mount /dev/md2 /mnt/array
mount: /mnt/array: must be superuser to use mount.
       dmesg(1) may have more information after failed mount system call.
marc@debian:~$ sudo mount /dev/md2 /mnt/array
mount: /mnt/array: special device /dev/md2 does not exist.
       dmesg(1) may have more information after failed mount system call.
marc@debian:~$ mount /dev/md2 /mnt/array
mount: /mnt/array: must be superuser to use mount.
       dmesg(1) may have more information after failed mount system call.
marc@debian:~$ su
Password:
root@debian:/home/marc# mount /dev/md2 /mnt/array
mount: /mnt/array: special device /dev/md2 does not exist.
       dmesg(1) may have more information after failed mount system call.
root@debian:/home/marc# mdadm --detail --scan
bash: mdadm: command not found
root@debian:/home/marc# mdadm --detail --scan
bash: mdadm: command not found
root@debian:/home/marc# sudo mdadm
Usage: mdadm --help
  for help
root@debian:/home/marc# sudo mdadm --detail --scan
ARRAY /dev/md0 metadata=0.90 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/10 metadata=1.2 name=TS-XEL-EM02C:10 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3
ARRAY /dev/md/1 metadata=1.2 name=TS-XEL-EM02C:1 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf

Seems like I'm able to force build the array but can't mount it, and then it seems to disappear? Let me know if I am missing something. Like you suggested, just trying to make it active w/ 3 drives to try to do a full backup or as much as possible at this point. Thanks again!

take a look at dmesg

also, if your data is worth thousands of dollars you might consider taking all your drives to one of those data recovery companies.

you may want to get a full root shell to make this a bit easier, sudo su -

ls /sys/block

Thanks! It'll be sad, but not the end of the world if I lose any or all data. I made a point of keeping our important files elsewhere on my main computer and backed up to an external USB drive. The TS-XEL raid array houses all of our media, so it's kind of a local "streaming box", as I affectionately call it.

Will try what you suggested above and let you know how it goes. I have a new Seagate drive on the way, but I have a feeling there's more damage than just one drive going bad. Thanks so much again and I'll keep you posted!

Output from ls /sys/block

md0 md1 md10 mtdblock0 mtdblock1 sdc sdd

Output from dmesg (sorry for the long message!)


root@debian:/home/marc# dmesg
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 6.0.0-5-marvell (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-9) 12.2.0, GNU ld (GNU Binutils for Debian) 2.39) #1 Debian 6.0.10-2 (2022-12-01)
[    0.000000] CPU: Feroceon 88FR131 [56251311] revision 1 (ARMv5TE), cr=0005317f
[    0.000000] CPU: VIVT data cache, VIVT instruction cache
[    0.000000] OF: fdt: Machine model: Buffalo Terastation TS-XEL
[    0.000000] Memory policy: Data cache writeback
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 65024
[    0.000000] Kernel command line: console=ttyS0,115200
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[    0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off
[    0.000000] Memory: 244732K/262144K available (5031K kernel code, 833K rwdata, 1508K rodata, 320K init, 246K bss, 17412K reserved, 0K cma-reserved, 0K highmem)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] ftrace: allocating 24229 entries in 72 pages
[    0.000000] ftrace: allocated 71 pages with 4 groups
[    0.000000] trace event string verifier disabled
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] clocksource: orion_clocksource: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 9556302233 ns
[    0.000002] sched_clock: 32 bits at 200MHz, resolution 5ns, wraps every 10737418237ns
[    0.000042] Switching to timer-based delay loop, resolution 5ns
[    0.000287] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.000318] pid_max: default: 32768 minimum: 301
[    0.000922] LSM: Security Framework initializing
[    0.001274] landlock: Up and running.
[    0.001285] Yama: disabled by default; enable with sysctl kernel.yama.*
[    0.001581] AppArmor: AppArmor initialized
[    0.001962] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.001996] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.004131] CPU: Testing write buffer coherency: ok
[    0.006581] cblist_init_generic: Setting adjustable number of callback queues.
[    0.006598] cblist_init_generic: Setting shift to 0 and lim to 1.
[    0.006891] cblist_init_generic: Setting shift to 0 and lim to 1.
[    0.007266] Setting up static identity map for 0x8220 - 0x825c
[    0.007563] mvebu-soc-id: MVEBU SoC ID=0x6281, Rev=0x3
[    0.009272] devtmpfs: initialized
[    0.015204] VFP support v0.3: not present
[    0.015382] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.015423] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[    0.015646] pinctrl core: initialized pinctrl subsystem
[    0.018097] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.018890] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.019926] audit: initializing netlink subsys (disabled)
[    0.020419] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1
[    0.021350] thermal_sys: Registered thermal governor 'fair_share'
[    0.021366] thermal_sys: Registered thermal governor 'bang_bang'
[    0.021375] thermal_sys: Registered thermal governor 'step_wise'
[    0.021381] thermal_sys: Registered thermal governor 'user_space'
[    0.021479] cpuidle: using governor ladder
[    0.021845] Feroceon L2: Enabling L2
[    0.021881] Feroceon L2: Cache support initialised.
[    0.031035] No ATAGs?
[    0.071452] clocksource: Switched to clocksource orion_clocksource
[    0.072354] VFS: Disk quotas dquot_6.6.0
[    0.072448] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.073369] AppArmor: AppArmor Filesystem Enabled
[    0.075123] NET: Registered PF_INET protocol family
[    0.079614] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.081116] tcp_listen_portaddr_hash hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.081387] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.081414] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.081462] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.081500] TCP: Hash tables configured (established 2048 bind 2048)
[    0.081784] MPTCP token hash table entries: 512 (order: 0, 6144 bytes, linear)
[    0.081885] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.081922] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.082232] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.082319] PCI: CLS 0 bytes, default 32
[    0.088123] Trying to unpack rootfs image as initramfs...
[    0.156197] Initialise system trusted keyrings
[    0.156295] Key type blacklist registered
[    0.157645] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[    0.165514] Key type asymmetric registered
[    0.165533] Asymmetric key parser 'x509' registered
[    1.674504] Freeing initrd memory: 6908K
[    1.717213] alg: self-tests for CTR-KDF (hmac(sha256)) passed
[    1.717513] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    1.720383] kirkwood-pinctrl f1010000.pin-controller: registered pinctrl driver
[    1.723386] mv_xor f1060800.xor: Marvell shared XOR driver
[    1.761310] mv_xor f1060800.xor: Marvell XOR (Registers Mode): ( xor cpy intr )
[    1.761645] mv_xor f1060900.xor: Marvell shared XOR driver
[    1.797284] mv_xor f1060900.xor: Marvell XOR (Registers Mode): ( xor cpy intr )
[    1.797896] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
[    1.799384] printk: console [ttyS0] disabled
[    1.799520] f1012000.serial: ttyS0 at MMIO 0xf1012000 (irq = 27, base_baud = 12500000) is a 16550A
[    2.355595] printk: console [ttyS0] enabled
[    2.360724] f1012100.serial: ttyS1 at MMIO 0xf1012100 (irq = 28, base_baud = 12500000) is a 16550A
[    2.371228] i2c_dev: i2c /dev entries driver
[    2.376731] ledtrig-cpu: registered to indicate activity on CPUs
[    2.384089] registered taskstats version 1
[    2.388287] Loading compiled-in X.509 certificates
[    2.435698] Loaded X.509 cert 'Debian Secure Boot CA: 6ccece7e4c6c0d1f6149f3dd27dfcc5cbb419ea1'
[    2.444763] Loaded X.509 cert 'Debian Secure Boot Signer 2022 - linux: 14011249c2675ea8e5148542202005810584b25f'
[    2.495338] Key type encrypted registered
[    2.499719] AppArmor: AppArmor sha1 policy hashing enabled
[    2.510516] debugfs: Directory 'USB Power' with parent 'regulator' already present!
[    2.523057] Freeing unused kernel image (initmem) memory: 320K
[    2.528975] Kernel memory protection not selected by kernel config.
[    2.535413] Run /init as init process
[    2.539114]   with arguments:
[    2.539125]     /init
[    2.539133]   with environment:
[    2.539139]     HOME=/
[    2.539147]     TERM=linux
[    3.157151] rtc-mv f1010300.rtc: registered as rtc0
[    3.182790] rtc-mv f1010300.rtc: setting system clock to 2022-12-09T12:49:55 UTC (1670590195)
[    3.277059] SCSI subsystem initialized
[    3.375742] libata version 3.00 loaded.
[    3.381784] sata_mv f1080000.sata: version 1.28
[    3.383764] sata_mv f1080000.sata: slots 32 ports 1
[    3.392680] scsi host0: sata_mv
[    3.398414] ata1: SATA max UDMA/133 irq 30
[    3.875477] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[    3.882584] ata1.15: Port Multiplier 1.2, 0x11ab:0x4140 r193, 4 ports, feat 0x5/0x1f
[    3.902819] ata1.00: hard resetting link
[    4.383755] ata1.01: hard resetting link
[    4.923752] ata1.02: hard resetting link
[    5.463752] ata1.03: hard resetting link
[    6.006136] ata1.00: failed to read native max address (err_mask=0x1)
[    6.012629] ata1.00: HPA support seems broken, skipping HPA handling
[    6.019029] ata1.00: ATA-8: ST1000NM0033, 0001, max UDMA/133
[    6.024754] ata1.00: 8089950 sectors, multi 16: LBA48 NCQ (depth 31/32)
[    6.033852] ata1.00: configured for UDMA/133
[    6.042672] ata1.01: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[    6.048993] ata1.01: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    6.064791] ata1.01: configured for UDMA/133
[    6.073620] ata1.02: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[    6.079940] ata1.02: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    6.095735] ata1.02: configured for UDMA/133
[    6.104543] ata1.03: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[    6.110870] ata1.03: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    6.126665] ata1.03: configured for UDMA/133
[    6.131183] ata1: EH complete
[    6.134702] scsi 0:0:0:0: Direct-Access     ATA      ST1000NM0033     0001 PQ: 0 ANSI: 5
[    6.154195] scsi 0:1:0:0: Direct-Access     ATA      ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[    6.165625] scsi 0:2:0:0: Direct-Access     ATA      ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[    6.177118] scsi 0:3:0:0: Direct-Access     ATA      ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[    6.369067] sd 0:0:0:0: [sda] 8089950 512-byte logical blocks: (4.14 GB/3.86 GiB)
[    6.377497] sd 0:1:0:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    6.386044] sd 0:2:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    6.397712] sd 0:3:0:0: [sdd] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    6.406012] sd 0:0:0:0: [sda] Write Protect is off
[    6.410872] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    6.410907] sd 0:2:0:0: [sdc] Write Protect is off
[    6.415752] sd 0:2:0:0: [sdc] Mode Sense: 00 3a 00 00
[    6.415785] sd 0:1:0:0: [sdb] Write Protect is off
[    6.420625] sd 0:1:0:0: [sdb] Mode Sense: 00 3a 00 00
[    6.420722] sd 0:3:0:0: [sdd] Write Protect is off
[    6.425564] sd 0:3:0:0: [sdd] Mode Sense: 00 3a 00 00
[    6.425937] sd 0:1:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    6.435080] sd 0:2:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    6.444216] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    6.453465] sd 0:3:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    6.463098] sd 0:2:0:0: [sdc] Preferred minimum I/O size 512 bytes
[    6.469359] sd 0:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[    6.475612] sd 0:1:0:0: [sdb] Preferred minimum I/O size 512 bytes
[    6.482029] sd 0:3:0:0: [sdd] Preferred minimum I/O size 512 bytes
[    6.501124] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=2800 failed_links=1 nr_active_links=2
[    6.510499] ata1: mv_handle_fbs_ncq_dev_err: waiting
[    6.515511] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=2000 failed_links=1 nr_active_links=1
[    6.524869] ata1: mv_handle_fbs_ncq_dev_err: done
[    6.539924] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[    6.545842] ata1.00: failed to read log page 10h (errno=-5)
[    6.551482] ata1.00: failed to read SCR 1 (Emask=0x40)
[    6.556676] ata1.01: failed to read SCR 1 (Emask=0x40)
[    6.561858] ata1.02: failed to read SCR 1 (Emask=0x40)
[    6.567045] ata1.03: failed to read SCR 1 (Emask=0x40)
[    6.572238] ata1.00: exception Emask 0x1 SAct 0x2000 SErr 0x0 action 0x6 frozen
[    6.579608] ata1.00: dev err
[    6.582512] ata1.00: failed command: READ FPDMA QUEUED
[    6.587693] ata1.00: cmd 60/02:68:00:00:00/00:00:00:00:00/40 tag 13 ncq dma 1024 in
                        res 51/04:68:00:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[    6.603283] ata1.00: status: { DRDY ERR }
[    6.607327] ata1.00: error: { ABRT }
[    7.083481] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[    7.090872] ata1.00: hard resetting link
[    9.184591] ata1.00: configured for UDMA/133
[    9.200271] ata1.01: configured for UDMA/133
[    9.215959] ata1.02: configured for UDMA/133
[    9.231625] ata1.03: configured for UDMA/133
[    9.236176] ata1: EH complete
[    9.239235] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=4000 failed_links=1 nr_active_links=1
[    9.248596] ata1: mv_handle_fbs_ncq_dev_err: done
[    9.263620] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[    9.269517] ata1.00: failed to read log page 10h (errno=-5)
[    9.275147] ata1.00: failed to read SCR 1 (Emask=0x40)
[    9.280337] ata1.00: NCQ disabled due to excessive errors
[    9.285791] ata1.01: failed to read SCR 1 (Emask=0x40)
[    9.290973] ata1.02: failed to read SCR 1 (Emask=0x40)
[    9.296162] ata1.03: failed to read SCR 1 (Emask=0x40)
[    9.301352] ata1.00: exception Emask 0x1 SAct 0x4000 SErr 0x0 action 0x6 frozen
[    9.308715] ata1.00: dev err
[    9.311633] ata1.00: failed command: READ FPDMA QUEUED
[    9.316815] ata1.00: cmd 60/02:70:02:00:00/00:00:00:00:00/40 tag 14 ncq dma 1024 in
                        res 51/04:70:02:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[    9.332406] ata1.00: status: { DRDY ERR }
[    9.336452] ata1.00: error: { ABRT }
[    9.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[    9.818852] ata1.00: hard resetting link
[   11.912589] ata1.00: configured for UDMA/133
[   11.928320] ata1.01: configured for UDMA/133
[   11.944058] ata1.02: configured for UDMA/133
[   11.959769] ata1.03: configured for UDMA/133
[   11.964351] ata1: EH complete
[   11.979933] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   11.986450] ata1.00: SError: { RecovComm }
[   11.990608] ata1.00: failed command: READ DMA
[   11.995007] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   12.010250] ata1.00: status: { DRDY ERR }
[   12.014303] ata1.00: error: { ABRT }
[   12.487508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   12.494844] ata1.00: hard resetting link
[   14.588572] ata1.00: configured for UDMA/133
[   14.604282] ata1.01: configured for UDMA/133
[   14.620041] ata1.02: configured for UDMA/133
[   14.635742] ata1.03: configured for UDMA/133
[   14.640325] ata1: EH complete
[   14.643897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   14.650412] ata1.00: SError: { RecovComm }
[   14.654562] ata1.00: failed command: READ DMA
[   14.658957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
                        res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   14.674204] ata1.00: status: { DRDY ERR }
[   14.678254] ata1.00: error: { ABRT }
[   15.151507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   15.158844] ata1.00: hard resetting link
[   17.252574] ata1.00: configured for UDMA/133
[   17.268278] ata1.01: configured for UDMA/133
[   17.284042] ata1.02: configured for UDMA/133
[   17.299749] ata1.03: configured for UDMA/133
[   17.304325] ata1: EH complete
[   17.307899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   17.314416] ata1.00: SError: { RecovComm }
[   17.318566] ata1.00: failed command: READ DMA
[   17.322961] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
                        res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   17.338203] ata1.00: status: { DRDY ERR }
[   17.342249] ata1.00: error: { ABRT }
[   17.815508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   17.822851] ata1.00: hard resetting link
[   19.916570] ata1.00: configured for UDMA/133
[   19.932271] ata1.01: configured for UDMA/133
[   19.948034] ata1.02: configured for UDMA/133
[   19.963739] ata1.03: configured for UDMA/133
[   19.968321] ata1: EH complete
[   19.971892] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   19.978411] ata1.00: SError: { RecovComm }
[   19.982561] ata1.00: failed command: READ DMA
[   19.986956] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   20.002200] ata1.00: status: { DRDY ERR }
[   20.006244] ata1.00: error: { ABRT }
[   20.479507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   20.486845] ata1.00: hard resetting link
[   22.580567] ata1.00: configured for UDMA/133
[   22.596272] ata1.01: configured for UDMA/133
[   22.612037] ata1.02: configured for UDMA/133
[   22.627744] ata1.03: configured for UDMA/133
[   22.632324] ata1: EH complete
[   22.635893] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   22.642405] ata1.00: SError: { RecovComm }
[   22.646554] ata1.00: failed command: READ DMA
[   22.650951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
                        res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   22.666201] ata1.00: status: { DRDY ERR }
[   22.670248] ata1.00: error: { ABRT }
[   23.143507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   23.150841] ata1.00: hard resetting link
[   25.244568] ata1.00: configured for UDMA/133
[   25.260271] ata1.01: configured for UDMA/133
[   25.276031] ata1.02: configured for UDMA/133
[   25.291741] ata1.03: configured for UDMA/133
[   25.296319] ata1: EH complete
[   25.299890] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   25.306399] ata1.00: SError: { RecovComm }
[   25.310550] ata1.00: failed command: READ DMA
[   25.314946] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
                        res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   25.330188] ata1.00: status: { DRDY ERR }
[   25.334234] ata1.00: error: { ABRT }
[   25.807507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   25.814843] ata1.00: hard resetting link
[   27.908571] ata1.00: configured for UDMA/133
[   27.924270] ata1.01: configured for UDMA/133
[   27.940033] ata1.02: configured for UDMA/133
[   27.955736] ata1.03: configured for UDMA/133
[   27.960313] ata1: EH complete
[   27.963890] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   27.970403] ata1.00: SError: { RecovComm }
[   27.974554] ata1.00: failed command: READ DMA
[   27.978949] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   27.994196] ata1.00: status: { DRDY ERR }
[   27.998248] ata1.00: error: { ABRT }
[   28.471507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   28.478848] ata1.00: hard resetting link
[   30.572569] ata1.00: configured for UDMA/133
[   30.588274] ata1.01: configured for UDMA/133
[   30.604041] ata1.02: configured for UDMA/133
[   30.619748] ata1.03: configured for UDMA/133
[   30.624328] ata1: EH complete
[   30.627894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   30.634406] ata1.00: SError: { RecovComm }
[   30.638557] ata1.00: failed command: READ DMA
[   30.642954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
                        res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   30.658195] ata1.00: status: { DRDY ERR }
[   30.662241] ata1.00: error: { ABRT }
[   31.135506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   31.142842] ata1.00: hard resetting link
[   33.236570] ata1.00: configured for UDMA/133
[   33.252282] ata1.01: configured for UDMA/133
[   33.268041] ata1.02: configured for UDMA/133
[   33.283742] ata1.03: configured for UDMA/133
[   33.288321] ata1: EH complete
[   33.291891] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   33.298402] ata1.00: SError: { RecovComm }
[   33.302552] ata1.00: failed command: READ DMA
[   33.306947] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
                        res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   33.322191] ata1.00: status: { DRDY ERR }
[   33.326236] ata1.00: error: { ABRT }
[   33.799507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   33.806847] ata1.00: hard resetting link
[   35.900571] ata1.00: configured for UDMA/133
[   35.916274] ata1.01: configured for UDMA/133
[   35.932035] ata1.02: configured for UDMA/133
[   35.947735] ata1.03: configured for UDMA/133
[   35.952317] ata1: EH complete
[   35.955888] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   35.962405] ata1.00: SError: { RecovComm }
[   35.966557] ata1.00: failed command: READ DMA
[   35.970952] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   35.986194] ata1.00: status: { DRDY ERR }
[   35.990239] ata1.00: error: { ABRT }
[   36.463507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   36.470848] ata1.00: hard resetting link
[   38.564571] ata1.00: configured for UDMA/133
[   40.496621] ata1.01: configured for UDMA/133
[   40.512282] ata1.02: configured for UDMA/133
[   40.527965] ata1.03: configured for UDMA/133
[   40.532510] ata1: EH complete
[   40.536080] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   40.542584] ata1.00: SError: { RecovComm }
[   40.546746] ata1.00: failed command: READ DMA
[   40.551142] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
                        res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   40.566384] ata1.00: status: { DRDY ERR }
[   40.570428] ata1.00: error: { ABRT }
[   41.043505] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   41.050847] ata1.00: hard resetting link
[   43.144568] ata1.00: configured for UDMA/133
[   43.160278] ata1.01: configured for UDMA/133
[   43.176056] ata1.02: configured for UDMA/133
[   43.191764] ata1.03: configured for UDMA/133
[   43.196340] ata1: EH complete
[   43.199915] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   43.206432] ata1.00: SError: { RecovComm }
[   43.210587] ata1.00: failed command: READ DMA
[   43.214978] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
                        res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   43.230220] ata1.00: status: { DRDY ERR }
[   43.234267] ata1.00: error: { ABRT }
[   43.707508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   43.714840] ata1.00: hard resetting link
[   45.808570] ata1.00: configured for UDMA/133
[   45.824280] ata1.01: configured for UDMA/133
[   45.840040] ata1.02: configured for UDMA/133
[   45.855740] ata1.03: configured for UDMA/133
[   45.860320] ata1: EH complete
[   45.863893] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   45.870408] ata1.00: SError: { RecovComm }
[   45.874561] ata1.00: failed command: READ DMA
[   45.878955] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   45.894202] ata1.00: status: { DRDY ERR }
[   45.898253] ata1.00: error: { ABRT }
[   46.371506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   46.378845] ata1.00: hard resetting link
[   47.515481] random: crng init done
[   48.472573] ata1.00: configured for UDMA/133
[   48.504538] ata1.01: configured for UDMA/133
[   48.520240] ata1.02: configured for UDMA/133
[   48.536007] ata1.03: configured for UDMA/133
[   48.540588] ata1: EH complete
[   48.544156] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   48.550658] ata1.00: SError: { RecovComm }
[   48.554820] ata1.00: failed command: READ DMA
[   48.559215] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
                        res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   48.574457] ata1.00: status: { DRDY ERR }
[   48.578501] ata1.00: error: { ABRT }
[   49.051507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   49.058849] ata1.00: hard resetting link
[   51.152570] ata1.00: configured for UDMA/133
[   51.168278] ata1.01: configured for UDMA/133
[   51.184044] ata1.02: configured for UDMA/133
[   51.199744] ata1.03: configured for UDMA/133
[   51.204340] sd 0:0:0:0: [sda] tag#13 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=44s
[   51.213567] sd 0:0:0:0: [sda] tag#13 Sense Key : Illegal Request [current]
[   51.220590] sd 0:0:0:0: [sda] tag#13 Add. Sense: Unaligned write command
[   51.227355] sd 0:0:0:0: [sda] tag#13 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[   51.234809] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[   51.242963] Buffer I/O error on dev sda, logical block 0, async page read
[   51.249823] ata1: EH complete
[   51.260129] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   51.266655] ata1.00: SError: { RecovComm }
[   51.270814] ata1.00: failed command: READ DMA
[   51.275207] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
                        res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[   51.290448] ata1.00: status: { DRDY ERR }
[   51.294494] ata1.00: error: { ABRT }
[   51.767508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   51.774854] ata1.00: hard resetting link
[   55.668585] ata1.00: configured for UDMA/133
[   55.684295] ata1.01: configured for UDMA/133
[   55.700048] ata1.02: configured for UDMA/133
[   55.715751] ata1.03: configured for UDMA/133
[   55.720348] sd 0:0:0:0: [sda] tag#14 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=49s
[   55.729575] sd 0:0:0:0: [sda] tag#14 Sense Key : Illegal Request [current]
[   55.736599] sd 0:0:0:0: [sda] tag#14 Add. Sense: Unaligned write command
[   55.743363] sd 0:0:0:0: [sda] tag#14 CDB: Read(10) 28 00 00 00 00 02 00 00 02 00
[   55.750809] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[   55.758964] Buffer I/O error on dev sda, logical block 1, async page read
[   55.765824] ata1: EH complete
[   55.769384] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   55.775906] ata1.00: SError: { RecovComm }
[   55.780063] ata1.00: failed command: READ DMA
[   55.784458] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
                        res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   55.799699] ata1.00: status: { DRDY ERR }
[   55.803745] ata1.00: error: { ABRT }
[   56.279478] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   56.286847] ata1.00: hard resetting link
[   60.180549] ata1.00: configured for UDMA/133
[   60.196215] ata1.01: configured for UDMA/133
[   60.211897] ata1.02: configured for UDMA/133
[   60.227560] ata1.03: configured for UDMA/133
[   60.232112] sd 0:0:0:0: [sda] tag#18 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=50s
[   60.241336] sd 0:0:0:0: [sda] tag#18 Sense Key : Illegal Request [current]
[   60.248366] sd 0:0:0:0: [sda] tag#18 Add. Sense: Unaligned write command
[   60.255126] sd 0:0:0:0: [sda] tag#18 CDB: Read(10) 28 00 00 00 00 04 00 00 04 00
[   60.262572] I/O error, dev sda, sector 4 op 0x0:(READ) flags 0x0 phys_seg 2 prio class 2
[   60.270726] Buffer I/O error on dev sda, logical block 2, async page read
[   60.277571] Buffer I/O error on dev sda, logical block 3, async page read
[   60.284435] ata1: EH complete
[   60.315924] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   60.322446] ata1.00: SError: { RecovComm }
[   60.326603] ata1.00: failed command: READ DMA
[   60.330996] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   60.346239] ata1.00: status: { DRDY ERR }
[   60.350284] ata1.00: error: { ABRT }
[   60.823509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   60.830854] ata1.00: hard resetting link
[   62.924584] ata1.00: configured for UDMA/133
[   62.940297] ata1.01: configured for UDMA/133
[   62.956047] ata1.02: configured for UDMA/133
[   62.971748] ata1.03: configured for UDMA/133
[   62.976333] ata1: EH complete
[   62.991936] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   62.998450] ata1.00: SError: { RecovComm }
[   63.002609] ata1.00: failed command: READ DMA
[   63.007007] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   63.022250] ata1.00: status: { DRDY ERR }
[   63.026295] ata1.00: error: { ABRT }
[   63.499506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   63.506842] ata1.00: hard resetting link
[   65.600573] ata1.00: configured for UDMA/133
[   65.616284] ata1.01: configured for UDMA/133
[   65.632043] ata1.02: configured for UDMA/133
[   65.647749] ata1.03: configured for UDMA/133
[   65.652335] ata1: EH complete
[   65.655912] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   65.662431] ata1.00: SError: { RecovComm }
[   65.666581] ata1.00: failed command: READ DMA
[   65.670975] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   65.686219] ata1.00: status: { DRDY ERR }
[   65.690263] ata1.00: error: { ABRT }
[   66.163507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   66.170849] ata1.00: hard resetting link
[   68.264616] ata1.00: configured for UDMA/133
[   68.280371] ata1.01: configured for UDMA/133
[   68.296080] ata1.02: configured for UDMA/133
[   68.311783] ata1.03: configured for UDMA/133
[   68.316372] ata1: EH complete
[   68.319979] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   68.326487] ata1.00: SError: { RecovComm }
[   68.330648] ata1.00: failed command: READ DMA
[   68.335042] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   68.350283] ata1.00: status: { DRDY ERR }
[   68.354327] ata1.00: error: { ABRT }
[   68.827509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   68.834854] ata1.00: hard resetting link
[   70.928574] ata1.00: configured for UDMA/133
[   70.944283] ata1.01: configured for UDMA/133
[   70.960040] ata1.02: configured for UDMA/133
[   70.975739] ata1.03: configured for UDMA/133
[   70.980323] ata1: EH complete
[   70.983897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   70.990411] ata1.00: SError: { RecovComm }
[   70.994562] ata1.00: failed command: READ DMA
[   70.998957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   71.014200] ata1.00: status: { DRDY ERR }
[   71.018244] ata1.00: error: { ABRT }
[   71.491508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   71.498847] ata1.00: hard resetting link
[   73.592572] ata1.00: configured for UDMA/133
[   73.608274] ata1.01: configured for UDMA/133
[   73.624035] ata1.02: configured for UDMA/133
[   73.639736] ata1.03: configured for UDMA/133
[   73.644317] ata1: EH complete
[   73.647898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   73.654413] ata1.00: SError: { RecovComm }
[   73.658566] ata1.00: failed command: READ DMA
[   73.662960] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   73.678205] ata1.00: status: { DRDY ERR }
[   73.682258] ata1.00: error: { ABRT }
[   74.155506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   74.162840] ata1.00: hard resetting link
[   76.256571] ata1.00: configured for UDMA/133
[   76.272278] ata1.01: configured for UDMA/133
[   76.288041] ata1.02: configured for UDMA/133
[   76.303747] ata1.03: configured for UDMA/133
[   76.308330] ata1: EH complete
[   76.311905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   76.318417] ata1.00: SError: { RecovComm }
[   76.322570] ata1.00: failed command: READ DMA
[   76.326964] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   76.342206] ata1.00: status: { DRDY ERR }
[   76.346251] ata1.00: error: { ABRT }
[   76.819507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   76.826844] ata1.00: hard resetting link
[   78.920565] ata1.00: configured for UDMA/133
[   78.936272] ata1.01: configured for UDMA/133
[   78.952034] ata1.02: configured for UDMA/133
[   78.967738] ata1.03: configured for UDMA/133
[   78.972311] ata1: EH complete
[   78.975886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   78.982404] ata1.00: SError: { RecovComm }
[   78.986555] ata1.00: failed command: READ DMA
[   78.990949] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   79.006192] ata1.00: status: { DRDY ERR }
[   79.010237] ata1.00: error: { ABRT }
[   79.483506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   79.490847] ata1.00: hard resetting link
[   81.584571] ata1.00: configured for UDMA/133
[   81.600275] ata1.01: configured for UDMA/133
[   81.616036] ata1.02: configured for UDMA/133
[   81.631739] ata1.03: configured for UDMA/133
[   81.636322] ata1: EH complete
[   81.639894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   81.646406] ata1.00: SError: { RecovComm }
[   81.650559] ata1.00: failed command: READ DMA
[   81.654954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   81.670197] ata1.00: status: { DRDY ERR }
[   81.674242] ata1.00: error: { ABRT }
[   82.147505] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   82.154843] ata1.00: hard resetting link
[   84.248570] ata1.00: configured for UDMA/133
[   84.264267] ata1.01: configured for UDMA/133
[   84.280033] ata1.02: configured for UDMA/133
[   84.295739] ata1.03: configured for UDMA/133
[   84.300319] ata1: EH complete
[   84.303898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   84.310411] ata1.00: SError: { RecovComm }
[   84.314563] ata1.00: failed command: READ DMA
[   84.318958] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   84.334200] ata1.00: status: { DRDY ERR }
[   84.338244] ata1.00: error: { ABRT }
[   84.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   84.818845] ata1.00: hard resetting link
[   86.912568] ata1.00: configured for UDMA/133
[   86.928272] ata1.01: configured for UDMA/133
[   86.944038] ata1.02: configured for UDMA/133
[   86.959744] ata1.03: configured for UDMA/133
[   86.964326] ata1: EH complete
[   86.967898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   86.974413] ata1.00: SError: { RecovComm }
[   86.978565] ata1.00: failed command: READ DMA
[   86.982961] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   86.998207] ata1.00: status: { DRDY ERR }
[   87.002258] ata1.00: error: { ABRT }
[   87.475507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   87.482839] ata1.00: hard resetting link
[   89.576569] ata1.00: configured for UDMA/133
[   89.592280] ata1.01: configured for UDMA/133
[   89.608041] ata1.02: configured for UDMA/133
[   89.623746] ata1.03: configured for UDMA/133
[   89.628348] sd 0:0:0:0: [sda] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[   89.637576] sd 0:0:0:0: [sda] tag#23 Sense Key : Illegal Request [current]
[   89.644598] sd 0:0:0:0: [sda] tag#23 Add. Sense: Unaligned write command
[   89.651363] sd 0:0:0:0: [sda] tag#23 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[   89.658818] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[   89.666971] Buffer I/O error on dev sda, logical block 0, async page read
[   89.673833] ata1: EH complete
[   89.688027] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   89.694553] ata1.00: SError: { RecovComm }
[   89.698712] ata1.00: failed command: READ DMA
[   89.703108] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   89.718356] ata1.00: status: { DRDY ERR }
[   89.722399] ata1.00: error: { ABRT }
[   90.195504] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   90.202849] ata1.00: hard resetting link
[   92.296575] ata1.00: configured for UDMA/133
[   92.312285] ata1.01: configured for UDMA/133
[   92.328047] ata1.02: configured for UDMA/133
[   92.343745] ata1.03: configured for UDMA/133
[   92.348342] sd 0:0:0:0: [sda] tag#25 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[   92.357560] sd 0:0:0:0: [sda] tag#25 Sense Key : Illegal Request [current]
[   92.364584] sd 0:0:0:0: [sda] tag#25 Add. Sense: Unaligned write command
[   92.371348] sd 0:0:0:0: [sda] tag#25 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[   92.378794] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[   92.386947] Buffer I/O error on dev sda, logical block 1, async page read
[   92.393786] Buffer I/O error on dev sda, logical block 2, async page read
[   92.400629] Buffer I/O error on dev sda, logical block 3, async page read
[   92.407499] ata1: EH complete
[   92.439948] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   92.446471] ata1.00: SError: { RecovComm }
[   92.450631] ata1.00: failed command: READ DMA
[   92.455024] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   92.470178] ata1.00: status: { DRDY ERR }
[   92.474222] ata1.00: error: { ABRT }
[   92.947508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   92.954855] ata1.00: hard resetting link
[   95.048582] ata1.00: configured for UDMA/133
[   95.064295] ata1.01: configured for UDMA/133
[   95.080050] ata1.02: configured for UDMA/133
[   95.095759] ata1.03: configured for UDMA/133
[   95.100342] ata1: EH complete
[   95.115939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   95.122450] ata1.00: SError: { RecovComm }
[   95.126609] ata1.00: failed command: READ DMA
[   95.131000] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   95.146154] ata1.00: status: { DRDY ERR }
[   95.150199] ata1.00: error: { ABRT }
[   95.623506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   95.630842] ata1.00: hard resetting link
[   97.724573] ata1.00: configured for UDMA/133
[   97.740281] ata1.01: configured for UDMA/133
[   97.756045] ata1.02: configured for UDMA/133
[   97.771751] ata1.03: configured for UDMA/133
[   97.776334] ata1: EH complete
[   97.779910] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[   97.786420] ata1.00: SError: { RecovComm }
[   97.790571] ata1.00: failed command: READ DMA
[   97.794968] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[   97.810122] ata1.00: status: { DRDY ERR }
[   97.814167] ata1.00: error: { ABRT }
[   98.287508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[   98.294846] ata1.00: hard resetting link
[  100.388571] ata1.00: configured for UDMA/133
[  100.404276] ata1.01: configured for UDMA/133
[  100.420038] ata1.02: configured for UDMA/133
[  100.435745] ata1.03: configured for UDMA/133
[  100.440325] ata1: EH complete
[  100.443907] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  100.450424] ata1.00: SError: { RecovComm }
[  100.454573] ata1.00: failed command: READ DMA
[  100.458970] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  100.474125] ata1.00: status: { DRDY ERR }
[  100.478171] ata1.00: error: { ABRT }
[  100.951506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  100.958841] ata1.00: hard resetting link
[  103.052571] ata1.00: configured for UDMA/133
[  103.068279] ata1.01: configured for UDMA/133
[  103.084042] ata1.02: configured for UDMA/133
[  103.099746] ata1.03: configured for UDMA/133
[  103.104324] ata1: EH complete
[  103.107899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  103.114410] ata1.00: SError: { RecovComm }
[  103.118560] ata1.00: failed command: READ DMA
[  103.122960] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  103.138121] ata1.00: status: { DRDY ERR }
[  103.142175] ata1.00: error: { ABRT }
[  103.615506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  103.622844] ata1.00: hard resetting link
[  105.716569] ata1.00: configured for UDMA/133
[  105.732277] ata1.01: configured for UDMA/133
[  105.748036] ata1.02: configured for UDMA/133
[  105.763736] ata1.03: configured for UDMA/133
[  105.768316] ata1: EH complete
[  105.771896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  105.778414] ata1.00: SError: { RecovComm }
[  105.782563] ata1.00: failed command: READ DMA
[  105.786960] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  105.802115] ata1.00: status: { DRDY ERR }
[  105.806161] ata1.00: error: { ABRT }
[  106.279507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  106.286849] ata1.00: hard resetting link
[  108.380569] ata1.00: configured for UDMA/133
[  108.396280] ata1.01: configured for UDMA/133
[  108.412038] ata1.02: configured for UDMA/133
[  108.427741] ata1.03: configured for UDMA/133
[  108.432324] ata1: EH complete
[  108.435896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  108.442408] ata1.00: SError: { RecovComm }
[  108.446559] ata1.00: failed command: READ DMA
[  108.450956] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  108.466110] ata1.00: status: { DRDY ERR }
[  108.470156] ata1.00: error: { ABRT }
[  108.943508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  108.950844] ata1.00: hard resetting link
[  111.044567] ata1.00: configured for UDMA/133
[  111.060273] ata1.01: configured for UDMA/133
[  111.076037] ata1.02: configured for UDMA/133
[  111.091740] ata1.03: configured for UDMA/133
[  111.096323] ata1: EH complete
[  111.099904] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  111.106421] ata1.00: SError: { RecovComm }
[  111.110571] ata1.00: failed command: READ DMA
[  111.114968] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  111.130127] ata1.00: status: { DRDY ERR }
[  111.134178] ata1.00: error: { ABRT }
[  111.607506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  111.614845] ata1.00: hard resetting link
[  113.708569] ata1.00: configured for UDMA/133
[  113.724277] ata1.01: configured for UDMA/133
[  113.740037] ata1.02: configured for UDMA/133
[  113.755736] ata1.03: configured for UDMA/133
[  113.760320] ata1: EH complete
[  113.763894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  113.770406] ata1.00: SError: { RecovComm }
[  113.774557] ata1.00: failed command: READ DMA
[  113.778954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  113.794109] ata1.00: status: { DRDY ERR }
[  113.798154] ata1.00: error: { ABRT }
[  114.271507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  114.278842] ata1.00: hard resetting link
[  116.372571] ata1.00: configured for UDMA/133
[  116.388284] ata1.01: configured for UDMA/133
[  116.404042] ata1.02: configured for UDMA/133
[  116.419749] ata1.03: configured for UDMA/133
[  116.424328] ata1: EH complete
[  116.427909] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  116.434421] ata1.00: SError: { RecovComm }
[  116.438569] ata1.00: failed command: READ DMA
[  116.442966] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  116.458121] ata1.00: status: { DRDY ERR }
[  116.462166] ata1.00: error: { ABRT }
[  116.935507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  116.942844] ata1.00: hard resetting link
[  119.036571] ata1.00: configured for UDMA/133
[  119.052274] ata1.01: configured for UDMA/133
[  119.068037] ata1.02: configured for UDMA/133
[  119.083735] ata1.03: configured for UDMA/133
[  119.088321] ata1: EH complete
[  119.091894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  119.098406] ata1.00: SError: { RecovComm }
[  119.102555] ata1.00: failed command: READ DMA
[  119.106953] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  119.122108] ata1.00: status: { DRDY ERR }
[  119.126152] ata1.00: error: { ABRT }
[  119.599508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  119.606848] ata1.00: hard resetting link
[  121.700571] ata1.00: configured for UDMA/133
[  121.716279] ata1.01: configured for UDMA/133
[  121.732040] ata1.02: configured for UDMA/133
[  121.747738] ata1.03: configured for UDMA/133
[  121.752334] sd 0:0:0:0: [sda] tag#7 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[  121.761471] sd 0:0:0:0: [sda] tag#7 Sense Key : Illegal Request [current]
[  121.768407] sd 0:0:0:0: [sda] tag#7 Add. Sense: Unaligned write command
[  121.775084] sd 0:0:0:0: [sda] tag#7 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[  121.782452] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  121.790604] Buffer I/O error on dev sda, logical block 0, async page read
[  121.797455] ata1: EH complete
[  121.824038] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  121.830562] ata1.00: SError: { RecovComm }
[  121.834726] ata1.00: failed command: READ DMA
[  121.839121] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  121.854279] ata1.00: status: { DRDY ERR }
[  121.858330] ata1.00: error: { ABRT }
[  122.331503] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  122.338850] ata1.00: hard resetting link
[  124.432599] ata1.00: configured for UDMA/133
[  124.448351] ata1.01: configured for UDMA/133
[  124.464052] ata1.02: configured for UDMA/133
[  124.479754] ata1.03: configured for UDMA/133
[  124.484369] sd 0:0:0:0: [sda] tag#8 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[  124.493510] sd 0:0:0:0: [sda] tag#8 Sense Key : Illegal Request [current]
[  124.500453] sd 0:0:0:0: [sda] tag#8 Add. Sense: Unaligned write command
[  124.507131] sd 0:0:0:0: [sda] tag#8 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[  124.514498] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[  124.522652] Buffer I/O error on dev sda, logical block 1, async page read
[  124.529498] Buffer I/O error on dev sda, logical block 2, async page read
[  124.536342] Buffer I/O error on dev sda, logical block 3, async page read
[  124.543209] ata1: EH complete
[  124.583940] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  124.590468] ata1.00: SError: { RecovComm }
[  124.594624] ata1.00: failed command: READ DMA
[  124.599019] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  124.614261] ata1.00: status: { DRDY ERR }
[  124.618305] ata1.00: error: { ABRT }
[  125.091523] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  125.098870] ata1.00: hard resetting link
[  127.192591] ata1.00: configured for UDMA/133
[  127.208322] ata1.01: configured for UDMA/133
[  127.224056] ata1.02: configured for UDMA/133
[  127.239760] ata1.03: configured for UDMA/133
[  127.244347] ata1: EH complete
[  127.259939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  127.266456] ata1.00: SError: { RecovComm }
[  127.270611] ata1.00: failed command: READ DMA
[  127.275004] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  127.290245] ata1.00: status: { DRDY ERR }
[  127.294290] ata1.00: error: { ABRT }
[  127.767507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  127.774848] ata1.00: hard resetting link
[  129.868576] ata1.00: configured for UDMA/133
[  129.884292] ata1.01: configured for UDMA/133
[  129.900049] ata1.02: configured for UDMA/133
[  129.915754] ata1.03: configured for UDMA/133
[  129.920343] ata1: EH complete
[  129.923923] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  129.930442] ata1.00: SError: { RecovComm }
[  129.934598] ata1.00: failed command: READ DMA
[  129.938989] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  129.954232] ata1.00: status: { DRDY ERR }
[  129.958276] ata1.00: error: { ABRT }
[  130.431506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  130.438843] ata1.00: hard resetting link
[  132.532569] ata1.00: configured for UDMA/133
[  132.548271] ata1.01: configured for UDMA/133
[  132.564037] ata1.02: configured for UDMA/133
[  132.579741] ata1.03: configured for UDMA/133
[  132.584319] ata1: EH complete
[  132.587906] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  132.594419] ata1.00: SError: { RecovComm }
[  132.598571] ata1.00: failed command: READ DMA
[  132.602966] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  132.618209] ata1.00: status: { DRDY ERR }
[  132.622253] ata1.00: error: { ABRT }
[  133.095509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  133.102844] ata1.00: hard resetting link
[  135.196569] ata1.00: configured for UDMA/133
[  135.212275] ata1.01: configured for UDMA/133
[  135.228032] ata1.02: configured for UDMA/133
[  135.243736] ata1.03: configured for UDMA/133
[  135.248319] ata1: EH complete
[  135.251892] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  135.258406] ata1.00: SError: { RecovComm }
[  135.262556] ata1.00: failed command: READ DMA
[  135.266953] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  135.282199] ata1.00: status: { DRDY ERR }
[  135.286250] ata1.00: error: { ABRT }
[  135.759506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  135.766839] ata1.00: hard resetting link
[  137.860568] ata1.00: configured for UDMA/133
[  137.876271] ata1.01: configured for UDMA/133
[  137.892033] ata1.02: configured for UDMA/133
[  137.907743] ata1.03: configured for UDMA/133
[  137.912319] ata1: EH complete
[  137.915899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  137.922409] ata1.00: SError: { RecovComm }
[  137.926560] ata1.00: failed command: READ DMA
[  137.930955] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  137.946198] ata1.00: status: { DRDY ERR }
[  137.950244] ata1.00: error: { ABRT }
[  138.423507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  138.430846] ata1.00: hard resetting link
[  140.524566] ata1.00: configured for UDMA/133
[  140.540272] ata1.01: configured for UDMA/133
[  140.556037] ata1.02: configured for UDMA/133
[  140.571740] ata1.03: configured for UDMA/133
[  140.576317] ata1: EH complete
[  140.579888] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  140.586405] ata1.00: SError: { RecovComm }
[  140.590555] ata1.00: failed command: READ DMA
[  140.594951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  140.610193] ata1.00: status: { DRDY ERR }
[  140.614238] ata1.00: error: { ABRT }
[  141.087507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  141.094850] ata1.00: hard resetting link
[  143.188570] ata1.00: configured for UDMA/133
[  143.204277] ata1.01: configured for UDMA/133
[  143.220036] ata1.02: configured for UDMA/133
[  143.235735] ata1.03: configured for UDMA/133
[  143.240315] ata1: EH complete
[  143.243897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  143.250415] ata1.00: SError: { RecovComm }
[  143.254568] ata1.00: failed command: READ DMA
[  143.258963] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  143.274206] ata1.00: status: { DRDY ERR }
[  143.278255] ata1.00: error: { ABRT }
[  143.751507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  143.758842] ata1.00: hard resetting link
[  145.852571] ata1.00: configured for UDMA/133
[  145.868274] ata1.01: configured for UDMA/133
[  145.884034] ata1.02: configured for UDMA/133
[  145.899742] ata1.03: configured for UDMA/133
[  145.904324] ata1: EH complete
[  145.907895] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  145.914410] ata1.00: SError: { RecovComm }
[  145.918562] ata1.00: failed command: READ DMA
[  145.922958] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  145.938200] ata1.00: status: { DRDY ERR }
[  145.942246] ata1.00: error: { ABRT }
[  146.415506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  146.422848] ata1.00: hard resetting link
[  148.516566] ata1.00: configured for UDMA/133
[  148.532268] ata1.01: configured for UDMA/133
[  148.548028] ata1.02: configured for UDMA/133
[  148.563728] ata1.03: configured for UDMA/133
[  148.568305] ata1: EH complete
[  148.571886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  148.578398] ata1.00: SError: { RecovComm }
[  148.582547] ata1.00: failed command: READ DMA
[  148.586944] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  148.602189] ata1.00: status: { DRDY ERR }
[  148.606241] ata1.00: error: { ABRT }
[  149.079507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  149.086843] ata1.00: hard resetting link
[  151.180569] ata1.00: configured for UDMA/133
[  151.196270] ata1.01: configured for UDMA/133
[  151.212036] ata1.02: configured for UDMA/133
[  151.227737] ata1.03: configured for UDMA/133
[  151.232314] ata1: EH complete
[  151.235887] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  151.242402] ata1.00: SError: { RecovComm }
[  151.246552] ata1.00: failed command: READ DMA
[  151.250947] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  151.266191] ata1.00: status: { DRDY ERR }
[  151.270235] ata1.00: error: { ABRT }
[  151.743507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  151.750844] ata1.00: hard resetting link
[  153.844568] ata1.00: configured for UDMA/133
[  153.860278] ata1.01: configured for UDMA/133
[  153.876035] ata1.02: configured for UDMA/133
[  153.891735] ata1.03: configured for UDMA/133
[  153.896332] sd 0:0:0:0: [sda] tag#15 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[  153.905555] sd 0:0:0:0: [sda] tag#15 Sense Key : Illegal Request [current]
[  153.912585] sd 0:0:0:0: [sda] tag#15 Add. Sense: Unaligned write command
[  153.919350] sd 0:0:0:0: [sda] tag#15 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[  153.926805] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  153.934957] Buffer I/O error on dev sda, logical block 0, async page read
[  153.941808] ata1: EH complete
[  153.968039] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  153.974563] ata1.00: SError: { RecovComm }
[  153.978717] ata1.00: failed command: READ DMA
[  153.983108] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  153.998350] ata1.00: status: { DRDY ERR }
[  154.002394] ata1.00: error: { ABRT }
[  154.475503] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  154.482840] ata1.00: hard resetting link
[  156.576582] ata1.00: configured for UDMA/133
[  156.592285] ata1.01: configured for UDMA/133
[  156.608036] ata1.02: configured for UDMA/133
[  156.623731] ata1.03: configured for UDMA/133
[  156.628327] sd 0:0:0:0: [sda] tag#16 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[  156.637555] sd 0:0:0:0: [sda] tag#16 Sense Key : Illegal Request [current]
[  156.644578] sd 0:0:0:0: [sda] tag#16 Add. Sense: Unaligned write command
[  156.651342] sd 0:0:0:0: [sda] tag#16 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[  156.658789] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[  156.666943] Buffer I/O error on dev sda, logical block 1, async page read
[  156.673789] Buffer I/O error on dev sda, logical block 2, async page read
[  156.680633] Buffer I/O error on dev sda, logical block 3, async page read
[  156.687496] ata1: EH complete
[  156.690602] ldm_validate_partition_table(): Disk read failed.
[  156.731945] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  156.738473] ata1.00: SError: { RecovComm }
[  156.742634] ata1.00: failed command: READ DMA
[  156.747025] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  156.762267] ata1.00: status: { DRDY ERR }
[  156.766311] ata1.00: error: { ABRT }
[  157.239506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  157.246845] ata1.00: hard resetting link
[  159.340578] ata1.00: configured for UDMA/133
[  159.356285] ata1.01: configured for UDMA/133
[  159.372051] ata1.02: configured for UDMA/133
[  159.387748] ata1.03: configured for UDMA/133
[  159.392332] ata1: EH complete
[  159.407939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  159.414452] ata1.00: SError: { RecovComm }
[  159.418613] ata1.00: failed command: READ DMA
[  159.423009] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  159.438252] ata1.00: status: { DRDY ERR }
[  159.442297] ata1.00: error: { ABRT }
[  159.915507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  159.922846] ata1.00: hard resetting link
[  162.016572] ata1.00: configured for UDMA/133
[  162.032279] ata1.01: configured for UDMA/133
[  162.048044] ata1.02: configured for UDMA/133
[  162.063743] ata1.03: configured for UDMA/133
[  162.068328] ata1: EH complete
[  162.071900] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  162.078415] ata1.00: SError: { RecovComm }
[  162.082566] ata1.00: failed command: READ DMA
[  162.086959] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  162.102203] ata1.00: status: { DRDY ERR }
[  162.106248] ata1.00: error: { ABRT }
[  162.579506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  162.586841] ata1.00: hard resetting link
[  164.680571] ata1.00: configured for UDMA/133
[  164.696284] ata1.01: configured for UDMA/133
[  164.712049] ata1.02: configured for UDMA/133
[  164.727755] ata1.03: configured for UDMA/133
[  164.732333] ata1: EH complete
[  164.735910] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  164.742425] ata1.00: SError: { RecovComm }
[  164.746579] ata1.00: failed command: READ DMA
[  164.750972] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  164.766214] ata1.00: status: { DRDY ERR }
[  164.770260] ata1.00: error: { ABRT }
[  165.243507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  165.250845] ata1.00: hard resetting link
[  167.344567] ata1.00: configured for UDMA/133
[  167.360273] ata1.01: configured for UDMA/133
[  167.376031] ata1.02: configured for UDMA/133
[  167.391732] ata1.03: configured for UDMA/133
[  167.396318] ata1: EH complete
[  167.399887] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  167.406402] ata1.00: SError: { RecovComm }
[  167.410555] ata1.00: failed command: READ DMA
[  167.414951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  167.430196] ata1.00: status: { DRDY ERR }
[  167.434247] ata1.00: error: { ABRT }
[  167.907506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  167.914848] ata1.00: hard resetting link
[  170.008568] ata1.00: configured for UDMA/133
[  170.024280] ata1.01: configured for UDMA/133
[  170.040040] ata1.02: configured for UDMA/133
[  170.055745] ata1.03: configured for UDMA/133
[  170.060325] ata1: EH complete
[  170.063905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  170.070417] ata1.00: SError: { RecovComm }
[  170.074569] ata1.00: failed command: READ DMA
[  170.078962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  170.094205] ata1.00: status: { DRDY ERR }
[  170.098249] ata1.00: error: { ABRT }
[  170.571506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  170.578844] ata1.00: hard resetting link
[  172.672569] ata1.00: configured for UDMA/133
[  172.688270] ata1.01: configured for UDMA/133
[  172.704033] ata1.02: configured for UDMA/133
[  172.719758] ata1.03: configured for UDMA/133
[  172.724341] ata1: EH complete
[  172.727916] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  172.734428] ata1.00: SError: { RecovComm }
[  172.738585] ata1.00: failed command: READ DMA
[  172.742975] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  172.758216] ata1.00: status: { DRDY ERR }
[  172.762261] ata1.00: error: { ABRT }
[  173.235506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  173.242845] ata1.00: hard resetting link
[  175.336572] ata1.00: configured for UDMA/133
[  175.352273] ata1.01: configured for UDMA/133
[  175.368037] ata1.02: configured for UDMA/133
[  175.383746] ata1.03: configured for UDMA/133
[  175.388320] ata1: EH complete
[  175.391897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  175.398415] ata1.00: SError: { RecovComm }
[  175.402566] ata1.00: failed command: READ DMA
[  175.406962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  175.422203] ata1.00: status: { DRDY ERR }
[  175.426248] ata1.00: error: { ABRT }
[  175.899506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  175.906841] ata1.00: hard resetting link
[  178.000571] ata1.00: configured for UDMA/133
[  178.016281] ata1.01: configured for UDMA/133
[  178.032038] ata1.02: configured for UDMA/133
[  178.047740] ata1.03: configured for UDMA/133
[  178.052323] ata1: EH complete
[  178.055895] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  178.062409] ata1.00: SError: { RecovComm }
[  178.066561] ata1.00: failed command: READ DMA
[  178.070956] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  178.086198] ata1.00: status: { DRDY ERR }
[  178.090243] ata1.00: error: { ABRT }
[  178.563506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  178.570845] ata1.00: hard resetting link
[  180.664573] ata1.00: configured for UDMA/133
[  180.680283] ata1.01: configured for UDMA/133
[  180.696045] ata1.02: configured for UDMA/133
[  180.711750] ata1.03: configured for UDMA/133
[  180.716333] ata1: EH complete
[  180.719913] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  180.726429] ata1.00: SError: { RecovComm }
[  180.730586] ata1.00: failed command: READ DMA
[  180.734977] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  180.750222] ata1.00: status: { DRDY ERR }
[  180.754274] ata1.00: error: { ABRT }
[  181.227507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  181.234848] ata1.00: hard resetting link
[  183.328570] ata1.00: configured for UDMA/133
[  183.344275] ata1.01: configured for UDMA/133
[  183.360040] ata1.02: configured for UDMA/133
[  183.375746] ata1.03: configured for UDMA/133
[  183.380327] ata1: EH complete
[  183.383902] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  183.390416] ata1.00: SError: { RecovComm }
[  183.394568] ata1.00: failed command: READ DMA
[  183.398963] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  183.414205] ata1.00: status: { DRDY ERR }
[  183.418250] ata1.00: error: { ABRT }
[  183.891507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  183.898842] ata1.00: hard resetting link
[  185.992570] ata1.00: configured for UDMA/133
[  186.008271] ata1.01: configured for UDMA/133
[  186.024052] ata1.02: configured for UDMA/133
[  186.039759] ata1.03: configured for UDMA/133
[  186.044354] sd 0:0:0:0: [sda] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[  186.053578] sd 0:0:0:0: [sda] tag#23 Sense Key : Illegal Request [current]
[  186.060601] sd 0:0:0:0: [sda] tag#23 Add. Sense: Unaligned write command
[  186.067365] sd 0:0:0:0: [sda] tag#23 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[  186.074812] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  186.082965] Buffer I/O error on dev sda, logical block 0, async page read
[  186.089824] ata1: EH complete
[  186.109327]  sdc: sdc1 sdc2 sdc3 sdc4 sdc5 sdc6
[  186.119849] sd 0:2:0:0: [sdc] Attached SCSI disk
[  186.137871] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  186.144408] ata1.00: SError: { RecovComm }
[  186.148565] ata1.00: failed command: READ DMA
[  186.152959] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  186.168204] ata1.00: status: { DRDY ERR }
[  186.172254] ata1.00: error: { ABRT }
[  186.647501] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  186.654852] ata1.00: hard resetting link
[  188.748596] ata1.00: configured for UDMA/133
[  188.764341] ata1.01: configured for UDMA/133
[  188.780045] ata1.02: configured for UDMA/133
[  188.795739] ata1.03: configured for UDMA/133
[  188.800353] sd 0:0:0:0: [sda] tag#24 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[  188.809577] sd 0:0:0:0: [sda] tag#24 Sense Key : Illegal Request [current]
[  188.816599] sd 0:0:0:0: [sda] tag#24 Add. Sense: Unaligned write command
[  188.823365] sd 0:0:0:0: [sda] tag#24 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[  188.830820] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[  188.838975] Buffer I/O error on dev sda, logical block 1, async page read
[  188.845821] Buffer I/O error on dev sda, logical block 2, async page read
[  188.852663] Buffer I/O error on dev sda, logical block 3, async page read
[  188.859535] ata1: EH complete
[  188.899979] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  188.906511] ata1.00: SError: { RecovComm }
[  188.910669] ata1.00: failed command: READ DMA
[  188.915062] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  188.930217] ata1.00: status: { DRDY ERR }
[  188.934261] ata1.00: error: { ABRT }
[  189.407511] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  189.414896] ata1.00: hard resetting link
[  191.508598] ata1.00: configured for UDMA/133
[  191.524340] ata1.01: configured for UDMA/133
[  191.540057] ata1.02: configured for UDMA/133
[  191.555765] ata1.03: configured for UDMA/133
[  191.560353] ata1: EH complete
[  191.575942] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  191.582455] ata1.00: SError: { RecovComm }
[  191.586610] ata1.00: failed command: READ DMA
[  191.591003] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  191.606157] ata1.00: status: { DRDY ERR }
[  191.610203] ata1.00: error: { ABRT }
[  192.083507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  192.090847] ata1.00: hard resetting link
[  194.184577] ata1.00: configured for UDMA/133
[  194.200286] ata1.01: configured for UDMA/133
[  194.216063] ata1.02: configured for UDMA/133
[  194.231765] ata1.03: configured for UDMA/133
[  194.236350] ata1: EH complete
[  194.239935] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  194.246450] ata1.00: SError: { RecovComm }
[  194.250603] ata1.00: failed command: READ DMA
[  194.254997] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  194.270151] ata1.00: status: { DRDY ERR }
[  194.274198] ata1.00: error: { ABRT }
[  194.747506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  194.754841] ata1.00: hard resetting link
[  196.848571] ata1.00: configured for UDMA/133
[  196.864282] ata1.01: configured for UDMA/133
[  196.880041] ata1.02: configured for UDMA/133
[  196.895746] ata1.03: configured for UDMA/133
[  196.900328] ata1: EH complete
[  196.903911] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  196.910426] ata1.00: SError: { RecovComm }
[  196.914581] ata1.00: failed command: READ DMA
[  196.918975] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  196.934129] ata1.00: status: { DRDY ERR }
[  196.938174] ata1.00: error: { ABRT }
[  197.411507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  197.418844] ata1.00: hard resetting link
[  199.512569] ata1.00: configured for UDMA/133
[  199.528274] ata1.01: configured for UDMA/133
[  199.544039] ata1.02: configured for UDMA/133
[  199.559743] ata1.03: configured for UDMA/133
[  199.564328] ata1: EH complete
[  199.567896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  199.574413] ata1.00: SError: { RecovComm }
[  199.578562] ata1.00: failed command: READ DMA
[  199.582960] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  199.598119] ata1.00: status: { DRDY ERR }
[  199.602170] ata1.00: error: { ABRT }
[  200.075507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  200.082848] ata1.00: hard resetting link
[  202.176571] ata1.00: configured for UDMA/133
[  202.192278] ata1.01: configured for UDMA/133
[  202.208039] ata1.02: configured for UDMA/133
[  202.223737] ata1.03: configured for UDMA/133
[  202.228317] ata1: EH complete
[  202.231897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  202.238409] ata1.00: SError: { RecovComm }
[  202.242557] ata1.00: failed command: READ DMA
[  202.246955] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  202.262110] ata1.00: status: { DRDY ERR }
[  202.266155] ata1.00: error: { ABRT }
[  202.739507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  202.746846] ata1.00: hard resetting link
[  204.840566] ata1.00: configured for UDMA/133
[  204.856270] ata1.01: configured for UDMA/133
[  204.872032] ata1.02: configured for UDMA/133
[  204.887730] ata1.03: configured for UDMA/133
[  204.892318] ata1: EH complete
[  204.895889] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  204.902406] ata1.00: SError: { RecovComm }
[  204.906552] ata1.00: failed command: READ DMA
[  204.910941] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  204.926096] ata1.00: status: { DRDY ERR }
[  204.930142] ata1.00: error: { ABRT }
[  205.403507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  205.410846] ata1.00: hard resetting link
[  207.504567] ata1.00: configured for UDMA/133
[  207.520268] ata1.01: configured for UDMA/133
[  207.536045] ata1.02: configured for UDMA/133
[  207.551745] ata1.03: configured for UDMA/133
[  207.556327] ata1: EH complete
[  207.559905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  207.566418] ata1.00: SError: { RecovComm }
[  207.570564] ata1.00: failed command: READ DMA
[  207.574962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  207.590117] ata1.00: status: { DRDY ERR }
[  207.594163] ata1.00: error: { ABRT }
[  208.067507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  208.074842] ata1.00: hard resetting link
[  210.168572] ata1.00: configured for UDMA/133
[  210.184281] ata1.01: configured for UDMA/133
[  210.200041] ata1.02: configured for UDMA/133
[  210.215741] ata1.03: configured for UDMA/133
[  210.220325] ata1: EH complete
[  210.223899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  210.230410] ata1.00: SError: { RecovComm }
[  210.234559] ata1.00: failed command: READ DMA
[  210.238957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  210.254112] ata1.00: status: { DRDY ERR }
[  210.258157] ata1.00: error: { ABRT }
[  210.731507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  210.738846] ata1.00: hard resetting link
[  212.832568] ata1.00: configured for UDMA/133
[  212.848269] ata1.01: configured for UDMA/133
[  212.864027] ata1.02: configured for UDMA/133
[  212.879724] ata1.03: configured for UDMA/133
[  212.884306] ata1: EH complete
[  212.887886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  212.894397] ata1.00: SError: { RecovComm }
[  212.898545] ata1.00: failed command: READ DMA
[  212.902935] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
                        res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  212.918094] ata1.00: status: { DRDY ERR }
[  212.922145] ata1.00: error: { ABRT }
[  213.395506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  213.402840] ata1.00: hard resetting link
[  215.496570] ata1.00: configured for UDMA/133
[  215.528538] ata1.01: configured for UDMA/133
[  215.544243] ata1.02: configured for UDMA/133
[  215.560004] ata1.03: configured for UDMA/133
[  215.564586] ata1: EH complete
[  215.568155] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[  215.574664] ata1.00: SError: { RecovComm }
[  215.578822] ata1.00: failed command: READ DMA
[  215.583220] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
                        res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[  215.598373] ata1.00: status: { DRDY ERR }
[  215.602419] ata1.00: error: { ABRT }
[  216.075506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[  216.082847] ata1.00: hard resetting link
[  218.183230] ata1.01: configured for UDMA/133
[  218.198940] ata1.02: configured for UDMA/133
[  218.214625] ata1.03: configured for UDMA/133
[  221.667510] ata1.00: hard resetting link
[  227.043497] ata1.00: hard resetting link
[  227.364854] ata1.00: disable device
[  227.368737] sd 0:0:0:0: [sda] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=38s
[  227.377879] sd 0:0:0:0: [sda] tag#1 Sense Key : Illegal Request [current]
[  227.384821] sd 0:0:0:0: [sda] tag#1 Add. Sense: Unaligned write command
[  227.391498] sd 0:0:0:0: [sda] tag#1 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[  227.398865] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.407020] Buffer I/O error on dev sda, logical block 0, async page read
[  227.413884] ata1: EH complete
[  227.416987] sd 0:0:0:0: rejecting I/O to offline device
[  227.422268] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[  227.430427] Buffer I/O error on dev sda, logical block 1, async page read
[  227.437269] Buffer I/O error on dev sda, logical block 2, async page read
[  227.444114] Buffer I/O error on dev sda, logical block 3, async page read
[  227.451120] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.459288] Buffer I/O error on dev sda, logical block 0, async page read
[  227.466336] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[  227.474503] Buffer I/O error on dev sda, logical block 1, async page read
[  227.481361] Buffer I/O error on dev sda, logical block 2, async page read
[  227.488203] Buffer I/O error on dev sda, logical block 3, async page read
[  227.499788] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 2
[  227.507978] Buffer I/O error on dev sda, logical block 0, async page read
[  227.514826] Buffer I/O error on dev sda, logical block 1, async page read
[  227.521838] Dev sda: unable to read RDB block 0
[  227.526838]  sdb: sdb1 sdb2 sdb3 sdb4 sdb5 sdb6
[  227.532134]  sdd: sdd1 sdd2 sdd3 sdd4 sdd5 sdd6
[  227.539633] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.547871] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.556075] I/O error, dev sda, sector 4 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.564283] I/O error, dev sda, sector 6 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.572511] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[  227.588218] sd 0:1:0:0: [sdb] Attached SCSI disk
[  227.593742] sd 0:3:0:0: [sdd] Attached SCSI disk
[  227.608079]  sda: unable to read partition table
[  227.623202] sd 0:0:0:0: [sda] Attached SCSI disk
[  227.650491] ata1.00: detaching (SCSI 0:0:0:0)
[  227.660097] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[  227.703629] sd 0:0:0:0: [sda] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  227.713966] sd 0:0:0:0: [sda] Stopping disk
[  227.762656] sd 0:0:0:0: [sda] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  228.379491] raid6: int32x8  gen()   120 MB/s
[  228.451650] raid6: int32x4  gen()    99 MB/s
[  228.523551] raid6: int32x2  gen()   138 MB/s
[  228.595528] raid6: int32x1  gen()   100 MB/s
[  228.599833] raid6: using algorithm int32x2 gen() 138 MB/s
[  228.671589] raid6: .... xor() 81 MB/s, rmw enabled
[  228.676423] raid6: using intx1 recovery algorithm
[  229.014940] md/raid1:md0: active with 2 out of 2 mirrors
[  229.020411] md/raid1:md1: active with 2 out of 2 mirrors
[  229.025904] md0: detected capacity change from 0 to 2000768
[  229.069399] async_tx: api initialized (async)
[  229.077301] xor: measuring software checksum speed
[  229.091129]    arm4regs        :  1106 MB/sec
[  229.110221]    8regs           :   669 MB/sec
[  229.124984]    32regs          :   948 MB/sec
[  229.129381] xor: using function: arm4regs (1106 MB/sec)
[  229.137220] md1: detected capacity change from 0 to 9998312
[  229.291746] md/raid1:md10: active with 2 out of 2 mirrors
[  229.367779] md10: detected capacity change from 0 to 2000872
[  230.308342] EXT4-fs (md1): mounted filesystem with ordered data mode. Quota mode: none.
[  231.437752] systemd[1]: Inserted module 'autofs4'
[  231.500164] NET: Registered PF_INET6 protocol family
[  231.570591] Segment Routing with IPv6
[  231.574521] In-situ OAM (IOAM) with IPv6
[  231.666946] systemd[1]: systemd 252.2-1 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[  231.699125] systemd[1]: Detected architecture arm.
[  231.754858] systemd[1]: Hostname set to <debian>.
[  233.926808] systemd[1]: /etc/systemd/system/micon_boot.service:5: Unknown key name 'Restart' in section 'Unit', ignoring.
[  233.937984] systemd[1]: /etc/systemd/system/micon_boot.service:6: Unknown key name 'RestartSec' in section 'Unit', ignoring.
[  234.699154] systemd[1]: Queued start job for default target Graphical Interface.
[  234.723117] systemd[1]: Created slice Slice /system/getty.
[  234.747059] systemd[1]: Created slice Slice /system/modprobe.
[  234.771036] systemd[1]: Created slice Slice /system/postfix.
[  234.795003] systemd[1]: Created slice Slice /system/serial-getty.
[  234.819058] systemd[1]: Created slice Slice /system/systemd-fsck.
[  234.841491] systemd[1]: Created slice User and Session Slice.
[  234.864419] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[  234.892336] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[  234.917597] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[  234.944688] systemd[1]: Reached target Local Encrypted Volumes.
[  234.968214] systemd[1]: Reached target Local Integrity Protected Volumes.
[  234.992428] systemd[1]: Reached target Host and Network Name Lookups.
[  235.015872] systemd[1]: Reached target Path Units.
[  235.036344] systemd[1]: Reached target Slice Units.
[  235.056330] systemd[1]: Reached target Local Verity Protected Volumes.
[  235.081344] systemd[1]: Listening on RPCbind Server Activation Socket.
[  235.105606] systemd[1]: Listening on Syslog Socket.
[  235.125064] systemd[1]: Listening on fsck to fsckd communication Socket.
[  235.148495] systemd[1]: Listening on initctl Compatibility Named Pipe.
[  235.176226] systemd[1]: Listening on Journal Audit Socket.
[  235.200989] systemd[1]: Listening on Journal Socket (/dev/log).
[  235.225140] systemd[1]: Listening on Journal Socket.
[  235.246220] systemd[1]: Listening on udev Control Socket.
[  235.269076] systemd[1]: Listening on udev Kernel Socket.
[  235.293456] systemd[1]: Huge Pages File System was skipped because of an unmet condition check (ConditionPathExists=/sys/kernel/mm/hugepages).
[  235.313273] systemd[1]: Mounting POSIX Message Queue File System...
[  235.348691] systemd[1]: Mounting NFSD configuration filesystem...
[  235.392201] systemd[1]: Mounting Kernel Debug File System...
[  235.436196] systemd[1]: Mounting Kernel Trace File System...
[  235.468295] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[  235.522918] systemd[1]: Starting Restore / save the current clock...
[  235.628727] systemd[1]: Starting Create List of Static Device Nodes...
[  235.688462] systemd[1]: Starting Load Kernel Module configfs...
[  235.745107] RPC: Registered named UNIX socket transport module.
[  235.751127] RPC: Registered udp transport module.
[  235.755870] RPC: Registered tcp transport module.
[  235.760610] RPC: Registered tcp NFSv4.1 backchannel transport module.
[  235.768648] systemd[1]: Starting Load Kernel Module drm...
[  235.822721] systemd[1]: Starting Load Kernel Module efi_pstore...
[  235.881860] systemd[1]: Starting Load Kernel Module fuse...
[  235.923226] systemd[1]: File System Check on Root Device was skipped because of an unmet condition check (ConditionPathExists=!/run/initramfs/fsck-root).
[  235.957055] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[  235.988645] fuse: init (API version 7.36)
[  235.999064] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[  236.031536] systemd[1]: Starting Journal Service...
[  236.093804] systemd[1]: Starting Load Kernel Modules...
[  236.153436] systemd[1]: Starting Remount Root and Kernel File Systems...
[  236.200477] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met.
[  236.274272] systemd[1]: Starting Coldplug All udev Devices...
[  236.401490] systemd[1]: Mounted POSIX Message Queue File System.
[  236.449500] systemd[1]: Mounted NFSD configuration filesystem.
[  236.492973] systemd[1]: Mounted Kernel Debug File System.
[  236.536928] systemd[1]: Mounted Kernel Trace File System.
[  236.578489] systemd[1]: Finished Restore / save the current clock.
[  236.618396] systemd[1]: Finished Create List of Static Device Nodes.
[  236.639568] EXT4-fs (md1): re-mounted. Quota mode: none.
[  236.686823] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[  236.719735] systemd[1]: Finished Load Kernel Module configfs.
[  236.750723] systemd[1]: modprobe@drm.service: Deactivated successfully.
[  236.772959] systemd[1]: Finished Load Kernel Module drm.
[  236.798791] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[  236.824928] systemd[1]: Finished Load Kernel Module efi_pstore.
[  236.866701] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[  236.892970] systemd[1]: Finished Load Kernel Module fuse.
[  236.934278] systemd[1]: Finished Load Kernel Modules.
[  236.970081] systemd[1]: Finished Remount Root and Kernel File Systems.
[  237.032204] systemd[1]: Mounting FUSE Control File System...
[  237.088426] systemd[1]: Mounting Kernel Configuration File System...
[  237.136449] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[  237.164319] systemd[1]: Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
[  237.236782] systemd[1]: Starting Load/Save Random Seed...
[  237.296781] systemd[1]: Starting Apply Kernel Variables...
[  237.373680] systemd[1]: Starting Create System Users...
[  237.543166] systemd[1]: Mounted FUSE Control File System.
[  237.608818] systemd[1]: Mounted Kernel Configuration File System.
[  237.702713] systemd[1]: Finished Apply Kernel Variables.
[  238.036685] systemd[1]: Finished Load/Save Random Seed.
[  238.070441] systemd[1]: Finished Coldplug All udev Devices.
[  238.104334] systemd[1]: First Boot Complete was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[  238.144368] systemd[1]: Starting Helper to synchronize boot up for ifupdown...
[  238.190172] systemd[1]: Finished Create System Users.
[  238.241943] systemd[1]: Starting Create Static Device Nodes in /dev...
[  238.269484] systemd-journald[240]: Data hash table of /run/log/journal/ebb5a33ac15a42c49f241fd201a8dfb7/system.journal has a fill level at 75.0 (1536 of 2047 items, 524288 file size, 341 bytes per hash table item), suggesting rotation.
[  238.342830] systemd-journald[240]: /run/log/journal/ebb5a33ac15a42c49f241fd201a8dfb7/system.journal: Journal header limits reached or header out-of-date, rotating.
[  238.519719] systemd[1]: Started Journal Service.
[  238.694023] systemd-journald[240]: Received client request to flush runtime journal.
[  239.872342] sd 0:1:0:0: Attached scsi generic sg0 type 0
[  239.945773] sd 0:2:0:0: Attached scsi generic sg1 type 0
[  240.011825] sd 0:3:0:0: Attached scsi generic sg2 type 0
[  240.629818] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[  240.898853] spi-nor spi0.0: m25p40 (512 Kbytes)
[  241.056154] kirkwood-pinctrl f1010000.pin-controller: pin PIN0 already requested by f1010600.spi; cannot claim for f4000000.nand
[  241.067862] kirkwood-pinctrl f1010000.pin-controller: pin-0 (f4000000.nand) status -22
[  241.075853] kirkwood-pinctrl f1010000.pin-controller: could not request pin 0 (PIN0) from group mpp0  on device f1010000.pin-controller
[  241.088108] orion_nand f4000000.nand: Error applying setting, reverse things back
[  241.505755] 2 fixed-partitions partitions found on MTD device spi0.0
[  241.512216] Creating 2 MTD partitions on "spi0.0":
[  241.622557] 0x000000000000-0x000000070000 : "u-boot"
[  241.720257] 0x000000070000-0x000000080000 : "u-boot-env"
[  242.129867] orion_wdt: Initial timeout 21 sec
[  242.282998] marvell-cesa f1030000.crypto: CESA device successfully registered
[  242.344239] mv643xx_eth: MV-643xx 10/100/1000 ethernet driver version 1.4
[  242.594759] usbcore: registered new interface driver usbfs
[  242.683657] usbcore: registered new interface driver hub
[  242.728820] mv643xx_eth_port mv643xx_eth_port.0 eth0: port 0 with MAC address 10:6f:3f:b9:50:2c
[  242.763692] usbcore: registered new device driver usb
[  242.846883] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[  242.983378] ehci-orion: EHCI orion driver
[  243.000698] mv643xx_eth_port mv643xx_eth_port.1 eth1: port 0 with MAC address 10:6f:3f:b9:50:2d
[  243.058533] orion-ehci f1050000.ehci: EHCI Host Controller
[  243.127573] orion-ehci f1050000.ehci: new USB bus registered, assigned bus number 1
[  243.219336] orion-ehci f1050000.ehci: irq 41, io mem 0xf1050000
[  243.311559] orion-ehci f1050000.ehci: USB 2.0 started, EHCI 1.00
[  243.364913] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.00
[  243.373288] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[  243.380584] usb usb1: Product: EHCI Host Controller
[  243.385507] usb usb1: Manufacturer: Linux 6.0.0-5-marvell ehci_hcd
[  243.391740] usb usb1: SerialNumber: f1050000.ehci
[  243.737783] hub 1-0:1.0: USB hub found
[  243.787584] hub 1-0:1.0: 1 port detected
[  244.103538] usb 1-1: new high-speed USB device number 2 using orion-ehci
[  244.320238] usb 1-1: New USB device found, idVendor=0424, idProduct=2512, bcdDevice= b.b3
[  244.328523] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[  244.488198] hub 1-1:1.0: USB hub found
[  244.547565] hub 1-1:1.0: 2 ports detected
[  247.228380] Adding 1000432k swap on /dev/md10.  Priority:-2 extents:1 across:1000432k
[  248.175559] EXT4-fs (md0): mounting ext3 file system using the ext4 subsystem
[  248.257562] EXT4-fs (md0): mounted filesystem with ordered data mode. Quota mode: none.
[  248.280552] ext3 filesystem being mounted at /boot supports timestamps until 2038 (0x7fffffff)
[  249.131804] audit: type=1400 audit(1670590441.448:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=361 comm="apparmor_parser"
[  249.215919] audit: type=1400 audit(1670590441.532:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=362 comm="apparmor_parser"
[  249.269912] audit: type=1400 audit(1670590441.532:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=362 comm="apparmor_parser"
[  249.396064] audit: type=1400 audit(1670590441.712:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=363 comm="apparmor_parser"
[  249.457729] audit: type=1400 audit(1670590441.712:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=363 comm="apparmor_parser"
[  249.552470] audit: type=1400 audit(1670590441.712:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=363 comm="apparmor_parser"
[  249.660918] audit: type=1400 audit(1670590441.976:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cups-browsed" pid=367 comm="apparmor_parser"
[  249.926589] audit: type=1400 audit(1670590442.240:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/cups/backend/cups-pdf" pid=372 comm="apparmor_parser"
[  249.958369] audit: type=1400 audit(1670590442.240:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd" pid=372 comm="apparmor_parser"
[  249.978737] audit: type=1400 audit(1670590442.240:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd//third_party" pid=372 comm="apparmor_parser"
[  253.163649] NFSD: Using nfsdcld client tracking operations.
[  253.169319] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[  253.920796] mv643xx_eth_port mv643xx_eth_port.0 eth0: link up, 1000 Mb/s, full duplex, flow control disabled
[  253.930866] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[19661.996096] md: md2 stopped.
[19671.219470] md: md2 stopped.
[19671.417367] md/raid:md2: device sdb6 operational as raid disk 1
[19671.423388] md/raid:md2: device sdd6 operational as raid disk 3
[19671.429388] md/raid:md2: device sdc6 operational as raid disk 2
[19671.466126] md/raid:md2: raid level 5 active with 3 out of 4 devices, algorithm 2
[19671.482838] md2: bitmap file is out of date (39797 < 39799) -- forcing full recovery
[19671.498258] md2: bitmap file is out of date, doing full recovery
[19671.738418] md2: detected capacity change from 0 to 5770490880
[19675.028926] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0002 qc_map=0060 failed_links=1 nr_active_links=1
[19675.038307] ata1: mv_handle_fbs_ncq_dev_err: done
[19690.309577] ata1.01: qc timeout (cmd 0x47)
[19690.313866] ata1.01: Read log 0x10 page 0x00 failed, Emask 0x40
[19690.319849] ata1.01: failed to read log page 10h (errno=-5)
[19690.325492] ata1.00: failed to read SCR 1 (Emask=0x40)
[19690.330699] ata1.01: failed to read SCR 1 (Emask=0x40)
[19690.335889] ata1.02: failed to read SCR 1 (Emask=0x40)
[19690.341074] ata1.03: failed to read SCR 1 (Emask=0x40)
[19690.346274] ata1.01: exception Emask 0x1 SAct 0x60 SErr 0x0 action 0x6 frozen
[19690.353471] ata1.01: dev err
[19690.356388] ata1.01: failed command: READ FPDMA QUEUED
[19690.361571] ata1.01: cmd 60/00:28:a0:c8:d5/02:00:00:00:00/40 tag 5 ncq dma 262144 in
                        res 43/40:30:00:07:7c/40:00:73:00:00/40 Emask 0x9 (media error)
[19690.377250] ata1.01: status: { DRDY SENSE ERR }
[19690.381841] ata1.01: error: { UNC }
[19690.385356] ata1.01: failed command: READ FPDMA QUEUED
[19690.390540] ata1.01: cmd 60/08:30:00:07:7c/00:00:73:00:00/40 tag 6 ncq dma 4096 in
                        res 43/40:30:00:07:7c/40:00:73:00:00/40 Emask 0x9 (media error)
[19690.405964] ata1.01: status: { DRDY SENSE ERR }
[19690.410541] ata1.01: error: { UNC }
[19690.889871] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19691.215191] ata1.01: hard resetting link
[19696.733821] ata1.15: link is slow to respond, please be patient (ready=0)
[19701.237800] ata1.01: SRST failed (errno=-16)
[19704.373756] ata1.15: qc timeout (cmd 0xe4)
[19704.377951] ata1.01: failed to read SCR 0 (Emask=0x4)
[19704.383055] ata1.01: reset failed, giving up
[19704.387375] ata1.15: hard resetting link
[19704.861761] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19704.869124] ata1.01: hard resetting link
[19710.389697] ata1.15: link is slow to respond, please be patient (ready=0)
[19714.893656] ata1.01: SRST failed (errno=-16)
[19717.941626] ata1.15: qc timeout (cmd 0xe4)
[19717.945816] ata1.01: failed to read SCR 0 (Emask=0x4)
[19717.950921] ata1.01: reset failed, giving up
[19717.955240] ata1.15: hard resetting link
[19718.429641] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19718.755041] ata1.01: hard resetting link
[19724.273544] ata1.15: link is slow to respond, please be patient (ready=0)
[19728.777504] ata1.01: SRST failed (errno=-16)
[19732.021494] ata1.15: qc timeout (cmd 0xe4)
[19732.025678] ata1.01: failed to read SCR 0 (Emask=0x4)
[19732.030782] ata1.01: reset failed, giving up
[19732.035087] ata1.01: failed to recover link after 3 tries, disabling
[19732.041494] ata1.01: disable device
[19732.045013] ata1.15: hard resetting link
[19732.521492] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19732.853494] sd 0:1:0:0: rejecting I/O to offline device
[19732.858800] blk_print_req_error: 11 callbacks suppressed
[19732.858812] I/O error, dev sdb, sector 14008336 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 2
[19732.873155] md: super_written gets error=-5
[19732.877363] md/raid:md2: Disk failure on sdb6, disabling device.
[19732.883399] md/raid:md2: Cannot continue operation (2/4 failed).
[19733.927109] ata1.02: configured for UDMA/133
[19733.942852] ata1.03: configured for UDMA/133
[19733.948194] sd 0:1:0:0: [sdb] tag#5 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=61s
[19733.957349] sd 0:1:0:0: [sdb] tag#5 Sense Key : Medium Error [current]
[19733.964032] sd 0:1:0:0: [sdb] tag#5 Add. Sense: Unrecovered read error - auto reallocate failed
[19733.972816] sd 0:1:0:0: [sdb] tag#5 CDB: Read(10) 28 00 00 d5 c8 a0 00 02 00 00
[19733.980182] I/O error, dev sdb, sector 14010528 op 0x0:(READ) flags 0x0 phys_seg 64 prio class 2
[19733.989046] md/raid:md2: read error not correctable (sector 2208 on sdb6).
[19733.995993] md/raid:md2: read error not correctable (sector 2216 on sdb6).
[19734.002925] md/raid:md2: read error not correctable (sector 2224 on sdb6).
[19734.009862] md/raid:md2: read error not correctable (sector 2232 on sdb6).
[19734.016788] md/raid:md2: read error not correctable (sector 2240 on sdb6).
[19734.023726] md/raid:md2: read error not correctable (sector 2248 on sdb6).
[19734.030664] md/raid:md2: read error not correctable (sector 2256 on sdb6).
[19734.037604] md/raid:md2: read error not correctable (sector 2264 on sdb6).
[19734.044536] md/raid:md2: read error not correctable (sector 2272 on sdb6).
[19734.051468] md/raid:md2: read error not correctable (sector 2280 on sdb6).
[19734.058531] sd 0:1:0:0: [sdb] tag#6 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=61s
[19734.067657] sd 0:1:0:0: [sdb] tag#6 Sense Key : Medium Error [current]
[19734.074340] sd 0:1:0:0: [sdb] tag#6 Add. Sense: Unrecovered read error - auto reallocate failed
[19734.083113] sd 0:1:0:0: [sdb] tag#6 CDB: Read(10) 28 00 73 7c 07 00 00 00 08 00
[19734.090480] I/O error, dev sdb, sector 1937508096 op 0x0:(READ) flags 0x800 phys_seg 1 prio class 2
[19734.099613] ata1: EH complete
[19734.103050] I/O error, dev sdb, sector 1937508304 op 0x0:(READ) flags 0x800 phys_seg 1 prio class 2
[19734.121891] buffer_io_error: 18 callbacks suppressed
[19734.121912] Buffer I/O error on dev md2, logical block 32, async page read
[19734.170053] ata1.01: detaching (SCSI 0:1:0:0)
[19734.189647] sd 0:1:0:0: [sdb] Synchronizing SCSI cache
[19734.215123] sd 0:1:0:0: [sdb] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[19734.225416] sd 0:1:0:0: [sdb] Stopping disk
[19734.273491] sd 0:1:0:0: [sdb] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[19734.888262] md2: detected capacity change from 5770490880 to 0
[19734.894197] md: md2 stopped.
[19744.644300] /dev/md2: Can't open blockdev
[19763.213036] /dev/md2: Can't open blockdev

Of note are some errors that are called out where "md2" is referenced.

I rebooted and did ls /sys/block, and md2 is back

md0 md1 md10 md2 mtdblock0 mtdblock1 sda sdb sdc

And I'm able to force assemble, but then right after, the array disappears until I reboot and try again.

I should note I'm booting with drives 2, 3, and 4 in the bays. Drive 1 is not in there, because it prevents me from booting.

looks like one of your drives is throwing IO errors.

[    9.263620] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[    9.269517] ata1.00: failed to read log page 10h (errno=-5)
[    9.275147] ata1.00: failed to read SCR 1 (Emask=0x40)
[    9.280337] ata1.00: NCQ disabled due to excessive errors
[    9.285791] ata1.01: failed to read SCR 1 (Emask=0x40)
[    9.290973] ata1.02: failed to read SCR 1 (Emask=0x40)
[    9.296162] ata1.03: failed to read SCR 1 (Emask=0x40)
[    9.301352] ata1.00: exception Emask 0x1 SAct 0x4000 SErr 0x0 action 0x6 frozen
[    9.308715] ata1.00: dev err
[    9.311633] ata1.00: failed command: READ FPDMA QUEUED
[    9.316815] ata1.00: cmd 60/02:70:02:00:00/00:00:00:00:00/40 tag 14 ncq dma 1024 in
                        res 51/04:70:02:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[    9.332406] ata1.00: status: { DRDY ERR }
[    9.336452] ata1.00: error: { ABRT }
[    9.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[    9.818852] ata1.00: hard resetting link

It also seems to complain about some bad data in the MD device, not shocking since you had to force it to assemble.
md/raid:md2: read error not correctable (sector 2280 on sdb6).

another thing to look at is the SMART data. You could reboot and before you mess with MD2 try getting the smart data smartctl -a from all the drives, particularly the one that now seems to have trouble.

if the drive is still mostly working you might be able to clone it to a new drive and then force add that to the array. There might even be a way to make mdadm ignore a few data errors so you can try to recover what's left. To be honest I've never gotten to that point personally.

Cool, thanks. Interesting about cloning to a new drive. I'm guessing I'd have to try that outside of the TS box itself? Like on a Linux desktop or something. Will cross that bridge if and when I have to, but it's a good suggestion.

I'll try for the SMART data now, momentarily, and post back here.

sdd:

smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES.3
Device Model:     ST1000NM0033-9ZM173
Serial Number:    Z1W0MD3D
LU WWN Device Id: 5 000c50 064cad930
Firmware Version: 0001
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
Local Time is:    Fri Dec  9 17:27:36 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
Drive failure expected in less than 24 hours. SAVE ALL DATA.
See vendor-specific Attribute list for failed Attributes.

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (  592) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off supp                                                                           ort.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 116) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x50bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_                                                                           FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   037   036   044    Pre-fail  Always   FAILI                                                                           NG_NOW 12263131
  3 Spin_Up_Time            0x0003   097   097   000    Pre-fail  Always       -                                                                                  0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -                                                                                  617
  5 Reallocated_Sector_Ct   0x0033   077   077   010    Pre-fail  Always       -                                                                                  1285
  7 Seek_Error_Rate         0x000f   090   060   030    Pre-fail  Always       -                                                                                  1179813657
  9 Power_On_Hours          0x0032   062   062   000    Old_age   Always       -                                                                                  33422
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -                                                                                  0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -                                                                                  615
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -                                                                                  0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -                                                                                  0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -                                                                                  4295032833
189 High_Fly_Writes         0x003a   093   093   000    Old_age   Always       -                                                                                  7
190 Airflow_Temperature_Cel 0x0022   070   047   045    Old_age   Always       -                                                                                  30 (Min/Max 29/30)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -                                                                                  0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -                                                                                  611
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -                                                                                  617
194 Temperature_Celsius     0x0022   030   053   000    Old_age   Always       -                                                                                  30 (0 12 0 0 0)
195 Hardware_ECC_Recovered  0x001a   012   012   000    Old_age   Always       -                                                                                  12263131
197 Current_Pending_Sector  0x0012   095   095   000    Old_age   Always       -                                                                                  856
198 Offline_Uncorrectable   0x0010   095   095   000    Old_age   Offline      -                                                                                  856
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -                                                                                  0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA                                                                           _of_first_error
# 1  Short offline       Completed without error       00%     15256         -
# 2  Short offline       Completed without error       00%         3         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

sdc:

smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES.3
Device Model:     ST1000NM0033-9ZM173
Serial Number:    Z1W03Z5C
LU WWN Device Id: 5 000c50 050ace05a
Firmware Version: 0001
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Fri Dec  9 17:28:43 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (  600) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 127) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x50bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   081   059   044    Pre-fail  Always       -       156575972
  3 Spin_Up_Time            0x0003   096   096   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       622
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       5
  7 Seek_Error_Rate         0x000f   090   060   030    Pre-fail  Always       -       1298740013
  9 Power_On_Hours          0x0032   061   061   000    Old_age   Always       -       34166
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       618
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   063   063   000    Old_age   Always       -       37
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       2
189 High_Fly_Writes         0x003a   095   095   000    Old_age   Always       -       5
190 Airflow_Temperature_Cel 0x0022   069   047   045    Old_age   Always       -       31 (0 1 31 30 0)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       614
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       622
194 Temperature_Celsius     0x0022   031   053   000    Old_age   Always       -       31 (128 0 0 0 0)
195 Hardware_ECC_Recovered  0x001a   021   004   000    Old_age   Always       -       156575972
197 Current_Pending_Sector  0x0012   100   098   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   098   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0

SMART Error Log Version: 1
ATA Error Count: 37 (device log contains only the most recent five errors)
        CR = Command Register [HEX]
        FR = Features Register [HEX]
        SC = Sector Count Register [HEX]
        SN = Sector Number Register [HEX]
        CL = Cylinder Low Register [HEX]
        CH = Cylinder High Register [HEX]
        DH = Device/Head Register [HEX]
        DC = Device Command Register [HEX]
        ER = Error register [HEX]
        ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 37 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 00 ff ff ff 4f 00      06:10:15.816  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:13.141  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:10.504  READ DMA EXT
  25 00 58 ff ff ff 4f 00      06:10:10.385  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.763  READ DMA EXT

Error 36 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 00 ff ff ff 4f 00      06:10:13.141  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:10.504  READ DMA EXT
  25 00 58 ff ff ff 4f 00      06:10:10.385  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.763  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.644  READ DMA EXT

Error 35 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 00 ff ff ff 4f 00      06:10:10.504  READ DMA EXT
  25 00 58 ff ff ff 4f 00      06:10:10.385  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.763  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.644  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:05.112  READ DMA EXT

Error 34 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 00 ff ff ff 4f 00      06:10:07.763  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:07.644  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:10:05.112  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:09:24.315  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:09:21.575  READ DMA EXT

Error 33 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 00 ff ff ff 4f 00      06:10:05.112  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:09:24.315  READ DMA EXT
  25 00 00 ff ff ff 4f 00      06:09:21.575  READ DMA EXT
  35 00 a8 ff ff ff 4f 00      06:09:21.568  WRITE DMA EXT
  ea 00 00 00 00 00 40 00      06:09:21.553  FLUSH CACHE EXT

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%        48         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.```

sdb:

smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES.3
Device Model:     ST1000NM0033-9ZM173
Serial Number:    Z1W02XDJ
LU WWN Device Id: 5 000c50 050519a6e
Firmware Version: 0001
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Fri Dec  9 17:29:44 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (  584) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 112) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x50bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   081   063   044    Pre-fail  Always       -       151642236
  3 Spin_Up_Time            0x0003   096   096   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       620
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   090   060   030    Pre-fail  Always       -       1157132968
  9 Power_On_Hours          0x0032   062   062   000    Old_age   Always       -       34158
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       619
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   098   098   000    Old_age   Always       -       2
190 Airflow_Temperature_Cel 0x0022   068   050   045    Old_age   Always       -       32 (Min/Max 31/32)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       618
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       620
194 Temperature_Celsius     0x0022   032   050   000    Old_age   Always       -       32 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   027   012   000    Old_age   Always       -       151642236
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%         6         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.```

So, looks like 1 drive is failing, 2 drives are fine. And I tried to put in the first (missing) drive ,but it holds up booting and it even messes things up when I try to add it while the TS is booted up properly, so that one seems completely botched.

yeah, SDD basically dead. SDC with the 5 relocated sectors and all those read errors is on its way too most likely.

Sucks, but at least it's good to know officially. Not sure if it's worth the effort, but is there any value in stripping out the drive and plugging them into a full desktop to try to run recovery?

Had I had my time back, I would've run smartmon a little more often to anticipate these things. Good news is I was looking at the backup on my external 4 TB drive and it looks to be about 70-80% of what was available on the array, so it could be worse. I've learned a lot along the way and am grateful for all your help!

Got to thinking again. When I get my new drive in the mail, is it worth swapping out the existing SDD for the new one and see if the array rebuilds w/ the three drives? Not to use long-term, but rather to salvage any other data i might be missing from my backup.

ARRAY /dev/md0 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/1  metadata=1.2 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf name=TS-XEL-EM02C:1
ARRAY /dev/md/10  metadata=1.2 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3 name=TS-XEL-EM02C:10
ARRAY /dev/md/2  metadata=1.2 UUID=46c1d87e:e7b2970a:3edd105f:c51f08fe name=TS-XEL02C:2
root@debian:/home/marc# sudo mount /dev/md/2 /mnsudo mdadm -D /dev/md0t/array
mount: invalid option -- 'D'
Try 'mount --help' for more information.
root@debian:/home/marc# sudo mdadm -D /dev/md2
mdadm: cannot open /dev/md2: No such file or directory
root@debian:/home/marc# sudo mdadm -D /dev/md/2
mdadm: cannot open /dev/md/2: No such file or directory
root@debian:/home/marc# sudo mdadm -D /dev/md/2
mdadm: cannot open /dev/md/2: No such file or directory
root@debian:/home/marc# mdadm --assemble --force --uuid 46c1d87e:e7b2970a:3edd105f:c51f08fe /dev/md/2
bash: mdadm: command not found
root@debian:/home/marc# sudo mdadm --assemble --force --uuid 46c1d87e:e7b2970a:3edd105f:c51f08fe /dev/md/2
mdadm: /dev/md/2 assembled from 2 drives - not enough to start the array.

Hadn't tried w/ the uuid option before. That seems to result in a more "realistic" outcome, given the 2 drives assembling (as opposed to 3 when i manually force them, but then the array does a disappearing act)

it needs all 3 stable to do anything with a fourth.

it might be worth a shot taking a new drive and the drive that is failing and putting them into a dock or something and trying to clone it. there are tools like ddrescue that will keep trying to read the drive even if hitting IO errors and even support multiple tries at reads/etc.

I thought there used to be tricks for trying to get a dying drive to behave long enough to try to clone it, but the top google result makes it sound the the "freezer trick" isn't really a thing any more:
https://drivesaversdatarecovery.com/why-the-freezer-trick-for-hard-drives-doesnt-work/#:~:text=Bottom%20line%2C%20modern%20hard%20drives,destroy%20the%20hard%20drive%20permanently.

Hey again! Hope that 2023 is treating you well so far.

So just an update that I decided to retire the TS-XEL, at least for the time being. I might keep it around and do a side project with it at some point, but I'll be shifting to a full tower setup with Windows or Linux (likely TrueNAS, but will think on it more). A few questions:

  • Would I need to use all 4 drive bays if i wanted to revive the TS down the road? Can I get away with 2 drives as a minimum?
  • I like your suggestion of setting up the TS as a passive backup system. How's that working out for you? What kind of drives are you using?
  • If I do decide to truly retire it/sell/donate, is there a way to factory reset the box even with Debian on there?

Thanks again for all your help. I learned a lot along the way.

The OS is one the drives so you can always wipe the drives and install the stock firmware or debian using the instructions on the wiki etc.

Debian can run on any number of disks. The stock firmware can too though you need to tweak something to use less than 4 in some cases. Theres a note on the wiki about that part.

I’ve been playing around with a few different backup strategies lately mixing zfs send/receive and simpler rsync based backups. I’ve also played a little bit with iscsi. most terastations are mostly good enough for most of that though zfs on 32-bit devices is unsupported now (though I did get it to work on a device as an experiment).

as write all of this I realize it’s probably better suited to discord rather than a github issue. In any case, good luck!

np, sounds good! Thanks so much again for all your help. I can reach out on Discord if anything arises and I need help. Will close this ticket for now. Cheers!