Как стать автором
Обновить

Анализ производительности ВМ в VMware vSphere. Часть 3: Storage

Время на прочтение7 мин
Количество просмотров31K
Всего голосов 23: ↑23 и ↓0+23
Комментарии3

Комментарии 3

Вопрос, может ктото внести ясность?
Согласно этой статьи kb.vmware.com/s/article/1003469
esxi работает с блоками до 32767 KB я правильно понимаю что это 32 мебагайта?
Если да, то я не понимаю тогда какой блок при создании LUN выберать? (давайте обстрагируемся от типа данных в данном случае)
я на LUN обычно вижу, 8,16,32,64,128,256,512К
В первую очередь посмотрите документацию СХД, скорее всего там описано какие параметры оптимальны для работы с VMWARE
Спасибо за серию статей.

Может быть, кто подскажет, куда смотреть вот в таком случае:

  1. Запущена 1 виртуалка.
  2. В ней клонезиллой копируются данные с раздела одного толстого диска на раздел другого толстого диска.
  3. В какой-то момент запускается еще 1 виртуалка, при этом скорость копирования на первой падает в несколько раз (со 120 метров в секунду до 30), в логе наблюдаются записи:
    dmesg
    2019-08-05T22:17:02.095Z cpu2:32963)<6>ahci_scsi_abort: cmd 0x28 (0x43b5c1823240), entering...
    2019-08-05T22:17:02.095Z cpu2:32963)<7>ata2: ahci_port_reset, entering...
    2019-08-05T22:17:02.098Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3302: Cmd 0x2a (0x43b5c08a9cc0, 52833) to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" on path "vmhba33:C0:T0:L0" Failed: H:0xc D:0x0 P:0x0 Possible sens$
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08a9cc0) 0x2a, CmdSN 0xb7 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c088adc0) 0x2a, CmdSN 0x6b from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 10 times
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c087da80) 0x2a, CmdSN 0xe8 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08733c0) 0x2a, CmdSN 0x93 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0882500) 0x2a, CmdSN 0x7b from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08d93c0) 0x2a, CmdSN 0x9c from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 20 times
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08bee40) 0x2a, CmdSN 0xdf from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08c2140) 0x2a, CmdSN 0xba from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08ba640) 0x2a, CmdSN 0x90 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0870540) 0x2a, CmdSN 0xb2 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c086eb00) 0x2a, CmdSN 0x97 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0854240) 0x2a, CmdSN 0x82 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08ce240) 0x2a, CmdSN 0x9e from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0830f80) 0x2a, CmdSN 0x9d from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 40 times
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08baac0) 0x2a, CmdSN 0xaa from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0841300) 0x2a, CmdSN 0x8b from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c088b240) 0x2a, CmdSN 0x63 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08a87c0) 0x2a, CmdSN 0xe5 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c08ace40) 0x2a, CmdSN 0x79 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x24 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c0885e00) 0x2a, CmdSN 0x91 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x24 0x0.
    2019-08-05T22:17:02.098Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c084aa40) 0x2a, CmdSN 0xc8 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.108Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 80 times
    2019-08-05T22:17:02.121Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 160 times
    2019-08-05T22:17:02.128Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c08b0c40) 0x2a, CmdSN 0xf5 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x24 0x0.
    2019-08-05T22:17:02.128Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c0879e80) 0x2a, CmdSN 0xcc from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
    2019-08-05T22:17:02.129Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c08b3340) 0x2a, CmdSN 0xda from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.129Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c08da5c0) 0x2a, CmdSN 0x5c from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.131Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c08c52c0) 0x2a, CmdSN 0xc6 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.131Z cpu1:32788)ScsiDeviceIO: 2613: Cmd(0x43b5c08999c0) 0x2a, CmdSN 0xa0 from world 52833 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.156Z cpu3:32790)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 320 times
    2019-08-05T22:17:02.201Z cpu1:32788)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 640 times
    2019-08-05T22:17:02.283Z cpu3:32790)ScsiDeviceIO: 2613: Cmd(0x43b5c083a7c0) 0x28, CmdSN 0x216057 from world 55162 to dev "t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD" failed H:0xc D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
    2019-08-05T22:17:02.314Z cpu1:32788)NMP: nmp_ThrottleLogForDevice:3235: last error status from device t10.ATA_____HGST_HTE721010A9E630__________________________0123456789ABCD repeated 1280 times
    2019-08-05T22:17:02.320Z cpu2:32963)<6>ata2: ahci_port_reset: SUCCEEDED
    2019-08-05T22:17:02.320Z cpu2:32963)<6>ahci_scsi_abort: cmd 0x28 (0x43b5c1823240), SUCCEEDED
    

  4. После выключения второй виртуалки скорость не восстанавливается, в прерываниях esxtop вот такая картина (смущает VMK timer):
    esxtop interrupts
    COOKIE  COUNT/s TIME/int COUNT_0  COUNT_1  COUNT_2  COUNT_3  DEVICES
    0x1         0.0      0.0      0.0      0.0      0.0      0.0 VMK dmar
    0x2         0.0      0.0      0.0      0.0      0.0      0.0 VMK dmar
    0x3         0.0      0.0      0.0      0.0      0.0      0.0 VMK ACPI Interrupt
    0x4         0.0      0.0      0.0      0.0      0.0      0.0 VMK hpet
    0x5         0.0      0.0      0.0      0.0      0.0      0.0 VMK keyboard
    0x6         0.0      0.0      0.0      0.0      0.0      0.0
    0x7         0.0      0.0      0.0      0.0      0.0      0.0
    0x8         0.0      0.0      0.0      0.0      0.0      0.0
    0x9         0.0      0.0      0.0      0.0      0.0      0.0
    0xa         0.0      0.0      0.0      0.0      0.0      0.0
    0xb         0.0      0.0      0.0      0.0      0.0      0.0
    0xc         0.0      0.0      0.0      0.0      0.0      0.0
    0xd         0.0      0.0      0.0      0.0      0.0      0.0
    0xe         0.0      0.0      0.0      0.0      0.0      0.0 VMK mouse
    0xf         0.0      0.0      0.0      0.0      0.0      0.0
    0x10        0.0      0.0      0.0      0.0      0.0      0.0
    0x11        0.0      0.0      0.0      0.0      0.0      0.0
    0x12      186.2      4.0      0.0      0.0    186.2      0.0 VMK ahci
    0x13        0.0      0.0      0.0      0.0      0.0      0.0
    0x14        0.0      0.0      0.0      0.0      0.0      0.0 VMK vmnic0
    0x15       30.0      2.0     22.1      1.6      0.0      6.3 VMK vmnic0-TxRx-0
    0x16        0.0      0.0      0.0      0.0      0.0      0.0 VMK vmnic1
    0x17        0.0      0.0      0.0      0.0      0.0      0.0 VMK vmnic1-TxRx-0
    0x18        0.0      0.0      0.0      0.0      0.0      0.0 VMK xhci_hcd
    0x19        0.0      0.0      0.0      0.0      0.0      0.0 VMK mpt2sas0-msix0
    0xef      663.6      0.0    154.6    164.9    179.9    164.3 VMK timer
    0xf3       41.2      0.0      9.5      9.5     17.6      4.7 VMK hv_ipi
    0xf4        1.6      0.0      0.0      0.0      0.0      1.6 VMK timer-ipi
    0xf5       20.7      0.0      7.9      1.6      3.2      8.1 VMK monitor
    0xf6       29.4      0.0      4.7      5.1      6.3     13.2 VMK resched
    0xf7        0.0      0.0      0.0      0.0      0.0      0.0
    0xf8       30.0      0.0     15.8      9.5      0.0      4.7 VMK tlb
    0xf9        0.0      0.0      0.0      0.0      0.0      0.0
    0xfa        0.0      0.0      0.0      0.0      0.0      0.0 VMK perfctr
    0xfb        0.0      0.0      0.0      0.0      0.0      0.0 VMK cmci
    0xfc        0.0      0.0      0.0      0.0      0.0      0.0 VMK thermal
    0xfd        0.0      0.0      0.0      0.0      0.0      0.0 VMK lint1
    0xfe        0.0      0.0      0.0      0.0      0.0      0.0 VMK error
    0xff        0.0      0.0      0.0      0.0      0.0      0.0 VMK spurious
    


P.S. Речь о домашнем сервере, поэтому никаких СХД и прочих суровых штук.
Зарегистрируйтесь на Хабре, чтобы оставить комментарий