I am running omnios r151008 on a recent box with 3TB SAS disks arranged in a raidz2 pool.
I have this 7TB filesystem where I have my zimbra server store its backups. The backup-sets are highly redundant, so for a time I had deduplication turned on to great effect, but as the size of the backup-sets grew, I ran out of ram and performance on the system became realy bad. So I turned deduplication of. Performance for newly written data is fine again.
The other day, I destroyed a bunch of old snapshots on this filesysem. Thanks to background destruction this did not realy take a long time. But now as background destruction is progressing, the system remains very slugish when doing io on the pool (slow) where the destruction is taking place.
slow 2185.4 0.0 1218.1 0.0 87.3 54.9 65.1 100 100 slow 2228.3 0.0 1240.8 0.0 79.6 56.1 60.9 100 100 slow 2204.9 0.0 1232.5 0.0 83.2 56.2 63.2 100 100 slow 2229.5 0.0 1242.5 0.0 89.6 56.4 65.5 100 100 slow 2253.0 0.0 1257.1 0.0 95.0 56.5 67.3 100 100 slow 2279.7 0.0 1267.2 0.0 100.4 58.7 69.8 100 100 slow 2228.8 0.0 1245.0 0.0 81.9 56.5 62.1 100 100 slow 2213.3 0.0 1232.8 0.0 86.7 57.9 65.3 100 100 slow 2175.9 0.0 1211.6 0.0 84.9 54.3 63.9 100 100 slow 2260.3 0.0 1257.7 0.0 93.9 57.7 67.1 100 100 slow 2199.3 0.0 1224.3 0.0 84.3 56.3 63.9 100 100 slow 2227.1 0.0 1241.2 0.0 91.6 57.5 66.9 100 100 slow 2185.0 0.0 1215.1 0.0 88.0 54.8 65.4 100 100 slow 2251.4 0.0 1254.8 0.0 92.9 57.9 67.0 100 100 slow 2281.2 0.0 1272.4 0.0 96.2 59.6 68.3 100 100 slow 2203.4 0.0 1223.8 0.0 90.8 55.9 66.6 100 100 slow 2211.9 0.0 1232.0 0.0 91.0 56.0 66.5 100 100 slow 1189.8 855.3 663.8 3304.7 43341.7 31.9 21207.7 63 66 slow 0.0 6802.0 0.0 35629.0 4088757.0 11.8 601114.5 100 100 slow 0.0 7077.3 0.0 44870.2 4431679.0 11.8 626184.3 100 100 slow 0.0 6367.8 0.0 30357.8 3891257.8 11.9 611084.9 100 100 slow 0.0 5952.8 0.0 20642.0 3450759.9 11.9 579689.1 100 100 slow 0.0 6064.2 0.0 25400.6 3143297.5 11.9 518338.6 100 100 slow 0.0 6635.5 0.0 53655.0 2431519.5 11.8 366443.0 100 100 slow 0.0 6233.4 0.0 42255.9 1748349.4 11.8 280482.7 100 100 slow 0.0 6023.6 0.0 28501.1 1124384.1 10.9 186664.9 100 100 slow 0.0 3398.3 0.0 9049.5 861359.8 6.2 253469.3 100 100 slow 0.0 3048.8 0.0 7107.1 734775.7 6.0 241007.3 100 100 slow 0.0 3183.0 0.0 7140.8 623284.5 6.0 195817.4 100 100 slow 0.0 3171.4 0.0 7063.1 516293.5 6.0 162799.4 100 100 slow 0.0 3208.0 0.0 7287.1 403837.9 6.0 125886.4 100 100 slow 0.0 3219.2 0.0 6600.9 292808.2 6.0 90958.8 100 100 slow 0.0 2552.2 0.0 14747.0 134342.3 4.7 52639.5 100 100 slow 149.5 1334.6 83.2 6264.1 4403.3 7.1 2971.8 44 46 slow 2216.2 0.0 2862.5 0.0 88.4 56.6 65.4 100 100 slow 2207.1 0.0 1230.1 0.0 83.5 54.9 62.7 100 100 slow 2134.6 0.0 1185.1 0.0 87.5 51.7 65.2 100 100 slow 2240.1 0.0 1248.5 0.0 88.6 59.0 65.9 100 100 slow 2281.7 0.0 1270.1 0.0 99.5 58.8 69.4 100 100 slow 2261.0 0.0 1258.9 0.0 89.3 57.3 64.9 100 100 slow 351.2 5137.9 194.8 19608.2 691972.9 16.8 126066.3 85 88 slow 0.0 6077.0 0.0 22531.0 752606.9 11.9 123847.1 100 100 slow 0.0 4440.1 0.0 21622.6 362138.5 8.5 81562.7 100 100 slow 0.0 2280.8 0.0 16759.0 85254.3 3.9 37381.0 99 98 slow 1156.5 152.1 642.4 693.8 64.1 31.5 73.1 56 56 slow 2209.8 0.0 1226.5 0.0 88.2 54.4 64.6 100 100 slow 2182.1 0.0 1212.2 0.0 79.2 54.0 61.0 100 100 slow 2224.2 0.0 1233.8 0.0 87.9 56.5 64.9 100 100 slow 2247.8 0.0 1251.2 0.0 94.4 58.3 67.9 100 100 slow 2211.9 0.0 1230.5 0.0 95.7 57.3 69.2 100 100