Greeting, FYI, we noticed a 6.5% improvement of fio.write_iops due to commit: commit: 49e7f0c789add1330b111af0b7caeb0e87df063e ("io-wq: fix bug of creating io-wokers unconditionally") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: fio-basic on test machine: 192 threads 4 sockets Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory with following parameters: disk: 1SSD fs: btrfs runtime: 300s nr_task: 8 rw: randwrite bs: 4k ioengine: io_uring test_size: 256g cpufreq_governor: performance ucode: 0x4003006 test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user. test-url: https://github.com/axboe/fio Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run bin/lkp run generated-yaml-file ========================================================================================= bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode: 4k/gcc-9/performance/1SSD/btrfs/io_uring/x86_64-rhel-8.3/8/debian-10.4-x86_64-20200603.cgz/300s/randwrite/lkp-csl-2ap1/256g/fio-basic/0x4003006 commit: 4956b9eaad ("io_uring: rsrc ref lock needs to be IRQ safe") 49e7f0c789 ("io-wq: fix bug of creating io-wokers unconditionally") 4956b9eaad456a88 49e7f0c789add1330b111af0b7c ---------------- --------------------------- %stddev %change %stddev \ | \ 0.05 ± 13% -0.0 0.01 ± 21% fio.latency_100ms% 3.86 ± 7% -0.8 3.05 ± 25% fio.latency_100us% 59.74 ± 3% -4.8 54.98 ± 4% fio.latency_10ms% 0.03 ± 21% -0.0 0.01 fio.latency_20us% 17.26 ± 4% -7.0 10.29 ± 35% fio.latency_250us% 0.01 -0.0 0.00 fio.latency_2us% 0.01 -0.0 0.00 fio.latency_4us% 1.65 ± 6% +10.4 12.01 ± 42% fio.latency_500us% 0.57 ± 7% -0.5 0.10 ± 27% fio.latency_50ms% 0.25 ± 20% -0.1 0.13 ± 30% fio.latency_750us% 1.339e+08 +6.5% 1.426e+08 ± 3% fio.time.file_system_outputs 1399221 ± 8% -99.6% 5944 ± 16% fio.time.involuntary_context_switches 77553 -68.7% 24263 ± 11% fio.time.minor_page_faults 409.83 ± 2% -27.4% 297.50 ± 15% fio.time.percent_of_cpu_this_job_got 1178 ± 2% -29.9% 825.64 ± 16% fio.time.system_time 56.44 +22.6% 69.22 ± 3% fio.time.user_time 16736113 +6.5% 17820174 ± 3% fio.workload 217.84 +6.5% 232.03 ± 3% fio.write_bw_MBps 15269888 ± 4% -32.9% 10245461 ± 5% fio.write_clat_99%_us 4587051 -6.0% 4312390 ± 3% fio.write_clat_mean_us 18522537 ± 3% -10.1% 16652081 ± 6% fio.write_clat_stddev 55768 +6.5% 59399 ± 3% fio.write_iops 2314 -29.0% 1642 ± 2% fio.write_slat_mean_us 64378 -97.9% 1372 ± 19% fio.write_slat_stddev 93.81 +3.8% 97.38 iostat.cpu.idle 6.07 ± 3% -58.7% 2.51 ± 4% iostat.cpu.system 0.15 -0.0 0.11 ± 5% mpstat.cpu.all.irq% 0.14 ± 3% -0.1 0.04 ± 10% mpstat.cpu.all.soft% 5.80 ± 3% -3.4 2.37 ± 4% mpstat.cpu.all.sys% 266156 +6.0% 282160 ± 3% vmstat.io.bo 239.00 ± 30% -97.7% 5.50 ± 9% vmstat.procs.r 116028 -14.0% 99777 vmstat.system.in 1233071 ± 3% -97.2% 34438 meminfo.KernelStack 4380278 -26.7% 3211647 ± 2% meminfo.SUnreclaim 5092429 -23.0% 3922629 ± 2% meminfo.Slab 1516197 ± 2% -78.8% 320788 meminfo.VmallocUsed 2166 ± 3% -20.5% 1721 meminfo.Writeback 306494 ± 2% -96.5% 10695 ± 14% numa-meminfo.node0.KernelStack 688.00 ± 57% -81.4% 127.83 ± 71% numa-meminfo.node1.Active(anon) 311234 ± 5% -97.6% 7466 ± 11% numa-meminfo.node1.KernelStack 288649 ± 11% -97.3% 7844 ± 11% numa-meminfo.node2.KernelStack 1003414 ± 18% -43.9% 562515 ± 63% numa-meminfo.node2.SUnreclaim 329049 ± 9% -97.4% 8450 ± 21% numa-meminfo.node3.KernelStack 9936713 ± 5% -76.9% 2293578 ±142% numa-numastat.node1.local_node 9936855 ± 5% -76.9% 2293700 ±142% numa-numastat.node1.numa_hit 9479455 ± 11% -54.7% 4297938 ± 66% numa-numastat.node2.local_node 9479816 ± 11% -54.7% 4298406 ± 66% numa-numastat.node2.numa_hit 586.50 ± 19% -55.1% 263.17 ± 45% numa-numastat.node2.other_node 472.50 ± 38% -64.4% 168.00 ± 82% numa-numastat.node3.other_node 105.33 ± 4% -66.1% 35.67 ± 38% turbostat.Avg_MHz 7.19 ± 3% -4.6 2.56 ± 37% turbostat.Busy% 10873854 ± 5% -52.3% 5182215 ± 52% turbostat.C1E 2.81 ± 4% -1.4 1.40 ± 39% turbostat.C1E% 50.18 ± 3% -31.4% 34.42 ± 37% turbostat.CPU%c1 42.62 ± 4% +47.9% 63.03 ± 21% turbostat.CPU%c6 17315724 ± 6% -36.9% 10924425 ± 42% turbostat.IRQ 21.30 ± 23% +291.9% 83.47 ± 52% turbostat.Pkg%pc2 119.72 -16.6% 99.81 ± 9% turbostat.PkgWatt 305449 ± 2% -96.5% 10693 ± 14% numa-vmstat.node0.nr_kernel_stack 171.50 ± 57% -81.6% 31.50 ± 72% numa-vmstat.node1.nr_active_anon 310666 ± 5% -97.6% 7464 ± 11% numa-vmstat.node1.nr_kernel_stack 171.50 ± 57% -81.6% 31.50 ± 72% numa-vmstat.node1.nr_zone_active_anon 5228773 ± 9% -69.1% 1615960 ±107% numa-vmstat.node1.numa_hit 5218279 ± 9% -69.2% 1605806 ±107% numa-vmstat.node1.numa_local 287601 ± 11% -97.3% 7841 ± 11% numa-vmstat.node2.nr_kernel_stack 250835 ± 18% -43.9% 140762 ± 63% numa-vmstat.node2.nr_slab_unreclaimable 5194508 ± 17% -50.5% 2571450 ± 64% numa-vmstat.node2.numa_hit 5183184 ± 17% -50.6% 2561990 ± 65% numa-vmstat.node2.numa_local 328244 ± 9% -97.4% 8447 ± 21% numa-vmstat.node3.nr_kernel_stack 20705401 +6.3% 22007142 ± 3% proc-vmstat.nr_dirtied 455629 +3.6% 472088 ± 2% proc-vmstat.nr_dirty 4677015 +1.2% 4734237 proc-vmstat.nr_dirty_background_threshold 9365467 +1.2% 9480050 proc-vmstat.nr_dirty_threshold 10179299 +6.0% 10791700 ± 3% proc-vmstat.nr_file_pages 8641718 +6.4% 9193417 ± 3% proc-vmstat.nr_inactive_file 1231898 ± 3% -97.2% 34449 proc-vmstat.nr_kernel_stack 1095036 -26.7% 803065 ± 2% proc-vmstat.nr_slab_unreclaimable 551.67 ± 3% -20.6% 438.17 proc-vmstat.nr_writeback 20126821 +6.0% 21339414 ± 3% proc-vmstat.nr_written 8641718 +6.4% 9193418 ± 3% proc-vmstat.nr_zone_inactive_file 456256 +3.6% 472608 ± 2% proc-vmstat.nr_zone_write_pending 73885 ± 3% -71.2% 21271 ± 14% proc-vmstat.numa_hint_faults 55528 ± 5% -71.3% 15920 ± 16% proc-vmstat.numa_hint_faults_local 41199082 ± 2% -52.2% 19704059 ± 14% proc-vmstat.numa_hit 41197887 ± 2% -52.2% 19711757 ± 14% proc-vmstat.numa_local 93747 ± 20% -50.2% 46700 ± 17% proc-vmstat.numa_pte_updates 41201950 ± 2% -47.6% 21574441 ± 2% proc-vmstat.pgalloc_normal 1267460 -4.0% 1217143 proc-vmstat.pgfault 21880105 ± 3% -95.2% 1052708 proc-vmstat.pgfree 80510442 +6.0% 85359836 ± 3% proc-vmstat.pgpgout 2456 ± 12% +20.0% 2946 ± 14% slabinfo.PING.active_objs 2456 ± 12% +20.0% 2946 ± 14% slabinfo.PING.num_objs 3066 ± 2% -42.2% 1771 ± 19% slabinfo.biovec-max.active_objs 401.67 ± 2% -42.2% 232.17 ± 19% slabinfo.biovec-max.active_slabs 3217 ± 2% -42.1% 1861 ± 19% slabinfo.biovec-max.num_objs 401.67 ± 2% -42.2% 232.17 ± 19% slabinfo.biovec-max.num_slabs 31652 ± 9% -27.8% 22839 ± 14% slabinfo.btrfs_delayed_tree_ref.active_objs 846.00 ± 9% -27.0% 618.00 ± 14% slabinfo.btrfs_delayed_tree_ref.active_slabs 33009 ± 9% -26.9% 24123 ± 14% slabinfo.btrfs_delayed_tree_ref.num_objs 846.00 ± 9% -27.0% 618.00 ± 14% slabinfo.btrfs_delayed_tree_ref.num_slabs 42626 ± 2% -48.2% 22100 ± 20% slabinfo.btrfs_ordered_extent.active_objs 1160 ± 2% -48.3% 600.50 ± 20% slabinfo.btrfs_ordered_extent.active_slabs 42968 ± 2% -48.2% 22239 ± 20% slabinfo.btrfs_ordered_extent.num_objs 1160 ± 2% -48.3% 600.50 ± 20% slabinfo.btrfs_ordered_extent.num_slabs 8211 -23.3% 6301 ± 17% slabinfo.buffer_head.active_objs 8211 -23.3% 6301 ± 17% slabinfo.buffer_head.num_objs 6779 ± 7% -30.2% 4735 ± 11% slabinfo.files_cache.active_objs 6779 ± 7% -30.2% 4735 ± 11% slabinfo.files_cache.num_objs 74707 ± 4% -34.8% 48731 ± 17% slabinfo.fsnotify_mark_connector.active_objs 592.33 ± 4% -34.9% 385.33 ± 17% slabinfo.fsnotify_mark_connector.active_slabs 75902 ± 4% -34.9% 49395 ± 17% slabinfo.fsnotify_mark_connector.num_objs 592.33 ± 4% -34.9% 385.33 ± 17% slabinfo.fsnotify_mark_connector.num_slabs 150767 ± 2% -77.8% 33494 ± 3% slabinfo.kmalloc-128.active_objs 2375 ± 2% -77.9% 524.83 ± 3% slabinfo.kmalloc-128.active_slabs 152040 ± 2% -77.9% 33616 ± 3% slabinfo.kmalloc-128.num_objs 2375 ± 2% -77.9% 524.83 ± 3% slabinfo.kmalloc-128.num_slabs 63523 ± 7% -74.0% 16500 ± 36% slabinfo.kmalloc-192.active_objs 1515 ± 7% -73.8% 397.00 ± 36% slabinfo.kmalloc-192.active_slabs 63658 ± 7% -73.8% 16696 ± 36% slabinfo.kmalloc-192.num_objs 1515 ± 7% -73.8% 397.00 ± 36% slabinfo.kmalloc-192.num_slabs 473410 -70.9% 137824 slabinfo.kmalloc-32.active_objs 3717 -70.9% 1080 slabinfo.kmalloc-32.active_slabs 475867 -70.9% 138306 slabinfo.kmalloc-32.num_objs 3717 -70.9% 1080 slabinfo.kmalloc-32.num_slabs 254377 ± 2% -58.9% 104504 ± 2% slabinfo.kmalloc-64.active_objs 3993 ± 2% -59.1% 1635 ± 2% slabinfo.kmalloc-64.active_slabs 255597 ± 2% -59.0% 104686 ± 2% slabinfo.kmalloc-64.num_objs 3993 ± 2% -59.1% 1635 ± 2% slabinfo.kmalloc-64.num_slabs 413431 -75.2% 102570 slabinfo.kmalloc-8.active_objs 809.00 -74.3% 207.83 ± 2% slabinfo.kmalloc-8.active_slabs 414373 -74.2% 106772 ± 2% slabinfo.kmalloc-8.num_objs 809.00 -74.3% 207.83 ± 2% slabinfo.kmalloc-8.num_slabs 5281 ± 8% -40.0% 3169 ± 17% slabinfo.kmalloc-cg-192.active_objs 5281 ± 8% -40.0% 3169 ± 17% slabinfo.kmalloc-cg-192.num_objs 4601 ± 8% -32.7% 3097 ± 12% slabinfo.kmalloc-cg-1k.active_objs 4611 ± 8% -32.8% 3098 ± 12% slabinfo.kmalloc-cg-1k.num_objs 1499 ± 8% +15.6% 1734 ± 3% slabinfo.kmalloc-cg-64.active_objs 1499 ± 8% +15.6% 1734 ± 3% slabinfo.kmalloc-cg-64.num_objs 5437 ± 3% -21.7% 4258 ± 14% slabinfo.mm_struct.active_objs 5437 ± 3% -21.7% 4258 ± 14% slabinfo.mm_struct.num_objs 41256 ± 4% -44.0% 23115 ± 18% slabinfo.mnt_cache.active_objs 816.67 ± 4% -44.2% 455.83 ± 17% slabinfo.mnt_cache.active_slabs 41674 ± 4% -44.2% 23268 ± 17% slabinfo.mnt_cache.num_objs 816.67 ± 4% -44.2% 455.83 ± 17% slabinfo.mnt_cache.num_slabs 15207 ± 4% -30.9% 10513 ± 16% slabinfo.pde_opener.active_objs 15207 ± 4% -30.9% 10513 ± 16% slabinfo.pde_opener.num_objs 189783 ± 2% -93.0% 13332 ± 3% slabinfo.pid.active_objs 2968 ± 2% -93.0% 207.67 ± 3% slabinfo.pid.active_slabs 190011 ± 2% -93.0% 13332 ± 3% slabinfo.pid.num_objs 2968 ± 2% -93.0% 207.67 ± 3% slabinfo.pid.num_slabs 13191 -9.7% 11916 ± 4% slabinfo.proc_inode_cache.active_objs 13191 -9.7% 11916 ± 4% slabinfo.proc_inode_cache.num_objs 3939 ± 3% -17.0% 3270 ± 5% slabinfo.sighand_cache.active_objs 3945 ± 3% -16.3% 3303 ± 5% slabinfo.sighand_cache.num_objs 7171 ± 3% -10.2% 6437 ± 6% slabinfo.signal_cache.active_objs 7225 ± 3% -10.8% 6445 ± 6% slabinfo.signal_cache.num_objs 77785 ± 3% -96.6% 2629 slabinfo.task_struct.active_objs 77789 ± 3% -96.6% 2643 slabinfo.task_struct.active_slabs 77789 ± 3% -96.6% 2643 slabinfo.task_struct.num_objs 77789 ± 3% -96.6% 2643 slabinfo.task_struct.num_slabs 5752 ± 2% -14.5% 4917 ± 5% slabinfo.trace_event_file.active_objs 5857 ± 2% -14.8% 4988 ± 6% slabinfo.trace_event_file.num_objs 174574 ± 2% -81.8% 31777 slabinfo.vmap_area.active_objs 4179 ± 3% -88.1% 497.67 slabinfo.vmap_area.active_slabs 267512 ± 3% -88.1% 31895 slabinfo.vmap_area.num_objs 4179 ± 3% -88.1% 497.67 slabinfo.vmap_area.num_slabs 10531 ±141% -94.9% 534.83 ±157% softirqs.CPU12.NET_RX 14547 ± 4% -64.8% 5117 ±113% softirqs.CPU123.RCU 15217 ± 3% -55.1% 6829 ± 85% softirqs.CPU123.SCHED 14546 ± 4% -64.4% 5174 ±111% softirqs.CPU124.RCU 15266 ± 3% -57.1% 6551 ± 82% softirqs.CPU124.SCHED 14620 ± 5% -63.7% 5306 ±106% softirqs.CPU125.RCU 15419 ± 3% -57.2% 6596 ± 82% softirqs.CPU125.SCHED 15752 ± 4% -58.1% 6593 ± 82% softirqs.CPU126.SCHED 14453 ± 4% -65.4% 4999 ±111% softirqs.CPU127.RCU 14649 ± 4% -66.6% 4890 ±111% softirqs.CPU128.RCU 15105 ± 3% -56.8% 6531 ± 80% softirqs.CPU128.SCHED 14879 ± 7% -67.1% 4899 ±112% softirqs.CPU129.RCU 14978 ± 2% -55.7% 6633 ± 81% softirqs.CPU129.SCHED 14645 ± 3% -65.8% 5012 ±114% softirqs.CPU130.RCU 15351 ± 3% -55.5% 6833 ± 84% softirqs.CPU130.SCHED 14766 ± 5% -64.8% 5191 ±115% softirqs.CPU131.RCU 14583 ± 3% -66.5% 4891 ±113% softirqs.CPU134.RCU 14495 ± 4% -66.3% 4878 ±113% softirqs.CPU135.RCU 14370 ± 4% -66.9% 4761 ±114% softirqs.CPU136.RCU 14991 ± 3% -58.1% 6274 ± 79% softirqs.CPU136.SCHED 14717 ± 4% -68.4% 4647 ±111% softirqs.CPU137.RCU 15103 ± 4% -57.3% 6443 ± 79% softirqs.CPU137.SCHED 14623 ± 3% -68.2% 4650 ±112% softirqs.CPU138.RCU 15095 ± 2% -57.9% 6352 ± 78% softirqs.CPU138.SCHED 14411 ± 3% -68.0% 4615 ±115% softirqs.CPU139.RCU 14567 ± 4% -65.4% 5046 ±105% softirqs.CPU140.RCU 15355 ± 6% -56.8% 6638 ± 80% softirqs.CPU140.SCHED 14745 ± 2% -57.6% 6247 ± 79% softirqs.CPU141.SCHED 14389 ± 4% -67.0% 4742 ±112% softirqs.CPU142.RCU 14516 ± 5% -66.4% 4880 ±108% softirqs.CPU143.RCU 15071 ± 3% -57.3% 6437 ± 79% softirqs.CPU143.SCHED 14881 ± 8% -37.9% 9236 ± 44% softirqs.CPU147.SCHED 14488 ± 11% -40.4% 8637 ± 51% softirqs.CPU148.RCU 15145 ± 9% -37.1% 9526 ± 40% softirqs.CPU148.SCHED 14730 ± 12% -38.6% 9043 ± 49% softirqs.CPU152.RCU 14455 ± 11% -41.0% 8523 ± 53% softirqs.CPU153.RCU 14334 ± 10% -37.9% 8907 ± 46% softirqs.CPU154.RCU 14563 ± 11% -35.7% 9367 ± 46% softirqs.CPU155.RCU 14452 ± 10% -41.5% 8458 ± 54% softirqs.CPU156.RCU 14381 ± 11% -38.7% 8812 ± 49% softirqs.CPU157.RCU 14377 ± 10% -37.3% 9021 ± 47% softirqs.CPU158.RCU 14660 ± 10% -42.6% 8410 ± 54% softirqs.CPU159.RCU 14047 ± 13% -39.4% 8508 ± 48% softirqs.CPU160.RCU 13823 ± 11% -36.4% 8789 ± 50% softirqs.CPU162.RCU 13810 ± 11% -38.0% 8563 ± 47% softirqs.CPU163.RCU 13952 ± 11% -36.8% 8815 ± 47% softirqs.CPU164.RCU 13860 ± 10% -38.7% 8498 ± 45% softirqs.CPU165.RCU 14959 ± 9% -32.5% 10099 ± 41% softirqs.CPU165.SCHED 13364 ± 4% -64.3% 4768 ±104% softirqs.CPU27.RCU 13707 ± 3% -57.7% 5797 ± 72% softirqs.CPU27.SCHED 13172 ± 5% -66.6% 4402 ±102% softirqs.CPU28.RCU 13555 ± 4% -59.9% 5433 ± 69% softirqs.CPU28.SCHED 13171 ± 5% -64.0% 4735 ±103% softirqs.CPU29.RCU 13744 ± 5% -57.6% 5829 ± 73% softirqs.CPU29.SCHED 13465 ± 8% -63.3% 4939 ± 98% softirqs.CPU30.RCU 13774 ± 4% -58.8% 5677 ± 74% softirqs.CPU30.SCHED 13209 ± 4% -64.5% 4687 ±104% softirqs.CPU31.RCU 13569 ± 4% -58.7% 5603 ± 71% softirqs.CPU31.SCHED 13473 ± 4% -64.9% 4723 ±105% softirqs.CPU32.RCU 13421 ± 3% -57.6% 5691 ± 73% softirqs.CPU32.SCHED 13455 ± 2% -57.6% 5711 ± 73% softirqs.CPU33.SCHED 13518 ± 7% -64.0% 4860 ±102% softirqs.CPU34.RCU 13345 ± 4% -55.6% 5927 ± 74% softirqs.CPU34.SCHED 13341 ± 4% -55.6% 5920 ± 79% softirqs.CPU36.SCHED 13732 ± 5% -64.2% 4916 ±112% softirqs.CPU45.RCU 13645 ± 4% -55.4% 6080 ± 81% softirqs.CPU45.SCHED 13762 ± 2% -56.1% 6046 ± 79% softirqs.CPU46.SCHED 13872 ± 4% -63.1% 5114 ±109% softirqs.CPU47.RCU 13452 ± 10% -35.6% 8662 ± 43% softirqs.CPU50.RCU 13169 ± 10% -32.1% 8936 ± 40% softirqs.CPU52.RCU 13417 ± 9% -36.0% 8591 ± 41% softirqs.CPU54.RCU 13336 ± 11% -34.0% 8800 ± 37% softirqs.CPU55.RCU 13624 ± 8% -31.9% 9282 ± 33% softirqs.CPU55.SCHED 12903 ± 9% -35.2% 8356 ± 39% softirqs.CPU57.RCU 12886 ± 8% -32.8% 8661 ± 37% softirqs.CPU58.RCU 12899 ± 9% -31.6% 8821 ± 39% softirqs.CPU59.RCU 12868 ± 9% -33.2% 8599 ± 37% softirqs.CPU62.RCU 13316 ± 7% -35.3% 8610 ± 32% softirqs.CPU62.SCHED 12813 ± 10% -32.9% 8600 ± 37% softirqs.CPU63.RCU 13036 ± 7% -32.4% 8812 ± 33% softirqs.CPU63.SCHED 13099 ± 11% -37.6% 8178 ± 46% softirqs.CPU70.RCU 13551 ± 7% -35.8% 8704 ± 38% softirqs.CPU70.SCHED 2820557 ± 2% -30.8% 1951127 ± 4% softirqs.RCU 2928365 -26.2% 2162292 ± 5% softirqs.SCHED 182814 -60.4% 72343 ± 5% softirqs.TIMER 20875 ±142% -95.6% 928.50 ±166% interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2 16010 ± 17% +47.1% 23545 ± 9% interrupts.CPU101.CAL:Function_call_interrupts 17863 ± 18% +41.1% 25197 ± 22% interrupts.CPU102.CAL:Function_call_interrupts 17527 ± 15% +72.4% 30208 ± 47% interrupts.CPU102.RES:Rescheduling_interrupts 17185 ± 19% +83.9% 31604 ± 57% interrupts.CPU104.RES:Rescheduling_interrupts 16777 ± 15% +90.7% 32001 ± 64% interrupts.CPU105.RES:Rescheduling_interrupts 16214 ± 12% +46.3% 23725 ± 25% interrupts.CPU106.CAL:Function_call_interrupts 17396 ± 17% +104.7% 35607 ± 53% interrupts.CPU106.RES:Rescheduling_interrupts 15952 ± 17% +83.0% 29195 ± 22% interrupts.CPU107.CAL:Function_call_interrupts 17502 ± 17% +109.5% 36664 ± 54% interrupts.CPU107.RES:Rescheduling_interrupts 16424 ± 17% +81.8% 29867 ± 26% interrupts.CPU108.CAL:Function_call_interrupts 17388 ± 16% +98.7% 34556 ± 65% interrupts.CPU108.RES:Rescheduling_interrupts 17067 ± 18% +71.8% 29328 ± 27% interrupts.CPU109.CAL:Function_call_interrupts 17034 ± 19% +126.1% 38521 ± 64% interrupts.CPU109.RES:Rescheduling_interrupts 17854 ± 19% +117.1% 38753 ± 66% interrupts.CPU110.RES:Rescheduling_interrupts 16796 ± 15% +96.1% 32938 ± 31% interrupts.CPU111.CAL:Function_call_interrupts 17093 ± 19% +122.4% 38010 ± 61% interrupts.CPU111.RES:Rescheduling_interrupts 15940 ± 18% +133.4% 37204 ± 74% interrupts.CPU112.RES:Rescheduling_interrupts 16261 ± 14% +78.8% 29072 ± 45% interrupts.CPU113.CAL:Function_call_interrupts 16231 ± 17% +134.1% 37991 ± 61% interrupts.CPU113.RES:Rescheduling_interrupts 17040 ± 15% +69.4% 28874 ± 39% interrupts.CPU114.CAL:Function_call_interrupts 16118 ± 18% +137.5% 38284 ± 64% interrupts.CPU114.RES:Rescheduling_interrupts 16851 ± 16% +95.3% 32910 ± 27% interrupts.CPU115.CAL:Function_call_interrupts 15843 ± 17% +136.4% 37459 ± 64% interrupts.CPU115.RES:Rescheduling_interrupts 16407 ± 16% +79.8% 29494 ± 45% interrupts.CPU116.CAL:Function_call_interrupts 15713 ± 18% +138.3% 37449 ± 73% interrupts.CPU116.RES:Rescheduling_interrupts 15164 ± 17% +133.7% 35446 ± 77% interrupts.CPU117.RES:Rescheduling_interrupts 14807 ± 15% +84.5% 27317 ± 43% interrupts.CPU118.CAL:Function_call_interrupts 15494 ± 15% +145.8% 38082 ± 67% interrupts.CPU118.RES:Rescheduling_interrupts 16016 ± 20% +70.4% 27297 ± 46% interrupts.CPU119.CAL:Function_call_interrupts 20875 ±142% -95.6% 928.50 ±166% interrupts.CPU12.33:PCI-MSI.524291-edge.eth0-TxRx-2 72427 ± 3% -71.7% 20475 ±114% interrupts.CPU120.LOC:Local_timer_interrupts 73052 ± 3% -73.1% 19654 ±135% interrupts.CPU121.LOC:Local_timer_interrupts 75077 ± 2% -73.2% 20098 ±133% interrupts.CPU122.LOC:Local_timer_interrupts 74218 ± 3% -72.0% 20810 ±134% interrupts.CPU123.LOC:Local_timer_interrupts 74924 ± 2% -74.5% 19091 ±128% interrupts.CPU124.LOC:Local_timer_interrupts 75511 ± 4% -76.0% 18105 ±133% interrupts.CPU125.LOC:Local_timer_interrupts 74836 ± 2% -76.3% 17719 ±132% interrupts.CPU126.LOC:Local_timer_interrupts 74821 ± 2% -77.3% 17000 ±134% interrupts.CPU127.LOC:Local_timer_interrupts 73994 ± 3% -76.6% 17296 ±129% interrupts.CPU128.LOC:Local_timer_interrupts 73972 ± 2% -77.2% 16879 ±130% interrupts.CPU129.LOC:Local_timer_interrupts 13157 ± 14% +32.4% 17419 ± 17% interrupts.CPU13.CAL:Function_call_interrupts 6007 ± 11% +95.1% 11723 ± 58% interrupts.CPU13.RES:Rescheduling_interrupts 74693 ± 2% -76.2% 17812 ±133% interrupts.CPU130.LOC:Local_timer_interrupts 74648 ± 4% -75.7% 18175 ±133% interrupts.CPU131.LOC:Local_timer_interrupts 74852 ± 3% -74.3% 19252 ±130% interrupts.CPU132.LOC:Local_timer_interrupts 74104 ± 2% -75.0% 18498 ±133% interrupts.CPU133.LOC:Local_timer_interrupts 74126 -75.6% 18063 ±134% interrupts.CPU134.LOC:Local_timer_interrupts 73295 ± 2% -76.0% 17586 ±133% interrupts.CPU135.LOC:Local_timer_interrupts 73035 ± 3% -72.6% 20008 ±135% interrupts.CPU136.LOC:Local_timer_interrupts 74365 ± 4% -79.0% 15622 ±133% interrupts.CPU137.LOC:Local_timer_interrupts 73455 ± 2% -78.0% 16140 ±131% interrupts.CPU138.LOC:Local_timer_interrupts 72090 -77.1% 16519 ±135% interrupts.CPU139.LOC:Local_timer_interrupts 73629 ± 2% -75.9% 17731 ±131% interrupts.CPU140.LOC:Local_timer_interrupts 72093 ± 2% -77.5% 16251 ±133% interrupts.CPU141.LOC:Local_timer_interrupts 72806 ± 2% -77.5% 16410 ±132% interrupts.CPU142.LOC:Local_timer_interrupts 73033 ± 3% -77.1% 16756 ±131% interrupts.CPU143.LOC:Local_timer_interrupts 72181 ± 7% -54.3% 32968 ± 44% interrupts.CPU144.LOC:Local_timer_interrupts 72845 ± 10% -56.3% 31816 ± 52% interrupts.CPU145.LOC:Local_timer_interrupts 73265 ± 9% -59.3% 29809 ± 54% interrupts.CPU146.LOC:Local_timer_interrupts 72857 ± 8% -60.2% 28965 ± 59% interrupts.CPU147.LOC:Local_timer_interrupts 73391 ± 10% -58.1% 30724 ± 54% interrupts.CPU148.LOC:Local_timer_interrupts 74557 ± 6% -47.3% 39275 ± 52% interrupts.CPU149.LOC:Local_timer_interrupts 73259 ± 8% -57.4% 31201 ± 60% interrupts.CPU150.LOC:Local_timer_interrupts 73874 ± 9% -54.9% 33323 ± 60% interrupts.CPU151.LOC:Local_timer_interrupts 74681 ± 10% -56.8% 32229 ± 55% interrupts.CPU152.LOC:Local_timer_interrupts 74665 ± 10% -55.7% 33084 ± 56% interrupts.CPU153.LOC:Local_timer_interrupts 73867 ± 9% -56.6% 32062 ± 57% interrupts.CPU154.LOC:Local_timer_interrupts 73962 ± 8% -50.5% 36597 ± 47% interrupts.CPU155.LOC:Local_timer_interrupts 74510 ± 8% -58.5% 30891 ± 63% interrupts.CPU156.LOC:Local_timer_interrupts 73802 ± 8% -57.7% 31196 ± 61% interrupts.CPU157.LOC:Local_timer_interrupts 73839 ± 9% -54.4% 33690 ± 59% interrupts.CPU158.LOC:Local_timer_interrupts 75092 ± 9% -58.7% 30991 ± 64% interrupts.CPU159.LOC:Local_timer_interrupts 73923 ± 9% -56.1% 32453 ± 54% interrupts.CPU160.LOC:Local_timer_interrupts 73316 ± 10% -55.4% 32707 ± 61% interrupts.CPU161.LOC:Local_timer_interrupts 73491 ± 9% -54.6% 33372 ± 57% interrupts.CPU162.LOC:Local_timer_interrupts 73621 ± 11% -56.4% 32089 ± 58% interrupts.CPU163.LOC:Local_timer_interrupts 73539 ± 8% -55.4% 32822 ± 58% interrupts.CPU164.LOC:Local_timer_interrupts 72951 ± 9% -56.1% 32047 ± 56% interrupts.CPU165.LOC:Local_timer_interrupts 72166 ± 10% -56.4% 31460 ± 56% interrupts.CPU166.LOC:Local_timer_interrupts 72963 ± 11% -54.2% 33406 ± 56% interrupts.CPU167.LOC:Local_timer_interrupts 73475 ± 3% -75.2% 18251 ±120% interrupts.CPU24.LOC:Local_timer_interrupts 70205 ± 2% -77.1% 16105 ±139% interrupts.CPU26.LOC:Local_timer_interrupts 68005 ± 2% -80.0% 13630 ±127% interrupts.CPU27.LOC:Local_timer_interrupts 66077 ± 4% -82.0% 11915 ±130% interrupts.CPU28.LOC:Local_timer_interrupts 66181 ± 3% -81.1% 12538 ±122% interrupts.CPU29.LOC:Local_timer_interrupts 66238 ± 3% -80.7% 12752 ±133% interrupts.CPU30.LOC:Local_timer_interrupts 65953 ± 3% -81.3% 12353 ±131% interrupts.CPU31.LOC:Local_timer_interrupts 65886 ± 4% -80.2% 13070 ±132% interrupts.CPU32.LOC:Local_timer_interrupts 66328 ± 2% -79.3% 13703 ±145% interrupts.CPU33.LOC:Local_timer_interrupts 64962 ± 3% -76.7% 15125 ±122% interrupts.CPU34.LOC:Local_timer_interrupts 64685 ± 2% -77.7% 14397 ±139% interrupts.CPU35.LOC:Local_timer_interrupts 65119 ± 3% -78.3% 14153 ±139% interrupts.CPU36.LOC:Local_timer_interrupts 64116 ± 4% -74.4% 16427 ±137% interrupts.CPU37.LOC:Local_timer_interrupts 64913 ± 3% -72.7% 17708 ±141% interrupts.CPU38.LOC:Local_timer_interrupts 65303 ± 3% -74.1% 16881 ±140% interrupts.CPU39.LOC:Local_timer_interrupts 65009 ± 4% -79.1% 13593 ±146% interrupts.CPU40.LOC:Local_timer_interrupts 65844 ± 3% -72.9% 17867 ±139% interrupts.CPU43.LOC:Local_timer_interrupts 66450 ± 3% -74.3% 17053 ±136% interrupts.CPU44.LOC:Local_timer_interrupts 66983 ± 3% -74.5% 17070 ±138% interrupts.CPU45.LOC:Local_timer_interrupts 66800 ± 2% -77.1% 15294 ±137% interrupts.CPU46.LOC:Local_timer_interrupts 67329 ± 2% -76.5% 15817 ±138% interrupts.CPU47.LOC:Local_timer_interrupts 73052 ± 9% -49.7% 36725 ± 50% interrupts.CPU48.LOC:Local_timer_interrupts 68385 ± 8% -52.2% 32657 ± 56% interrupts.CPU49.LOC:Local_timer_interrupts 14015 ± 11% +72.3% 24147 ± 43% interrupts.CPU5.CAL:Function_call_interrupts 67240 ± 8% -54.2% 30777 ± 54% interrupts.CPU50.LOC:Local_timer_interrupts 67409 ± 7% -48.7% 34548 ± 43% interrupts.CPU51.LOC:Local_timer_interrupts 65839 ± 8% -53.3% 30714 ± 49% interrupts.CPU52.LOC:Local_timer_interrupts 67648 ± 7% -58.4% 28153 ± 51% interrupts.CPU53.LOC:Local_timer_interrupts 67836 ± 7% -59.4% 27537 ± 53% interrupts.CPU54.LOC:Local_timer_interrupts 65796 ± 8% -57.6% 27913 ± 43% interrupts.CPU55.LOC:Local_timer_interrupts 64730 ± 9% -55.9% 28569 ± 41% interrupts.CPU56.LOC:Local_timer_interrupts 64616 ± 8% -58.6% 26724 ± 45% interrupts.CPU57.LOC:Local_timer_interrupts 64181 ± 7% -54.4% 29264 ± 33% interrupts.CPU58.LOC:Local_timer_interrupts 63750 ± 6% -55.6% 28334 ± 37% interrupts.CPU59.LOC:Local_timer_interrupts 6159 ± 12% +79.5% 11057 ± 55% interrupts.CPU6.RES:Rescheduling_interrupts 63719 ± 8% -49.8% 31958 ± 29% interrupts.CPU60.LOC:Local_timer_interrupts 63149 ± 8% -54.0% 29028 ± 44% interrupts.CPU61.LOC:Local_timer_interrupts 64562 ± 7% -59.7% 26017 ± 42% interrupts.CPU62.LOC:Local_timer_interrupts 62870 ± 8% -59.1% 25711 ± 46% interrupts.CPU63.LOC:Local_timer_interrupts 63250 ± 8% -59.2% 25800 ± 51% interrupts.CPU64.LOC:Local_timer_interrupts 64252 ± 10% -56.7% 27827 ± 48% interrupts.CPU65.LOC:Local_timer_interrupts 64266 ± 7% -57.9% 27071 ± 56% interrupts.CPU66.LOC:Local_timer_interrupts 64679 ± 8% -60.4% 25597 ± 58% interrupts.CPU67.LOC:Local_timer_interrupts 64523 ± 8% -55.1% 28970 ± 59% interrupts.CPU68.LOC:Local_timer_interrupts 64860 ± 8% -59.5% 26244 ± 51% interrupts.CPU69.LOC:Local_timer_interrupts 65999 ± 7% -62.0% 25048 ± 53% interrupts.CPU70.LOC:Local_timer_interrupts 66372 ± 8% -59.9% 26642 ± 51% interrupts.CPU71.LOC:Local_timer_interrupts 69485 ± 7% -50.4% 34481 ± 53% interrupts.CPU84.LOC:Local_timer_interrupts 68752 ± 7% -50.3% 34173 ± 54% interrupts.CPU86.LOC:Local_timer_interrupts 70141 ± 5% -51.1% 34264 ± 54% interrupts.CPU89.LOC:Local_timer_interrupts 70623 ± 7% -53.1% 33113 ± 55% interrupts.CPU90.LOC:Local_timer_interrupts 71194 ± 6% -57.4% 30316 ± 64% interrupts.CPU92.LOC:Local_timer_interrupts 16189 ± 17% +69.7% 27479 ± 45% interrupts.CPU99.RES:Rescheduling_interrupts 14165420 -47.3% 7469656 ± 3% interrupts.LOC:Local_timer_interrupts 2073280 +24.7% 2584771 ± 4% interrupts.RES:Rescheduling_interrupts fio.write_iops 65000 +-------------------------------------------------------------------+ 64000 |-+ O | | O | 63000 |-+ | 62000 |-+ O | 61000 |-+ | 60000 |-+ O O O | | O O O O O | 59000 |-+ O O O O O O O O | 58000 |-+ O O O O O O O O O | 57000 |-+ +.. | 56000 |-+ +.. .+. .+..+. .+. + +. | |.+.. .+. + + +.. .+.+..+.+..+.+ +.+. + +.+.. .| 55000 |-+ .+.+. + + + | 54000 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. --- 0DAY/LKP+ Test Infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation Thanks, Oliver Sang