LKML Archive on lore.kernel.org
help / color / mirror / Atom feed
* [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
@ 2015-03-18  8:20 Huang Ying
  2015-03-18 10:05 ` Filipe Manana
  0 siblings, 1 reply; 6+ messages in thread
From: Huang Ying @ 2015-03-18  8:20 UTC (permalink / raw)
  To: Filipe Manana; +Cc: Chris Mason, LKML, LKP ML

[-- Attachment #1: Type: text/plain, Size: 31081 bytes --]

FYI, we noticed the below changes on

git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
commit 3a8b36f378060d20062a0918e99fae39ff077bf0 ("Btrfs: fix data loss in the fast fsync path")


testbox/testcase/testparams: lkp-sb02/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync

f5c0a122800c301e  3a8b36f378060d20062a0918e9  
----------------  --------------------------  
         %stddev     %change         %stddev
             \          |                \  
     45.33 ±  0%     -62.6%      16.94 ±  0%  fileio.requests_per_sec
    138983 ±  0%     +15.1%     160000 ±  0%  fileio.time.voluntary_context_switches
     16035 ±  0%     +13.0%      18124 ±  0%  fileio.time.involuntary_context_switches
   2504328 ±  0%      -7.2%    2324488 ±  0%  fileio.time.file_system_outputs
      1.35 ±  1%      +2.8%       1.38 ±  0%  turbostat.CorWatt
      0.77 ±  6%     +34.6%       1.03 ±  3%  turbostat.Pkg%pc3
   7224199 ± 22%     -26.7%    5298697 ± 12%  cpuidle.C1-SNB.time
   8377756 ±  1%     +15.7%    9690687 ±  4%  cpuidle.C3-SNB.time
     16035 ±  0%     +13.0%      18124 ±  0%  time.involuntary_context_switches
    138983 ±  0%     +15.1%     160000 ±  0%  time.voluntary_context_switches
     45941 ±  0%     +11.0%      50983 ±  0%  softirqs.BLOCK
     35635 ±  2%     +13.7%      40524 ±  2%  softirqs.RCU
     26255 ±  1%     +10.5%      29017 ±  0%  softirqs.SCHED
     50650 ±  2%     +11.3%      56371 ±  0%  softirqs.TIMER
      3448 ±  0%      +1.6%       3503 ±  0%  vmstat.io.bo
      4010 ±  0%      +2.7%       4119 ±  0%  vmstat.system.cs
    294711 ±  1%     -17.1%     244365 ±  0%  meminfo.Active
    275793 ±  2%     -18.1%     225971 ±  0%  meminfo.Active(file)
     53614 ±  6%     +27.6%      68412 ± 15%  meminfo.DirectMap4k
      3781 ±  0%     -46.9%       2006 ±  0%  meminfo.Dirty
     47786 ±  0%     -14.7%      40780 ±  0%  meminfo.SReclaimable
     66047 ±  0%     -10.7%      58973 ±  0%  meminfo.Slab
     68947 ±  2%     -18.1%      56492 ±  0%  proc-vmstat.nr_active_file
    337110 ±  0%     -10.0%     303330 ±  0%  proc-vmstat.nr_dirtied
       944 ±  0%     -46.9%        501 ±  0%  proc-vmstat.nr_dirty
     11946 ±  0%     -14.7%      10195 ±  0%  proc-vmstat.nr_slab_reclaimable
    335424 ±  0%      -9.7%     302754 ±  0%  proc-vmstat.nr_written
     55839 ±  3%     -15.0%      47438 ±  0%  proc-vmstat.pgactivate
      1142 ±  5%     -16.2%        957 ± 17%  slabinfo.btrfs_delayed_ref_head.active_objs
      1146 ±  5%     -16.0%        962 ± 17%  slabinfo.btrfs_delayed_ref_head.num_objs
      1246 ±  6%     -29.4%        880 ± 15%  slabinfo.btrfs_delayed_tree_ref.active_objs
      1246 ±  6%     -29.4%        880 ± 15%  slabinfo.btrfs_delayed_tree_ref.num_objs
      2037 ±  2%     +60.0%       3260 ±  1%  slabinfo.btrfs_extent_buffer.num_objs
      2023 ±  2%     +60.7%       3250 ±  1%  slabinfo.btrfs_extent_buffer.active_objs
     13307 ±  0%     -57.7%       5634 ±  0%  slabinfo.btrfs_extent_state.num_objs
       260 ±  0%     -57.8%        110 ±  0%  slabinfo.btrfs_extent_state.num_slabs
     13292 ±  0%     -57.6%       5634 ±  0%  slabinfo.btrfs_extent_state.active_objs
       260 ±  0%     -57.8%        110 ±  0%  slabinfo.btrfs_extent_state.active_slabs
       713 ±  1%     -51.2%        348 ±  1%  slabinfo.btrfs_ordered_extent.active_objs
       718 ±  1%     -48.1%        373 ±  1%  slabinfo.btrfs_ordered_extent.num_objs
     26930 ±  0%     -57.1%      11557 ±  0%  slabinfo.btrfs_path.num_objs
       961 ±  0%     -57.1%        412 ±  0%  slabinfo.btrfs_path.active_slabs
       961 ±  0%     -57.1%        412 ±  0%  slabinfo.btrfs_path.num_slabs
     26930 ±  0%     -57.1%      11557 ±  0%  slabinfo.btrfs_path.active_objs
       789 ±  4%     -48.5%        406 ±  0%  slabinfo.ext4_extent_status.num_objs
       789 ±  4%     -48.5%        406 ±  0%  slabinfo.ext4_extent_status.active_objs
     26083 ±  0%     -28.3%      18697 ±  0%  slabinfo.radix_tree_node.num_objs
     26083 ±  0%     -28.3%      18697 ±  0%  slabinfo.radix_tree_node.active_objs
       931 ±  0%     -28.3%        667 ±  0%  slabinfo.radix_tree_node.active_slabs
       931 ±  0%     -28.3%        667 ±  0%  slabinfo.radix_tree_node.num_slabs
         4 ± 38%    +129.4%          9 ± 31%  sched_debug.cfs_rq[0]:/.runnable_load_avg
        17 ± 32%     -54.9%          8 ± 45%  sched_debug.cfs_rq[3]:/.runnable_load_avg
       385 ± 14%     -25.3%        287 ± 17%  sched_debug.cfs_rq[3]:/.load
     51947 ±  3%     +15.4%      59938 ±  3%  sched_debug.cpu#0.nr_load_updates
    200860 ±  5%     +11.6%     224079 ±  4%  sched_debug.cpu#1.ttwu_local
     47218 ±  2%      +7.4%      50701 ±  2%  sched_debug.cpu#1.nr_load_updates
         5 ± 37%    +105.0%         10 ± 26%  sched_debug.cpu#1.cpu_load[1]
    226755 ±  4%     +11.4%     252611 ±  4%  sched_debug.cpu#1.ttwu_count
      2500 ± 34%     -45.6%       1360 ± 33%  sched_debug.cpu#3.curr->pid
       385 ± 14%     -25.8%        285 ± 16%  sched_debug.cpu#3.load

testbox/testcase/testparams: bay/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndrw-sync

f5c0a122800c301e  3a8b36f378060d20062a0918e9  
----------------  --------------------------  
     62.17 ±  0%     -64.6%      22.03 ±  0%  fileio.requests_per_sec
    712336 ±  0%     -64.2%     255005 ±  0%  fileio.time.file_system_inputs
    712336 ±  0%     -64.2%     255005 ±  0%  time.file_system_inputs
      0.73 ±  3%     -21.1%       0.58 ±  3%  time.user_time
     46562 ±  0%     +29.5%      60303 ±  1%  softirqs.RCU
     57662 ±  0%     +16.7%      67299 ±  0%  softirqs.SCHED
       259 ±  0%     -64.3%         92 ±  0%  vmstat.io.bi
      3638 ±  1%     -10.1%       3272 ±  2%  meminfo.Dirty
       432 ±  8%     -25.8%        320 ± 28%  proc-vmstat.allocstall
       253 ±  9%     -21.9%        197 ± 19%  proc-vmstat.compact_fail
       506 ±  8%     -17.8%        416 ± 14%  proc-vmstat.compact_stall
     11262 ±  3%     -20.1%       8996 ±  2%  proc-vmstat.kswapd_low_wmark_hit_quickly
       910 ±  1%     -10.5%        815 ±  0%  proc-vmstat.nr_dirty
     17652 ±  2%     -16.0%      14833 ±  3%  proc-vmstat.pageoutrun
     59446 ±  0%     -20.2%      47455 ±  0%  proc-vmstat.pgactivate
    169701 ±  0%     +11.5%     189186 ±  5%  proc-vmstat.pgmigrate_success
    355946 ±  0%     -64.2%     127593 ±  0%  proc-vmstat.pgpgin
     27402 ±  7%     -23.9%      20844 ± 29%  proc-vmstat.pgsteal_direct_dma32
      4868 ±  0%     -56.8%       2104 ±  1%  proc-vmstat.workingset_refault
      1624 ±  3%      -5.7%       1530 ±  1%  slabinfo.Acpi-ParseExt.active_objs
      1624 ±  3%      -5.7%       1530 ±  1%  slabinfo.Acpi-ParseExt.num_objs
      1009 ±  6%     -28.6%        720 ± 17%  slabinfo.btrfs_delayed_data_ref.active_objs
      1016 ±  6%     -28.5%        726 ± 16%  slabinfo.btrfs_delayed_data_ref.num_objs
       849 ±  0%     -10.3%        761 ±  4%  slabinfo.btrfs_delayed_ref_head.active_objs
       851 ±  0%      -9.9%        767 ±  4%  slabinfo.btrfs_delayed_ref_head.num_objs
     10883 ±  1%     -47.5%       5709 ±  4%  slabinfo.btrfs_extent_state.num_objs
       213 ±  1%     -47.6%        111 ±  4%  slabinfo.btrfs_extent_state.num_slabs
     10794 ±  1%     -48.6%       5551 ±  3%  slabinfo.btrfs_extent_state.active_objs
       213 ±  1%     -47.6%        111 ±  4%  slabinfo.btrfs_extent_state.active_slabs
      6596 ±  0%     -58.5%       2735 ±  1%  slabinfo.btrfs_path.num_objs
       235 ±  0%     -58.6%         97 ±  1%  slabinfo.btrfs_path.active_slabs
       235 ±  0%     -58.6%         97 ±  1%  slabinfo.btrfs_path.num_slabs
      6592 ±  0%     -58.6%       2731 ±  1%  slabinfo.btrfs_path.active_objs
      5055 ±  6%      -9.0%       4601 ±  2%  slabinfo.kmalloc-32.num_objs
      5055 ±  6%      -9.0%       4601 ±  2%  slabinfo.kmalloc-32.active_objs
      1512 ±  2%     -12.2%       1328 ±  5%  slabinfo.kmalloc-96.num_objs
      1512 ±  2%     -12.2%       1328 ±  5%  slabinfo.kmalloc-96.active_objs
       459 ±  2%     -16.8%        382 ±  6%  sched_debug.cfs_rq[0]:/.blocked_load_avg
       478 ±  1%     -15.6%        403 ±  5%  sched_debug.cfs_rq[0]:/.tg_load_contrib
        49 ±  7%      -9.1%         45 ± 11%  sched_debug.cfs_rq[3]:/.tg_runnable_contrib
      2337 ±  6%      -9.9%       2106 ± 11%  sched_debug.cfs_rq[3]:/.avg->runnable_avg_sum
     25079 ±  3%     -10.1%      22542 ±  4%  sched_debug.cfs_rq[3]:/.exec_clock
        28 ± 17%     -35.7%         18 ±  9%  sched_debug.cfs_rq[3]:/.nr_spread_over
    499222 ± 12%     -59.7%     201330 ± 40%  sched_debug.cpu#0.sched_goidle
   1018389 ± 12%     -58.2%     425747 ± 37%  sched_debug.cpu#0.nr_switches
     90529 ±  4%     -17.6%      74603 ±  8%  sched_debug.cpu#0.nr_load_updates
    513982 ± 13%     -56.9%     221386 ± 36%  sched_debug.cpu#0.ttwu_count
   1019018 ± 12%     -58.2%     426387 ± 37%  sched_debug.cpu#0.sched_count
       320 ±  3%     -14.3%        274 ± 13%  sched_debug.cpu#0.load
    323974 ± 21%    +131.6%     750473 ± 12%  sched_debug.cpu#1.sched_count
    323373 ± 21%    +131.9%     749837 ± 12%  sched_debug.cpu#1.nr_switches
     89555 ± 46%    +230.0%     295518 ± 16%  sched_debug.cpu#1.ttwu_local
        13 ± 30%     +59.0%         20 ±  8%  sched_debug.cpu#1.cpu_load[2]
         8 ± 41%    +111.8%         18 ± 12%  sched_debug.cpu#1.cpu_load[4]
     68535 ±  4%     +22.2%      83732 ±  1%  sched_debug.cpu#1.nr_load_updates
        10 ± 33%     +84.1%         19 ±  9%  sched_debug.cpu#1.cpu_load[3]
    160382 ± 16%    +122.7%     357238 ± 12%  sched_debug.cpu#1.ttwu_count
    151508 ± 22%    +140.8%     364820 ± 12%  sched_debug.cpu#1.sched_goidle
    388481 ±  2%     -42.8%     222376 ± 46%  sched_debug.cpu#2.ttwu_local
     87970 ±  3%      -6.8%      81971 ±  6%  sched_debug.cpu#2.nr_load_updates
    452753 ±  3%     -37.3%     283785 ± 36%  sched_debug.cpu#2.ttwu_count
    916511 ±  5%     -36.7%     580526 ± 36%  sched_debug.cpu#2.nr_switches
    917118 ±  5%     -36.6%     581168 ± 36%  sched_debug.cpu#2.sched_count
    448592 ±  5%     -37.9%     278755 ± 38%  sched_debug.cpu#2.sched_goidle
    140376 ±  7%    +179.3%     392097 ± 28%  sched_debug.cpu#3.sched_goidle
     68344 ±  2%     +24.1%      84790 ±  8%  sched_debug.cpu#3.nr_load_updates
     78592 ± 33%    +335.3%     342125 ± 33%  sched_debug.cpu#3.ttwu_local
    300663 ±  7%    +168.1%     806077 ± 27%  sched_debug.cpu#3.sched_count
    149690 ± 12%    +182.2%     422447 ± 26%  sched_debug.cpu#3.ttwu_count
    300054 ±  7%    +168.5%     805498 ± 27%  sched_debug.cpu#3.nr_switches

testbox/testcase/testparams: bay/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync

f5c0a122800c301e  3a8b36f378060d20062a0918e9  
----------------  --------------------------  
      1.32 ±  6%   +8834.3%     117.71 ±171%  fileio.request_latency_max_ms
     44.70 ±  0%     -56.7%      19.35 ±  0%  fileio.requests_per_sec
    156010 ±  0%     +38.4%     215846 ±  0%  fileio.time.voluntary_context_switches
   2663864 ±  0%      -6.2%    2499112 ±  0%  fileio.time.file_system_outputs
    156010 ±  0%     +38.4%     215846 ±  0%  time.voluntary_context_switches
     39761 ±  1%     +22.5%      48712 ±  2%  softirqs.RCU
     37048 ±  1%     +17.1%      43380 ±  2%  softirqs.SCHED
     52147 ±  1%     +15.3%      60140 ±  1%  softirqs.TIMER
      2142 ±  0%      +4.6%       2239 ±  0%  vmstat.system.in
      4067 ±  0%      +5.9%       4307 ±  0%  vmstat.system.cs
    315172 ±  0%     -13.9%     271267 ±  0%  meminfo.Active
    296097 ±  0%     -14.5%     253063 ±  0%  meminfo.Active(file)
      3678 ±  0%     -42.1%       2131 ±  1%  meminfo.Dirty
     47204 ±  0%     -14.5%      40351 ±  0%  meminfo.SReclaimable
     64571 ±  0%     -10.7%      57634 ±  0%  meminfo.Slab
     74024 ±  0%     -14.5%      63263 ±  0%  proc-vmstat.nr_active_file
       919 ±  0%     -42.1%        532 ±  1%  proc-vmstat.nr_dirty
     11801 ±  0%     -14.5%      10087 ±  0%  proc-vmstat.nr_slab_reclaimable
     59906 ±  0%     -25.1%      44895 ±  0%  proc-vmstat.pgactivate
      1971 ±  5%      -8.0%       1814 ±  3%  slabinfo.anon_vma.active_objs
      1971 ±  5%      -8.0%       1814 ±  3%  slabinfo.anon_vma.num_objs
      1759 ±  7%     -17.1%       1457 ±  5%  slabinfo.btrfs_delayed_data_ref.active_objs
      1768 ±  7%     -17.2%       1464 ±  5%  slabinfo.btrfs_delayed_data_ref.num_objs
      1081 ± 15%     -41.9%        628 ± 11%  slabinfo.btrfs_delayed_tree_ref.active_objs
      1082 ± 15%     -41.9%        628 ± 11%  slabinfo.btrfs_delayed_tree_ref.num_objs
      2313 ±  1%     -21.9%       1805 ±  0%  slabinfo.btrfs_extent_buffer.num_objs
      2301 ±  1%     -22.1%       1792 ±  0%  slabinfo.btrfs_extent_buffer.active_objs
     13162 ±  0%     -51.8%       6341 ±  0%  slabinfo.btrfs_extent_state.num_objs
       257 ±  0%     -51.9%        123 ±  0%  slabinfo.btrfs_extent_state.num_slabs
     13152 ±  0%     -51.8%       6341 ±  0%  slabinfo.btrfs_extent_state.active_objs
       257 ±  0%     -51.9%        123 ±  0%  slabinfo.btrfs_extent_state.active_slabs
       715 ±  0%     -46.2%        385 ±  5%  slabinfo.btrfs_ordered_extent.active_objs
       720 ±  0%     -43.4%        408 ±  5%  slabinfo.btrfs_ordered_extent.num_objs
     26591 ±  0%     -51.4%      12924 ±  0%  slabinfo.btrfs_path.num_objs
       949 ±  0%     -51.4%        461 ±  0%  slabinfo.btrfs_path.active_slabs
       949 ±  0%     -51.4%        461 ±  0%  slabinfo.btrfs_path.num_slabs
     26591 ±  0%     -51.4%      12924 ±  0%  slabinfo.btrfs_path.active_objs
       670 ±  8%     -39.2%        407 ±  0%  slabinfo.ext4_extent_status.num_objs
       670 ±  8%     -39.2%        407 ±  0%  slabinfo.ext4_extent_status.active_objs
       503 ±  6%     -13.2%        437 ±  8%  slabinfo.mnt_cache.active_objs
       522 ±  7%     -13.4%        452 ±  6%  slabinfo.mnt_cache.num_objs
     26243 ±  0%     -26.8%      19212 ±  0%  slabinfo.radix_tree_node.num_objs
     26243 ±  0%     -26.8%      19212 ±  0%  slabinfo.radix_tree_node.active_objs
       937 ±  0%     -26.8%        685 ±  0%  slabinfo.radix_tree_node.active_slabs
       937 ±  0%     -26.8%        685 ±  0%  slabinfo.radix_tree_node.num_slabs

lkp-sb02: Sandy Bridge-EP
Memory: 4G

bay: Pentium D
Memory: 2G




                             fileio.requests_per_sec

  50 ++---------------------------------------------------------------------+
     |                                                                      |
  45 *+.*..*...*..*..*..*...*..*..*..*...*..*..*..*..*...*..*..*..*...*..*..*
  40 ++                                                                     |
     |                                                                      |
  35 ++                                                                     |
     |                                                                      |
  30 ++                                                                     |
     |                                                                      |
  25 ++                                                                     |
  20 ++                                                                     |
     O         O        O   O     O                                         |
  15 ++ O  O      O            O     O   O  O  O  O  O   O  O  O            |
     |                                                                      |
  10 ++--------------O------------------------------------------------------+


                            fileio.time.file_system_outputs

  2.6e+06 ++----------------------------------------------------------------+
  2.5e+06 *+.*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
          |                                                                 |
  2.4e+06 O+ O  O  O        O  O           O     O           O  O           |
  2.3e+06 ++          O           O  O  O     O     O  O  O                 |
  2.2e+06 ++                                                                |
  2.1e+06 ++                                                                |
          |                                                                 |
    2e+06 ++                                                                |
  1.9e+06 ++                                                                |
  1.8e+06 ++                                                                |
  1.7e+06 ++                                                                |
          |                                                                 |
  1.6e+06 ++             O                                                  |
  1.5e+06 ++----------------------------------------------------------------+


                             proc-vmstat.nr_active_file

  75000 ++------------------------------------------------------------------+
        |                                                                   |
  70000 ++                                                              .*..|
        *..*..*..*..*..*...*..*..*..*..*..*..*..  .*..  .*...*..*..*..*.    *
        |                                       *.    *.                    |
  65000 ++                                                                  |
        |                                                                   |
  60000 ++                                                                  |
        |                              O              O                     |
  55000 O+ O  O  O  O      O  O  O  O     O  O  O  O     O   O  O           |
        |                                                                   |
        |                                                                   |
  50000 ++             O                                                    |
        |                                                                   |
  45000 ++------------------------------------------------------------------+


                               proc-vmstat.nr_dirty

  1000 ++-------------------------------------------------------------------+
       *..*..*..*...*..*..*..*..*..*..*...  .*..  .*..  .*..*..*...*..*..*..*
   900 ++                                 *.    *.    *.                    |
       |                                                                    |
   800 ++                                                                   |
       |                                                                    |
   700 ++                                                                   |
       |                                                                    |
   600 ++                                                                   |
       |                                                                    |
   500 O+ O  O  O   O     O  O  O  O  O   O  O  O  O  O  O  O  O            |
       |                                                                    |
   400 ++              O                                                    |
       |                                                                    |
   300 ++-------------------------------------------------------------------+


                           proc-vmstat.nr_slab_reclaimable

  12000 ++--------------------------*--*-----*-----*-----*---*-----*--*-----*
        |                         ..      *.     ..    ..       *.       *. |
        *..*..*..*..*..*...*..*..*              *     *                     |
  11500 ++                                                                  |
        |                                                                   |
        |                                                                   |
  11000 ++                                                                  |
        |                                                                   |
  10500 ++                                                                  |
        |                                                                   |
        |                                 O  O  O  O  O  O   O  O           |
  10000 ++    O               O                                             |
        O  O     O  O      O     O  O  O                                    |
        |                                                                   |
   9500 ++-------------O----------------------------------------------------+


                               proc-vmstat.nr_dirtied

  340000 *+-*--*--*--*--*--*--*--*--*--*---*--*--*--*--*--*--*--*--*--*--*--*
         |                                                                  |
  320000 ++                                                                 |
         |                 O                                                |
  300000 O+ O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
         |                                                                  |
  280000 ++                                                                 |
         |                                                                  |
  260000 ++                                                                 |
         |                                                                  |
  240000 ++                                                                 |
         |                                                                  |
  220000 ++                                                                 |
         |                                                                  |
  200000 ++-------------O---------------------------------------------------+


                               proc-vmstat.nr_written

  340000 ++-*-----*--------*------------------*--*--*--*-----*--*--*--*-----*
         *.    *.    *..*.    *..*..*..*...*.             *.             *. |
  320000 ++                                                                 |
         |                                                                  |
  300000 O+ O  O  O  O     O  O  O  O  O   O  O  O  O  O  O  O  O           |
         |                                                                  |
  280000 ++                                                                 |
         |                                                                  |
  260000 ++                                                                 |
         |                                                                  |
  240000 ++                                                                 |
         |                                                                  |
  220000 ++                                                                 |
         |                                                                  |
  200000 ++-------------O---------------------------------------------------+


                               proc-vmstat.pgactivate

  60000 ++---------------------------------------------------------------*--+
        |                                                              ..   |
  55000 *+.*..*..*..*..*...*..*..*..*..*..*..*..*..*..*..*...*..*..*..*     *
        |                                                                   |
  50000 ++                                                                  |
        O  O  O  O  O         O  O  O  O  O  O  O  O  O  O   O  O           |
  45000 ++                 O                                                |
        |                                                                   |
  40000 ++                                                                  |
        |                                                                   |
  35000 ++                                                                  |
        |                                                                   |
  30000 ++             O                                                    |
        |                                                                   |
  25000 ++------------------------------------------------------------------+


                                   meminfo.Active

  310000 ++-----------------------------------------------------------------+
  300000 ++                                                              *..|
         | .*..*..*..*..              .*...  .*..         *..          ..   *
  290000 *+             *..*..*..*..*.     *.      .*.. ..   *..*..*..*     |
  280000 ++                                      *.    *                    |
         |                                                                  |
  270000 ++                                                                 |
  260000 ++                                                                 |
  250000 ++                                                                 |
         O  O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
  240000 ++                O                                                |
  230000 ++                                                                 |
         |                                                                  |
  220000 ++             O                                                   |
  210000 ++-----------------------------------------------------------------+


                                meminfo.Active(file)

  290000 ++-----------------------------------------------------------------+
  280000 ++                                                              *..|
         | .*..*..*..*..*..*..*..*..*..*...  .*..         *..*..       ..   *
  270000 *+                                *.    *..*.. ..      *..*..*     |
  260000 ++                                            *                    |
         |                                                                  |
  250000 ++                                                                 |
  240000 ++                                                                 |
  230000 ++                                                                 |
         O  O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
  220000 ++                O                                                |
  210000 ++                                                                 |
         |                                                                  |
  200000 ++             O                                                   |
  190000 ++-----------------------------------------------------------------+


                                   meminfo.Dirty

  4000 ++-------------------------------------------------------------------+
       *..*..*..*...*..*..*..*..*..*..*...  .*..        .*..*..*...*..*..*..*
       |                                  *.    *..*..*.                    |
  3500 ++                                                                   |
       |                                                                    |
       |                                                                    |
  3000 ++                                                                   |
       |                                                                    |
  2500 ++                                                                   |
       |                                                                    |
       |                                                                    |
  2000 O+ O  O  O   O     O  O  O  O  O   O  O  O  O  O  O  O  O            |
       |                                                                    |
       |                                                                    |
  1500 ++--------------O----------------------------------------------------+


                                    meminfo.Slab

  67000 ++------------------------------------------------------------------+
  66000 ++                          *..*..  .*..   *..     ..*..  .*..  .*..*
        |                         ..      *.     ..     .*.     *.    *.    |
  65000 *+.*..*..*..*..*...*..*..*              *     *.                    |
  64000 ++                                                                  |
  63000 ++                                                                  |
  62000 ++                                                                  |
        |                                                                   |
  61000 ++                                                                  |
  60000 ++                                                                  |
  59000 ++                       O        O  O  O  O  O  O   O  O           |
  58000 ++ O  O               O        O                                    |
        O        O  O      O        O                                       |
  57000 ++             O                                                    |
  56000 ++------------------------------------------------------------------+


                                meminfo.SReclaimable

  48000 ++--------------------------*--*-----*-----*-----*---*-----*--*-----*
  47000 ++                        ..      *.     ..    ..       *.       *. |
        *..*..*..*..*..*...*..*..*              *     *                     |
  46000 ++                                                                  |
  45000 ++                                                                  |
        |                                                                   |
  44000 ++                                                                  |
  43000 ++                                                                  |
  42000 ++                                                                  |
        |                                                                   |
  41000 ++                                O  O  O  O  O  O   O  O           |
  40000 ++    O               O                                             |
        O  O     O  O      O     O  O  O                                    |
  39000 ++                                                                  |
  38000 ++-------------O----------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

	apt-get install ruby
	git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
	cd lkp-tests
	bin/setup-local job.yaml # the job file attached in this email
	bin/run-local   job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang


[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 1831 bytes --]

---
testcase: fileio
default-monitors:
  wait: pre-test
  uptime: 
  iostat: 
  vmstat: 
  numa-numastat: 
  numa-vmstat: 
  numa-meminfo: 
  proc-vmstat: 
  proc-stat: 
  meminfo: 
  slabinfo: 
  interrupts: 
  lock_stat: 
  latency_stats: 
  softirqs: 
  bdi_dev_mapping: 
  diskstats: 
  nfsstat: 
  cpuidle: 
  cpufreq-stats: 
  turbostat: 
  pmeter: 
  sched_debug:
    interval: 10
default_watchdogs:
  watch-oom: 
  watchdog: 
cpufreq_governor: performance
commit: 9eccca0843205f87c00404b663188b88eb248051
model: Sandy Bridge-EP
memory: 4G
hdd_partitions: "/dev/disk/by-id/ata-HDT722516DLA380_VDSD1DTCEKYAEJ-part2"
swap_partitions: 
rootfs_partition: "/dev/disk/by-id/ata-HDT722516DLA380_VDSD1DTCEKYAEJ-part1"
period: 600s
nr_threads: 100%
disk: 1HDD
fs: btrfs
size: 64G
fileio:
  filenum: 1024f
  rwmode: rndwr
  iomode: sync
testbox: lkp-sb02
tbox_group: lkp-sb02
kconfig: x86_64-rhel
enqueue_time: 2015-03-09 18:58:56.664224511 +08:00
head_commit: 22b0731038c7bed19161c232134e457bfd0ab7c7
base_commit: 9eccca0843205f87c00404b663188b88eb248051
branch: linux-devel/devel-hourly-2015031206
kernel: "/kernel/x86_64-rhel/9eccca0843205f87c00404b663188b88eb248051/vmlinuz-4.0.0-rc3"
user: wfg
queue: cyclic
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/lkp-sb02/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync/debian-x86_64-2015-02-07.cgz/x86_64-rhel/9eccca0843205f87c00404b663188b88eb248051/0"
job_file: "/lkp/scheduled/lkp-sb02/cyclic_fileio-performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync-x86_64-rhel-BASE-9eccca0843205f87c00404b663188b88eb248051-0-20150309-106430-ne86sn.yaml"
dequeue_time: 2015-03-12 13:29:16.651686503 +08:00
nr_cpu: "$(nproc)"
job_state: finished
loadavg: 3.14 3.34 1.92 1/132 12642
start_time: '1426138196'
end_time: '1426138827'
version: "/lkp/wfg/.src-20150312-111505"

[-- Attachment #3: reproduce --]
[-- Type: text/plain, Size: 37304 bytes --]

echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
mkfs -t btrfs /dev/sda2
mount -t btrfs /dev/sda2 /fs/sda2
cd /fs/sda2
fallocate -l 67108864 test_file.0
fallocate -l 67108864 test_file.1
fallocate -l 67108864 test_file.2
fallocate -l 67108864 test_file.3
fallocate -l 67108864 test_file.4
fallocate -l 67108864 test_file.5
fallocate -l 67108864 test_file.6
fallocate -l 67108864 test_file.7
fallocate -l 67108864 test_file.8
fallocate -l 67108864 test_file.9
fallocate -l 67108864 test_file.10
fallocate -l 67108864 test_file.11
fallocate -l 67108864 test_file.12
fallocate -l 67108864 test_file.13
fallocate -l 67108864 test_file.14
fallocate -l 67108864 test_file.15
fallocate -l 67108864 test_file.16
fallocate -l 67108864 test_file.17
fallocate -l 67108864 test_file.18
fallocate -l 67108864 test_file.19
fallocate -l 67108864 test_file.20
fallocate -l 67108864 test_file.21
fallocate -l 67108864 test_file.22
fallocate -l 67108864 test_file.23
fallocate -l 67108864 test_file.24
fallocate -l 67108864 test_file.25
fallocate -l 67108864 test_file.26
fallocate -l 67108864 test_file.27
fallocate -l 67108864 test_file.28
fallocate -l 67108864 test_file.29
fallocate -l 67108864 test_file.30
fallocate -l 67108864 test_file.31
fallocate -l 67108864 test_file.32
fallocate -l 67108864 test_file.33
fallocate -l 67108864 test_file.34
fallocate -l 67108864 test_file.35
fallocate -l 67108864 test_file.36
fallocate -l 67108864 test_file.37
fallocate -l 67108864 test_file.38
fallocate -l 67108864 test_file.39
fallocate -l 67108864 test_file.40
fallocate -l 67108864 test_file.41
fallocate -l 67108864 test_file.42
fallocate -l 67108864 test_file.43
fallocate -l 67108864 test_file.44
fallocate -l 67108864 test_file.45
fallocate -l 67108864 test_file.46
fallocate -l 67108864 test_file.47
fallocate -l 67108864 test_file.48
fallocate -l 67108864 test_file.49
fallocate -l 67108864 test_file.50
fallocate -l 67108864 test_file.51
fallocate -l 67108864 test_file.52
fallocate -l 67108864 test_file.53
fallocate -l 67108864 test_file.54
fallocate -l 67108864 test_file.55
fallocate -l 67108864 test_file.56
fallocate -l 67108864 test_file.57
fallocate -l 67108864 test_file.58
fallocate -l 67108864 test_file.59
fallocate -l 67108864 test_file.60
fallocate -l 67108864 test_file.61
fallocate -l 67108864 test_file.62
fallocate -l 67108864 test_file.63
fallocate -l 67108864 test_file.64
fallocate -l 67108864 test_file.65
fallocate -l 67108864 test_file.66
fallocate -l 67108864 test_file.67
fallocate -l 67108864 test_file.68
fallocate -l 67108864 test_file.69
fallocate -l 67108864 test_file.70
fallocate -l 67108864 test_file.71
fallocate -l 67108864 test_file.72
fallocate -l 67108864 test_file.73
fallocate -l 67108864 test_file.74
fallocate -l 67108864 test_file.75
fallocate -l 67108864 test_file.76
fallocate -l 67108864 test_file.77
fallocate -l 67108864 test_file.78
fallocate -l 67108864 test_file.79
fallocate -l 67108864 test_file.80
fallocate -l 67108864 test_file.81
fallocate -l 67108864 test_file.82
fallocate -l 67108864 test_file.83
fallocate -l 67108864 test_file.84
fallocate -l 67108864 test_file.85
fallocate -l 67108864 test_file.86
fallocate -l 67108864 test_file.87
fallocate -l 67108864 test_file.88
fallocate -l 67108864 test_file.89
fallocate -l 67108864 test_file.90
fallocate -l 67108864 test_file.91
fallocate -l 67108864 test_file.92
fallocate -l 67108864 test_file.93
fallocate -l 67108864 test_file.94
fallocate -l 67108864 test_file.95
fallocate -l 67108864 test_file.96
fallocate -l 67108864 test_file.97
fallocate -l 67108864 test_file.98
fallocate -l 67108864 test_file.99
fallocate -l 67108864 test_file.100
fallocate -l 67108864 test_file.101
fallocate -l 67108864 test_file.102
fallocate -l 67108864 test_file.103
fallocate -l 67108864 test_file.104
fallocate -l 67108864 test_file.105
fallocate -l 67108864 test_file.106
fallocate -l 67108864 test_file.107
fallocate -l 67108864 test_file.108
fallocate -l 67108864 test_file.109
fallocate -l 67108864 test_file.110
fallocate -l 67108864 test_file.111
fallocate -l 67108864 test_file.112
fallocate -l 67108864 test_file.113
fallocate -l 67108864 test_file.114
fallocate -l 67108864 test_file.115
fallocate -l 67108864 test_file.116
fallocate -l 67108864 test_file.117
fallocate -l 67108864 test_file.118
fallocate -l 67108864 test_file.119
fallocate -l 67108864 test_file.120
fallocate -l 67108864 test_file.121
fallocate -l 67108864 test_file.122
fallocate -l 67108864 test_file.123
fallocate -l 67108864 test_file.124
fallocate -l 67108864 test_file.125
fallocate -l 67108864 test_file.126
fallocate -l 67108864 test_file.127
fallocate -l 67108864 test_file.128
fallocate -l 67108864 test_file.129
fallocate -l 67108864 test_file.130
fallocate -l 67108864 test_file.131
fallocate -l 67108864 test_file.132
fallocate -l 67108864 test_file.133
fallocate -l 67108864 test_file.134
fallocate -l 67108864 test_file.135
fallocate -l 67108864 test_file.136
fallocate -l 67108864 test_file.137
fallocate -l 67108864 test_file.138
fallocate -l 67108864 test_file.139
fallocate -l 67108864 test_file.140
fallocate -l 67108864 test_file.141
fallocate -l 67108864 test_file.142
fallocate -l 67108864 test_file.143
fallocate -l 67108864 test_file.144
fallocate -l 67108864 test_file.145
fallocate -l 67108864 test_file.146
fallocate -l 67108864 test_file.147
fallocate -l 67108864 test_file.148
fallocate -l 67108864 test_file.149
fallocate -l 67108864 test_file.150
fallocate -l 67108864 test_file.151
fallocate -l 67108864 test_file.152
fallocate -l 67108864 test_file.153
fallocate -l 67108864 test_file.154
fallocate -l 67108864 test_file.155
fallocate -l 67108864 test_file.156
fallocate -l 67108864 test_file.157
fallocate -l 67108864 test_file.158
fallocate -l 67108864 test_file.159
fallocate -l 67108864 test_file.160
fallocate -l 67108864 test_file.161
fallocate -l 67108864 test_file.162
fallocate -l 67108864 test_file.163
fallocate -l 67108864 test_file.164
fallocate -l 67108864 test_file.165
fallocate -l 67108864 test_file.166
fallocate -l 67108864 test_file.167
fallocate -l 67108864 test_file.168
fallocate -l 67108864 test_file.169
fallocate -l 67108864 test_file.170
fallocate -l 67108864 test_file.171
fallocate -l 67108864 test_file.172
fallocate -l 67108864 test_file.173
fallocate -l 67108864 test_file.174
fallocate -l 67108864 test_file.175
fallocate -l 67108864 test_file.176
fallocate -l 67108864 test_file.177
fallocate -l 67108864 test_file.178
fallocate -l 67108864 test_file.179
fallocate -l 67108864 test_file.180
fallocate -l 67108864 test_file.181
fallocate -l 67108864 test_file.182
fallocate -l 67108864 test_file.183
fallocate -l 67108864 test_file.184
fallocate -l 67108864 test_file.185
fallocate -l 67108864 test_file.186
fallocate -l 67108864 test_file.187
fallocate -l 67108864 test_file.188
fallocate -l 67108864 test_file.189
fallocate -l 67108864 test_file.190
fallocate -l 67108864 test_file.191
fallocate -l 67108864 test_file.192
fallocate -l 67108864 test_file.193
fallocate -l 67108864 test_file.194
fallocate -l 67108864 test_file.195
fallocate -l 67108864 test_file.196
fallocate -l 67108864 test_file.197
fallocate -l 67108864 test_file.198
fallocate -l 67108864 test_file.199
fallocate -l 67108864 test_file.200
fallocate -l 67108864 test_file.201
fallocate -l 67108864 test_file.202
fallocate -l 67108864 test_file.203
fallocate -l 67108864 test_file.204
fallocate -l 67108864 test_file.205
fallocate -l 67108864 test_file.206
fallocate -l 67108864 test_file.207
fallocate -l 67108864 test_file.208
fallocate -l 67108864 test_file.209
fallocate -l 67108864 test_file.210
fallocate -l 67108864 test_file.211
fallocate -l 67108864 test_file.212
fallocate -l 67108864 test_file.213
fallocate -l 67108864 test_file.214
fallocate -l 67108864 test_file.215
fallocate -l 67108864 test_file.216
fallocate -l 67108864 test_file.217
fallocate -l 67108864 test_file.218
fallocate -l 67108864 test_file.219
fallocate -l 67108864 test_file.220
fallocate -l 67108864 test_file.221
fallocate -l 67108864 test_file.222
fallocate -l 67108864 test_file.223
fallocate -l 67108864 test_file.224
fallocate -l 67108864 test_file.225
fallocate -l 67108864 test_file.226
fallocate -l 67108864 test_file.227
fallocate -l 67108864 test_file.228
fallocate -l 67108864 test_file.229
fallocate -l 67108864 test_file.230
fallocate -l 67108864 test_file.231
fallocate -l 67108864 test_file.232
fallocate -l 67108864 test_file.233
fallocate -l 67108864 test_file.234
fallocate -l 67108864 test_file.235
fallocate -l 67108864 test_file.236
fallocate -l 67108864 test_file.237
fallocate -l 67108864 test_file.238
fallocate -l 67108864 test_file.239
fallocate -l 67108864 test_file.240
fallocate -l 67108864 test_file.241
fallocate -l 67108864 test_file.242
fallocate -l 67108864 test_file.243
fallocate -l 67108864 test_file.244
fallocate -l 67108864 test_file.245
fallocate -l 67108864 test_file.246
fallocate -l 67108864 test_file.247
fallocate -l 67108864 test_file.248
fallocate -l 67108864 test_file.249
fallocate -l 67108864 test_file.250
fallocate -l 67108864 test_file.251
fallocate -l 67108864 test_file.252
fallocate -l 67108864 test_file.253
fallocate -l 67108864 test_file.254
fallocate -l 67108864 test_file.255
fallocate -l 67108864 test_file.256
fallocate -l 67108864 test_file.257
fallocate -l 67108864 test_file.258
fallocate -l 67108864 test_file.259
fallocate -l 67108864 test_file.260
fallocate -l 67108864 test_file.261
fallocate -l 67108864 test_file.262
fallocate -l 67108864 test_file.263
fallocate -l 67108864 test_file.264
fallocate -l 67108864 test_file.265
fallocate -l 67108864 test_file.266
fallocate -l 67108864 test_file.267
fallocate -l 67108864 test_file.268
fallocate -l 67108864 test_file.269
fallocate -l 67108864 test_file.270
fallocate -l 67108864 test_file.271
fallocate -l 67108864 test_file.272
fallocate -l 67108864 test_file.273
fallocate -l 67108864 test_file.274
fallocate -l 67108864 test_file.275
fallocate -l 67108864 test_file.276
fallocate -l 67108864 test_file.277
fallocate -l 67108864 test_file.278
fallocate -l 67108864 test_file.279
fallocate -l 67108864 test_file.280
fallocate -l 67108864 test_file.281
fallocate -l 67108864 test_file.282
fallocate -l 67108864 test_file.283
fallocate -l 67108864 test_file.284
fallocate -l 67108864 test_file.285
fallocate -l 67108864 test_file.286
fallocate -l 67108864 test_file.287
fallocate -l 67108864 test_file.288
fallocate -l 67108864 test_file.289
fallocate -l 67108864 test_file.290
fallocate -l 67108864 test_file.291
fallocate -l 67108864 test_file.292
fallocate -l 67108864 test_file.293
fallocate -l 67108864 test_file.294
fallocate -l 67108864 test_file.295
fallocate -l 67108864 test_file.296
fallocate -l 67108864 test_file.297
fallocate -l 67108864 test_file.298
fallocate -l 67108864 test_file.299
fallocate -l 67108864 test_file.300
fallocate -l 67108864 test_file.301
fallocate -l 67108864 test_file.302
fallocate -l 67108864 test_file.303
fallocate -l 67108864 test_file.304
fallocate -l 67108864 test_file.305
fallocate -l 67108864 test_file.306
fallocate -l 67108864 test_file.307
fallocate -l 67108864 test_file.308
fallocate -l 67108864 test_file.309
fallocate -l 67108864 test_file.310
fallocate -l 67108864 test_file.311
fallocate -l 67108864 test_file.312
fallocate -l 67108864 test_file.313
fallocate -l 67108864 test_file.314
fallocate -l 67108864 test_file.315
fallocate -l 67108864 test_file.316
fallocate -l 67108864 test_file.317
fallocate -l 67108864 test_file.318
fallocate -l 67108864 test_file.319
fallocate -l 67108864 test_file.320
fallocate -l 67108864 test_file.321
fallocate -l 67108864 test_file.322
fallocate -l 67108864 test_file.323
fallocate -l 67108864 test_file.324
fallocate -l 67108864 test_file.325
fallocate -l 67108864 test_file.326
fallocate -l 67108864 test_file.327
fallocate -l 67108864 test_file.328
fallocate -l 67108864 test_file.329
fallocate -l 67108864 test_file.330
fallocate -l 67108864 test_file.331
fallocate -l 67108864 test_file.332
fallocate -l 67108864 test_file.333
fallocate -l 67108864 test_file.334
fallocate -l 67108864 test_file.335
fallocate -l 67108864 test_file.336
fallocate -l 67108864 test_file.337
fallocate -l 67108864 test_file.338
fallocate -l 67108864 test_file.339
fallocate -l 67108864 test_file.340
fallocate -l 67108864 test_file.341
fallocate -l 67108864 test_file.342
fallocate -l 67108864 test_file.343
fallocate -l 67108864 test_file.344
fallocate -l 67108864 test_file.345
fallocate -l 67108864 test_file.346
fallocate -l 67108864 test_file.347
fallocate -l 67108864 test_file.348
fallocate -l 67108864 test_file.349
fallocate -l 67108864 test_file.350
fallocate -l 67108864 test_file.351
fallocate -l 67108864 test_file.352
fallocate -l 67108864 test_file.353
fallocate -l 67108864 test_file.354
fallocate -l 67108864 test_file.355
fallocate -l 67108864 test_file.356
fallocate -l 67108864 test_file.357
fallocate -l 67108864 test_file.358
fallocate -l 67108864 test_file.359
fallocate -l 67108864 test_file.360
fallocate -l 67108864 test_file.361
fallocate -l 67108864 test_file.362
fallocate -l 67108864 test_file.363
fallocate -l 67108864 test_file.364
fallocate -l 67108864 test_file.365
fallocate -l 67108864 test_file.366
fallocate -l 67108864 test_file.367
fallocate -l 67108864 test_file.368
fallocate -l 67108864 test_file.369
fallocate -l 67108864 test_file.370
fallocate -l 67108864 test_file.371
fallocate -l 67108864 test_file.372
fallocate -l 67108864 test_file.373
fallocate -l 67108864 test_file.374
fallocate -l 67108864 test_file.375
fallocate -l 67108864 test_file.376
fallocate -l 67108864 test_file.377
fallocate -l 67108864 test_file.378
fallocate -l 67108864 test_file.379
fallocate -l 67108864 test_file.380
fallocate -l 67108864 test_file.381
fallocate -l 67108864 test_file.382
fallocate -l 67108864 test_file.383
fallocate -l 67108864 test_file.384
fallocate -l 67108864 test_file.385
fallocate -l 67108864 test_file.386
fallocate -l 67108864 test_file.387
fallocate -l 67108864 test_file.388
fallocate -l 67108864 test_file.389
fallocate -l 67108864 test_file.390
fallocate -l 67108864 test_file.391
fallocate -l 67108864 test_file.392
fallocate -l 67108864 test_file.393
fallocate -l 67108864 test_file.394
fallocate -l 67108864 test_file.395
fallocate -l 67108864 test_file.396
fallocate -l 67108864 test_file.397
fallocate -l 67108864 test_file.398
fallocate -l 67108864 test_file.399
fallocate -l 67108864 test_file.400
fallocate -l 67108864 test_file.401
fallocate -l 67108864 test_file.402
fallocate -l 67108864 test_file.403
fallocate -l 67108864 test_file.404
fallocate -l 67108864 test_file.405
fallocate -l 67108864 test_file.406
fallocate -l 67108864 test_file.407
fallocate -l 67108864 test_file.408
fallocate -l 67108864 test_file.409
fallocate -l 67108864 test_file.410
fallocate -l 67108864 test_file.411
fallocate -l 67108864 test_file.412
fallocate -l 67108864 test_file.413
fallocate -l 67108864 test_file.414
fallocate -l 67108864 test_file.415
fallocate -l 67108864 test_file.416
fallocate -l 67108864 test_file.417
fallocate -l 67108864 test_file.418
fallocate -l 67108864 test_file.419
fallocate -l 67108864 test_file.420
fallocate -l 67108864 test_file.421
fallocate -l 67108864 test_file.422
fallocate -l 67108864 test_file.423
fallocate -l 67108864 test_file.424
fallocate -l 67108864 test_file.425
fallocate -l 67108864 test_file.426
fallocate -l 67108864 test_file.427
fallocate -l 67108864 test_file.428
fallocate -l 67108864 test_file.429
fallocate -l 67108864 test_file.430
fallocate -l 67108864 test_file.431
fallocate -l 67108864 test_file.432
fallocate -l 67108864 test_file.433
fallocate -l 67108864 test_file.434
fallocate -l 67108864 test_file.435
fallocate -l 67108864 test_file.436
fallocate -l 67108864 test_file.437
fallocate -l 67108864 test_file.438
fallocate -l 67108864 test_file.439
fallocate -l 67108864 test_file.440
fallocate -l 67108864 test_file.441
fallocate -l 67108864 test_file.442
fallocate -l 67108864 test_file.443
fallocate -l 67108864 test_file.444
fallocate -l 67108864 test_file.445
fallocate -l 67108864 test_file.446
fallocate -l 67108864 test_file.447
fallocate -l 67108864 test_file.448
fallocate -l 67108864 test_file.449
fallocate -l 67108864 test_file.450
fallocate -l 67108864 test_file.451
fallocate -l 67108864 test_file.452
fallocate -l 67108864 test_file.453
fallocate -l 67108864 test_file.454
fallocate -l 67108864 test_file.455
fallocate -l 67108864 test_file.456
fallocate -l 67108864 test_file.457
fallocate -l 67108864 test_file.458
fallocate -l 67108864 test_file.459
fallocate -l 67108864 test_file.460
fallocate -l 67108864 test_file.461
fallocate -l 67108864 test_file.462
fallocate -l 67108864 test_file.463
fallocate -l 67108864 test_file.464
fallocate -l 67108864 test_file.465
fallocate -l 67108864 test_file.466
fallocate -l 67108864 test_file.467
fallocate -l 67108864 test_file.468
fallocate -l 67108864 test_file.469
fallocate -l 67108864 test_file.470
fallocate -l 67108864 test_file.471
fallocate -l 67108864 test_file.472
fallocate -l 67108864 test_file.473
fallocate -l 67108864 test_file.474
fallocate -l 67108864 test_file.475
fallocate -l 67108864 test_file.476
fallocate -l 67108864 test_file.477
fallocate -l 67108864 test_file.478
fallocate -l 67108864 test_file.479
fallocate -l 67108864 test_file.480
fallocate -l 67108864 test_file.481
fallocate -l 67108864 test_file.482
fallocate -l 67108864 test_file.483
fallocate -l 67108864 test_file.484
fallocate -l 67108864 test_file.485
fallocate -l 67108864 test_file.486
fallocate -l 67108864 test_file.487
fallocate -l 67108864 test_file.488
fallocate -l 67108864 test_file.489
fallocate -l 67108864 test_file.490
fallocate -l 67108864 test_file.491
fallocate -l 67108864 test_file.492
fallocate -l 67108864 test_file.493
fallocate -l 67108864 test_file.494
fallocate -l 67108864 test_file.495
fallocate -l 67108864 test_file.496
fallocate -l 67108864 test_file.497
fallocate -l 67108864 test_file.498
fallocate -l 67108864 test_file.499
fallocate -l 67108864 test_file.500
fallocate -l 67108864 test_file.501
fallocate -l 67108864 test_file.502
fallocate -l 67108864 test_file.503
fallocate -l 67108864 test_file.504
fallocate -l 67108864 test_file.505
fallocate -l 67108864 test_file.506
fallocate -l 67108864 test_file.507
fallocate -l 67108864 test_file.508
fallocate -l 67108864 test_file.509
fallocate -l 67108864 test_file.510
fallocate -l 67108864 test_file.511
fallocate -l 67108864 test_file.512
fallocate -l 67108864 test_file.513
fallocate -l 67108864 test_file.514
fallocate -l 67108864 test_file.515
fallocate -l 67108864 test_file.516
fallocate -l 67108864 test_file.517
fallocate -l 67108864 test_file.518
fallocate -l 67108864 test_file.519
fallocate -l 67108864 test_file.520
fallocate -l 67108864 test_file.521
fallocate -l 67108864 test_file.522
fallocate -l 67108864 test_file.523
fallocate -l 67108864 test_file.524
fallocate -l 67108864 test_file.525
fallocate -l 67108864 test_file.526
fallocate -l 67108864 test_file.527
fallocate -l 67108864 test_file.528
fallocate -l 67108864 test_file.529
fallocate -l 67108864 test_file.530
fallocate -l 67108864 test_file.531
fallocate -l 67108864 test_file.532
fallocate -l 67108864 test_file.533
fallocate -l 67108864 test_file.534
fallocate -l 67108864 test_file.535
fallocate -l 67108864 test_file.536
fallocate -l 67108864 test_file.537
fallocate -l 67108864 test_file.538
fallocate -l 67108864 test_file.539
fallocate -l 67108864 test_file.540
fallocate -l 67108864 test_file.541
fallocate -l 67108864 test_file.542
fallocate -l 67108864 test_file.543
fallocate -l 67108864 test_file.544
fallocate -l 67108864 test_file.545
fallocate -l 67108864 test_file.546
fallocate -l 67108864 test_file.547
fallocate -l 67108864 test_file.548
fallocate -l 67108864 test_file.549
fallocate -l 67108864 test_file.550
fallocate -l 67108864 test_file.551
fallocate -l 67108864 test_file.552
fallocate -l 67108864 test_file.553
fallocate -l 67108864 test_file.554
fallocate -l 67108864 test_file.555
fallocate -l 67108864 test_file.556
fallocate -l 67108864 test_file.557
fallocate -l 67108864 test_file.558
fallocate -l 67108864 test_file.559
fallocate -l 67108864 test_file.560
fallocate -l 67108864 test_file.561
fallocate -l 67108864 test_file.562
fallocate -l 67108864 test_file.563
fallocate -l 67108864 test_file.564
fallocate -l 67108864 test_file.565
fallocate -l 67108864 test_file.566
fallocate -l 67108864 test_file.567
fallocate -l 67108864 test_file.568
fallocate -l 67108864 test_file.569
fallocate -l 67108864 test_file.570
fallocate -l 67108864 test_file.571
fallocate -l 67108864 test_file.572
fallocate -l 67108864 test_file.573
fallocate -l 67108864 test_file.574
fallocate -l 67108864 test_file.575
fallocate -l 67108864 test_file.576
fallocate -l 67108864 test_file.577
fallocate -l 67108864 test_file.578
fallocate -l 67108864 test_file.579
fallocate -l 67108864 test_file.580
fallocate -l 67108864 test_file.581
fallocate -l 67108864 test_file.582
fallocate -l 67108864 test_file.583
fallocate -l 67108864 test_file.584
fallocate -l 67108864 test_file.585
fallocate -l 67108864 test_file.586
fallocate -l 67108864 test_file.587
fallocate -l 67108864 test_file.588
fallocate -l 67108864 test_file.589
fallocate -l 67108864 test_file.590
fallocate -l 67108864 test_file.591
fallocate -l 67108864 test_file.592
fallocate -l 67108864 test_file.593
fallocate -l 67108864 test_file.594
fallocate -l 67108864 test_file.595
fallocate -l 67108864 test_file.596
fallocate -l 67108864 test_file.597
fallocate -l 67108864 test_file.598
fallocate -l 67108864 test_file.599
fallocate -l 67108864 test_file.600
fallocate -l 67108864 test_file.601
fallocate -l 67108864 test_file.602
fallocate -l 67108864 test_file.603
fallocate -l 67108864 test_file.604
fallocate -l 67108864 test_file.605
fallocate -l 67108864 test_file.606
fallocate -l 67108864 test_file.607
fallocate -l 67108864 test_file.608
fallocate -l 67108864 test_file.609
fallocate -l 67108864 test_file.610
fallocate -l 67108864 test_file.611
fallocate -l 67108864 test_file.612
fallocate -l 67108864 test_file.613
fallocate -l 67108864 test_file.614
fallocate -l 67108864 test_file.615
fallocate -l 67108864 test_file.616
fallocate -l 67108864 test_file.617
fallocate -l 67108864 test_file.618
fallocate -l 67108864 test_file.619
fallocate -l 67108864 test_file.620
fallocate -l 67108864 test_file.621
fallocate -l 67108864 test_file.622
fallocate -l 67108864 test_file.623
fallocate -l 67108864 test_file.624
fallocate -l 67108864 test_file.625
fallocate -l 67108864 test_file.626
fallocate -l 67108864 test_file.627
fallocate -l 67108864 test_file.628
fallocate -l 67108864 test_file.629
fallocate -l 67108864 test_file.630
fallocate -l 67108864 test_file.631
fallocate -l 67108864 test_file.632
fallocate -l 67108864 test_file.633
fallocate -l 67108864 test_file.634
fallocate -l 67108864 test_file.635
fallocate -l 67108864 test_file.636
fallocate -l 67108864 test_file.637
fallocate -l 67108864 test_file.638
fallocate -l 67108864 test_file.639
fallocate -l 67108864 test_file.640
fallocate -l 67108864 test_file.641
fallocate -l 67108864 test_file.642
fallocate -l 67108864 test_file.643
fallocate -l 67108864 test_file.644
fallocate -l 67108864 test_file.645
fallocate -l 67108864 test_file.646
fallocate -l 67108864 test_file.647
fallocate -l 67108864 test_file.648
fallocate -l 67108864 test_file.649
fallocate -l 67108864 test_file.650
fallocate -l 67108864 test_file.651
fallocate -l 67108864 test_file.652
fallocate -l 67108864 test_file.653
fallocate -l 67108864 test_file.654
fallocate -l 67108864 test_file.655
fallocate -l 67108864 test_file.656
fallocate -l 67108864 test_file.657
fallocate -l 67108864 test_file.658
fallocate -l 67108864 test_file.659
fallocate -l 67108864 test_file.660
fallocate -l 67108864 test_file.661
fallocate -l 67108864 test_file.662
fallocate -l 67108864 test_file.663
fallocate -l 67108864 test_file.664
fallocate -l 67108864 test_file.665
fallocate -l 67108864 test_file.666
fallocate -l 67108864 test_file.667
fallocate -l 67108864 test_file.668
fallocate -l 67108864 test_file.669
fallocate -l 67108864 test_file.670
fallocate -l 67108864 test_file.671
fallocate -l 67108864 test_file.672
fallocate -l 67108864 test_file.673
fallocate -l 67108864 test_file.674
fallocate -l 67108864 test_file.675
fallocate -l 67108864 test_file.676
fallocate -l 67108864 test_file.677
fallocate -l 67108864 test_file.678
fallocate -l 67108864 test_file.679
fallocate -l 67108864 test_file.680
fallocate -l 67108864 test_file.681
fallocate -l 67108864 test_file.682
fallocate -l 67108864 test_file.683
fallocate -l 67108864 test_file.684
fallocate -l 67108864 test_file.685
fallocate -l 67108864 test_file.686
fallocate -l 67108864 test_file.687
fallocate -l 67108864 test_file.688
fallocate -l 67108864 test_file.689
fallocate -l 67108864 test_file.690
fallocate -l 67108864 test_file.691
fallocate -l 67108864 test_file.692
fallocate -l 67108864 test_file.693
fallocate -l 67108864 test_file.694
fallocate -l 67108864 test_file.695
fallocate -l 67108864 test_file.696
fallocate -l 67108864 test_file.697
fallocate -l 67108864 test_file.698
fallocate -l 67108864 test_file.699
fallocate -l 67108864 test_file.700
fallocate -l 67108864 test_file.701
fallocate -l 67108864 test_file.702
fallocate -l 67108864 test_file.703
fallocate -l 67108864 test_file.704
fallocate -l 67108864 test_file.705
fallocate -l 67108864 test_file.706
fallocate -l 67108864 test_file.707
fallocate -l 67108864 test_file.708
fallocate -l 67108864 test_file.709
fallocate -l 67108864 test_file.710
fallocate -l 67108864 test_file.711
fallocate -l 67108864 test_file.712
fallocate -l 67108864 test_file.713
fallocate -l 67108864 test_file.714
fallocate -l 67108864 test_file.715
fallocate -l 67108864 test_file.716
fallocate -l 67108864 test_file.717
fallocate -l 67108864 test_file.718
fallocate -l 67108864 test_file.719
fallocate -l 67108864 test_file.720
fallocate -l 67108864 test_file.721
fallocate -l 67108864 test_file.722
fallocate -l 67108864 test_file.723
fallocate -l 67108864 test_file.724
fallocate -l 67108864 test_file.725
fallocate -l 67108864 test_file.726
fallocate -l 67108864 test_file.727
fallocate -l 67108864 test_file.728
fallocate -l 67108864 test_file.729
fallocate -l 67108864 test_file.730
fallocate -l 67108864 test_file.731
fallocate -l 67108864 test_file.732
fallocate -l 67108864 test_file.733
fallocate -l 67108864 test_file.734
fallocate -l 67108864 test_file.735
fallocate -l 67108864 test_file.736
fallocate -l 67108864 test_file.737
fallocate -l 67108864 test_file.738
fallocate -l 67108864 test_file.739
fallocate -l 67108864 test_file.740
fallocate -l 67108864 test_file.741
fallocate -l 67108864 test_file.742
fallocate -l 67108864 test_file.743
fallocate -l 67108864 test_file.744
fallocate -l 67108864 test_file.745
fallocate -l 67108864 test_file.746
fallocate -l 67108864 test_file.747
fallocate -l 67108864 test_file.748
fallocate -l 67108864 test_file.749
fallocate -l 67108864 test_file.750
fallocate -l 67108864 test_file.751
fallocate -l 67108864 test_file.752
fallocate -l 67108864 test_file.753
fallocate -l 67108864 test_file.754
fallocate -l 67108864 test_file.755
fallocate -l 67108864 test_file.756
fallocate -l 67108864 test_file.757
fallocate -l 67108864 test_file.758
fallocate -l 67108864 test_file.759
fallocate -l 67108864 test_file.760
fallocate -l 67108864 test_file.761
fallocate -l 67108864 test_file.762
fallocate -l 67108864 test_file.763
fallocate -l 67108864 test_file.764
fallocate -l 67108864 test_file.765
fallocate -l 67108864 test_file.766
fallocate -l 67108864 test_file.767
fallocate -l 67108864 test_file.768
fallocate -l 67108864 test_file.769
fallocate -l 67108864 test_file.770
fallocate -l 67108864 test_file.771
fallocate -l 67108864 test_file.772
fallocate -l 67108864 test_file.773
fallocate -l 67108864 test_file.774
fallocate -l 67108864 test_file.775
fallocate -l 67108864 test_file.776
fallocate -l 67108864 test_file.777
fallocate -l 67108864 test_file.778
fallocate -l 67108864 test_file.779
fallocate -l 67108864 test_file.780
fallocate -l 67108864 test_file.781
fallocate -l 67108864 test_file.782
fallocate -l 67108864 test_file.783
fallocate -l 67108864 test_file.784
fallocate -l 67108864 test_file.785
fallocate -l 67108864 test_file.786
fallocate -l 67108864 test_file.787
fallocate -l 67108864 test_file.788
fallocate -l 67108864 test_file.789
fallocate -l 67108864 test_file.790
fallocate -l 67108864 test_file.791
fallocate -l 67108864 test_file.792
fallocate -l 67108864 test_file.793
fallocate -l 67108864 test_file.794
fallocate -l 67108864 test_file.795
fallocate -l 67108864 test_file.796
fallocate -l 67108864 test_file.797
fallocate -l 67108864 test_file.798
fallocate -l 67108864 test_file.799
fallocate -l 67108864 test_file.800
fallocate -l 67108864 test_file.801
fallocate -l 67108864 test_file.802
fallocate -l 67108864 test_file.803
fallocate -l 67108864 test_file.804
fallocate -l 67108864 test_file.805
fallocate -l 67108864 test_file.806
fallocate -l 67108864 test_file.807
fallocate -l 67108864 test_file.808
fallocate -l 67108864 test_file.809
fallocate -l 67108864 test_file.810
fallocate -l 67108864 test_file.811
fallocate -l 67108864 test_file.812
fallocate -l 67108864 test_file.813
fallocate -l 67108864 test_file.814
fallocate -l 67108864 test_file.815
fallocate -l 67108864 test_file.816
fallocate -l 67108864 test_file.817
fallocate -l 67108864 test_file.818
fallocate -l 67108864 test_file.819
fallocate -l 67108864 test_file.820
fallocate -l 67108864 test_file.821
fallocate -l 67108864 test_file.822
fallocate -l 67108864 test_file.823
fallocate -l 67108864 test_file.824
fallocate -l 67108864 test_file.825
fallocate -l 67108864 test_file.826
fallocate -l 67108864 test_file.827
fallocate -l 67108864 test_file.828
fallocate -l 67108864 test_file.829
fallocate -l 67108864 test_file.830
fallocate -l 67108864 test_file.831
fallocate -l 67108864 test_file.832
fallocate -l 67108864 test_file.833
fallocate -l 67108864 test_file.834
fallocate -l 67108864 test_file.835
fallocate -l 67108864 test_file.836
fallocate -l 67108864 test_file.837
fallocate -l 67108864 test_file.838
fallocate -l 67108864 test_file.839
fallocate -l 67108864 test_file.840
fallocate -l 67108864 test_file.841
fallocate -l 67108864 test_file.842
fallocate -l 67108864 test_file.843
fallocate -l 67108864 test_file.844
fallocate -l 67108864 test_file.845
fallocate -l 67108864 test_file.846
fallocate -l 67108864 test_file.847
fallocate -l 67108864 test_file.848
fallocate -l 67108864 test_file.849
fallocate -l 67108864 test_file.850
fallocate -l 67108864 test_file.851
fallocate -l 67108864 test_file.852
fallocate -l 67108864 test_file.853
fallocate -l 67108864 test_file.854
fallocate -l 67108864 test_file.855
fallocate -l 67108864 test_file.856
fallocate -l 67108864 test_file.857
fallocate -l 67108864 test_file.858
fallocate -l 67108864 test_file.859
fallocate -l 67108864 test_file.860
fallocate -l 67108864 test_file.861
fallocate -l 67108864 test_file.862
fallocate -l 67108864 test_file.863
fallocate -l 67108864 test_file.864
fallocate -l 67108864 test_file.865
fallocate -l 67108864 test_file.866
fallocate -l 67108864 test_file.867
fallocate -l 67108864 test_file.868
fallocate -l 67108864 test_file.869
fallocate -l 67108864 test_file.870
fallocate -l 67108864 test_file.871
fallocate -l 67108864 test_file.872
fallocate -l 67108864 test_file.873
fallocate -l 67108864 test_file.874
fallocate -l 67108864 test_file.875
fallocate -l 67108864 test_file.876
fallocate -l 67108864 test_file.877
fallocate -l 67108864 test_file.878
fallocate -l 67108864 test_file.879
fallocate -l 67108864 test_file.880
fallocate -l 67108864 test_file.881
fallocate -l 67108864 test_file.882
fallocate -l 67108864 test_file.883
fallocate -l 67108864 test_file.884
fallocate -l 67108864 test_file.885
fallocate -l 67108864 test_file.886
fallocate -l 67108864 test_file.887
fallocate -l 67108864 test_file.888
fallocate -l 67108864 test_file.889
fallocate -l 67108864 test_file.890
fallocate -l 67108864 test_file.891
fallocate -l 67108864 test_file.892
fallocate -l 67108864 test_file.893
fallocate -l 67108864 test_file.894
fallocate -l 67108864 test_file.895
fallocate -l 67108864 test_file.896
fallocate -l 67108864 test_file.897
fallocate -l 67108864 test_file.898
fallocate -l 67108864 test_file.899
fallocate -l 67108864 test_file.900
fallocate -l 67108864 test_file.901
fallocate -l 67108864 test_file.902
fallocate -l 67108864 test_file.903
fallocate -l 67108864 test_file.904
fallocate -l 67108864 test_file.905
fallocate -l 67108864 test_file.906
fallocate -l 67108864 test_file.907
fallocate -l 67108864 test_file.908
fallocate -l 67108864 test_file.909
fallocate -l 67108864 test_file.910
fallocate -l 67108864 test_file.911
fallocate -l 67108864 test_file.912
fallocate -l 67108864 test_file.913
fallocate -l 67108864 test_file.914
fallocate -l 67108864 test_file.915
fallocate -l 67108864 test_file.916
fallocate -l 67108864 test_file.917
fallocate -l 67108864 test_file.918
fallocate -l 67108864 test_file.919
fallocate -l 67108864 test_file.920
fallocate -l 67108864 test_file.921
fallocate -l 67108864 test_file.922
fallocate -l 67108864 test_file.923
fallocate -l 67108864 test_file.924
fallocate -l 67108864 test_file.925
fallocate -l 67108864 test_file.926
fallocate -l 67108864 test_file.927
fallocate -l 67108864 test_file.928
fallocate -l 67108864 test_file.929
fallocate -l 67108864 test_file.930
fallocate -l 67108864 test_file.931
fallocate -l 67108864 test_file.932
fallocate -l 67108864 test_file.933
fallocate -l 67108864 test_file.934
fallocate -l 67108864 test_file.935
fallocate -l 67108864 test_file.936
fallocate -l 67108864 test_file.937
fallocate -l 67108864 test_file.938
fallocate -l 67108864 test_file.939
fallocate -l 67108864 test_file.940
fallocate -l 67108864 test_file.941
fallocate -l 67108864 test_file.942
fallocate -l 67108864 test_file.943
fallocate -l 67108864 test_file.944
fallocate -l 67108864 test_file.945
fallocate -l 67108864 test_file.946
fallocate -l 67108864 test_file.947
fallocate -l 67108864 test_file.948
fallocate -l 67108864 test_file.949
fallocate -l 67108864 test_file.950
fallocate -l 67108864 test_file.951
fallocate -l 67108864 test_file.952
fallocate -l 67108864 test_file.953
fallocate -l 67108864 test_file.954
fallocate -l 67108864 test_file.955
fallocate -l 67108864 test_file.956
fallocate -l 67108864 test_file.957
fallocate -l 67108864 test_file.958
fallocate -l 67108864 test_file.959
fallocate -l 67108864 test_file.960
fallocate -l 67108864 test_file.961
fallocate -l 67108864 test_file.962
fallocate -l 67108864 test_file.963
fallocate -l 67108864 test_file.964
fallocate -l 67108864 test_file.965
fallocate -l 67108864 test_file.966
fallocate -l 67108864 test_file.967
fallocate -l 67108864 test_file.968
fallocate -l 67108864 test_file.969
fallocate -l 67108864 test_file.970
fallocate -l 67108864 test_file.971
fallocate -l 67108864 test_file.972
fallocate -l 67108864 test_file.973
fallocate -l 67108864 test_file.974
fallocate -l 67108864 test_file.975
fallocate -l 67108864 test_file.976
fallocate -l 67108864 test_file.977
fallocate -l 67108864 test_file.978
fallocate -l 67108864 test_file.979
fallocate -l 67108864 test_file.980
fallocate -l 67108864 test_file.981
fallocate -l 67108864 test_file.982
fallocate -l 67108864 test_file.983
fallocate -l 67108864 test_file.984
fallocate -l 67108864 test_file.985
fallocate -l 67108864 test_file.986
fallocate -l 67108864 test_file.987
fallocate -l 67108864 test_file.988
fallocate -l 67108864 test_file.989
fallocate -l 67108864 test_file.990
fallocate -l 67108864 test_file.991
fallocate -l 67108864 test_file.992
fallocate -l 67108864 test_file.993
fallocate -l 67108864 test_file.994
fallocate -l 67108864 test_file.995
fallocate -l 67108864 test_file.996
fallocate -l 67108864 test_file.997
fallocate -l 67108864 test_file.998
fallocate -l 67108864 test_file.999
fallocate -l 67108864 test_file.1000
fallocate -l 67108864 test_file.1001
fallocate -l 67108864 test_file.1002
fallocate -l 67108864 test_file.1003
fallocate -l 67108864 test_file.1004
fallocate -l 67108864 test_file.1005
fallocate -l 67108864 test_file.1006
fallocate -l 67108864 test_file.1007
fallocate -l 67108864 test_file.1008
fallocate -l 67108864 test_file.1009
fallocate -l 67108864 test_file.1010
fallocate -l 67108864 test_file.1011
fallocate -l 67108864 test_file.1012
fallocate -l 67108864 test_file.1013
fallocate -l 67108864 test_file.1014
fallocate -l 67108864 test_file.1015
fallocate -l 67108864 test_file.1016
fallocate -l 67108864 test_file.1017
fallocate -l 67108864 test_file.1018
fallocate -l 67108864 test_file.1019
fallocate -l 67108864 test_file.1020
fallocate -l 67108864 test_file.1021
fallocate -l 67108864 test_file.1022
fallocate -l 67108864 test_file.1023
sysbench --test=fileio --max-requests=0 --num-threads=4 --max-time=600 --file-test-mode=rndwr --file-total-size=68719476736 --file-io-mode=sync --file-num=1024 run

[-- Attachment #4: Type: text/plain, Size: 89 bytes --]

_______________________________________________
LKP mailing list
LKP@linux.intel.com
\r

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
  2015-03-18  8:20 [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec Huang Ying
@ 2015-03-18 10:05 ` Filipe Manana
  2015-03-31  8:32   ` Huang Ying
  0 siblings, 1 reply; 6+ messages in thread
From: Filipe Manana @ 2015-03-18 10:05 UTC (permalink / raw)
  To: Huang Ying; +Cc: Chris Mason, LKML, LKP ML



On 03/18/2015 08:20 AM, Huang Ying wrote:
> FYI, we noticed the below changes on
> 
> git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
> commit 3a8b36f378060d20062a0918e99fae39ff077bf0 ("Btrfs: fix data loss in the fast fsync path")
> 
> 
> testbox/testcase/testparams: lkp-sb02/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync
> 
> f5c0a122800c301e  3a8b36f378060d20062a0918e9  
> ----------------  --------------------------  
>          %stddev     %change         %stddev
>              \          |                \  
>      45.33 ±  0%     -62.6%      16.94 ±  0%  fileio.requests_per_sec
>     138983 ±  0%     +15.1%     160000 ±  0%  fileio.time.voluntary_context_switches
>      16035 ±  0%     +13.0%      18124 ±  0%  fileio.time.involuntary_context_switches
>    2504328 ±  0%      -7.2%    2324488 ±  0%  fileio.time.file_system_outputs
>       1.35 ±  1%      +2.8%       1.38 ±  0%  turbostat.CorWatt
>       0.77 ±  6%     +34.6%       1.03 ±  3%  turbostat.Pkg%pc3
>    7224199 ± 22%     -26.7%    5298697 ± 12%  cpuidle.C1-SNB.time
>    8377756 ±  1%     +15.7%    9690687 ±  4%  cpuidle.C3-SNB.time
>      16035 ±  0%     +13.0%      18124 ±  0%  time.involuntary_context_switches
>     138983 ±  0%     +15.1%     160000 ±  0%  time.voluntary_context_switches
>      45941 ±  0%     +11.0%      50983 ±  0%  softirqs.BLOCK
>      35635 ±  2%     +13.7%      40524 ±  2%  softirqs.RCU
>      26255 ±  1%     +10.5%      29017 ±  0%  softirqs.SCHED
>      50650 ±  2%     +11.3%      56371 ±  0%  softirqs.TIMER
>       3448 ±  0%      +1.6%       3503 ±  0%  vmstat.io.bo
>       4010 ±  0%      +2.7%       4119 ±  0%  vmstat.system.cs
>     294711 ±  1%     -17.1%     244365 ±  0%  meminfo.Active
>     275793 ±  2%     -18.1%     225971 ±  0%  meminfo.Active(file)
>      53614 ±  6%     +27.6%      68412 ± 15%  meminfo.DirectMap4k
>       3781 ±  0%     -46.9%       2006 ±  0%  meminfo.Dirty
>      47786 ±  0%     -14.7%      40780 ±  0%  meminfo.SReclaimable
>      66047 ±  0%     -10.7%      58973 ±  0%  meminfo.Slab
>      68947 ±  2%     -18.1%      56492 ±  0%  proc-vmstat.nr_active_file
>     337110 ±  0%     -10.0%     303330 ±  0%  proc-vmstat.nr_dirtied
>        944 ±  0%     -46.9%        501 ±  0%  proc-vmstat.nr_dirty
>      11946 ±  0%     -14.7%      10195 ±  0%  proc-vmstat.nr_slab_reclaimable
>     335424 ±  0%      -9.7%     302754 ±  0%  proc-vmstat.nr_written
>      55839 ±  3%     -15.0%      47438 ±  0%  proc-vmstat.pgactivate
>       1142 ±  5%     -16.2%        957 ± 17%  slabinfo.btrfs_delayed_ref_head.active_objs
>       1146 ±  5%     -16.0%        962 ± 17%  slabinfo.btrfs_delayed_ref_head.num_objs
>       1246 ±  6%     -29.4%        880 ± 15%  slabinfo.btrfs_delayed_tree_ref.active_objs
>       1246 ±  6%     -29.4%        880 ± 15%  slabinfo.btrfs_delayed_tree_ref.num_objs
>       2037 ±  2%     +60.0%       3260 ±  1%  slabinfo.btrfs_extent_buffer.num_objs
>       2023 ±  2%     +60.7%       3250 ±  1%  slabinfo.btrfs_extent_buffer.active_objs
>      13307 ±  0%     -57.7%       5634 ±  0%  slabinfo.btrfs_extent_state.num_objs
>        260 ±  0%     -57.8%        110 ±  0%  slabinfo.btrfs_extent_state.num_slabs
>      13292 ±  0%     -57.6%       5634 ±  0%  slabinfo.btrfs_extent_state.active_objs
>        260 ±  0%     -57.8%        110 ±  0%  slabinfo.btrfs_extent_state.active_slabs
>        713 ±  1%     -51.2%        348 ±  1%  slabinfo.btrfs_ordered_extent.active_objs
>        718 ±  1%     -48.1%        373 ±  1%  slabinfo.btrfs_ordered_extent.num_objs
>      26930 ±  0%     -57.1%      11557 ±  0%  slabinfo.btrfs_path.num_objs
>        961 ±  0%     -57.1%        412 ±  0%  slabinfo.btrfs_path.active_slabs
>        961 ±  0%     -57.1%        412 ±  0%  slabinfo.btrfs_path.num_slabs
>      26930 ±  0%     -57.1%      11557 ±  0%  slabinfo.btrfs_path.active_objs
>        789 ±  4%     -48.5%        406 ±  0%  slabinfo.ext4_extent_status.num_objs
>        789 ±  4%     -48.5%        406 ±  0%  slabinfo.ext4_extent_status.active_objs
>      26083 ±  0%     -28.3%      18697 ±  0%  slabinfo.radix_tree_node.num_objs
>      26083 ±  0%     -28.3%      18697 ±  0%  slabinfo.radix_tree_node.active_objs
>        931 ±  0%     -28.3%        667 ±  0%  slabinfo.radix_tree_node.active_slabs
>        931 ±  0%     -28.3%        667 ±  0%  slabinfo.radix_tree_node.num_slabs
>          4 ± 38%    +129.4%          9 ± 31%  sched_debug.cfs_rq[0]:/.runnable_load_avg
>         17 ± 32%     -54.9%          8 ± 45%  sched_debug.cfs_rq[3]:/.runnable_load_avg
>        385 ± 14%     -25.3%        287 ± 17%  sched_debug.cfs_rq[3]:/.load
>      51947 ±  3%     +15.4%      59938 ±  3%  sched_debug.cpu#0.nr_load_updates
>     200860 ±  5%     +11.6%     224079 ±  4%  sched_debug.cpu#1.ttwu_local
>      47218 ±  2%      +7.4%      50701 ±  2%  sched_debug.cpu#1.nr_load_updates
>          5 ± 37%    +105.0%         10 ± 26%  sched_debug.cpu#1.cpu_load[1]
>     226755 ±  4%     +11.4%     252611 ±  4%  sched_debug.cpu#1.ttwu_count
>       2500 ± 34%     -45.6%       1360 ± 33%  sched_debug.cpu#3.curr->pid
>        385 ± 14%     -25.8%        285 ± 16%  sched_debug.cpu#3.load
> 
> testbox/testcase/testparams: bay/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndrw-sync
> 
> f5c0a122800c301e  3a8b36f378060d20062a0918e9  
> ----------------  --------------------------  
>      62.17 ±  0%     -64.6%      22.03 ±  0%  fileio.requests_per_sec
>     712336 ±  0%     -64.2%     255005 ±  0%  fileio.time.file_system_inputs
>     712336 ±  0%     -64.2%     255005 ±  0%  time.file_system_inputs
>       0.73 ±  3%     -21.1%       0.58 ±  3%  time.user_time
>      46562 ±  0%     +29.5%      60303 ±  1%  softirqs.RCU
>      57662 ±  0%     +16.7%      67299 ±  0%  softirqs.SCHED
>        259 ±  0%     -64.3%         92 ±  0%  vmstat.io.bi
>       3638 ±  1%     -10.1%       3272 ±  2%  meminfo.Dirty
>        432 ±  8%     -25.8%        320 ± 28%  proc-vmstat.allocstall
>        253 ±  9%     -21.9%        197 ± 19%  proc-vmstat.compact_fail
>        506 ±  8%     -17.8%        416 ± 14%  proc-vmstat.compact_stall
>      11262 ±  3%     -20.1%       8996 ±  2%  proc-vmstat.kswapd_low_wmark_hit_quickly
>        910 ±  1%     -10.5%        815 ±  0%  proc-vmstat.nr_dirty
>      17652 ±  2%     -16.0%      14833 ±  3%  proc-vmstat.pageoutrun
>      59446 ±  0%     -20.2%      47455 ±  0%  proc-vmstat.pgactivate
>     169701 ±  0%     +11.5%     189186 ±  5%  proc-vmstat.pgmigrate_success
>     355946 ±  0%     -64.2%     127593 ±  0%  proc-vmstat.pgpgin
>      27402 ±  7%     -23.9%      20844 ± 29%  proc-vmstat.pgsteal_direct_dma32
>       4868 ±  0%     -56.8%       2104 ±  1%  proc-vmstat.workingset_refault
>       1624 ±  3%      -5.7%       1530 ±  1%  slabinfo.Acpi-ParseExt.active_objs
>       1624 ±  3%      -5.7%       1530 ±  1%  slabinfo.Acpi-ParseExt.num_objs
>       1009 ±  6%     -28.6%        720 ± 17%  slabinfo.btrfs_delayed_data_ref.active_objs
>       1016 ±  6%     -28.5%        726 ± 16%  slabinfo.btrfs_delayed_data_ref.num_objs
>        849 ±  0%     -10.3%        761 ±  4%  slabinfo.btrfs_delayed_ref_head.active_objs
>        851 ±  0%      -9.9%        767 ±  4%  slabinfo.btrfs_delayed_ref_head.num_objs
>      10883 ±  1%     -47.5%       5709 ±  4%  slabinfo.btrfs_extent_state.num_objs
>        213 ±  1%     -47.6%        111 ±  4%  slabinfo.btrfs_extent_state.num_slabs
>      10794 ±  1%     -48.6%       5551 ±  3%  slabinfo.btrfs_extent_state.active_objs
>        213 ±  1%     -47.6%        111 ±  4%  slabinfo.btrfs_extent_state.active_slabs
>       6596 ±  0%     -58.5%       2735 ±  1%  slabinfo.btrfs_path.num_objs
>        235 ±  0%     -58.6%         97 ±  1%  slabinfo.btrfs_path.active_slabs
>        235 ±  0%     -58.6%         97 ±  1%  slabinfo.btrfs_path.num_slabs
>       6592 ±  0%     -58.6%       2731 ±  1%  slabinfo.btrfs_path.active_objs
>       5055 ±  6%      -9.0%       4601 ±  2%  slabinfo.kmalloc-32.num_objs
>       5055 ±  6%      -9.0%       4601 ±  2%  slabinfo.kmalloc-32.active_objs
>       1512 ±  2%     -12.2%       1328 ±  5%  slabinfo.kmalloc-96.num_objs
>       1512 ±  2%     -12.2%       1328 ±  5%  slabinfo.kmalloc-96.active_objs
>        459 ±  2%     -16.8%        382 ±  6%  sched_debug.cfs_rq[0]:/.blocked_load_avg
>        478 ±  1%     -15.6%        403 ±  5%  sched_debug.cfs_rq[0]:/.tg_load_contrib
>         49 ±  7%      -9.1%         45 ± 11%  sched_debug.cfs_rq[3]:/.tg_runnable_contrib
>       2337 ±  6%      -9.9%       2106 ± 11%  sched_debug.cfs_rq[3]:/.avg->runnable_avg_sum
>      25079 ±  3%     -10.1%      22542 ±  4%  sched_debug.cfs_rq[3]:/.exec_clock
>         28 ± 17%     -35.7%         18 ±  9%  sched_debug.cfs_rq[3]:/.nr_spread_over
>     499222 ± 12%     -59.7%     201330 ± 40%  sched_debug.cpu#0.sched_goidle
>    1018389 ± 12%     -58.2%     425747 ± 37%  sched_debug.cpu#0.nr_switches
>      90529 ±  4%     -17.6%      74603 ±  8%  sched_debug.cpu#0.nr_load_updates
>     513982 ± 13%     -56.9%     221386 ± 36%  sched_debug.cpu#0.ttwu_count
>    1019018 ± 12%     -58.2%     426387 ± 37%  sched_debug.cpu#0.sched_count
>        320 ±  3%     -14.3%        274 ± 13%  sched_debug.cpu#0.load
>     323974 ± 21%    +131.6%     750473 ± 12%  sched_debug.cpu#1.sched_count
>     323373 ± 21%    +131.9%     749837 ± 12%  sched_debug.cpu#1.nr_switches
>      89555 ± 46%    +230.0%     295518 ± 16%  sched_debug.cpu#1.ttwu_local
>         13 ± 30%     +59.0%         20 ±  8%  sched_debug.cpu#1.cpu_load[2]
>          8 ± 41%    +111.8%         18 ± 12%  sched_debug.cpu#1.cpu_load[4]
>      68535 ±  4%     +22.2%      83732 ±  1%  sched_debug.cpu#1.nr_load_updates
>         10 ± 33%     +84.1%         19 ±  9%  sched_debug.cpu#1.cpu_load[3]
>     160382 ± 16%    +122.7%     357238 ± 12%  sched_debug.cpu#1.ttwu_count
>     151508 ± 22%    +140.8%     364820 ± 12%  sched_debug.cpu#1.sched_goidle
>     388481 ±  2%     -42.8%     222376 ± 46%  sched_debug.cpu#2.ttwu_local
>      87970 ±  3%      -6.8%      81971 ±  6%  sched_debug.cpu#2.nr_load_updates
>     452753 ±  3%     -37.3%     283785 ± 36%  sched_debug.cpu#2.ttwu_count
>     916511 ±  5%     -36.7%     580526 ± 36%  sched_debug.cpu#2.nr_switches
>     917118 ±  5%     -36.6%     581168 ± 36%  sched_debug.cpu#2.sched_count
>     448592 ±  5%     -37.9%     278755 ± 38%  sched_debug.cpu#2.sched_goidle
>     140376 ±  7%    +179.3%     392097 ± 28%  sched_debug.cpu#3.sched_goidle
>      68344 ±  2%     +24.1%      84790 ±  8%  sched_debug.cpu#3.nr_load_updates
>      78592 ± 33%    +335.3%     342125 ± 33%  sched_debug.cpu#3.ttwu_local
>     300663 ±  7%    +168.1%     806077 ± 27%  sched_debug.cpu#3.sched_count
>     149690 ± 12%    +182.2%     422447 ± 26%  sched_debug.cpu#3.ttwu_count
>     300054 ±  7%    +168.5%     805498 ± 27%  sched_debug.cpu#3.nr_switches
> 
> testbox/testcase/testparams: bay/fileio/performance-600s-100%-1HDD-btrfs-64G-1024f-rndwr-sync
> 
> f5c0a122800c301e  3a8b36f378060d20062a0918e9  
> ----------------  --------------------------  
>       1.32 ±  6%   +8834.3%     117.71 ±171%  fileio.request_latency_max_ms
>      44.70 ±  0%     -56.7%      19.35 ±  0%  fileio.requests_per_sec
>     156010 ±  0%     +38.4%     215846 ±  0%  fileio.time.voluntary_context_switches
>    2663864 ±  0%      -6.2%    2499112 ±  0%  fileio.time.file_system_outputs
>     156010 ±  0%     +38.4%     215846 ±  0%  time.voluntary_context_switches
>      39761 ±  1%     +22.5%      48712 ±  2%  softirqs.RCU
>      37048 ±  1%     +17.1%      43380 ±  2%  softirqs.SCHED
>      52147 ±  1%     +15.3%      60140 ±  1%  softirqs.TIMER
>       2142 ±  0%      +4.6%       2239 ±  0%  vmstat.system.in
>       4067 ±  0%      +5.9%       4307 ±  0%  vmstat.system.cs
>     315172 ±  0%     -13.9%     271267 ±  0%  meminfo.Active
>     296097 ±  0%     -14.5%     253063 ±  0%  meminfo.Active(file)
>       3678 ±  0%     -42.1%       2131 ±  1%  meminfo.Dirty
>      47204 ±  0%     -14.5%      40351 ±  0%  meminfo.SReclaimable
>      64571 ±  0%     -10.7%      57634 ±  0%  meminfo.Slab
>      74024 ±  0%     -14.5%      63263 ±  0%  proc-vmstat.nr_active_file
>        919 ±  0%     -42.1%        532 ±  1%  proc-vmstat.nr_dirty
>      11801 ±  0%     -14.5%      10087 ±  0%  proc-vmstat.nr_slab_reclaimable
>      59906 ±  0%     -25.1%      44895 ±  0%  proc-vmstat.pgactivate
>       1971 ±  5%      -8.0%       1814 ±  3%  slabinfo.anon_vma.active_objs
>       1971 ±  5%      -8.0%       1814 ±  3%  slabinfo.anon_vma.num_objs
>       1759 ±  7%     -17.1%       1457 ±  5%  slabinfo.btrfs_delayed_data_ref.active_objs
>       1768 ±  7%     -17.2%       1464 ±  5%  slabinfo.btrfs_delayed_data_ref.num_objs
>       1081 ± 15%     -41.9%        628 ± 11%  slabinfo.btrfs_delayed_tree_ref.active_objs
>       1082 ± 15%     -41.9%        628 ± 11%  slabinfo.btrfs_delayed_tree_ref.num_objs
>       2313 ±  1%     -21.9%       1805 ±  0%  slabinfo.btrfs_extent_buffer.num_objs
>       2301 ±  1%     -22.1%       1792 ±  0%  slabinfo.btrfs_extent_buffer.active_objs
>      13162 ±  0%     -51.8%       6341 ±  0%  slabinfo.btrfs_extent_state.num_objs
>        257 ±  0%     -51.9%        123 ±  0%  slabinfo.btrfs_extent_state.num_slabs
>      13152 ±  0%     -51.8%       6341 ±  0%  slabinfo.btrfs_extent_state.active_objs
>        257 ±  0%     -51.9%        123 ±  0%  slabinfo.btrfs_extent_state.active_slabs
>        715 ±  0%     -46.2%        385 ±  5%  slabinfo.btrfs_ordered_extent.active_objs
>        720 ±  0%     -43.4%        408 ±  5%  slabinfo.btrfs_ordered_extent.num_objs
>      26591 ±  0%     -51.4%      12924 ±  0%  slabinfo.btrfs_path.num_objs
>        949 ±  0%     -51.4%        461 ±  0%  slabinfo.btrfs_path.active_slabs
>        949 ±  0%     -51.4%        461 ±  0%  slabinfo.btrfs_path.num_slabs
>      26591 ±  0%     -51.4%      12924 ±  0%  slabinfo.btrfs_path.active_objs
>        670 ±  8%     -39.2%        407 ±  0%  slabinfo.ext4_extent_status.num_objs
>        670 ±  8%     -39.2%        407 ±  0%  slabinfo.ext4_extent_status.active_objs
>        503 ±  6%     -13.2%        437 ±  8%  slabinfo.mnt_cache.active_objs
>        522 ±  7%     -13.4%        452 ±  6%  slabinfo.mnt_cache.num_objs
>      26243 ±  0%     -26.8%      19212 ±  0%  slabinfo.radix_tree_node.num_objs
>      26243 ±  0%     -26.8%      19212 ±  0%  slabinfo.radix_tree_node.active_objs
>        937 ±  0%     -26.8%        685 ±  0%  slabinfo.radix_tree_node.active_slabs
>        937 ±  0%     -26.8%        685 ±  0%  slabinfo.radix_tree_node.num_slabs
> 
> lkp-sb02: Sandy Bridge-EP
> Memory: 4G
> 
> bay: Pentium D
> Memory: 2G
> 
> 
> 
> 
>                              fileio.requests_per_sec
> 
>   50 ++---------------------------------------------------------------------+
>      |                                                                      |
>   45 *+.*..*...*..*..*..*...*..*..*..*...*..*..*..*..*...*..*..*..*...*..*..*
>   40 ++                                                                     |
>      |                                                                      |
>   35 ++                                                                     |
>      |                                                                      |
>   30 ++                                                                     |
>      |                                                                      |
>   25 ++                                                                     |
>   20 ++                                                                     |
>      O         O        O   O     O                                         |
>   15 ++ O  O      O            O     O   O  O  O  O  O   O  O  O            |
>      |                                                                      |
>   10 ++--------------O------------------------------------------------------+
> 
> 
>                             fileio.time.file_system_outputs
> 
>   2.6e+06 ++----------------------------------------------------------------+
>   2.5e+06 *+.*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
>           |                                                                 |
>   2.4e+06 O+ O  O  O        O  O           O     O           O  O           |
>   2.3e+06 ++          O           O  O  O     O     O  O  O                 |
>   2.2e+06 ++                                                                |
>   2.1e+06 ++                                                                |
>           |                                                                 |
>     2e+06 ++                                                                |
>   1.9e+06 ++                                                                |
>   1.8e+06 ++                                                                |
>   1.7e+06 ++                                                                |
>           |                                                                 |
>   1.6e+06 ++             O                                                  |
>   1.5e+06 ++----------------------------------------------------------------+
> 
> 
>                              proc-vmstat.nr_active_file
> 
>   75000 ++------------------------------------------------------------------+
>         |                                                                   |
>   70000 ++                                                              .*..|
>         *..*..*..*..*..*...*..*..*..*..*..*..*..  .*..  .*...*..*..*..*.    *
>         |                                       *.    *.                    |
>   65000 ++                                                                  |
>         |                                                                   |
>   60000 ++                                                                  |
>         |                              O              O                     |
>   55000 O+ O  O  O  O      O  O  O  O     O  O  O  O     O   O  O           |
>         |                                                                   |
>         |                                                                   |
>   50000 ++             O                                                    |
>         |                                                                   |
>   45000 ++------------------------------------------------------------------+
> 
> 
>                                proc-vmstat.nr_dirty
> 
>   1000 ++-------------------------------------------------------------------+
>        *..*..*..*...*..*..*..*..*..*..*...  .*..  .*..  .*..*..*...*..*..*..*
>    900 ++                                 *.    *.    *.                    |
>        |                                                                    |
>    800 ++                                                                   |
>        |                                                                    |
>    700 ++                                                                   |
>        |                                                                    |
>    600 ++                                                                   |
>        |                                                                    |
>    500 O+ O  O  O   O     O  O  O  O  O   O  O  O  O  O  O  O  O            |
>        |                                                                    |
>    400 ++              O                                                    |
>        |                                                                    |
>    300 ++-------------------------------------------------------------------+
> 
> 
>                            proc-vmstat.nr_slab_reclaimable
> 
>   12000 ++--------------------------*--*-----*-----*-----*---*-----*--*-----*
>         |                         ..      *.     ..    ..       *.       *. |
>         *..*..*..*..*..*...*..*..*              *     *                     |
>   11500 ++                                                                  |
>         |                                                                   |
>         |                                                                   |
>   11000 ++                                                                  |
>         |                                                                   |
>   10500 ++                                                                  |
>         |                                                                   |
>         |                                 O  O  O  O  O  O   O  O           |
>   10000 ++    O               O                                             |
>         O  O     O  O      O     O  O  O                                    |
>         |                                                                   |
>    9500 ++-------------O----------------------------------------------------+
> 
> 
>                                proc-vmstat.nr_dirtied
> 
>   340000 *+-*--*--*--*--*--*--*--*--*--*---*--*--*--*--*--*--*--*--*--*--*--*
>          |                                                                  |
>   320000 ++                                                                 |
>          |                 O                                                |
>   300000 O+ O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
>          |                                                                  |
>   280000 ++                                                                 |
>          |                                                                  |
>   260000 ++                                                                 |
>          |                                                                  |
>   240000 ++                                                                 |
>          |                                                                  |
>   220000 ++                                                                 |
>          |                                                                  |
>   200000 ++-------------O---------------------------------------------------+
> 
> 
>                                proc-vmstat.nr_written
> 
>   340000 ++-*-----*--------*------------------*--*--*--*-----*--*--*--*-----*
>          *.    *.    *..*.    *..*..*..*...*.             *.             *. |
>   320000 ++                                                                 |
>          |                                                                  |
>   300000 O+ O  O  O  O     O  O  O  O  O   O  O  O  O  O  O  O  O           |
>          |                                                                  |
>   280000 ++                                                                 |
>          |                                                                  |
>   260000 ++                                                                 |
>          |                                                                  |
>   240000 ++                                                                 |
>          |                                                                  |
>   220000 ++                                                                 |
>          |                                                                  |
>   200000 ++-------------O---------------------------------------------------+
> 
> 
>                                proc-vmstat.pgactivate
> 
>   60000 ++---------------------------------------------------------------*--+
>         |                                                              ..   |
>   55000 *+.*..*..*..*..*...*..*..*..*..*..*..*..*..*..*..*...*..*..*..*     *
>         |                                                                   |
>   50000 ++                                                                  |
>         O  O  O  O  O         O  O  O  O  O  O  O  O  O  O   O  O           |
>   45000 ++                 O                                                |
>         |                                                                   |
>   40000 ++                                                                  |
>         |                                                                   |
>   35000 ++                                                                  |
>         |                                                                   |
>   30000 ++             O                                                    |
>         |                                                                   |
>   25000 ++------------------------------------------------------------------+
> 
> 
>                                    meminfo.Active
> 
>   310000 ++-----------------------------------------------------------------+
>   300000 ++                                                              *..|
>          | .*..*..*..*..              .*...  .*..         *..          ..   *
>   290000 *+             *..*..*..*..*.     *.      .*.. ..   *..*..*..*     |
>   280000 ++                                      *.    *                    |
>          |                                                                  |
>   270000 ++                                                                 |
>   260000 ++                                                                 |
>   250000 ++                                                                 |
>          O  O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
>   240000 ++                O                                                |
>   230000 ++                                                                 |
>          |                                                                  |
>   220000 ++             O                                                   |
>   210000 ++-----------------------------------------------------------------+
> 
> 
>                                 meminfo.Active(file)
> 
>   290000 ++-----------------------------------------------------------------+
>   280000 ++                                                              *..|
>          | .*..*..*..*..*..*..*..*..*..*...  .*..         *..*..       ..   *
>   270000 *+                                *.    *..*.. ..      *..*..*     |
>   260000 ++                                            *                    |
>          |                                                                  |
>   250000 ++                                                                 |
>   240000 ++                                                                 |
>   230000 ++                                                                 |
>          O  O  O  O  O        O  O  O  O   O  O  O  O  O  O  O  O           |
>   220000 ++                O                                                |
>   210000 ++                                                                 |
>          |                                                                  |
>   200000 ++             O                                                   |
>   190000 ++-----------------------------------------------------------------+
> 
> 
>                                    meminfo.Dirty
> 
>   4000 ++-------------------------------------------------------------------+
>        *..*..*..*...*..*..*..*..*..*..*...  .*..        .*..*..*...*..*..*..*
>        |                                  *.    *..*..*.                    |
>   3500 ++                                                                   |
>        |                                                                    |
>        |                                                                    |
>   3000 ++                                                                   |
>        |                                                                    |
>   2500 ++                                                                   |
>        |                                                                    |
>        |                                                                    |
>   2000 O+ O  O  O   O     O  O  O  O  O   O  O  O  O  O  O  O  O            |
>        |                                                                    |
>        |                                                                    |
>   1500 ++--------------O----------------------------------------------------+
> 
> 
>                                     meminfo.Slab
> 
>   67000 ++------------------------------------------------------------------+
>   66000 ++                          *..*..  .*..   *..     ..*..  .*..  .*..*
>         |                         ..      *.     ..     .*.     *.    *.    |
>   65000 *+.*..*..*..*..*...*..*..*              *     *.                    |
>   64000 ++                                                                  |
>   63000 ++                                                                  |
>   62000 ++                                                                  |
>         |                                                                   |
>   61000 ++                                                                  |
>   60000 ++                                                                  |
>   59000 ++                       O        O  O  O  O  O  O   O  O           |
>   58000 ++ O  O               O        O                                    |
>         O        O  O      O        O                                       |
>   57000 ++             O                                                    |
>   56000 ++------------------------------------------------------------------+
> 
> 
>                                 meminfo.SReclaimable
> 
>   48000 ++--------------------------*--*-----*-----*-----*---*-----*--*-----*
>   47000 ++                        ..      *.     ..    ..       *.       *. |
>         *..*..*..*..*..*...*..*..*              *     *                     |
>   46000 ++                                                                  |
>   45000 ++                                                                  |
>         |                                                                   |
>   44000 ++                                                                  |
>   43000 ++                                                                  |
>   42000 ++                                                                  |
>         |                                                                   |
>   41000 ++                                O  O  O  O  O  O   O  O           |
>   40000 ++    O               O                                             |
>         O  O     O  O      O     O  O  O                                    |
>   39000 ++                                                                  |
>   38000 ++-------------O----------------------------------------------------+
> 
> 
> 	[*] bisect-good sample
> 	[O] bisect-bad  sample
> 
> To reproduce:
> 
> 	apt-get install ruby
> 	git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
> 	cd lkp-tests
> 	bin/setup-local job.yaml # the job file attached in this email
> 	bin/run-local   job.yaml

Hi, thanks for this.

However this doesn't make sense to me.
This commit only touches btrfs' fsync handler and the test uses sysbench
without passing --file-fsync-freq to it, which means sysbench will never
do fsyncs according to its man page (default for fsync frequency is 0).

Or maybe I missed something?

thanks


> 
> 
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
> 
> 
> Thanks,
> Ying Huang
> 
> 
> 
> _______________________________________________
> LKP mailing list
> LKP@linux.intel.com
> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
  2015-03-18 10:05 ` Filipe Manana
@ 2015-03-31  8:32   ` Huang Ying
  2015-03-31 14:59     ` Filipe Manana
  0 siblings, 1 reply; 6+ messages in thread
From: Huang Ying @ 2015-03-31  8:32 UTC (permalink / raw)
  To: Filipe Manana; +Cc: Chris Mason, LKML, LKP ML

Hi, Filipe,

On Wed, 2015-03-18 at 10:05 +0000, Filipe Manana wrote:
[snip]

> Hi, thanks for this.
> 
> However this doesn't make sense to me.
> This commit only touches btrfs' fsync handler and the test uses sysbench
> without passing --file-fsync-freq to it, which means sysbench will never
> do fsyncs according to its man page (default for fsync frequency is 0).
> 
> Or maybe I missed something?

Sorry for late.

I checked source code of sysbench and found that the actual default
value of --file-fsync-freq is 100 instead of 0 in man page, as in the
following lines.

  {"file-fsync-freq", "do fsync() after this number of requests (0 - don't use fsync())",
   SB_ARG_TYPE_INT, "100"},

I double checked that via a debug patch to sysbench too.

Best Regards,
Huang, Ying



^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
  2015-03-31  8:32   ` Huang Ying
@ 2015-03-31 14:59     ` Filipe Manana
  2015-04-01  4:59       ` Huang Ying
  0 siblings, 1 reply; 6+ messages in thread
From: Filipe Manana @ 2015-03-31 14:59 UTC (permalink / raw)
  To: Huang Ying; +Cc: Chris Mason, LKML, LKP ML



On 03/31/2015 09:32 AM, Huang Ying wrote:
> Hi, Filipe,
> 
> On Wed, 2015-03-18 at 10:05 +0000, Filipe Manana wrote:
> [snip]
> 
>> Hi, thanks for this.
>>
>> However this doesn't make sense to me.
>> This commit only touches btrfs' fsync handler and the test uses sysbench
>> without passing --file-fsync-freq to it, which means sysbench will never
>> do fsyncs according to its man page (default for fsync frequency is 0).
>>
>> Or maybe I missed something?
> 
> Sorry for late.
> 
> I checked source code of sysbench and found that the actual default
> value of --file-fsync-freq is 100 instead of 0 in man page, as in the
> following lines.
> 
>   {"file-fsync-freq", "do fsync() after this number of requests (0 - don't use fsync())",
>    SB_ARG_TYPE_INT, "100"},
> 
> I double checked that via a debug patch to sysbench too.

Ok, thanks for checking that.
What the 100 means is that an fsync is done after every 100 requests
(both writes and reads I assume).

The patch removed an optimization where we would not do any IO if no new
data was written to the file between 2 consecutive fsync requests and if
a btrfs transaction was committed between the 2 fsync requests as well
(by default it happens about every 30 seconds, changeable with -o
commit=xx). Which I think it's a rare/uncommon scenario.

With that optimization removed, the inode's metadata data is always
synced to disk

I've just tested on kvm guest with a debug kernel and got similar
decrease of file io requests as you reported.

The following brought back the performance for me (without reverting the
data loss fix from 3a8b36f37806 of course). Can you give it a try? 
Thanks.


From: Filipe Manana <fdmanana@suse.com>
Date: Tue, 31 Mar 2015 14:16:52 +0100
Subject: [PATCH] Btrfs: avoid syncing log in the fast fsync path when not
 necessary

Commit 3a8b36f37806 ("Btrfs: fix data loss in the fast fsync path") added
a performance regression for that causes an unnecessary sync of the log
trees (fs/subvol and root log trees) when 2 consecutive fsyncs are done
against a file, without no writes or any metadata updates to the inode in
between them and if a transaction is committed before the second fsync is
called.

Huang Ying reported this to lkml after a test sysbench test that measured
a -62% decrease of file io requests for that tests' workload.

The test is:

  echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
  echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
  echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
  echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
  mkfs -t btrfs /dev/sda2
  mount -t btrfs /dev/sda2 /fs/sda2
  cd /fs/sda2
  for ((i = 0; i < 1024; i++)); do fallocate -l 67108864 testfile.$i; done
  sysbench --test=fileio --max-requests=0 --num-threads=4 --max-time=600 \
    --file-test-mode=rndwr --file-total-size=68719476736 --file-io-mode=sync \
    --file-num=1024 run

A test on kvm guest, running a debug kernel gave me the following results:

Without 3a8b36f378060d:             16.01 reqs/sec
With 3a8b36f378060d:                 3.39 reqs/sec
With 3a8b36f378060d and this patch: 16.04 reqs/sec

Reported-by: Huang Ying <ying.huang@intel.com>
Signed-off-by: Filipe Manana <fdmanana@suse.com>
---
 fs/btrfs/file.c         |  9 ++++++---
 fs/btrfs/ordered-data.c | 14 ++++++++++++++
 fs/btrfs/ordered-data.h |  3 +++
 3 files changed, 23 insertions(+), 3 deletions(-)

diff --git a/fs/btrfs/file.c b/fs/btrfs/file.c
index 309dd57..379275c 100644
--- a/fs/btrfs/file.c
+++ b/fs/btrfs/file.c
@@ -1878,6 +1878,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)
 	struct btrfs_log_ctx ctx;
 	int ret = 0;
 	bool full_sync = 0;
+	const u64 len = end - start + 1;
 
 	trace_btrfs_sync_file(file, datasync);
 
@@ -1906,7 +1907,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)
 		 * all extents are persisted and the respective file extent
 		 * items are in the fs/subvol btree.
 		 */
-		ret = btrfs_wait_ordered_range(inode, start, end - start + 1);
+		ret = btrfs_wait_ordered_range(inode, start, len);
 	} else {
 		/*
 		 * Start any new ordered operations before starting to log the
@@ -1978,8 +1979,10 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)
 	 */
 	smp_mb();
 	if (btrfs_inode_in_log(inode, root->fs_info->generation) ||
-	    (full_sync && BTRFS_I(inode)->last_trans <=
-	     root->fs_info->last_trans_committed)) {
+	    (BTRFS_I(inode)->last_trans <=
+	     root->fs_info->last_trans_committed &&
+	     (full_sync ||
+	      !btrfs_have_ordered_extents_in_range(inode, start, len)))) {
 		/*
 		 * We'v had everything committed since the last time we were
 		 * modified so clear this flag in case it was set for whatever
diff --git a/fs/btrfs/ordered-data.c b/fs/btrfs/ordered-data.c
index 157cc54..72b6f0d 100644
--- a/fs/btrfs/ordered-data.c
+++ b/fs/btrfs/ordered-data.c
@@ -838,6 +838,20 @@ out:
 	return entry;
 }
 
+bool btrfs_have_ordered_extents_in_range(struct inode *inode,
+					 u64 file_offset,
+					 u64 len)
+{
+	struct btrfs_ordered_extent *oe;
+
+	oe = btrfs_lookup_ordered_range(inode, file_offset, len);
+	if (oe) {
+		btrfs_put_ordered_extent(oe);
+		return true;
+	}
+	return false;
+}
+
 /*
  * lookup and return any extent before 'file_offset'.  NULL is returned
  * if none is found
diff --git a/fs/btrfs/ordered-data.h b/fs/btrfs/ordered-data.h
index e96cd4c..9ba7209 100644
--- a/fs/btrfs/ordered-data.h
+++ b/fs/btrfs/ordered-data.h
@@ -191,6 +191,9 @@ btrfs_lookup_first_ordered_extent(struct inode * inode, u64 file_offset);
 struct btrfs_ordered_extent *btrfs_lookup_ordered_range(struct inode *inode,
 							u64 file_offset,
 							u64 len);
+bool btrfs_have_ordered_extents_in_range(struct inode *inode,
+					 u64 file_offset,
+					 u64 len);
 int btrfs_ordered_update_i_size(struct inode *inode, u64 offset,
 				struct btrfs_ordered_extent *ordered);
 int btrfs_find_ordered_sum(struct inode *inode, u64 offset, u64 disk_bytenr,
-- 
2.1.3





^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
  2015-03-31 14:59     ` Filipe Manana
@ 2015-04-01  4:59       ` Huang Ying
  2015-04-01  9:56         ` Filipe Manana
  0 siblings, 1 reply; 6+ messages in thread
From: Huang Ying @ 2015-04-01  4:59 UTC (permalink / raw)
  To: Filipe Manana; +Cc: Chris Mason, LKML, LKP ML

On Tue, 2015-03-31 at 15:59 +0100, Filipe Manana wrote:

[snip]

> From: Filipe Manana <fdmanana@suse.com>
> Date: Tue, 31 Mar 2015 14:16:52 +0100
> Subject: [PATCH] Btrfs: avoid syncing log in the fast fsync path when not
>  necessary
> 
> Commit 3a8b36f37806 ("Btrfs: fix data loss in the fast fsync path") added
> a performance regression for that causes an unnecessary sync of the log
> trees (fs/subvol and root log trees) when 2 consecutive fsyncs are done
> against a file, without no writes or any metadata updates to the inode in
> between them and if a transaction is committed before the second fsync is
> called.
> 
> Huang Ying reported this to lkml after a test sysbench test that measured
> a -62% decrease of file io requests for that tests' workload.
> 
> The test is:
> 
>   echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
>   echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
>   echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
>   echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
>   mkfs -t btrfs /dev/sda2
>   mount -t btrfs /dev/sda2 /fs/sda2
>   cd /fs/sda2
>   for ((i = 0; i < 1024; i++)); do fallocate -l 67108864 testfile.$i; done
>   sysbench --test=fileio --max-requests=0 --num-threads=4 --max-time=600 \
>     --file-test-mode=rndwr --file-total-size=68719476736 --file-io-mode=sync \
>     --file-num=1024 run
> 
> A test on kvm guest, running a debug kernel gave me the following results:
> 
> Without 3a8b36f378060d:             16.01 reqs/sec
> With 3a8b36f378060d:                 3.39 reqs/sec
> With 3a8b36f378060d and this patch: 16.04 reqs/sec
> 
> Reported-by: Huang Ying <ying.huang@intel.com>

I have tested your patch, the regression restored in our test.  Thanks!

Tested-by: Huang, Ying <ying.huang@intel.com>

Best Regards,
Huang, Ying

[snip]



^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec
  2015-04-01  4:59       ` Huang Ying
@ 2015-04-01  9:56         ` Filipe Manana
  0 siblings, 0 replies; 6+ messages in thread
From: Filipe Manana @ 2015-04-01  9:56 UTC (permalink / raw)
  To: Huang Ying; +Cc: Chris Mason, LKML, LKP ML



On 04/01/2015 05:59 AM, Huang Ying wrote:
> On Tue, 2015-03-31 at 15:59 +0100, Filipe Manana wrote:
> 
> [snip]
> 
>> From: Filipe Manana <fdmanana@suse.com>
>> Date: Tue, 31 Mar 2015 14:16:52 +0100
>> Subject: [PATCH] Btrfs: avoid syncing log in the fast fsync path when not
>>  necessary
>>
>> Commit 3a8b36f37806 ("Btrfs: fix data loss in the fast fsync path") added
>> a performance regression for that causes an unnecessary sync of the log
>> trees (fs/subvol and root log trees) when 2 consecutive fsyncs are done
>> against a file, without no writes or any metadata updates to the inode in
>> between them and if a transaction is committed before the second fsync is
>> called.
>>
>> Huang Ying reported this to lkml after a test sysbench test that measured
>> a -62% decrease of file io requests for that tests' workload.
>>
>> The test is:
>>
>>   echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
>>   echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
>>   echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
>>   echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
>>   mkfs -t btrfs /dev/sda2
>>   mount -t btrfs /dev/sda2 /fs/sda2
>>   cd /fs/sda2
>>   for ((i = 0; i < 1024; i++)); do fallocate -l 67108864 testfile.$i; done
>>   sysbench --test=fileio --max-requests=0 --num-threads=4 --max-time=600 \
>>     --file-test-mode=rndwr --file-total-size=68719476736 --file-io-mode=sync \
>>     --file-num=1024 run
>>
>> A test on kvm guest, running a debug kernel gave me the following results:
>>
>> Without 3a8b36f378060d:             16.01 reqs/sec
>> With 3a8b36f378060d:                 3.39 reqs/sec
>> With 3a8b36f378060d and this patch: 16.04 reqs/sec
>>
>> Reported-by: Huang Ying <ying.huang@intel.com>
> 
> I have tested your patch, the regression restored in our test.  Thanks!
> 
> Tested-by: Huang, Ying <ying.huang@intel.com>

Thank you very much for testing it and the report.
I'll now send the exact same patch, with your Tested-by tag, to the
btrfs mailing list, so that Chris can pick it from patchwork and can
more easily be noticed by the btrfs community (for review, test, etc).

regards,
Filipe Manana

> 
> Best Regards,
> Huang, Ying
> 
> [snip]
> 
> 
> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2015-04-01  9:56 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-03-18  8:20 [LKP] [Btrfs] 3a8b36f3780: -62.6% fileio.requests_per_sec Huang Ying
2015-03-18 10:05 ` Filipe Manana
2015-03-31  8:32   ` Huang Ying
2015-03-31 14:59     ` Filipe Manana
2015-04-01  4:59       ` Huang Ying
2015-04-01  9:56         ` Filipe Manana

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).