LKML Archive on
help / color / mirror / Atom feed
From: Chris Snook <>
To: Martin Knoblauch <>
Subject: Re: Strange NFS write performance Linux->Solaris-10/VXFS, maybe VW related
Date: Fri, 28 Dec 2007 13:45:13 -0500	[thread overview]
Message-ID: <> (raw)
In-Reply-To: <>

Martin Knoblauch wrote:
> Hi,
> currently I am tracking down an "interesting" effect when writing to a
> Solars-10/Sparc based server. The server exports two filesystems. One UFS,
> one VXFS. The filesystems are mounted NFS3/TCP, no special options. Linux
> kernel in question is 2.6.24-rc6, but it happens with earlier kernels
> (, as well. The client is x86_64 with 8 GB of ram.
> The problem: when writing to the VXFS based filesystem, performance drops
> dramatically when the the filesize reaches or exceeds "dirty_ratio". For a
> dirty_ratio of 10% (about 800MB) files below 750 MB are transfered with about
> 30 MB/sec. Anything above 770 MB drops down to below 10 MB/sec. If I perform
> the same tests on the UFS based FS, performance stays at about 30 MB/sec
> until 3GB and likely larger (I just stopped at 3 GB).
> Any ideas what could cause this difference? Any suggestions on debugging it?

1) Try normal NFS tuning, such as rsize/wsize tuning.

2) You're entering synchronous writeback mode, so you can delay the problem by 
raising dirty_ratio to 100, or reduce the size of the problem by lowering 
dirty_ratio to 1.  Either one could help.

3) It sounds like the bottleneck is the vxfs filesystem.  It only *appears* on 
the client side because writes up until dirty_ratio get buffered on the client. 
  If you can confirm that the server is actually writing stuff to disk slower 
when the client is in writeback mode, then it's possible the Linux NFS client is 
doing something inefficient in writeback mode.

	-- Chris

  reply	other threads:[~2007-12-28 18:45 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-12-28 15:24 Strange NFS write performance Linux->Solaris-10/VXFS, maybe VW related Martin Knoblauch
2007-12-28 18:45 ` Chris Snook [this message]
2007-12-29  9:59 Martin Knoblauch
2007-12-29 11:11 Martin Knoblauch
2008-01-14  8:01 Martin Knoblauch

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \ \ \ \ \ \

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).