LKML Archive on
help / color / mirror / Atom feed
From: Bron Gondwana <>
To: Linus Torvalds <>
Cc: Mark Lord <>, Adrian Bunk <>,
	Bron Gondwana <>,
	Mike Houston <>,
	Chuck Ebbert <>,
	linux-kernel <>
Subject: Re: How many people are using 2.6.16?
Date: Wed, 31 Jan 2007 16:49:10 +1100	[thread overview]
Message-ID: <> (raw)
In-Reply-To: <>

On Tue, Jan 30, 2007 at 06:36:48PM -0800, Linus Torvalds wrote:
> On Tue, 30 Jan 2007, Mark Lord wrote:
> > 
> > I believe our featherless leader said he though it was an ancient bug,
> > exasperated by something that went into 2.6.19.
> > 
> > If Linus's opinion is correct (still?), then the bug exists in all
> > kernels since somewhere back in the 2.4.xx days.
> The issue was somewhat confused by people certainly *reporting* it for 
> older kernels. Also, as part of the dirty bit cleanups and sanity 
> checkingwe did actually seem to fix a long-standing CIFS corruption (and 
> apparently reisertfs/XFS problems too).
> But the *common* case was actually introduced with 2.6.19, and 2.6.16 
> wouldn't be affected. 

We run on reiserfs.  I did try ext3 for a little while on a couple of
servers but performance was really awful compared to reiser, and we
heaved a sigh of relief when we finally migrated all the users off
those filesystems.  There were many complaints about the speed of our
service for a while.

I'm really hoping this is the cause, because do still see occasional
corruption of MMAPed files under heavy load, though less often now
that we've balanced our servers to the point where load spikes are
much less common.

The servers are using either internal Areca cards or LSI SCSI adaptors
connected to external SATA raid boxes.  Either way, there's a few
terabytes of SATA attached to each box, with 10kRPM drives in RAID1
for Cyrus's metadata and 7,2k bigger drives in RAID5 for the actual
emails.  According to iostat these drives are being utilised at over
50% of available bandwidth even now during the "quiet time" - there
are many tens of thousands of users per machine - so we tend to
stress the IO subsystem quite a lot.

Cyrus is also very liberal in its use of MMAP, so we get to push
all sorts of exciting edge cases.  We were still applying patches
to reiserfs until recently, and I'm not sure what the status of that
is (Hans Reiser said to keep harassing him about it - but he's
hardly in a position to be dealing with our issues right now)

Thankfully, now that we're using 300Gb maximum rather than 2Tb
partitions (running multiple instances of Cyrus instead) with
the associated smaller mailboxes.db (the biggest MMAPed and
frequently updated file) things seem less edgy.  I don't like
edgy (queue Ubuntu jokes).

Anyway, I'm hoping to update one of our boxes to soon.
We do have one box running a 2.6.18 series kernel which has been
fine as well.  I'll give feedback if we see any issues with MMAP
on there.


  reply	other threads:[~2007-01-31  5:49 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-01-29 20:30 Chuck Ebbert
2007-01-29 20:35 ` Josh Boyer
2007-01-29 20:38   ` Chuck Ebbert
2007-02-07 20:36     ` Greg KH
2007-01-29 21:04 ` Mike Houston
2007-01-29 22:13   ` Bron Gondwana
2007-01-30 20:39     ` Adrian Bunk
2007-01-31  1:33       ` Mark Lord
2007-01-31  2:36         ` Linus Torvalds
2007-01-31  5:49           ` Bron Gondwana [this message]
2007-01-31  7:02           ` Adrian Bunk
2007-01-31 10:42             ` Reiserfs and MMAP (was: How many people are using 2.6.16?) Bron Gondwana
2007-01-31 11:49             ` How many people are using 2.6.16? David Chinner
2007-01-31 14:34               ` Steve French (smfltc)
2007-01-31 15:34             ` Linus Torvalds
2007-02-01 12:13             ` Vladimir V. Saveliev
2007-02-03  1:39               ` Adrian Bunk
2007-01-30 23:52   ` Adrian Bunk
2007-01-31  1:48     ` Mike Houston

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \ \ \ \ \ \ \ \ \
    --subject='Re: How many people are using 2.6.16?' \

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).