Netdev Archive on lore.kernel.org
help / color / mirror / Atom feed
From: Justin He <Justin.He@arm.com>
To: Prabhakar Kushwaha <prabhakar.pkin@gmail.com>,
	"David S. Miller" <davem@davemloft.net>
Cc: Ariel Elior <aelior@marvell.com>,
	"GR-everest-linux-l2@marvell.com"
	<GR-everest-linux-l2@marvell.com>,
	Jakub Kicinski <kuba@kernel.org>,
	"netdev@vger.kernel.org" <netdev@vger.kernel.org>,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	nd <nd@arm.com>, Shai Malin <malin1024@gmail.com>,
	Shai Malin <smalin@marvell.com>,
	Prabhakar Kushwaha <pkushwaha@marvell.com>
Subject: RE: [PATCH] qed: fix possible unpaired spin_{un}lock_bh in _qed_mcp_cmd_and_union()
Date: Tue, 20 Jul 2021 02:02:26 +0000	[thread overview]
Message-ID: <AM6PR08MB4376CD003BF58F85E0121F39F7E29@AM6PR08MB4376.eurprd08.prod.outlook.com> (raw)
In-Reply-To: <CAJ2QiJJ8=jkbRVscnXM2m_n2RX2pNdJG4iA3tYiNGDYefb-hjA@mail.gmail.com>



> -----Original Message-----
> From: Prabhakar Kushwaha <prabhakar.pkin@gmail.com>
> Sent: Monday, July 19, 2021 10:51 PM
> To: Justin He <Justin.He@arm.com>
> Cc: Ariel Elior <aelior@marvell.com>; GR-everest-linux-l2@marvell.com;
> David S. Miller <davem@davemloft.net>; Jakub Kicinski <kuba@kernel.org>;
> netdev@vger.kernel.org; Linux Kernel Mailing List <linux-
> kernel@vger.kernel.org>; nd <nd@arm.com>; Shai Malin <malin1024@gmail.com>;
> Shai Malin <smalin@marvell.com>; Prabhakar Kushwaha <pkushwaha@marvell.com>
> Subject: Re: [PATCH] qed: fix possible unpaired spin_{un}lock_bh in
> _qed_mcp_cmd_and_union()
> 
> Hi Justin,
> 
> On Mon, Jul 19, 2021 at 6:47 PM Justin He <Justin.He@arm.com> wrote:
> >
> > Hi Prabhakar
> >
> > > -----Original Message-----
> > > From: Prabhakar Kushwaha <prabhakar.pkin@gmail.com>
> > > Sent: Monday, July 19, 2021 6:36 PM
> > > To: Justin He <Justin.He@arm.com>
> > > Cc: Ariel Elior <aelior@marvell.com>; GR-everest-linux-l2@marvell.com;
> > > David S. Miller <davem@davemloft.net>; Jakub Kicinski <kuba@kernel.org>;
> > > netdev@vger.kernel.org; Linux Kernel Mailing List <linux-
> > > kernel@vger.kernel.org>; nd <nd@arm.com>; Shai Malin
> <malin1024@gmail.com>;
> > > Shai Malin <smalin@marvell.com>; Prabhakar Kushwaha
> <pkushwaha@marvell.com>
> > > Subject: Re: [PATCH] qed: fix possible unpaired spin_{un}lock_bh in
> > > _qed_mcp_cmd_and_union()
> > >
> > > Hi Jia,
> > >
> > > On Thu, Jul 15, 2021 at 2:28 PM Jia He <justin.he@arm.com> wrote:
> > > >
> > > > Liajian reported a bug_on hit on a ThunderX2 arm64 server with
> FastLinQ
> > > > QL41000 ethernet controller:
> > > >  BUG: scheduling while atomic: kworker/0:4/531/0x00000200
> > > >   [qed_probe:488()]hw prepare failed
> > > >   kernel BUG at mm/vmalloc.c:2355!
> > > >   Internal error: Oops - BUG: 0 [#1] SMP
> > > >   CPU: 0 PID: 531 Comm: kworker/0:4 Tainted: G W 5.4.0-77-generic
> #86-
> > > Ubuntu
> > > >   pstate: 00400009 (nzcv daif +PAN -UAO)
> > > >  Call trace:
> > > >   vunmap+0x4c/0x50
> > > >   iounmap+0x48/0x58
> > > >   qed_free_pci+0x60/0x80 [qed]
> > > >   qed_probe+0x35c/0x688 [qed]
> > > >   __qede_probe+0x88/0x5c8 [qede]
> > > >   qede_probe+0x60/0xe0 [qede]
> > > >   local_pci_probe+0x48/0xa0
> > > >   work_for_cpu_fn+0x24/0x38
> > > >   process_one_work+0x1d0/0x468
> > > >   worker_thread+0x238/0x4e0
> > > >   kthread+0xf0/0x118
> > > >   ret_from_fork+0x10/0x18
> > > >
> > > > In this case, qed_hw_prepare() returns error due to hw/fw error, but
> in
> > > > theory work queue should be in process context instead of interrupt.
> > > >
> > > > The root cause might be the unpaired spin_{un}lock_bh() in
> > > > _qed_mcp_cmd_and_union(), which causes botton half is disabled
> > > incorrectly.
> > > >
> > > > Reported-by: Lijian Zhang <Lijian.Zhang@arm.com>
> > > > Signed-off-by: Jia He <justin.he@arm.com>
> > > > ---
> > >
> > > This patch is adding additional spin_{un}lock_bh().
> > > Can you please enlighten about the exact flow causing this unpaired
> > > spin_{un}lock_bh.
> > >
> > For instance:
> > _qed_mcp_cmd_and_union()
> >   In while loop
> >     spin_lock_bh()
> >     qed_mcp_has_pending_cmd() (assume false), will break the loop
> 
> I agree till here.
> 
> >   if (cnt >= max_retries) {
> > ...
> >     return -EAGAIN; <-- here returns -EAGAIN without invoking bh unlock
> >   }
> >
> 
> Because of break, cnt has not been increased.
>    - cnt is still less than max_retries.
>   - if (cnt >= max_retries) will not be *true*, leading to spin_unlock_bh().
> Hence pairing completed.

Sorry, indeed. Let me check other possibilities.
@David S. Miller Sorry for the inconvenience, could you please revert it
in netdev tree?

Apologies again.

--
Cheers,
Justin (Jia He)



  reply	other threads:[~2021-07-20  2:04 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-07-15  8:08 Jia He
2021-07-15 19:50 ` patchwork-bot+netdevbpf
2021-07-15 23:42   ` Justin He
2021-07-19 10:35 ` Prabhakar Kushwaha
2021-07-19 13:16   ` Justin He
2021-07-19 14:50     ` Prabhakar Kushwaha
2021-07-20  2:02       ` Justin He [this message]
2021-07-20  9:05         ` Jakub Kicinski
2021-07-20  9:28           ` Justin He

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=AM6PR08MB4376CD003BF58F85E0121F39F7E29@AM6PR08MB4376.eurprd08.prod.outlook.com \
    --to=justin.he@arm.com \
    --cc=GR-everest-linux-l2@marvell.com \
    --cc=aelior@marvell.com \
    --cc=davem@davemloft.net \
    --cc=kuba@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=malin1024@gmail.com \
    --cc=nd@arm.com \
    --cc=netdev@vger.kernel.org \
    --cc=pkushwaha@marvell.com \
    --cc=prabhakar.pkin@gmail.com \
    --cc=smalin@marvell.com \
    --subject='RE: [PATCH] qed: fix possible unpaired spin_{un}lock_bh in _qed_mcp_cmd_and_union()' \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).