From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.2 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C880AC63793 for ; Thu, 22 Jul 2021 07:11:20 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id AB4FA61279 for ; Thu, 22 Jul 2021 07:11:20 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230393AbhGVGaW (ORCPT ); Thu, 22 Jul 2021 02:30:22 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:49149 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231376AbhGVGaU (ORCPT ); Thu, 22 Jul 2021 02:30:20 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1626937855; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6GDEyDpumTN5IUPI+gElXinoItS3oXeAjDccXnHKb+I=; b=Sd4ZcP7tNbqPIHSX98dxvGXM+kn6vzz+qgsm8WEFuJA5+RM06q8fFo6xPlmvH+j38037Z2 G6WJzphs0GIbvjGv5j20eWPIQOzyeDCbb2K7Gd8RpCF6OLGzfChnnqog6vlSAY2ZMhUsIz N2p//wdNBwIeApv+Lf9teAIQAOLkvgM= Received: from mail-wm1-f71.google.com (mail-wm1-f71.google.com [209.85.128.71]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-453-NK5CC9oQPVSRkJqdX8yVwg-1; Thu, 22 Jul 2021 03:10:54 -0400 X-MC-Unique: NK5CC9oQPVSRkJqdX8yVwg-1 Received: by mail-wm1-f71.google.com with SMTP id g13-20020a05600c4ecdb0290242a8f4cf9cso1181768wmq.5 for ; Thu, 22 Jul 2021 00:10:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=6GDEyDpumTN5IUPI+gElXinoItS3oXeAjDccXnHKb+I=; b=BxIjINLR41JSqAjsiddUQvufIqq3feOg14+qmKmo9e/NiCw/S+45t/+I5oMmfY8B1q wJVGvdP45k7Q1fOstLM5+LI6D6LoDnK+bQHC0FRFb/PjWvrkjbw5as88S6dKP317SH8f Q+4YEAfhQo6dmLDp3MxNnuhoqWMYuU/bOlo/EyHokC0doattA9pno8S5RDXIffM5GSf3 Q/mCit9WWiMe2x1yAw6+yzE52pVlPngByvhHAwB70pou1jrNxMvGN4u3wyZKyDPUzS8y Oec53XdhQGyNlkKd+/sTsJm4UfnoDRLaZCffndSjSvMZu29XlA8D+9QmoFyNDqscXuP4 HaNQ== X-Gm-Message-State: AOAM532wr2xdCNTERhocxlx2hx3X0fpcZT72/gR4pMV2IOmldyW/rKHX Jlzg6/iIfjIbZRdRq3Ej2w957bWZfBgj7GtG/j7ZcymC48+WQCIGXK0l6uc8jix+ePlDxMRu/BH La89PZu750+MXJuVk X-Received: by 2002:a7b:cbda:: with SMTP id n26mr40603520wmi.179.1626937853048; Thu, 22 Jul 2021 00:10:53 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxfG/aAXoKgHTRexPzO6AsTiTtPq6UsftoDAUnhc4K7JdYB/4vWvNVTHFlY/ZtfBDrgE5AXDg== X-Received: by 2002:a7b:cbda:: with SMTP id n26mr40603506wmi.179.1626937852869; Thu, 22 Jul 2021 00:10:52 -0700 (PDT) Received: from gerbillo.redhat.com (146-241-97-57.dyn.eolo.it. [146.241.97.57]) by smtp.gmail.com with ESMTPSA id 6sm1861061wmi.3.2021.07.22.00.10.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jul 2021 00:10:52 -0700 (PDT) Message-ID: Subject: Re: [PATCH RFC 0/9] sk_buff: optimize layout for GRO From: Paolo Abeni To: Casey Schaufler , netdev@vger.kernel.org Cc: "David S. Miller" , Jakub Kicinski , Florian Westphal , Eric Dumazet , linux-security-module@vger.kernel.org, selinux@vger.kernel.org Date: Thu, 22 Jul 2021 09:10:51 +0200 In-Reply-To: <1252ad17-3460-5e6a-8f0d-05d91a1a7b96@schaufler-ca.com> References: <1252ad17-3460-5e6a-8f0d-05d91a1a7b96@schaufler-ca.com> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.36.5 (3.36.5-2.fc32) MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org Hello, On Wed, 2021-07-21 at 11:15 -0700, Casey Schaufler wrote: > On 7/21/2021 9:44 AM, Paolo Abeni wrote: > > This is a very early draft - in a different world would be > > replaced by hallway discussion at in-person conference - aimed at > > outlining some ideas and collect feedback on the overall outlook. > > There are still bugs to be fixed, more test and benchmark need, etc. > > > > There are 3 main goals: > > - [try to] avoid the overhead for uncommon conditions at GRO time > > (patches 1-4) > > - enable backpressure for the veth GRO path (patches 5-6) > > - reduce the number of cacheline used by the sk_buff lifecycle > > from 4 to 3, at least in some common scenarios (patches 1,7-9). > > The idea here is avoid the initialization of some fields and > > control their validity with a bitmask, as presented by at least > > Florian and Jesper in the past. > > If I understand correctly, you're creating an optimized case > which excludes ct, secmark, vlan and UDP tunnel. Is this correct, > and if so, why those particular fields? What impact will this have > in the non-optimal (with any of the excluded fields) case? Thank you for the feedback. There are 2 different relevant points: - the GRO stage. packets carring any of CT, dst, sk or skb_ext will do 2 additional conditionals per gro_receive WRT the current code. My understanding is that having any of such field set at GRO receive time is quite exceptional for real nic. All others packet will do 4 or 5 less conditionals, and will traverse a little less code. - sk_buff lifecycle * packets carrying vlan and UDP will not see any differences: sk_buff lifecycle will stil use 4 cachelines, as currently does, and no additional conditional is introduced. * packets carring nfct or secmark will see an additional conditional every time such field is accessed. The number of cacheline used will still be 4, as in the current code. My understanding is that when such access happens, there is already a relevant amount of "additional" code to be executed, the conditional overhead should not be measurable. Cheers, Paolo