[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ipfilter
Subject:    Fw: Ipnat +freebsd mbuf clusters
From:       "Dave Raven" <dave () raven ! za ! net>
Date:       2003-03-31 22:00:40
[Download RAW message or body]

----- Original Message ----- 
From: "Dave Raven" <dave@raven.za.net>
To: "rmkml" <rmkml@wanadoo.fr>
Sent: Monday, March 31, 2003 10:15 PM
Subject: Re: Ipnat +freebsd mbuf clusters


: Hi again,
:     I have 512meg of ram in box; custom kernel,
:     here are relevant mbuf settings:
: 
: maxusers        2048
: options         NMBCLUSTERS=65536
: 
: maxusers will leave you with mbuf clusters of about 33000;
: but I changed this to max 65536 in order to try keep 
: box up for longer whilst having these problems..
: 
: maxusers 0   would give me about 4000 nmbclusters
: so.. that setting is not gonna cut it for long.
: 
: Haven't touched KVA, not sure how I would 
: tune that to help here, any advice?
: 
: Ipfilter rule list is totally blank, no states at all.
: 
: # ipnat -s
: mapped  in      98427   out     132124
: added   3636    expired 3581
: no memory       0       bad nat 6
: inuse   27
: rules   49
: wilds   0
: 
: Dont flush states (answered above)
: 
: 
: 34028/34128/262144 mbufs in use (current/peak/max):
:         33995 mbufs allocated to data
:         33 mbufs allocated to packet headers
: 33992/34042/65536 mbuf clusters in use (current/peak/max)
: 76616 Kbytes allocated to network (17% of mb_map in use)
: 0 requests for memory denied
: 0 requests for memory delayed
: 0 calls to protocol drain routines
: 
: thats netstat info; you can see its very high for a box doing 
: virtually nothing. its settled down now because its night time,
: but during the day it rises 5000 per 30 minutes about.
: also, now that no one is there. the mbufs aren't going down.
: they stay that high...
: 
: vmstat is attached vmstat.txt
: 
: yeh there are a few
: in particular an mbuf user is squid.
: other than that, apache, and mysql (not really under use)
: 
: That mail is talking about very high loads.. if I did have 
: states it would be less than 100...
: 
: Should I also send this to the list as extra info?
: 
: Thanks again
: Dave
: 
: 
: ----- Original Message ----- 
: From: "rmkml" <rmkml@wanadoo.fr>
: To: "Dave Raven" <dave@raven.za.net>
: Sent: Monday, March 31, 2003 7:33 PM
: Subject: Re: Ipnat +freebsd mbuf clusters
: 
: 
: : ok,
: : You have very good tunning,
: : 
: : How much have of memory physical ?
: : 
: : Do you have kernel tune or GENERIC ?
: : Do you tuned KVA option in kernel ?
: : 
: : How much have ipfilter state ? (ipfstat -s)
: : 
: : How much have ipfilter nat ? (ipfstat -s)
: : 
: : Do you flush ipfilter state ? (ipf -F <i|o|a|s|S>)
: : like with crontab
: : 
: : # netstat -m ?
: : # vmstat -m ?
: : 
: : Do you have other process in you freebsd box ?
: : (sendmail / apache / bind /... ?)
: : 
: : Send me # top  ?
: : 
: : Read this, is very interresting ?
: : http://marc.theaimsgroup.com/?l=ipfilter&m=104611403512129&w=2
: : 
: : Regard.
: : 
: : 
: : 
: 

["vmstat.txt" (text/plain)]

Memory statistics by bucket size
Size   In Use   Free   Requests  HighWater  Couldfree
  16      278    234       7629    1280          0
  32     3274     54       9688     640          0
  64     3330   1150      40891     320        142
 128     1540     60      12515     160          0
 256     2654      2       7223      80          1
 512       31      9        910      40          0
  1K       13     75        486      20        271
  2K       13      7         26      10          0
  4K       17      2      13343       5          0
  8K        4      2         11       5          0
 16K       14      0         14       5          0
 32K        6      0          6       5          0
128K        4      0          4       5          0
256K        2      0          2       5          0
512K        1      0          1       5          0

Memory usage type by bucket size
Size  Type(s)
  16  uc_devlist, routetbl, ether_multi, vnodes, mount, MD disk, pcb,
          soname, rman, bus, sysctloid, sysctl, ATA generic, temp, =
devbuf,
          atexit, proc-args, kld
  32  atkbddev, dirrem, mkdir, diradd, freefile, freefrag, indirdep,
          bmsafemap, newblk, tseg_qent, in_multi, routetbl, ether_multi,
          ifaddr, BPF, vnodes, cluster_save buffer, pcb, taskqueue, =
SWAP,
          eventhandler, bus, sysctl, uidinfo, subproc, pgrp, temp, =
devbuf,
          proc-args, sigio, kld
  64  isadev, allocindir, allocdirect, pagedep, routetbl, ether_multi,
          ifaddr, vnodes, cluster_save buffer, vfscache, pcb, rman,
          eventhandler, bus, sysctloid, subproc, session, temp, devbuf, =
lockf,
          proc-args, file, AR driver, AD driver
 128  ZONE, freeblks, inodedep, routetbl, vnodes, mount,
          cluster_save buffer, soname, ttys, bus, cred, temp, devbuf, =
zombie,
          proc-args, dev_t, timecounter, kld
 256  FFS node, newblk, routetbl, ifaddr, vnodes, ttys, bus, subproc, =
temp,
          devbuf, proc-args, file desc
 512  UFS mount, mount, BIO buffer, ptys, ioctlops, bus, ATA generic, =
temp,
          devbuf, AR driver
  1K  uc_devlist, BIO buffer, MD disk, ioctlops, bus, temp, devbuf,
          AD driver
  2K  UFS mount, ifaddr, BIO buffer, pcb, bus, uidinfo, devbuf, AR =
driver
  4K  memdesc, UFS mount, temp, devbuf
  8K  UFS mount, indirdep, syncache, proc
 16K  devbuf
 32K  VM pgdata, UFS mount, pagedep, temp, devbuf
128K  mbuf, UFS ihash, inodedep, ISOFS mount
256K  vfscache, SWAP
512K  temp

Memory statistics by type                          Type  Kern
        Type  InUse MemUse HighUse  Limit Requests Limit Limit Size(s)
     atkbddev     2     1K      1K 85295K        2    0     0  32
   uc_devlist    15     2K      2K 85295K       15    0     0  16,1K
      memdesc     1     4K      4K 85295K        1    0     0  4K
         mbuf     1    96K     96K 85295K        1    0     0  128K
       isadev    10     1K      1K 85295K       10    0     0  64
         ZONE    13     2K      2K 85295K       13    0     0  128
    VM pgdata     1    32K     32K 85295K        1    0     0  32K
    UFS mount    12    46K     46K 85295K       12    0     0  =
512,2K,4K,8K,32K
    UFS ihash     1   128K    128K 85295K        1    0     0  128K
     FFS node  2358   590K    590K 85295K     2387    0     0  256
       dirrem     0     0K      1K 85295K       35    0     0  32
        mkdir     0     0K      1K 85295K        2    0     0  32
       diradd     0     0K      1K 85295K       71    0     0  32
     freefile     0     0K      1K 85295K       28    0     0  32
     freeblks     0     0K      3K 85295K       66    0     0  128
     freefrag     0     0K      3K 85295K      359    0     0  32
   allocindir     0     0K    136K 85295K     3438    0     0  64
     indirdep     0     0K     17K 85295K       85    0     0  32,8K
  allocdirect     0     0K      3K 85295K      791    0     0  64
    bmsafemap     0     0K      1K 85295K      164    0     0  32
       newblk     1     1K      1K 85295K     4230    0     0  32,256
     inodedep     1   128K    133K 85295K      152    0     0  128,128K
      pagedep     1    32K     33K 85295K       30    0     0  64,32K
     syncache     1     8K      8K 85295K        1    0     0  8K
    tseg_qent     0     0K      1K 85295K       57    0     0  32
     in_multi     3     1K      1K 85295K        3    0     0  32
     routetbl   174    24K     25K 85295K      312    0     0  =
16,32,64,128,256
  ether_multi    12     1K      1K 85295K       12    0     0  16,32,64
       ifaddr    24     5K      5K 85295K       24    0     0  =
32,64,256,2K
          BPF     3     1K      1K 85295K        3    0     0  32
       vnodes    21     5K      5K 85295K      275    0     0  =
16,32,64,128,256
        mount     5     3K      3K 85295K        7    0     0  =
16,128,512
cluster_save buffer     0     0K      1K 85295K       47    0     0  =
32,64,128
     vfscache  2925   439K    439K 85295K     3128    0     0  64,256K
   BIO buffer     2     3K     88K 85295K      107    0     0  512,1K,2K
      MD disk     2     2K      2K 85295K        2    0     0  16,1K
          pcb    18     5K      5K 85295K      330    0     0  =
16,32,64,2K
       soname     3     1K      1K 85295K     6714    0     0  16,128
         ptys     3     2K      2K 85295K        3    0     0  512
         ttys   452    58K     58K 85295K     1310    0     0  128,256
         rman    41     3K      3K 85295K      402    0     0  16,64
     ioctlops     0     0K      1K 85295K      581    0     0  512,1K
    taskqueue     1     1K      1K 85295K        1    0     0  32
         SWAP     2   141K    141K 85295K        2    0     0  32,256K
 eventhandler    13     1K      1K 85295K       13    0     0  32,64
          bus   353    27K     28K 85295K      639    0     0  =
16,32,64,128,256,512,1K,2K
    sysctloid    20     1K      1K 85295K       20    0     0  16,64
       sysctl     0     0K      1K 85295K      151    0     0  16,32
      uidinfo     6     3K      3K 85295K        6    0     0  32,2K
         cred    15     2K      3K 85295K     1636    0     0  128
      subproc    93     8K      9K 85295K     1188    0     0  32,64,256
         proc     2    16K     16K 85295K        2    0     0  8K
      session    24     2K      2K 85295K       40    0     0  64
         pgrp    27     1K      1K 85295K       67    0     0  32
  ATA generic     4     2K      2K 85295K        4    0     0  16,512
         temp   457   604K    614K 85295K    13421    0     0  =
16,32,64,128,256,512,1K,4K,32K,512K
       devbuf  3129   453K    461K 85295K    16422    0     0  =
16,32,64,128,256,512,1K,2K,4K,16K,32K
        lockf     1     1K      1K 85295K     7131    0     0  64
       atexit     1     1K      1K 85295K        1    0     0  16
       zombie     0     0K      1K 85295K      539    0     0  128
    proc-args    32     2K      2K 85295K      538    0     0  =
16,32,64,128,256
        sigio     1     1K      1K 85295K        1    0     0  32
         file    96     6K      7K 85295K    11067    0     0  64
    file desc    41    11K     12K 85295K      580    0     0  256
        dev_t   744    93K     93K 85295K      744    0     0  128
  timecounter     5     1K      1K 85295K        5    0     0  128
          kld     4     1K      1K 85295K       35    0     0  16,32,128
    AR driver     1     1K      3K 85295K        5    0     0  64,512,2K
    AD driver     2     2K      3K 85295K    13278    0     0  64,1K
  ISOFS mount     1   128K    128K 85295K        1    0     0  128K

Memory Totals:  In Use    Free    Requests
                 3110K    203K       92749

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic