[prev in list] [next in list] [prev in thread] [next in thread] 

List:       freebsd-hackers
Subject:    RE: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < 24 hours
From:       "Caza, Aaron" <Aaron.Caza () ca ! weatherford ! com>
Date:       2017-06-17 7:11:41
Message-ID: 498c08b2d4d54d5aaa54abc1abfd4046 () BLUPR58MB002 ! 032d ! mgd ! msft ! net
[Download RAW message or body]


From: Adam Vande More [mailto:amvandemore@gmail.com]
 Sent: Saturday, June 17, 2017 12:49 AM
To: Caza, Aaron
Cc: freebsd-hackers@freebsd.org
Subject: [EXTERNAL] Re: FreeBSD10 Stable + ZFS + PostgreSQL + SSD performance drop < \
24 hours

On Sat, Jun 17, 2017 at 12:16 AM, Caza, Aaron \
<Aaron.Caza@ca.weatherford.com<mailto:Aaron.Caza@ca.weatherford.com>> wrote:

Regarding this issue, I've now conducted testing using merely a FreeBSD 10.3 Stable \
amd64 GENERIC kernel and using dd to read a large file.  The following is a log, \
taken hourly, of the degradation which occurred at just over 9 hours of uptime.  As \
the original is quite large, I've removed some sections; however, these can be \
supplied if desired. Supplied are the initial dmesg and zpool status, logged only on \
startup, followed by uptime, uname -a, and zfs-stats -a output, each of which are \
logged hourly.

What does this say?
# zpool get all

The output of zpool get all is as follows:

NAME            PROPERTY              VALUE                  SOURCE
wwbase          type                  filesystem             -
wwbase          creation              Wed Jun  7 10:37 2017  -
wwbase          used                  42.8G                  -
wwbase          available             186G                   -
wwbase          referenced            1.96G                  -
wwbase          compressratio         1.00x                  -
wwbase          mounted               yes                    -
wwbase          quota                 none                   default
wwbase          reservation           none                   default
wwbase          recordsize            128K                   default
wwbase          mountpoint            /zfsroot               local
wwbase          sharenfs              off                    default
wwbase          checksum              on                     default
wwbase          compression           off                    default
wwbase          atime                 on                     default
wwbase          devices               on                     default
wwbase          exec                  on                     default
wwbase          setuid                on                     default
wwbase          readonly              off                    default
wwbase          jailed                off                    default
wwbase          snapdir               hidden                 default
wwbase          aclmode               discard                default
wwbase          aclinherit            restricted             default
wwbase          canmount              on                     default
wwbase          xattr                 off                    temporary
wwbase          copies                1                      default
wwbase          version               5                      -
wwbase          utf8only              off                    -
wwbase          normalization         none                   -
wwbase          casesensitivity       sensitive              -
wwbase          vscan                 off                    default
wwbase          nbmand                off                    default
wwbase          sharesmb              off                    default
wwbase          refquota              none                   default
wwbase          refreservation        none                   default
wwbase          primarycache          all                    default
wwbase          secondarycache        all                    default
wwbase          usedbysnapshots       0                      -
wwbase          usedbydataset         1.96G                  -
wwbase          usedbychildren        40.8G                  -
wwbase          usedbyrefreservation  0                      -
wwbase          logbias               latency                default
wwbase          dedup                 off                    default
wwbase          mlslabel                                     -
wwbase          sync                  standard               default
wwbase          refcompressratio      1.00x                  -
wwbase          written               1.96G                  -
wwbase          logicalused           42.4G                  -
wwbase          logicalreferenced     1.88G                  -
wwbase          volmode               default                default
wwbase          filesystem_limit      none                   default
wwbase          snapshot_limit        none                   default
wwbase          filesystem_count      none                   default
wwbase          snapshot_count        none                   default
wwbase          redundant_metadata    all                    default
wwbase/tmp      type                  filesystem             -
wwbase/tmp      creation              Wed Jun  7 10:37 2017  -
wwbase/tmp      used                  128K                   -
wwbase/tmp      available             512M                   -
wwbase/tmp      referenced            128K                   -
wwbase/tmp      compressratio         1.00x                  -
wwbase/tmp      mounted               yes                    -
wwbase/tmp      quota                 512M                   local
wwbase/tmp      reservation           none                   default
wwbase/tmp      recordsize            128K                   default
wwbase/tmp      mountpoint            /zfsroot/tmp           local
wwbase/tmp      sharenfs              off                    default
wwbase/tmp      checksum              on                     default
wwbase/tmp      compression           off                    default
wwbase/tmp      atime                 on                     default
wwbase/tmp      devices               on                     default
wwbase/tmp      exec                  on                     default
wwbase/tmp      setuid                on                     default
wwbase/tmp      readonly              off                    default
wwbase/tmp      jailed                off                    default
wwbase/tmp      snapdir               hidden                 default
wwbase/tmp      aclmode               discard                default
wwbase/tmp      aclinherit            restricted             default
wwbase/tmp      canmount              on                     default
wwbase/tmp      xattr                 off                    temporary
wwbase/tmp      copies                1                      default
wwbase/tmp      version               5                      -
wwbase/tmp      utf8only              off                    -
wwbase/tmp      normalization         none                   -
wwbase/tmp      casesensitivity       sensitive              -
wwbase/tmp      vscan                 off                    default
wwbase/tmp      nbmand                off                    default
wwbase/tmp      sharesmb              off                    default
wwbase/tmp      refquota              none                   default
wwbase/tmp      refreservation        none                   default
wwbase/tmp      primarycache          all                    default
wwbase/tmp      secondarycache        all                    default
wwbase/tmp      usedbysnapshots       0                      -
wwbase/tmp      usedbydataset         128K                   -
wwbase/tmp      usedbychildren        0                      -
wwbase/tmp      usedbyrefreservation  0                      -
wwbase/tmp      logbias               latency                default
wwbase/tmp      dedup                 off                    default
wwbase/tmp      mlslabel                                     -
wwbase/tmp      sync                  standard               default
wwbase/tmp      refcompressratio      1.00x                  -
wwbase/tmp      written               128K                   -
wwbase/tmp      logicalused           59K                    -
wwbase/tmp      logicalreferenced     59K                    -
wwbase/tmp      volmode               default                default
wwbase/tmp      filesystem_limit      none                   default
wwbase/tmp      snapshot_limit        none                   default
wwbase/tmp      filesystem_count      none                   default
wwbase/tmp      snapshot_count        none                   default
wwbase/tmp      redundant_metadata    all                    default
wwbase/ww       type                  filesystem             -
wwbase/ww       creation              Wed Jun  7 10:37 2017  -
wwbase/ww       used                  40.8G                  -
wwbase/ww       available             186G                   -
wwbase/ww       referenced            40.8G                  -
wwbase/ww       compressratio         1.00x                  -
wwbase/ww       mounted               yes                    -
wwbase/ww       quota                 none                   default
wwbase/ww       reservation           none                   default
wwbase/ww       recordsize            8K                     local
wwbase/ww       mountpoint            /zfsroot/ww            local
wwbase/ww       sharenfs              off                    default
wwbase/ww       checksum              on                     default
wwbase/ww       compression           off                    local
wwbase/ww       atime                 on                     default
wwbase/ww       devices               on                     default
wwbase/ww       exec                  on                     default
wwbase/ww       setuid                on                     default
wwbase/ww       readonly              off                    default
wwbase/ww       jailed                off                    default
wwbase/ww       snapdir               hidden                 default
wwbase/ww       aclmode               discard                default
wwbase/ww       aclinherit            restricted             default
wwbase/ww       canmount              on                     default
wwbase/ww       xattr                 off                    temporary
wwbase/ww       copies                1                      default
wwbase/ww       version               5                      -
wwbase/ww       utf8only              off                    -
wwbase/ww       normalization         none                   -
wwbase/ww       casesensitivity       sensitive              -
wwbase/ww       vscan                 off                    default
wwbase/ww       nbmand                off                    default
wwbase/ww       sharesmb              off                    default
wwbase/ww       refquota              none                   default
wwbase/ww       refreservation        none                   default
wwbase/ww       primarycache          all                    default
wwbase/ww       secondarycache        all                    default
wwbase/ww       usedbysnapshots       0                      -
wwbase/ww       usedbydataset         40.8G                  -
wwbase/ww       usedbychildren        0                      -
wwbase/ww       usedbyrefreservation  0                      -
wwbase/ww       logbias               latency                default
wwbase/ww       dedup                 off                    default
wwbase/ww       mlslabel                                     -
wwbase/ww       sync                  standard               default
wwbase/ww       refcompressratio      1.00x                  -
wwbase/ww       written               40.8G                  -
wwbase/ww       logicalused           40.5G                  -
wwbase/ww       logicalreferenced     40.5G                  -
wwbase/ww       volmode               default                default
wwbase/ww       filesystem_limit      none                   default
wwbase/ww       snapshot_limit        none                   default
wwbase/ww       filesystem_count      none                   default
wwbase/ww       snapshot_count        none                   default
wwbase/ww       redundant_metadata    all                    default
wwbase/wwdebug  type                  filesystem             -
wwbase/wwdebug  creation              Wed Jun  7 10:37 2017  -
wwbase/wwdebug  used                  116K                   -
wwbase/wwdebug  available             512M                   -
wwbase/wwdebug  referenced            116K                   -
wwbase/wwdebug  compressratio         1.00x                  -
wwbase/wwdebug  mounted               yes                    -
wwbase/wwdebug  quota                 512M                   local
wwbase/wwdebug  reservation           none                   default
wwbase/wwdebug  recordsize            128K                   default
wwbase/wwdebug  mountpoint            /zfsroot/ww/debug      local
wwbase/wwdebug  sharenfs              off                    default
wwbase/wwdebug  checksum              on                     default
wwbase/wwdebug  compression           off                    default
wwbase/wwdebug  atime                 on                     default
wwbase/wwdebug  devices               on                     default
wwbase/wwdebug  exec                  on                     default
wwbase/wwdebug  setuid                on                     default
wwbase/wwdebug  readonly              off                    default
wwbase/wwdebug  jailed                off                    default
wwbase/wwdebug  snapdir               hidden                 default
wwbase/wwdebug  aclmode               discard                default
wwbase/wwdebug  aclinherit            restricted             default
wwbase/wwdebug  canmount              on                     default
wwbase/wwdebug  xattr                 off                    temporary
wwbase/wwdebug  copies                1                      default
wwbase/wwdebug  version               5                      -
wwbase/wwdebug  utf8only              off                    -
wwbase/wwdebug  normalization         none                   -
wwbase/wwdebug  casesensitivity       sensitive              -
wwbase/wwdebug  vscan                 off                    default
wwbase/wwdebug  nbmand                off                    default
wwbase/wwdebug  sharesmb              off                    default
wwbase/wwdebug  refquota              none                   default
wwbase/wwdebug  refreservation        none                   default
wwbase/wwdebug  primarycache          all                    default
wwbase/wwdebug  secondarycache        all                    default
wwbase/wwdebug  usedbysnapshots       0                      -
wwbase/wwdebug  usedbydataset         116K                   -
wwbase/wwdebug  usedbychildren        0                      -
wwbase/wwdebug  usedbyrefreservation  0                      -
wwbase/wwdebug  logbias               latency                default
wwbase/wwdebug  dedup                 off                    default
wwbase/wwdebug  mlslabel                                     -
wwbase/wwdebug  sync                  standard               default
wwbase/wwdebug  refcompressratio      1.00x                  -
wwbase/wwdebug  written               116K                   -
wwbase/wwdebug  logicalused           45.5K                  -
wwbase/wwdebug  logicalreferenced     45.5K                  -
wwbase/wwdebug  volmode               default                default
wwbase/wwdebug  filesystem_limit      none                   default
wwbase/wwdebug  snapshot_limit        none                   default
wwbase/wwdebug  filesystem_count      none                   default
wwbase/wwdebug  snapshot_count        none                   default
wwbase/wwdebug  redundant_metadata    all                    default

Note that the ‘dd' used in the previously posted logfile is on wwbase/ww hence the \
recordsize is 8K rather than the 128K as is used elsewhere (8K selection due to \
PostgreSQL usage).

(ps.  Please note that the above in no way reflects that I am in any way concerned \
about this issue nor that it is keeping me awake at night: 1:10AM here in rainy \
Calgary, Alberta Canada) This message may contain confidential and privileged \
information. If it has been sent to you in error, please reply to advise the sender \
of the error and then immediately delete it. If you are not the intended recipient, \
do not read, copy, disclose or otherwise use this message. The sender disclaims any \
liability for such unauthorized use. PLEASE NOTE that all incoming e-mails sent to \
Weatherford e-mail accounts will be archived and may be scanned by us and/or by \
external service providers to detect and prevent threats to our systems, investigate \
illegal or inappropriate behavior, and/or eliminate unsolicited promotional e-mails \
(spam). This process could result in deletion of a legitimate e-mail before it is \
read by its intended recipient at our organization. Moreover, based on the scanning \
results, the full text of e-mails and attachments may be made available to \
Weatherford security and other personnel for review and appropriate action. If you \
have any concerns about this process, please contact us at \
dataprivacy@weatherford.com. _______________________________________________
freebsd-hackers@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic