[prev in list] [next in list] [prev in thread] [next in thread] 

List:       bacula-devel
Subject:    Re: [Bacula-devel] bpipe mysqldump problem
From:       Ulrich Leodolter <ulrich.leodolter () obvsg ! at>
Date:       2009-05-28 10:51:09
Message-ID: 1243507869.16256.56.camel () leodolter ! bibvb ! ac ! at
[Download RAW message or body]

Hello,

On Thu, 2009-05-28 at 20:00 +1000, James Harper wrote:
> > 
> > What is different when bacula calls mysqldump via bpipe plugin?
> > 
> 
> Can you comment on how long between starting the mysqldump and the
> failure occuring? Is it consistently the same duration, which could
> indicate a timeout somewhere?
> 

Below are two backup job logs, 

First Job has FileSet Option compression = GZIP and runs 6:20min
mysqldump: Error 2013: Lost connection to MySQL server during query when
dumping table `File` at row: 26695285

Second has NO FileSet compression and runs 1:28min
mysqldump: Error 2013: Lost connection to MySQL server during query when
dumping table `File` at row: 8084943


So i would say it is not a timeout problem.

Both jobs transfer about 1 GB from FD to SD, maybe this is a hint.


Regards
Ulrich




troll-dir JobId 25339: Start Backup JobId 25339 Job=Backup-CatalogPipe.2009-05-28_10.37.30_07
troll-dir JobId 25339: Using Device "FileStorage"
troll-sd JobId 25339: Volume "Backup-0615" previously written, moving to end of data.
troll-sd JobId 25339: Ready to append to end of Volume "Backup-0615" size=71476858967
troll-sd JobId 25339: Job write elapsed time = 00:06:20, Transfer rate = 2.634 M bytes/second
troll-dir JobId 25339: Bacula troll-dir 3.0.2 (25May09): 28-May-2009 10:43:53
  Build OS:               i686-pc-linux-gnu redhat Enterprise release
  JobId:                  25339
  Job:                    Backup-CatalogPipe.2009-05-28_10.37.30_07
  Backup Level:           Full
  Client:                 "troll-fd" 3.0.2 (25May09) i686-pc-linux-gnu,redhat,Enterprise release
  FileSet:                "CatalogPipe" 2009-05-27 11:30:04
  Pool:                   "DiskBackup" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "File" (From Job resource)
  Scheduled time:         28-May-2009 10:37:24
  Start time:             28-May-2009 10:37:33
  End time:               28-May-2009 10:43:53
  Elapsed time:           6 mins 20 secs
  Priority:               11
  FD Files Written:       1
  SD Files Written:       1
  FD Bytes Written:       1,000,924,465 (1.000 GB)
  SD Bytes Written:       1,000,924,646 (1.000 GB)
  Rate:                   2634.0 KB/s
  Software Compression:   69.9 %
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):         Backup-0615
  Volume Session Id:      2
  Volume Session Time:    1243497680
  Last Volume Bytes:      72,478,495,229 (72.47 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

troll-dir JobId 25339: Begin pruning Jobs.
troll-dir JobId 25339: No Jobs found to prune.
troll-dir JobId 25339: Begin pruning Files.
troll-dir JobId 25339: No Files found to prune.
troll-dir JobId 25339: End auto prune.


troll-dir JobId 25340: Start Backup JobId 25340, Job=Backup-CatalogPipe.2009-05-28_12.15.48_09
troll-dir JobId 25340: Using Device "FileStorage"
troll-sd JobId 25340: Volume "Backup-0615" previously written, moving to end of data.
troll-sd JobId 25340: Ready to append to end of Volume "Backup-0615" size=72478495229
troll-sd JobId 25340: Job write elapsed time = 00:01:28, Transfer rate = 11.39 M bytes/second
troll-dir JobId 25340: Bacula troll-dir 3.0.2 (25May09): 28-May-2009 12:17:18
  Build OS:               i686-pc-linux-gnu redhat Enterprise release
  JobId:                  25340
  Job:                    Backup-CatalogPipe.2009-05-28_12.15.48_09
  Backup Level:           Full
  Client:                 "troll-fd" 3.0.2 (25May09) i686-pc-linux-gnu,redhat,Enterprise release
  FileSet:                "CatalogPipe" 2009-05-27 11:30:04
  Pool:                   "DiskBackup" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "File" (From Job resource)
  Scheduled time:         28-May-2009 12:15:45
  Start time:             28-May-2009 12:15:50
  End time:               28-May-2009 12:17:18
  Elapsed time:           1 min 28 secs
  Priority:               11
  FD Files Written:       1
  SD Files Written:       1
  FD Bytes Written:       1,002,520,967 (1.002 GB)
  SD Bytes Written:       1,002,521,148 (1.002 GB)
  Rate:                   11392.3 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):         Backup-0615
  Volume Session Id:      3
  Volume Session Time:    1243497680
  Last Volume Bytes:      73,481,622,513 (73.48 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

troll-dir JobId 25340: Begin pruning Jobs.
troll-dir JobId 25340: No Jobs found to prune.
troll-dir JobId 25340: Begin pruning Files.
troll-dir JobId 25340: No Files found to prune.
troll-dir JobId 25340: End auto prune.



> Btw - I always use gzip on the Exchange plugin and it works fine. After
> you have resolved the current problem you are having, I'd be interested
> if you can confirm if gzip does work for the bpipe plugin too.
> 
> James
> 
> 
-- 
Ulrich Leodolter <ulrich.leodolter@obvsg.at>
Oesterreichische Bibliothekenverbund und Service GmbH
Bruennlbadgasse 17/2A, A-1090 Wien
Fax +43 1 4035158-30
Tel +43 1 4035158-21
Web http://www.obvsg.at


------------------------------------------------------------------------------
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers & brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing, & 
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
_______________________________________________
Bacula-devel mailing list
Bacula-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-devel
[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic