[prev in list] [next in list] [prev in thread] [next in thread]
List: drbd-user
Subject: Re: [DRBD-user] DRDB on one host
From: Dan Barker <dbarker () visioncomm ! net>
Date: 2014-05-14 22:00:09
Message-ID: 698d89a220234a1092b76cec98e887cb () BN1PR04MB060 ! namprd04 ! prod ! outlook ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
[Attachment #4 (text/plain)]
From: drbd-user-bounces@lists.linbit.com [mailto:drbd-user-bounces@lists.linbit.com] \
On Behalf Of Csanad Novak
Sent: Tuesday, May 13, 2014 5:47 PM
To: Arnold Krille; drbd-user@lists.linbit.com
Subject: Re: [DRBD-user] DRDB on one host
Hi Arnold,
I guess the challenge here is that the instance-storage get reseted completely (back \
to the point when its just a raw device without partitions) on every stop/start \
cycle.
Currently I'm using a less than satisfactory solution on non critical servers, as \
follow:
I've got mounted my instance-storage as /dev/sdb1 to /var
I've got mounted my ebs device as /dev/sdc1 to /mnt/var-backup
I've lsyncd configured to sync from /var to /mnt/var-backup
I've wrote a little bash script for auto partitioning and mounting. When the instance \
get stopped for any reason the instance storage gets reseted and the whole /var \
directory destroyed. After boot up my script repartitioning the instance storage, \
mount it, and then automatically rsync back the data from /mnt/var-backup.
There is several issue with this architecture, but the biggest one with lsyncd, which \
wasn't designed for this. If I cloud change lsyncd to drbd, that would great.
I must stress again: instance-storage is a local hard-disk based block device, while \
the ebs storage is a network attached block device.
Cheers:
Csanad
From: Arnold Krille arnold@arnoldarts.de<mailto:arnold@arnoldarts.de>
Reply: Arnold Krille arnold@arnoldarts.de<mailto:arnold@arnoldarts.de>
Date: 14 May 2014 at 6:18:25
To: drbd-user@lists.linbit.com<mailto:drbd-user@lists.linbit.com> \
drbd-user@lists.linbit.com<mailto:drbd-user@lists.linbit.com>
Subject: Re: [DRBD-user] DRDB on one host
On Tue, 13 May 2014 09:57:21 +1200 Csanad Novak
<csanad@pixelfusion.co.nz<mailto:csanad@pixelfusion.co.nz>> wrote:
> Recently on the latest AWS Summit I've seen an interesting setup for
> utilising the AWS EC2 instance storage. The instance storage is the
> local filesystem on the Amazon cloud, unfortunately it is not
> persistent - all data get lost if the instance stops. For persistent
> storage one must use an so called EBS volume, which is a network
> attached block device. Unfortunately the EBS storage performance is
> varies, depending on the neighbour instances' traffic. An ideal world
> one can use the instance storage without the worry of data loss.
>
> On the latest AWS Summit a presenter proposed an architecture where
> the instance storage was utilised and was synced with DRBD to the EBS
> block
> device. http://www.slideshare.net/AmazonWebServices/so-you-think-you-are-an-aws-ninja-dean-samuels \
> - slide 11.
>
> I wonder how an example config would looks like. I went trough
> quickly on the tutorials, but couldn't find any example with one host
> setup.
drbd on one host. Isn't that what raid/md is?
I haven't had a chance to play with aws but if both ebs volumes and the
instance-storage are block devices, it should be easy to mirror them
with md or lvm.
- Arnold
________________________________
_______________________________________________
drbd-user mailing list
drbd-user@lists.linbit.com<mailto:drbd-user@lists.linbit.com>
http://lists.linbit.com/mailman/listinfo/drbd-user
--
Kind regards,
[cid:image001.gif@01CF6F9E.577D9E80]
Csanad Novak
Technical Lead
P / 09 353 1234<tel://09%20353%201234>
M / 021 060 1531<tel://09%20353%201234>
E / csanad@pixelfusion.co.nz<mailto:wouter@pixelfusion.co.nz>
W / PIXELFUSION.CO.NZ<http://pixelfusion.co.nz/> / WHERE DESIGN & DEVELOPMENT FUSE
A / SUITE 403 "FORBIDDEN", THE IRON BANK, 150 KARANGAHAPE RD, AUCKLAND / PIXEL FUSION \
LTD, PO BOX 68 564, NEWTON, AUCKLAND / \
MAP<http://maps.google.co.nz/maps?cid=7370666879334476751&q=Pixel+Fusion>
[Attachment #5 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
h1
{mso-style-priority:9;
mso-style-link:"Heading 1 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:24.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.Heading1Char
{mso-style-name:"Heading 1 Char";
mso-style-priority:9;
mso-style-link:"Heading 1";
font-family:"Calibri Light","sans-serif";
color:#2E74B5;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> \
drbd-user-bounces@lists.linbit.com [mailto:drbd-user-bounces@lists.linbit.com] <b>On \
Behalf Of </b>Csanad Novak<br> <b>Sent:</b> Tuesday, May 13, 2014 5:47 PM<br>
<b>To:</b> Arnold Krille; drbd-user@lists.linbit.com<br>
<b>Subject:</b> Re: [DRBD-user] DRDB on one host<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">Hi \
Arnold,<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I \
guess the challenge here is that the instance-storage get reseted completely (back to \
the point when its just a raw device without partitions) on every stop/start \
cycle.<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">Currently \
I'm using a less than satisfactory solution on non critical servers, as \
follow:<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I've \
got mounted my instance-storage as /dev/sdb1 to /var<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I've \
got mounted my ebs device as /dev/sdc1 to /mnt/var-backup<o:p></o:p></span></p> \
</div> <div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I've \
lsyncd configured to sync from /var to /mnt/var-backup<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I've \
wrote a little bash script for auto partitioning and mounting. When the instance get \
stopped for any reason the instance storage gets reseted and the whole /var directory \
destroyed. After boot up my script repartitioning the instance storage, mount it, and \
then automatically rsync back the data from /mnt/var-backup.<o:p></o:p></span></p> \
</div> <div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">There \
is several issue with this architecture, but the biggest one with lsyncd, which \
wasn't designed for this. If I cloud change lsyncd to drbd, that would \
great.<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">I \
must stress again: instance-storage is a local hard-disk based block device, while \
the ebs storage is a network attached block device.<o:p></o:p></span></p> </div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">Cheers:<o:p></o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">Csanad<o:p></o:p></span></p>
</div>
<div id="bloop_customfont">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif";color:black"><br>
From: Arnold Krille <a \
href="mailto:arnold@arnoldarts.de">arnold@arnoldarts.de</a><br> Reply: Arnold \
Krille <a href="mailto:arnold@arnoldarts.de">arnold@arnoldarts.de</a><br> \
Date: 14 May 2014 at 6:18:25<br> To: <a \
href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a> <a \
href="mailto:drbd-user@lists.linbit.com"> drbd-user@lists.linbit.com</a><br>
Subject: Re: [DRBD-user] DRDB on one host <o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><br>
<br>
<o:p></o:p></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">On \
Tue, 13 May 2014 09:57:21 +1200 Csanad Novak <br>
<<a href="mailto:csanad@pixelfusion.co.nz">csanad@pixelfusion.co.nz</a>> wrote: \
<br> > Recently on the latest AWS Summit I've seen an interesting setup for <br>
> utilising the AWS EC2 instance storage. The instance storage is the <br>
> local filesystem on the Amazon cloud, unfortunately it is not <br>
> persistent - all data get lost if the instance stops. For persistent <br>
> storage one must use an so called EBS volume, which is a network <br>
> attached block device. Unfortunately the EBS storage performance is <br>
> varies, depending on the neighbour instances' traffic. An ideal world <br>
> one can use the instance storage without the worry of data loss. <br>
> <br>
> On the latest AWS Summit a presenter proposed an architecture where <br>
> the instance storage was utilised and was synced with DRBD to the EBS <br>
> block <br>
> device. <a \
href="http://www.slideshare.net/AmazonWebServices/so-you-think-you-are-an-aws-ninja-de \
an-samuels">http://www.slideshare.net/AmazonWebServices/so-you-think-you-are-an-aws-ninja-dean-samuels</a> -
<br>
> slide 11. <br>
> <br>
> I wonder how an example config would looks like. I went trough <br>
> quickly on the tutorials, but couldn't find any example with one host <br>
> setup. <br>
<br>
drbd on one host. Isn't that what raid/md is? <br>
<br>
I haven't had a chance to play with aws but if both ebs volumes and the <br>
instance-storage are block devices, it should be easy to mirror them <br>
with md or lvm. <br>
<br>
- Arnold <o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif""> \
<hr size="2" width="100%" align="center"> </span></div>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">_______________________________________________
<br>
drbd-user mailing list <br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a> <br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user">http://lists.linbit.com/mailman/listinfo/drbd-user</a>
<o:p></o:p></span></p>
</div>
</div>
</blockquote>
<div id="bloop_sign_1400016520832648960">
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">-- <br>
Kind regards,<o:p></o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td valign="bottom" style="padding:3.75pt 11.25pt 11.25pt 0in">
<p class="MsoNormal"><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif""><br> \
<img border="0" width="117" height="69" id="_x0000_i1026" \
src="cid:image001.gif@01CF6F9E.577D9E80"><o:p></o:p></span></p> </td>
<td valign="bottom" style="padding:0in 0in 11.25pt 0in">
<h1 style="margin:0in;margin-bottom:.0001pt;line-height:11.25pt"><span \
style="font-size:10.0pt;font-family:"Helvetica","sans-serif"">Csanad \
Novak<br> </span><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:#AAC500">Technical \
Lead</span><span style="font-size:10.0pt;font-family:"Helvetica","sans-serif""><o:p></o:p></span></h1>
<div>
<p class="MsoNormal" style="line-height:11.25pt"><strong><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif"">P \
/</span></strong><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif""> <a \
href="tel://09%20353%201234">09 353 1234</a><o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal" style="line-height:11.25pt"><strong><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif"">M \
/</span></strong><span \
style="font-size:8.5pt;font-family:"Helvetica","sans-serif""> <a \
href="tel://09%20353%201234">021 060 1531</a><br> <strong><span \
style="font-family:"Helvetica","sans-serif"">E \
/</span></strong> <a href="mailto:wouter@pixelfusion.co.nz"><span \
style="color:#AAC500;text-decoration:none">csanad@pixelfusion.co.nz</span></a> <o:p></o:p></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<div>
<p class="MsoNormal" style="line-height:13.5pt"><strong><span \
style="font-size:7.0pt;font-family:"Helvetica","sans-serif";text-transform:uppercase">W \
/</span></strong><span \
style="font-size:7.0pt;font-family:"Helvetica","sans-serif";text-transform:uppercase"> <a \
href="http://pixelfusion.co.nz/"><span \
style="color:#AAC500;text-decoration:none">PIXELFUSION.CO.NZ</span></a> / \
WHERE <strong><span \
style="font-family:"Helvetica","sans-serif"">DESIGN & \
DEVELOPMENT</span></strong> FUSE<br> <strong><span \
style="font-family:"Helvetica","sans-serif"">A \
/</span></strong> SUITE 403 "FORBIDDEN", THE IRON BANK, 150 \
KARANGAHAPE RD, AUCKLAND / PIXEL FUSION LTD, PO BOX 68 564, NEWTON, \
AUCKLAND / <a \
href="http://maps.google.co.nz/maps?cid=7370666879334476751&q=Pixel+Fusion"><span \
style="color:#AAC500;text-decoration:none">MAP</span></a><o:p></o:p></span></p> \
</div> </div>
</div>
</div>
</div>
</body>
</html>
["image001.gif" (image/gif)]
_______________________________________________
drbd-user mailing list
drbd-user@lists.linbit.com
http://lists.linbit.com/mailman/listinfo/drbd-user
--===============8874980546792307790==--
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic