[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: Re: Hadoop on premise versus cloud
From: daemeon reiydelle <daemeonr () gmail ! com>
Date: 2015-10-26 18:16:14
Message-ID: CAOUOv0Hr9HBRgdYdq2oWZY=UjY22NfmeGgSP68Co9MdeuOp30g () mail ! gmail ! com
[Download RAW message or body]
In addition to the data privacy concern described well below, there are a
couple of other areas you might consider (you can also respond privately
where I can be a bit more candid). . My experience with most banks (I work
with most of the players in the EU and US) are such that (1) below drives
development heavily into the cloud, in spite of (2)
1. Physical plant processes?
1. Your culture and processes may add months to a hardware delivery
cycle for production systems,
2. Does the data center under your employer's control even have the
available racks, power, network ports and router software versions to
support (bonding/stacking/teaming multiple 10gbit ports)
3. Big data gets much less interesting and viable when layers like
SAN and heavy hypervisors (VMware, Citrix) get into the mix, ditto "full
nightly backups" and other interesting confusions about the tech, not to
mention heavily committed to this, and requier full DR and zero
data loss
backups.
2. Data issues
1. Are the data sources "inside" your employer's network which would
require extra authorizations to allow them to connect to a cloud provider?
2. Are the consumers of the data going to be able to access the
cluster (similar questions if an intermediating data manipulation tool is
access by your employee/consumers)
3. As to data privacy
1. There are several data center providers who are legally and
entirely based within either the continental (Netherlands, Germany) or
adding UK if you think that is an alternative. To my knowledge Amazon is
not yet there but will be, I do not know if it is generally available but
Google Compute does have such ringfenced facilities in the EU, etc.
4. Now the real motiviations:
1. Startup costs as you figure out your data ingest complexity and as
your user expectations get clarified mean you seldom know what you will
need in a manner that management needs for their planning cycle.
2. Capital (hardware) costs are zero and all costs can be written off
in the current period. (Management has no hit to their capital expenses
budget)
3. Chainging (increasing ;{) costs can be directly tied to specific
activities as they occur (customer wants more X, additional data
sources Y,
and data Z% dirtier than expected ... you know the drill, yes?)
*.......*
*"Life should not be a journey to the grave with the intention of arriving
safely in apretty and well preserved body, but rather to skid in broadside
in a cloud of smoke,thoroughly used up, totally worn out, and loudly
proclaiming "Wow! What a Ride!" - Hunter ThompsonDaemeon C.M. ReiydelleUSA
(+1) 415.501.0198London (+44) (0) 20 8144 9872*
On Mon, Oct 26, 2015 at 8:01 AM, Leonard, Michael <Michael.Leonard@opco.com>
wrote:
> Hi,
>
>
>
> I work at a large financial institution. I'm exploring deploying Hadoop
> and I'm trying to understand why I would deploy on premise when the cloud
> is faster and easier. What are the pros/cons of each? How does pricing
> compare between on premise and cloud deployments?
>
>
>
> Any color would be very helpful. Thank you in advance.
>
>
>
> Sincerely,
>
> Michael
>
>
>
>
> This communication and any attached files may contain information that is
> confidential or privileged. If this communication has been received in
> error, please delete or destroy it immediately. Please go to
> www.opco.com/EmailDisclosures
>
[Attachment #3 (text/html)]
<div dir="ltr"><div class="gmail_default" style="font-family:comic sans \
ms,sans-serif;color:rgb(7,55,99)">In addition to the data privacy concern described \
well below, there are a couple of other areas you might consider (you can also \
respond privately where I can be a bit more candid). . My experience with most banks \
(I work with most of the players in the EU and US) are such that (1) below drives \
development heavily into the cloud, in spite of (2)<br><br><ol><li>Physical plant \
processes?<br></li><ol><li>Your culture and processes may add months to a hardware \
delivery cycle for production systems,</li><li>Does the data center under your \
employer's control even have the available racks, power, network ports and router \
software versions to support (bonding/stacking/teaming multiple 10gbit \
ports)</li><li>Big data gets much less interesting and viable when layers like SAN \
and heavy hypervisors (VMware, Citrix) get into the mix, ditto "full nightly \
backups" and other interesting confusions about the tech, not to mention \
heavily committed to this, and requier full DR and zero data loss \
backups.<br></li></ol><li>Data issues<br></li><ol><li>Are the data sources \
"inside" your employer's network which would require extra \
authorizations to allow them to connect to a cloud provider?</li><li>Are the \
consumers of the data going to be able to access the cluster (similar questions if an \
intermediating data manipulation tool is access by your \
employee/consumers)</li></ol><li>As to data privacy</li><ol><li>There are several \
data center providers who are legally and entirely based within either the \
continental (Netherlands, Germany) or adding UK if you think that is an alternative. \
To my knowledge Amazon is not yet there but will be, I do not know if it is generally \
available but Google Compute does have such ringfenced facilities in the EU, \
etc.</li></ol><li>Now the real motiviations:</li><ol><li>Startup costs as you figure \
out your data ingest complexity and as your user expectations get clarified mean you \
seldom know what you will need in a manner that management needs for their planning \
cycle. <br></li><li>Capital (hardware) costs are zero and all costs can be written \
off in the current period. (Management has no hit to their capital expenses \
budget)</li><li>Chainging (increasing ;{) costs can be directly tied to specific \
activities as they occur (customer wants more X, additional data sources Y, and data \
Z% dirtier than expected ... you know the drill, \
yes?)<br></li></ol></ol></div></div><div class="gmail_extra"><br \
clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div \
dir="ltr"><span style="color:rgb(56,118,29)"><span \
style="background-color:rgb(255,255,255)"><b><span style="font-family:comic sans \
ms,sans-serif"></span></b></span></span><span style="color:rgb(56,118,29)"><span \
style="background-color:rgb(255,255,255)"><b><span style="font-family:comic sans \
ms,sans-serif"><br>.......<br></span></b></span></span><span \
style="color:rgb(56,118,29)"><span style="background-color:rgb(255,255,255)"><b><span \
style="font-family:comic sans ms,sans-serif"><strong>"Life should not be a journey to \
the grave with the intention of arriving safely in a<br>pretty and well preserved \
body, but rather to skid in broadside in a cloud of smoke,<br>thoroughly used up, \
totally worn out, and loudly proclaiming "Wow! What a Ride!"</strong> <br>- Hunter \
Thompson<br><br>Daemeon C.M. Reiydelle<br>USA (+1) 415.501.0198<br>London (+44) (0) \
20 8144 9872</span></b></span></span><font \
size="1"><i><br></i></font></div></div></div></div></div> <br><div \
class="gmail_quote">On Mon, Oct 26, 2015 at 8:01 AM, Leonard, Michael <span \
dir="ltr"><<a href="mailto:Michael.Leonard@opco.com" \
target="_blank">Michael.Leonard@opco.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-US"><div><p \
class="MsoNormal">Hi,<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p><p \
class="MsoNormal">I work at a large financial institution. I'm exploring deploying \
Hadoop and I'm trying to understand why I would deploy on premise when the cloud is \
faster and easier. What are the pros/cons of each? How does pricing compare between \
on premise and cloud deployments?<u></u><u></u></p><p class="MsoNormal"><u></u> \
<u></u></p><p class="MsoNormal">Any color would be very helpful. Thank you in \
advance.<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p><p \
class="MsoNormal">Sincerely,<u></u><u></u></p><p \
class="MsoNormal">Michael<u></u><u></u></p><p class="MsoNormal"><u></u> \
<u></u></p><p class="MsoNormal"><u></u> <u></u></p></div><font size="2"> This \
communication and any attached files may contain information that is confidential or \
privileged. If this communication has been received in error, please delete or \
destroy it immediately. Please go to <a href="http://www.opco.com/EmailDisclosures" \
target="_blank">www.opco.com/EmailDisclosures</a></font> \
</div></blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic