EMC ISILON SCALE

EMC ISILON
SCALE-OUT NAS
Remco Donkers
Regional Territory Manager
EMC Isilon Storage Division
April 2015
© Copyright 2015 EMC Corporation. All rights reserved.
1
Isilon Simplicity and Ease of Use
 Single volume and file system
SINGLE FILE SYSTEM
– Directories and files striped across cluster nodes
© Copyright 2015 EMC Corporation. All rights reserved.
 Automation:
– NO manual intervention
– NO reconfiguration
– NO server or client mount point or
application changes
– NO data migrations
– NO RAID
2
Massively Scalable
More scalable than traditional storage systems
Isilon scales from
16TB to 50PB
in a single file system,
single volume cluster
 Under 60 seconds to
scale with no downtime
© Copyright 2015 EMC Corporation. All rights reserved.
3
Gain New Levels of Efficiency
Isilon AutoBalance
AutoBalance
BALANCED
EMPTY
Automated data balancing across nodes reduces
costs, complexity, and risks for scaling storage
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
• AutoBalance automatically moves content
to new storage nodes
• Eliminates “hot spots”
• Enables unmatched storage capacity
utilization of more than 80%
BALANCED
EMPTY
FULL
BALANCED
EMPTY
© Copyright 2015 EMC Corporation. All rights reserved.
4
Unmatched Data Protection and Availability
Highly resilient, clustered architecture
WithN+1
N+2,protection,
N+3, and
With
N+4 protection,
data is 100%
data is 100% available
available
a
if multiple even
drivesifor
single
nodesdrive
fail
or node fails
100%
100%
FAILED
100%
100%
And with Isilon, the
more nodes in the
cluster, the faster
drive rebuild time
100%
100%
100%
FAILED
© Copyright 2015 EMC Corporation. All rights reserved.
100%
5
Isilon Security and Compliance Options
•
Roles-based access control (RBAC)
•
Access Zones for secure isolation
•
WORM Data Protection
•
File System Auditing
•
Data at Rest Encryption (DARE) with SelfEncrypting Drives (SEDs)
© Copyright 2015 EMC Corporation. All rights reserved.
6
“Never Refresh Again” Architecture
Meet Your Big Data
Requirements
with EMC Isilon
• One File System, One Volume Storage
Management Simplicity
• Zero Downtime Expansion
• Greater than 80% utilization rates
• Adapt your existing storage resources
• Robust Security Options and Enterprise
Data Protection
• Investment Protection: Pay As You Go
• Eliminate Silos and Hot Spots
© Copyright 2015 EMC Corporation. All rights reserved.
7
Isilon Platform Portfolio
S-SERIES
X-SERIES
NL-SERIES
HD-SERIES
A-SERIES
High Transactional
Platform
High Throughput
Platform
Nearline Storage
Platform
High Density
Platform
Backup and
Performance
Accelerators
S210
X410
X400
S200
A100 Performance
Accelerator
NL400
HD400
A100 Backup
Accelerator
X200
SSD and SAS
(16 TB – 4.15 PB)*
SSD and SATA
(24 TB –20.7 PB)*
SSD and SATA
(108 TB – 30 PB)*
SSD and SATA
(1 PB – 50 PB)*
Scale performance
without capacity
*Scales from 3 node cluster to 144 node cluster
© Copyright 2015 EMC Corporation. All rights reserved.
9
Syncplicity Panorama features
7.2
Next Generation Mobile Access to EMC Isilon/VNX/VNXe/Atmos
• Secure mobile read/write access to EMC file
storage home directories and file shares from
within and outside corporate network
• In-place access: No data migration, No cloud
component
• Augments EMC Isilon Authentication and
Permissions with advance mobile device
policies
• Access via Syncplicity Mobile App – one app, all
content
• Easy set up, with or without Syncplicity
• Available free of charge to Isilon/ VNX/ Atmos
customers
Powered by
© Copyright 2015 EMC Corporation. All rights reserved.
11
Klanten in Nederland
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Photobox
Radio538
RTL
SBS
Comscore
Capgemini
NOS
LUMC
Twee Steden
Ziekenhuis
Elisabeth Ziekenhuis
VUMC
Erasmus MC
Beeld & Geluid
AMC Networks
© Copyright 2015 EMC Corporation. All rights reserved.
•
•
•
•
•
•
•
•
•
•
•
•
•
Amsio
Cyclomedia
BT
KPN
LiveOffice
ORT
PON
Adobe
Kadaster
Atos
United
Atos
Maastro
•
•
•
•
•
•
•
•
•
•
•
•
•
AMC
•
Medtronic
•
Carestream
•
Gelder Archief
•
BZK
•
MCH
•
Kennemer
•
Gasthuis
MCA
•
Zorgsaam
•
UMC Utrecht
•
ADRZ
•
Maastricht
University
St Lucas Andreas •
Disney
eBay/Marktplaats
Ericsson
BS/Technicolor
Irdeto
MTV Networks
RTV Rijnmond
RWS
Viecuri
Vancis
Spaarne
Ziekenhuis
Maxima Medisch
Centrum
KNMI
13
Why do you need it?
© Copyright 2015 EMC Corporation. All rights reserved.
14
1994
© Copyright 2015 EMC Corporation. All rights reserved.
NASA's Lunar
Reconnaissance Orbiter has
transmitted its first images
since reaching the moon on
June 23. The spacecraft's
two cameras, collectively
known as the Lunar
Reconnaissance Orbiter
Camera, or LROC, were
activated June 30. The
cameras are working well
and have returned images of
a region in the lunar
highlands south of Mare
Nubium (Sea of Clouds).
15
© Copyright 2015 EMC Corporation. All rights reserved.
16
Unstructured Data Growth
80%
74%
67%
2013
2015
2017
37 EB
71 EB
133 EB
Total Capacity Shipped, Worldwide
Unstructured Data
Source: IDC
EMC CONFIDENTIAL—INTERNAL USE ONLY
17
Digital “Archiving” is Growing Rapidly
Petabytes
350 000
302 995
300 000
250 000
200 000
197 334
Backup Exec
150 000
123 157
100 000
50 000
0
15 034
22 071
33 217
2008
2009
2010
51 992
2011
79 151
2012
2013
2014
2015
Source: ESG: Total Worldwide Digital Archive Capacity, All Content Types, 2008-2015
© Copyright 2015 EMC Corporation. All rights reserved.
18
BIG DATA…. ?
© Copyright 2015 EMC Corporation. All rights reserved.
19
Forget Cost What about Response time
Response Times: The 3 Important Limits
0.1 second is about the limit for having the user feel that the system
is reacting instantaneously, meaning that no special feedback is
necessary except to display the result.
1.0 second is about the limit for the user's flow of thought to stay
uninterrupted, even though the user will notice the delay. Normally,
no special feedback is necessary during delays of more than 0.1 but
less than 1.0 second, but the user does lose the feeling of operating
directly on the data.
10 seconds is about the limit for keeping the user's attention focused
on the dialogue.
© Copyright 2015 EMC Corporation. All rights reserved.
20
2015 2 seconds will be the new standard
For Impatient Web Users, an Eye Blink Is Just Too Long to Wait
In 2009, a study by Forrester Research found that online shoppers
A more
recent
study
finds
that (by
time's
expected
pages
to load
in two
seconds
orthat
fewer
— and at three
data)
viewers
of online
video
start
to years earlier a
seconds,
a large
share
abandon
thestreams
site. Only
three
viewing
the video
its expectations
startup delayfor page load
similarabandon
Forrester
study found
the when
average
2 seconds
secondsor
. Progressively
more viewers
times reaches
were four
fewer.
abandon viewing as the startup delay
increases
Speed, Mr. Jain said, is a critical element in all of Google’s products.
There is even a companywide speed budget; new offerings and product
tweaks must not slow down Google services.
http://www.nytimes.com/2012/03/01/technology/impatient-web-users-flee-slow-loading-sites.html?pagewanted=all&_r=0
© Copyright 2015 EMC Corporation. All rights reserved.
21
The answer: Build A Data Lake
The data lake is the landing zone for all the data in your organization.
But building out such a next-generation data infrastructure requires
more than simply deploying Hadoop; there's a whole ecosystem of
related technologies that need to integrate with your “data lake” to
make it happen.
© Copyright 2015 EMC Corporation. All rights reserved.
22
2ND PLATFORM
3RD PLATFORM
DAS
NAS
Analytics
File Shares
SAN
CLOUD
Mobile
HPC
TAPE
Backup/Archive
© Copyright 2015 EMC Corporation. All rights reserved.
OBJECT
Cloud Apps
23
2ND PLATFORM
3RD PLATFORM
DAS
NAS
Analytics
File Shares
Isilon
Scale-Out
Data Lake
SAN
HPC
TAPE
Backup/Archive
© Copyright 2015 EMC Corporation. All rights reserved.
CLOUD
Mobile
OBJECT
Cloud Apps
24
Support for Multiple Hadoop Distributions
Node
reply
MAP Reduce
NameNode
NFS
MAP Reduce
MAP Reduce
Data
MAP Reduce
MAP Reduce
SMB
SMB
MAP Reduce
name
node
name
node
name
node
NFS
name
node
MAP Reduce
MAP Reduce
data node
SMB, NFS,
HTTP, FTP,
HDFS
MAP Reduce
MAP Reduce
MAP Reduce
HDFS
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
© Copyright 2015 EMC Corporation. All rights reserved.
25
HDFS: Integrated Isilon and vHadoop
Node
reply
NameNode
NFS
Data
SMB
Apache
SMB
name
node
name
node
name
node
NFS
© Copyright 2015 EMC Corporation. All rights reserved.
data node
SMB, NFS,
HTTP, FTP,
HDFS
HDFS
name
node
26
Unstructured Data Strategy Challenges
DB Dumps
File Shares
Archive
VMware
Log Files
BLOBS
SAN
NAS
OBJECT
TAPE
Remote Office
Cloud/Object
High Performance
Compute
Hadoop
Data Analytics
ANDROID IPHONE
Video
© Copyright 2015 EMC Corporation. All rights reserved.
IPAD
Call Recording
27
You can do it all today with Isilon
DB Dumps
File Shares
Archive
VMware
Log Files
BLOBS
Remote Office
Cloud/Object
High Performance
Compute
Hadoop
Data Analytics
ANDROIDIPHONE IPAD
Video
© Copyright 2015 EMC Corporation. All rights reserved.
Call Recording
28
Isilon Scale-Out NAS
Simple to manage
 Single file system, single volume, global namespace
Massively scalable
 Scales from 16 TB to over 50 PB in a single cluster
Unmatched efficiency
 Over 80% storage utilization, automated tiering and SmartDedupe
Enterprise data protection
 Efficient backup and disaster recovery, and N+1 thru N+4 redundancy
Robust security and compliance options
 RBAC, Access Zones, WORM data security, File System Auditing
 Data At Rest Encryption with SEDs
Operational flexibility
 Multi-protocol support including NFS, SMB, HTTP, FTP, and HDFS
 Syncplicity support for mobile computing
 Object and Cloud computing including OpenStack Swift
© Copyright 2015 EMC Corporation. All rights reserved.
29