zCloud : DS8000 and DFSMS Cloud Enablement

Transcription

zCloud : DS8000 and DFSMS
Cloud Enablement
Nick Clayton
IBM Systems Development
4th November 2015
Session DK
Agenda
• Introduction - Objects : What, Why and How?
• Multi Cloud Storage Toolkit (MCStore)
• DS8000 and DFSMS Cloud Enablement
• DS8000/DFSMS Use Cases
Session feedback – Do it online at conferences.gse.org.uk/2015/feedback/DK
2
Smart, new approaches to business and IT innovation
Leveraging the best of traditional
and new approaches
Industrial Strength, Universal Connectivity
Browsers
Content
Transactions
Web Servers
Security
Standards
Systems Mgmt
Availability
Efficient, dynamic and
responsive
Java
Massive Scalability, Rich Diversity
Business Services
Sensors
Fragmented, inefficient islands
of computing
Consumer Services
Autonomic Management
Devices
Real-time Info
Massive Compute Capacity
Scale-out data center designs
3
Object Storage Defined
Cost effective,
scalable,
self-healing
storage for
massive amounts
of unstructured
data.
4
Object Store Data Model
Object Storage:
Uses an object data model which is comprised of the object file and meta
data associated with the object.
Each object has an identifier and is treated as a whole entity, example: a
video, image, or document is treated as an object entity.
Objects and associated metadata is stored in Object Container
Account : Customer A
Object Container
Meta Data
ID
Object File
Meta Data
ID
Object File
5
Object Storage – Slightly More Technical
Interface
– Web-based: GET/PUT/DELETE
– RESTful: Stateless
– Metadata
Synchronization
– Eventual Consistency
– No distributed locking
Software Defined Storage
– Commodity hardware
– Designed to fault but never fail
– Built to auto-recover by design
Features
– Basic services that scale (KISS)
– SW extendible with web interfaces
6
OpenStack Object Storage (Swift)
•
•
Massively scalable redundant
storage system
(1000s servers, PBs data)
Objects are written to multiple
disk drives
–
•
•
•
default: 3-way replication
Swift software is responsible for
data replication and integrity
across the cluster
Application vendors can name
OpenStack Swift API as
supported storage configuration
Service Providers / application
hosting can use Swift to provide
Amazon S3 like services to their
customers
7
IBM’s SoftLayer Object Store Service
IBM Object Store Service provides:
Multi-tenant, highly
scalable and durable
object storage service
that was designed to
securely store large
amounts of unstructured
data at low cost
Object store that can be easily integrated into
applications and cloud services
High Availability with automatic data replication and
integrity across storage clusters in IBM Cloud
platform
OpenStack Swift Object API to create, modify, and
get objects and metadata
Management features ; scalability, availability, and
logging
Ability to organize and manage data with tagging,
search, and indexing capabilities and API
accessibility
Simplified usage reporting ,metrics, and billing
8
8
October 5th
9
9
MCStore technology
Cloud Storage
Provider
MCStore in Storage
NAS
Object
Storage Product
IBM
private cloud
data
data
IBM Softlayer
MCStore
in Cloud
De-duplication
Integrity
Protection
(ElasticStorage/ESS, SVC,
Storwize, DS8k, XIV,...)
Transparent Data
Migration
provider agnostic
KVS API
provider specific
REST API
Backup and
Disaster Recovery
Amazon S3
Security and
High Availability
Storage and I/O
Efficiency
10
IBM Big Storage Vision :
Industry’s lowest $x / PB of active data
General Storage
FC
iSCSI
General
XIV
MC Store
MC Store
FC
NAS
FC/FICON
iSCSI
Object
Spectrum Scale
DS8K
Spectrum
Virtualize
Hadoop
MC Store
MC Store
MC Store
AFM
SWIFT
Spectrum Scale
LTFS
Flash
•
•
•
•
Slow
Disk
Tape
Embed MCStore in IBM products for data storage tiering and back-up to cloud
Provide heterogeneous cloud support but feature Swift backed by Elastic storage on SoftLayer
Cloud storage will preserve the data to tape via LTFS (Near line access)
Cost efficient data preservation for long term data retention. Sample 5 year costs for 2 petabytes:
• Amazon: $1.2m ($1c per GB per month).
IBM: $300k (1/4c per GB per month)
11
11
Mainframe Data in the Cloud?
Take advantage of Cloud efficiencies by storing Mainframe data with a
Private/Hybrid Cloud model
• Cost Efficiencies
• Consolidate Hardware / Infrastructure
• Consolidate OPEX costs
• Service Delivery Model vs. Traditional IT
• Security
• Maintain fully encrypted, secure
environments
• Flexibility / Accessibility
• Globally accessible data
• Highly scalable
12
Disclaimer
The information on the new product is intended to outline our general product direction
and it should not be relied on in making a purchasing decision. The information on the new
product is for informational purposes only and may not be incorporated into any contract.
The information on the new product is not a commitment, promise, or legal obligation to
deliver any material, code or functionality. The development, release, and timing of any
features or functionality described for our products remains at our sole discretion.
13
DS8000 Cloud Enablement with DFSMS Integration
• Direct data transfer from DS8000 to a Cloud Service Provider
• No additional appliances in data path
• Save System z MIPS by avoiding data movement “horseshoe” through host
• Data Type Agnostic
• z/OS ECKD and Fixed Block Data Types Supported
• z/OS Datasets and Full Volumes Supported
• Encryption / Auditing / Security
DFSMS
• Full End to End Encryption including Encryption of Data in Flight
• Support of System z Audit Logging
• Architected with System z security (RACF)
• DFSMShsm Integration and APIs
• Seamless integration with DFSMS (HSM, SDM, DSS)
• Publically available APIs for DSS and SDM
MCStore
Enterprise
Private Cloud
14
DS8000 Cloud Enablement
DFSMS Migration
• Data set level Migration to Cloud
• Offload Data movement
• Compression not done with initial support
• OK for compressed data
Automatic Recall to Primary Storage
• Phase 1
• Command Driven at the data set, volume and storage group level.
• Data set level is expected to be most common because ALL data will be
processed from volume, storage group
• Explicitly state ‘Cloud’ as the Tier
MIGRATE DATASETNAME(dsname) MIGRATIONLEVEL(MLname)
•
•
Enable named constructs as new migration levels, to get away from fixed level
migration tiers
Same internal HSM structure, so management of data and recalls behave just the
same as ML1 / ML2 data
15
DFSMS Backup
Cloud
• Phase 1
• DSS Backup to the Cloud
COPY DS(INCL(dsname)) CLOUD(name)
Data Set
FlashCopy
Cloud
Primary
Target
• Using DSS, ALL data movement offloaded to controller
• FlashCopy used to create PiT copy on disk
• Disk to Cloud, movement performed by disk controller
16
DB2 Use Case
• Phase 1
• DB2 Image Copies to the Cloud
MIGRATE STORAGEGROUP(sgname) MIGRATIONLEVEL(cloud)
SGDB2IC
DB2
DB2
Image
Copies
MIGRATE
SG(SGDB2IC)
Cloud
• Using DSS FlashCopy to create DB2 Image Copies and HSM Storage
Group Migration to the Cloud, ALL data movement offloaded to controller
• FlashCopy used to create PiT copy on disk
• Disk to Cloud, movement performed by disk controller
17
Edge 2015 DS8000/HSM Archive Demo
FICON
Ethernet (TCPIP)
SWIFT
Spectrum Scale
LTFS
Tape
System z
DS8870
•
•
z/OS 2.1 running DFSMShsm with volumes connected to a DS8870 via FICON interface
DS8870 running MCStore connected to a Big Storage private cloud made of LTFS Tape as a
backend
•
•
DFSMS controls data movement of datasets
DS8870 moves data directly from disk to and from Cloud using MCStore
18
Session feedback
• Please submit your feedback at
http://conferences.gse.org.uk/2015/feedback/nn
• Session is DK
19

zCloud : DS8000 and DFSMS Cloud Enablement

Transcription

Similar documents

iPPlus Sales Sheet - IP Plus Consulting, Inc.

Company Fact Sheet 2016

Changes That Heal_indd

Open Cloud Initaitive http://www.opencloudinitiative.org/ Sam

Cloud IP Camera

02. Plenair Tom Welling Dharminder Debisarun

January 2015 - ZATIS TECHNOLOGY GROUP

Cloud Identification Guide

AppRiver - Franchise services Inc.