Teradata CLoud
Transcription
Teradata CLoud
TERADATA CLOUD Teradata User Group Cloud Musings To Cloud or Not to Cloud? That Is the Question! • CIOs consistently state cloud is a top three technology priority. • But confronted with myriad choices in providers, capabilities, and service options how does one choose the best fit? Or is cloud the right answer, especially for analytics? • This session will discuss “analytics in the cloud” considerations including performance, security, scalability and more to help you determine the best path to deployment success. 2 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud Computing Defined “ Cloud computing means someone else runs your computers and software while you use what they deliver and focus on delivering value.” – Daryl Plummer, Gartner Group, “The Business Landscape of Cloud Computing.” 3 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud and Analytics Are Top CIO Priorities *From Gartner’s 2013 Annual Survey of CIOs 4 Copyright © 2013-2014 by Teradata. All rights reserved. Let’s Start with Dilbert 5 Copyright © 2013-2014 by Teradata. All rights reserved. TODAY’S AGENDA • Use Cases • Cloud Costs • Moving Data • Analytic Performance • Cloud Security • Data Management • Governance and Compliance • Service Level Agreements • Teradata Cloud 6 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud Use Cases • Cloud Mandate • Test and Development • Data Marts • BC/DR • Data Gravity • Business Analytics as a Services • Sandbox 7 Copyright © 2013-2014 by Teradata. All rights reserved. Is Cloud Really Cheaper? • Cloud costs you may not have considered… > Bandwidth to connect to the cloud > Cost to take data out of the cloud > Integration of cloud and on-premises applications • Don’t forget about on-premise costs > Electricity and cooling > Annual software maintenance fees > Full time employees – How much time is associated with administration of on-prem hardware? > Cost of an outage “ Compared to on-premise systems, on average, public clouds still see much better reliability and uptime.” – Derrick Wlodarz, Betanews 8 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud Cost Continued… • When is cloud a less expensive alternative? > Short projects > Consider data gravity 9 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud Value • Intangibles in the cloud’s favor: > Don’t have to over buy or under buy > Faster deployment of resources can increase speed to market > Ability to redeploy in-house IT human capital to more important projects 10 Copyright © 2013-2014 by Teradata. All rights reserved. Moving Big Data • Latency • Data Integrity > What tools are needed to ensure integrity? • Data Portability > How easy is it to move to a new provider? 11 Copyright © 2013-2014 by Teradata. All rights reserved. Performance • Will cloud give you as good, if not better, performance than on-premise solutions? • Things to consider > Latency > Concurrency > Complexity of analytics > Loading strategies – Overnight batch or intra-day or intra-hour? 12 Copyright © 2013-2014 by Teradata. All rights reserved. Data Management • You manage/monitor/maintain/develop your analytic environment • Or someone else does it for you: > Managed Services – Flexible night/weekend or shift support > Consulting “ Cloud-related consulting, implementation, and management services help bridge the gap between the capabilities of standard cloud services and the specific needs of organizations.” – Gartner Group 13 Copyright © 2013-2014 by Teradata. All rights reserved. Security • Infrastructure Security > Computation and data stores must be secured • Data Privacy > Encryption and Robust Access Controls • Data Integrity and Monitoring • Compliance and Certifications 14 Copyright © 2013-2014 by Teradata. All rights reserved. Customer Security Checklist • IT Cloud Use Policy > Data Governance, International Compliance, Personal Identifiable Data Policy, User Access, and Restrictions • Cloud Security Training • Cloud Contract Requirements > Must cover IT Cloud Use Policy • Data Breach Procedures • Cloud Supplier Audit • Cyber Liability Insurance 15 Copyright © 2013-2014 by Teradata. All rights reserved. TERADATA CLOUD? 16 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Vision • “Gold Standard” for Cloud Analytics > Best-in-class performance, functionality, security, and reliability • Fast, Flexible Provisioning and Scale-Up > Choice of Teradata, Teradata Aster, or Hadoop > Up and running in 24 hours or less > “Upsize” in less than 24 hours • Simple, Competitive Flexible Pricing > Price per performance unit (Monthly, 1-Year, 3-Year Options) – includes nodes, software, storage, maintenance, operations, and daily back-up • Business Analytics as a Service > Business solutions – not just technology 17 Copyright © 2013-2014 by Teradata. All rights reserved. Cloud Computing Compare Cloud Model Pricing Model System Location System Management Provisioning /Elasticity Internal Private “Cloud” CapEx Your Data Center You Manage Months Teradata Cloud Data Center Teradata Cloud Operations with Managed Services Options 6-8 weeks Teradata Cloud Data Center Teradata Cloud Operations ~24 Hours Public Cloud Provider Public Cloud Provider Basic Infrastructure Minutes External Custom Private Cloud External Private Cloud Public Cloud 18 OpEx OpEx OpEx Copyright © 2013-2014 by Teradata. All rights reserved. “As a Service” Models 19 Data Warehouse as a Service Discovery as a Service Data Management as a Service Consulting Services for DWaaS Consulting Services for Discovery Consulting Services for Hadoop Enhanced Services Enhanced Services Enhanced Services DWaaS Foundation (Teradata) Discovery Foundation (Aster) Hadoop Foundation Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Architecture Teradata Cloud Viewpoint Load Server Client Tools Teradata Teradata Teradata Teradata Teradata Viewpoint Load Server Client Tools Viewpoint Load Server Client Tools Automatic Daily Backup Teradata Aster Aster Teradata Teradata Teradata Aster Aster Aster Hadoop Hadoop Hadoop Cloud Compute Units 20 ETL Server Network BI Server Server Management Virtual Application Servers Copyright © 2013-2014 by Teradata. All rights reserved. Redundant Infrastructure Teradata Cloud Architecture Segregated Virtual Networks Teradata Cloud Viewpoint Customer 1 Customer 2 Site-to-Site VPN 10-100 Mbps Site-to-Site VPN 10-100 Mbps Dedicated Circuit 1-10 Gbps Customer 3 Load Server Teradata Teradata Teradata Teradata Teradata Aster Aster Viewpoint Load Server Client Tools Teradata Teradata Teradata Aster Aster Aster Hadoop Hadoop Hadoop Viewpoint Load Server Client Tools Cloud Compute Units ETL Server Automatic Daily Backup Network BI Server Server Management Virtual Application Servers Dedicated 21 Client Tools Copyright © 2013-2014 by Teradata. All rights reserved. Redundant Infrastructure Multi-Tenant Cloud Compute Units • Cloud-Optimized Configurations > Hardware, software, Utilities, storage Teradata Teradata Teradata Teradata Teradata Aster Aster Teradata Teradata Teradata Aster Aster Aster Hadoop Hadoop Hadoop Cloud Compute Units 22 • Integrated database software > Teradata 14.10 > Teradata Aster 6.0 > Hadoop – Hortonworks (Future) • Pre-installed systems for Rapid provisioning and expansions • 7X24 support, subscription, and software updates managed by cloud operations team > Support for two major database releases Copyright © 2013-2014 by Teradata. All rights reserved. What’s Included in the Teradata CCU • Teradata 14.10 – Cloud Foundation > Teradata Database 14.10 for the cloud includes: – Core database functionality – Appliance-level workload management – Teradata tools and utilities • Teradata 14.10 Options (purchased separately) > Available as an enhanced option – Teradata Parallel Transporter Stream/Tpump – Temporal CCU Components – Columnar Teradata Database • Minimum Configuration > (1) CCU 23 TTU Load Utilities Viewpoint CPU Memory Drives DPN CDS/CCU Fallback AMPS/node Copyright © 2013-2014 by Teradata. All rights reserved. CCU Details 14.10 14.10 15.00 2x2.6Ghz(8c) 256 GB 900GB 24 (internal) 4 TB (after FALLBACK) On 36 What’s Included in Teradata Aster CCU • Teradata Aster 6.0 – Cloud Foundation > Teradata Aster 6.0 for the Cloud includes: – Teradata Aster MR Analytical Foundation – Teradata Aster MR Analytical Premium (Path/Pattern, Statistics, Relationship) – Teradata Aster Graph Analytics • Teradata Aster 6.0 Options: (purchased separately) > Available as and Enhanced Option – Teradata Aster SQL-H • Minimum Configuration: > (2) Queen > (2) Workers 24 Copyright © 2013-2014 by Teradata. All rights reserved. Hortonworks—A Deep Partnership • Hortonworks has a top-to-bottom partnership with Teradata from executive management through engineering, marketing, sales, and support We develop, distribute, and support the ONLY 100% complete open source Enterprise Hadoop distribution Develop • We employ the core architects, builders and operators of Apache Hadoop • We drive innovation within the open source community projects 25 Distribute • Application of enterprise software rigor to the open source process • Distribute the only 100% Open Source Enterprise Hadoop Distribution: Hortonworks Data Platform Copyright © 2013-2014 by Teradata. All rights reserved. Support • Enable the ecosystem to incorporate Hadoop • Uniquely positioned to deliver the highest quality of development and production support Virtual Application Servers Viewpoint Load Server Client Tools • Virtual Viewpoint Database Management Dashboard > Activity and capacity monitoring views Viewpoint Load Server Client Tools Viewpoint Load Server Client Tools ETL Server • Virtual Load Server • Windows Utility Server BI Server Virtual Application Servers 26 Copyright © 2013-2014 by Teradata. All rights reserved. Redundant Infrastructure • Automated Daily Back-ups Automatic Daily Backup > Two generations • Replicated to a Second Data Center • Secure, Segregated Customer Access • VPN Access up to 100Mpbs > 1GB and 10GB Direct Connect Options Network Server Management • BAR Connectivity • Hardware and Software Monitoring • Alerts for Automated Parts Replacement Redundant Infrastructure 27 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Data Movement • Data Movement > Teradata supplied external storage device (for initial load) > VPN up to 100Mbps (low volume daily data loads) > Dedicated 1Gb or 10Gb network connection (high-volume daily data loads) 28 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Performance • Latency > Need to right-size bandwidth – Teradata can help you decide • Concurrency > High query concurrency is a hallmark of Teradata Database • Complexity of analytics > Teradata Cloud built for complex queries 29 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Management • System provisioning • System administration, monitoring, and support > Provide upkeep for proactive monitoring and support tools > Execute periodic system health checks > Plan corrective action maintenance windows • Schedule and perform software upgrades • Incident ownership and resolution > Provide customer interface and contact > Provide coordination with internal Teradata support teams • Manage and execute BAR processes • Assist with system security administration 30 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Viewpoint Single Operational View for Teradata 31 Copyright © 2013-2014 by Teradata. All rights reserved. Enhanced Managed Services Operate your Environment • Operations support for Teradata, Teradata Aster, ETL, BI, and Hadoop • Coverage and SLA based Maintain and Enhance Your Environment • Development teams for ETL, DW, BI, Teradata Aster, Hadoop • From business discovery to EDW optimization Managed Services provide best practices, pro-active management and integrated support for your big data analytics eco-system 32 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Security Strategy • Secure Cloud Platform > The Teradata Cloud controls are built to meet the FedRAMP security standards > The Teradata Cloud has also been built to meet these commercial security standards: – PCI, HIPAA, ISO 27001, SSAE 16/ISAE 3402 > Teradata is planning to receive official certifications for ISO 27001, PCI, and HIPAA before the end of 2014 – Other certifications will follow based on business requirements Note: This is for Teradata and Teradata Aster security levels only. Hadoop certifications and timing TBD. 33 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Pricing • Flexible Pay-as-you-go-Pricing > Monthly, 1-year, 3-years > Reservation (setup) fee for 1-year and 3-year contracts • Teradata and Teradata Aster – priced per CCU (Cloud Compute Unit) • Cloud Enhanced Services (optional): > Priced separately at a monthly rate > Example: enhanced Security/Network Capacity/Load Servers • Partner Products (Integrated Partners) > Monthly pricing for software licenses – Single pricing model for BI vendors – Single pricing model for DI vendors 34 Copyright © 2013-2014 by Teradata. All rights reserved. “As a Service” TCO Summary • May be less capital intensive to get started, but not significantly cheaper over the long-term • Operational costs (and headaches) essentially shift from customer to cloud provider Operations Cost 3-Yr. On-Premise Overall TCO Customer Owned and Managed 35 • Data Center • FTEs 3-Yr. Teradata Hardware, Software, and Support Teradata Cloud Copyright © 2013-2014 by Teradata. All rights reserved. Business Continuity Use Cases • Protect against Data Center or System Failures • Standby-DR > Second system > Can be a fully-replicated system or a subset of production > Data is copied to the second system periodically – Minimize latency, removes restore time • Deployment Models > On-premise to cloud – Production environment is on-premise with a cloud-based DR system > Cloud to Cloud – Cloud-based production instance with secondary cloud site as the backup 36 Copyright © 2013-2014 by Teradata. All rights reserved. On Premise to Cloud • Production On-Premise, DR in Cloud > Move all or a subset (mission critical) of On-Premise Customer Data Center Teradata DM Server data from an on-premise environment to a cloud-based second system > Leverage Teradata Unity Data Mover for periodic table copies between systems > Data Mover servers must reside onpremise Data Mover 37 Copyright © 2013-2014 by Teradata. All rights reserved. Business Analytics as a Service • Provide Business Applications in the Teradata Cloud that can be functional day one • We’ll provide > Fixed set of business questions > > > > 38 answered fixed visualization/BI application layer Fixed semantic data model Fixed integrated data warehouse model Fixed set of load and transformation procedures Fixed set of source files optionally extracted from a set of known source software packages Copyright © 2013-2014 by Teradata. All rights reserved. Deployment Timeline Data Warehouse as a Service (Custom equipment available now/CCU platform in late June) • “Gold Standard” for Analytics in the Cloud • Full solution: data modeling, ETL, data warehousing, BI • Multiple production customers Discovery as a Service (Teradata Aster CCU available June 2014) • Faster provisioning • Flexible pricing Data Management as a Service (Hadoop available Q3-Q4) 39 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Futures (Release Date: TBD) • • • • • • Cloud Foundation Cloud Bursting Customer Self Provisioning Virtual Test/Dev Environment Support for Teradata 15 CCU Performance Options > CPU/IO rich options > Storage Rich options • Enhanced Services (Options) > Teradata Applications Integration > Campaign Management, Marketing Operations, etc > DCM > MDM > Teradata Value Analyzer > Data Labs 40 Copyright © 2013-2014 by Teradata. All rights reserved. Reasons BevMo Chose Teradata Cloud 1. No hardware or software to buy > Reduces investment risk 2. CAPEX to OPEX conversion > Monthly OPEX vs. larger up front capital 3. Industry expertise, best practices and consulting (in BI, DW and ETL) previously only available to top tier customers 4. Dedicated and secured hosted and managed production ecosystems 41 Copyright © 2013-2014 by Teradata. All rights reserved. Reasons Netflix Chose Teradata Cloud 1. Performance: Teradata demonstrated its analytic superiority 2. Best-in class: Teradata Database is recognized as the best-in-class technology for highperformance data warehousing used by leading companies 3. Economics: Subscription-based pricing 4. Choices: Flexible options to provision more resources and scale up as needed 42 Copyright © 2013-2014 by Teradata. All rights reserved. A Netflix Original: Analytics in the Cloud • Replay Available http://bit.ly/1hozTaZ • Presenter: Kurt Brown, Director, Data Platform at Netflix • 98% of viewers recommend their peers watch this webinar! • Discover how a leading entertainment company uses Teradata for cloud analytics • Get insight into the Netflix architecture, which includes MPP relational and non-relational technologies, to optimize the value of big data 43 Copyright © 2013-2014 by Teradata. All rights reserved. Teradata Cloud Summary • Everything You Expect in the Cloud > Rapid provisioning > Ability to scale-up quickly > Flexible pricing • Plus Much More… > Powerful technology – three “As a Service” models: • Data Warehouse as a Service • Discovery as a Service • Data Management as a Service > Managed services and unparalleled industry expertise for a complete end-to-end solution 44 Copyright © 2013-2014 by Teradata. All rights reserved. THANK YOU! 45 Copyright © 2013-2014 by Teradata. All rights reserved.