TechDay 2015 GPU

ARM Technology Forum
Multimedia Technology From ARM
June 2015
Dennis Laudick
VP Partner Marketing
1
Accelerating the Pace of Innovation
2014
2009
By Creative Tools. Watermark removed by User:Ainali [CC BY 2.0
(http://creativecommons.org/licenses/by/2.0)], via Wikimedia Commons
2
Display
5x
Camera
4x
Connectivity
20x
Sensors
3x
Video
34x
CPU
17x
GPU
40x
Memory Bandwidth
16x
By GalaxyOptimus (Own work) [CC BY-SA 3.0
(http://creativecommons.org/licenses/by-sa/3.0)], via Wikimedia Commons
Anything, Anywhere, Anytime
Rich user
experiences
Epic Games using Enlighten Technology from Geomerics, an ARM Company
3
Multi-casting, UHD and
4K video streams
"Arsenal vs Chelsea" by Wonker at Flickr. Licensed under CC BY 2.0 via Wikimedia Commons.
Anything, Anywhere, Anytime
Microsoft Office for Android, 2015
4
Autodesk Autocad360 for Android, 2014
Expanding Complexity of Content
760M
53%
Mobile game
users in
APAC1
of mobile data
was video
in 20132
Immersive Gaming Media Capture and Sharing
User Interfaces Computer Vision & Image Processing
5
73%
69%
of mobile device
resolutions are
HD or more3
Mobile video
CAGR
2013-20184
Sources:
1: Global Mobile Game Confederation (GMGC)
2: CISCO VNI report
3: Android Developer Dashboards
4: CISCO VNI report
Mobile Gaming in 2015 – High End Titles with Console Quality
Nitro Nation Stories
Araha
République
Creative Mobile
Inilogs
Camouflaj, LLC
Modern Combat 5: Blackout
Gameloft
Godfire: Rise of Prometheus
Vivid Games S.A.
Injustice: Gods Among Us
Joe Dever's Lone Wolf
Warner Bros.
BulkyPix
telltale
tool
Game of Thrones
Telltale Games
6
World of Tanks Blitz
Wargaming World
Oddworld: Stranger's Wrath
Oddworld Inhabitants Inc
Mobile Gaming in 2015 – High End Titles with Console Quality
Riptide GP2
Dead Trigger 2
GT Racing 2
Vector Unit
Madfinger Games
Gameloft
Engine 4
Mortal
Kombat X
Warner Bros.
International
Enterprises
7
*Released referring to the Play Store
Implosion
Real Boxing
Rayark Inc.
Vivid Games S.A.
8
Complexity of Device Requirements
Balancing performance, power and price to address consumer needs
Energy Efficiency
Higher
Performance
Higher
Cost Efficiency
Faster
Time to Market
Deliver extra
performance
in same
thermal
budget
Handle more
complex
content and
higher
resolutions
Bring highquality,
affordable
technology
to the
mainstream
Remain
competitive
in a fastpaced
market
Higher
9
Delivery Requires Innovation Throughout the SoC and Device
Performance
Slimmer and sleeker
form factors
Thermal design
Capabilities
Battery life
Features
10
Cost
ARM IP Suite Delivering 2016 Premium Mobile Experiences
Enabling innovation on the most
advanced process nodes
Highest performance
ARM Cortex CPU
Complements ARM big.LITTLE
enhancing energy efficiency
11
Highest performance and most
energy-efficient ARM Mali GPU
Next generation ARM CoreLink
Cache Coherent Interconnect
Premium configurations of Mali video
and display processors
ARM® Mali™-T880: New Horizon for Mobile Visuals
1.8x more performance of 2014 Mali-T760 based
devices
 Delivering advanced gaming and console-like experiences
Most energy-efficient Mali GPU
 40% energy reduction for same workloads
Enabling superior system level benefits
 Complemented by Mali-V550 video and Mali-DP550
display processors
 TrustZone secure video path for premium 4K content
12
Mali-T880 & Mali-T860 Overview
Mali-T880/T860 builds on top of the technical advances of Mali-T760
 Significant improvements in energy efficiency – up to 40% improvement over Mali-T760
 Incorporates proven bandwidth reduction technologies : ASTC, AFBC, Smart Composition, TE
Increased Performance
 Improved performance across real 3D, causal 2D and UI use cases
 Increased arithmetic performance for compute heavy applications
Support for high fidelity content for 4K and beyond
 Native 10-bit YUV input and output support
 Gamma correct filtering for maximum color fidelity
 High performance full speed implementation – no shader conversion
13
Improved Performance for High-End and Casual content
Quad prioritization
 2D blitting +40%
 2D-like content +12%
 Also benefits advanced content
3x ALUs
 Increased arithmetic performance
 Up to 33% Manhattan uplift from HW
 Up to 50% Peak compute performance increase
Performance Improvement vs. Mali-760
GFXBench Manhattan
GFXBench T-Rex
Improved Early Z test throughput
 Eliminating work earlier in the pipeline
BasemarkX
2D Blit
Casual Gaming
User Interface
Cache size tuning, improved thread
management
 Increase size of L1 and L0 instruction caches
14
CLBenchmark
Quaternion Rotation
10%
20%
30%
40%
Mali GPU Roadmap
Energy Efficient GPU Roadmap
 Mali™-T604
 Mali-T624
 Mali-T628
 Mali-T760
 Mali-T860 & T880
• First OpenGL® ES 3.1
and OpenCL Full Profile
mobile GPU
• 50% performance uplift
• Full ASTC support
• Extending scalability to 8
cores
• Increased SoC energy
efficiency
• Scalability to 16 cores
• Energy efficiency and
performance gains
• UI performance uplift
Cost Efficient GPU Roadmap
15
 Mali-400 MP
 Mali-450 MP
 Mali-T622
 Mali-T720
 Mali-T820 & T830
• First OpenGL ES 2 multicore GPU
• Leading area efficiency
• Double the performance
of Mali-400 MP
• Enabling Full Profile
Compute and OpenGL
ES 3.1 in mid-range
• Optimised area efficiency
and decreased cost and
time-to-market
• Performance density
increases
• Bandwidth efficiency with
AFBC and other features
ARM® Mali™ Success
Total
114
73 licensees
licenses
550M
25
Mali –based GPUs
shipped in 2014
new Mali
licenses
in FY14
600
500
Mali is in
75%
of DTVs…
…
…
>50%
>35%
of Android
tablets…
of
smartphones
Million units
400
300
200
100
0
2011
16
2012
2013
2014
Important Mali Design Values
Tile-Based
Multi-Core
Real Performance
11
Tile-based rendering gives
the best start for an energy
efficient GPU architecture.
But more than a technology
it’s a way of thinking to
keep working data close
and bandwidth to minimum
17
Building multi-core capability
into the core of the
architecture allows ultimate
scalability and partner
flexibility. A valuable and
unrivaled extra dimension
Paper specs are far less
important than real world
performance. Delivering
sustained performance in
real devices with real
constraints is what matters
Mali Scalability – True Partner Value
Mali is the only GPU IP with true scalability
 Multi-core from ground up allows partner configurability
 A Mali MP product covers a full roadmap of competing
monolithic products
Unrivaled ability to match to markets




Perfect for hitting the right product position
Fine tune balance of PPA and cost
Ranging from super-efficient performance champions…
… to cost optimized mass-market products
Core hardening can be reused in all configs
 Utilize hardening resource efficiency
 Reduce Time-To-Market
18
Real World Performance
Mali prioritizes real performance over specs
 A key example is peak architectural fill-rate
 I.e. pixel throughput per clock
 Nominal fill-rate has not changed
 Same for Mali-400 as for the latest, Mali-T880
 Effective actual fill-rate is close to double
 A true benefit for UI, browsing and casual uses
 Achieved through
 Innovation focus on real applications and use cases
 Architectural tuning for real SoC environments
Mali-400
19
Mali-T880
Real World Performance
 Another example is peak architectural GFLOPS
 Comparing between Mali-T604 and Mali-T760
 Nominal GFLOPS has not changed
 Effective performance more than doubled
 Achieved through
 Innovation focus on real applications and use cases
 Architectural tuning for real SoC environments
20
Mali-T604
Mali-T760
Console Class Gaming Right in your Hands
ARM acquired Geomerics in 2013
Enlighten – Physically based Dynamic Lighting
Enlighten reproduces console experiences on
all platforms
ARM and Enlighten – powerful ecosystems
Available in
Unity 5.0
21
22
Mali Video and Display Roadmap
Video Processor Roadmap
 Mali-V500
 Mali-V550
• Scalable to 4K120 encode/decode
• ARM® Frame Buffer Compression (AFBC)
• Trustzone™ technology enabled
• 10-bit HEVC decode
• HEVC encode
• Motion Elimination
Display Processor Roadmap
23
 Mali-DP500
 Mali-DP550
• Up to 4k2K display
• Secure display layer
• AFBC
• 7 layer composition
• Co-processor interface
• Motion elimination
Mali-V550 Overview
HEVC
H.264
First video IP with multi-standard codec including
HEVC ( H.265) for both encode and decode
in a single core
JPEG
MPEG4
 Optimal area solution enables HEVC
in the mainstream
VP8
Scalable performance and multi-stream video
 1080p 60 on a single core up to 4K120 on 8 cores
 Multiple simultaneous encode/decode streams
 10-bit YUV support
MPEG2
VC-1
Optimized for lowest power
 More than 50% system bandwidth saving with AFBC
 Up to 35% extra system bandwidth saving for WiFi
Display/Miracast with Motion Search Elimination
Robust to bus latency
 Design lower cost memory system without dropping frames
24
H.263
Real
Mali-DP550 Overview
Energy efficient processing all the way to the glass
Low power and low memory bandwidth usage
 Composition, rotation, scaling, post-processing and display output
in a single pass
 Supports system-wide AFBC and Motion Search Elimination
Efficient composition of up to 7 layers
 Scales to 4K resolution
Enable 3rd party display differentiation
 Co-processor interface enables 3rd party / SoC vendor IP
in Mali display pipeline
Feature rich IP




25
Wide range of pre-processing and post-processing features
Wide range of YUV/RGB pixel formats including 10-bit YUV
Single or dual display output
Compatible with all major display standards
ARM Mali and Future Trends
 Resolution race continues, but slowing down
 Peak around 4k for most handheld devices
Drive innovation in standards
 Better fidelity must come from better pixels
 Increased use of complex shading algorithms
 Growing complexity in geometry
 More innovation in middleware and apps
 Requires open but robust APIs and GPUs
Move the limits of architecture
 Real time graphics will continue to be tricks
 Every “correct” effect can be faked, cheaper
 The cheaper the effects, the more can be used
 More effects looks better
26
Increase value to customers
27
Leverage Mali Ecosystem Partnerships
28
Developer Outreach Activities
Presentations, demos and workshops at developer events
 Expected to be present at around 20 developer events in 2015
 Topics:
 Best practises and optimization techniques for ARM Mali graphics
(target game developers)
 ARM Tools: MGD, DS-5 Streamline, developer resources
 GPU acceleration for UI and Browser (target broadcast industry and
HTML5 developers)
 Computer Vision workshop at EVA summit (target ARM partners and
OpenCL / RS developers)
29
Mali Developer Center
 A full range of resources on one, easy-
access portal (EN & CN):





Tools
SDKs
Drivers
Tutorials & Developer Guides
Sample Code
http://malideveloper.arm.com
http://malideveloper.arm.com/cn
30
Mali GPU Software Tools
Performance Analysis, Debug, and Software Development
Mali Graphics Debugger
• API Trace & Debug
• OpenGL® ES,
OpenCL™
• Debug and improve
performance at frame
level
OpenGL ES Emulator
• Emulate OpenGL ES
2.0 and 3.0
• Windows and Linux
• Khronos Conformant
31
ARM DS-5 Streamline
Mali GPU
- Timeline
- HW Counters
- OpenCL visualizer
Texture Compression Tool
• Command line and GUI
• ETC, ETC2, ASTC
• 3D textures
Mali Offline Compiler
• Analyze shader
performance
• Generates binary
shaders
• Command line tool
Third Party Tools
Integration with
partners’ tools
Thank You
malideveloper.arm.com
32