Uncompressed HD Video over IP

HD Video over IP
Seungju Lee, Jaeyoun Kim, JongWon Kim
2006 21st APAN Meeting
@ Tokyo, Japan
Jan. 24th, 2006
Networked Media Laboratory
Dept. of Information & Communications
Gwangju Institute of Science & Technology (GIST)
jykim@nm.gist.ac.kr
http://hdtv.nm.gist.ac.kr
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-1-
Contents
‰Uncompressed HD Video over IP
o Introduction
o Challenges and Proposed System
o Experiment
‰Visualization for HD Video over
Collaborative Environments
o Introduction
o Challenges and Proposed System
o Experiment
‰Conclusion
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-2-
Uncompressed HD Video over IP
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-3-
Goals and Challenges
‰ Research Target
o Cost-effective system integration
o Dual-stream transport technique by using two 1GE-NIC
‰ Have to consider
o Hardware Compatibility
ƒ Motherboard Ù RAID card
ƒ Motherboard Ù HD-SDI Interface card
o Performance
ƒ Internal bottleneck
o Device Driver Support
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-4-
Uncompressed HDTV Streaming
‰ System Overview
o Software-based and Hardware-based display
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-5-
Cost-effective System Integration
‰ Total Costs (roughly, $ 30,000 ~ $ 40,000)
o
o
o
o
o
o
o
o
o
o
o
1 Sony HVR-Z1N camera and auxiliaries, $ 6,000
2 SuperMicro server systems, $ 10,000
2 Chelsio 10GE NICs, $ 5,400
2 AJA HD-SDI interface cards, $ 4,400
1 AJA Analog component to digital HD-SDI converter, $ 2,300
1 AJA HD-SDI to DVI-D converter, $ 1,200
2 24-bit audio A/D converters, $ 1,600
1 Mic., with echo cancellation, $ 800
1 Plasma 52’ HDTV, $ 10,000
1 LCD monitor supporting 1920x1080 resolution, $ 3,000
1 Avid Flying Cow A/D audio converter $ 400
‰ Software : UltraGrid (USC/ISI) modification
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-6-
Hardware Spec.
‰ Hardware spec. is important to prevent internal bottleneck
‰ We recommend followed system spec.
Device
Specification
Mainboard
SuperMicro X6DHE-XG2 DS & G (7520chipset)
CPU
Intel Dual-Xeon 3.0C FSB 800Mhz
Memory
PC3200 DDRII/400Mhz REG/ECC 2GB
RAID
3 ware 9500s-8 SATA RAID controller
HDD
WD Raptor 74GBx8 SATA 10000 RPM WD740GD for
server
Seagate 120GB SATA 7200 RPM for client
Graphics
NVIDIA Geforce 6600GT 128 MB PCI-Express x16
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-7-
Hardware Spec. (Cont.)
‰ Hardware Features
o HD-SDI card
ƒ AJA XENA HS capture card www.aja.com
- Support active samples ONLY (1920x1080 for 30 Hz/1.001)
- Maximum data rate : 1.244 Gbps
- Digital AV I/O
- Linux and Windows
ƒ BlackMagic DeckLink HD-Plus www.blackmagic-design.com
- Support total samples (2200x1125 for 30 Hz/1.001) along
with active samples
- Windows only
ƒ Centaurus card + audio www.dvs.de
- Support both total and active resolution
- Linux and Windows
- Expensive (over $ 10,000)
o Graphic card: support of xVideo (Software Display)
ƒ NVIDIA GeForce 6600GT 128 MB PCI-Express x16
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-8-
System Integration: OS Kernel Selection
‰ Linux OS Kernel (RedHat 9) dependency of
integrated system hardware
Kernel
Chelsio T210
Chelsio N201
XENA-HS
RAID
2.4.18
X
X
O
-
2.4.21
X
O
-
O
2.4.25
O
O
O
-
2.4.28
X
O
O
O
2.6.5
X
O
X
O
2.6.6
O
O
-
-
2.6.9
X
O
X
-
2.6.10
X
O
X
O
2.6.11
X
O
-
O
2.6.12
X
X
-
-
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
-9-
Dual-Stream Transport: Basic Problem
Receiver Ref Clock
Transmitter Ref Clock
Jitter makes packet arrive irregularly
Splitter
Network induces Delay, Jitter
and out-of-order packets
Assembler
Smoothes out jitter effect
brings them inorder
Packets created regularly at frequency f
‰ Dual-Stream Transport based on RTP/RTCP
‰ Frame splitting / assembly with synchronization
o Real-time Transport Protocol (RTP) & RTP Control protocol (RTCP)
o Payload format SMPTE-292M (draft-ieft-avt-smpte292-video-01.txt)
ƒ Specifies the widely used interconnect for HDTV equipment over IP
o `RTP Profile for TCP Friendly Rate Control’: interactions of TFRC with
RTP (draft-ietf-avt-tfrc-profile-03.txt)
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 10 -
Dual-Stream Transport: Proposed
Architecture
‰ Even / Odd frames are sent independently in a synchronized
manner (thread based realization)
‰ Dual-Stream RTP transport covers transport for each flow
‰ Receiver places frames into separate playout buffers
‰ Display unit gets those frames and render them to the display
(considering playout time)
‰
Detect packets dropped or reordered by network
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 11 -
Experiments
‰ Experiments
o Domestic (Daejeon-GwangJu, 19 Aug., 2005)
Daejeon
(KISTI)
1G SuperSiren-KREONET
Dedicated Link
GwangJu
(GIST)
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 12 -
Domestic Experiment
‰ Domestic Tests
o
o
o
o
o
o
Jumbo frames (9K MTU)
Dedicated 1G link from KISTI to GIST
Out-band audio (RAT or Skype)
Software (xVideo) display on Plasma TV (1280x768 Res.)
One-way live streaming
8-bit 4:2:2 active sampled video (down sized to roughly 910 Mbps)
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 13 -
Visualization for HD Video over
Collaborative Environments
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 14 -
High-quality Visualization
‰ Display large size image for various research areas
o satellite imagery (365Kx365K pixels maps) for geoscientists
o brain imagery (4Kx4K pixels sensor) for neurobiologists
o Medical still image or animation
‰ Enlarge display resolution
o Display device has the limit of resolution
o i.e., 20” LCD monitor at 1600x1200
‰ Tiled Display
o Clustered display devices provide a
virtual large-resolution display
o To overcome the limit of resolution in
display device
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 15 -
Goals and Challenges
‰ Target Area in Collaborative Environment
o AG SVC consists of multiple machines
How to visualize multiple video
streams over tiled display?
System Performance
Network Bandwidth
Scalability/Flexibility
Target area
Synchronization
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 16 -
System Design
‰ Decoupled Decoding and Display Structure
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 17 -
Data Distribution Strategy
‰ Fractional Pixel Streaming
o To reduce the bandwidth to multiple SVC Displayers
ƒ Considering the display area of each SVC Displayer over tiled display
< Design of SVC >
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 18 -
Experiments
.
.
DVI output
SVC control
interface
1G
bps
SVC control
interface
net
wo
rk
100 Mbps network
SVC Displayer-25
Sync Master
.
Sync channel
IEEE 1394
.
SVC Decoder
SVC Controller
SVC Provider
ƒ
SVC Displayer-1
ƒ
• Decoding MPEG-2 TS
With 1440 x 1080 resolution
captured from SONY HVR-Z1U HDV camcoder
•
•
•
•
Dual AMD 64bit 2.4Ghz processors
NVIDIA Quadro FX3000 graphics card
1 Giga Ethernet network interface
4GB main memory
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 19 -
HD Camcoder
10x5 Monitors
ƒ Resolution : 16000 x 6000
25 Display machines
ƒ 2 monitors per machine
Conclusion
‰ Versatile media tool for various media format for
heterogeneous collaborative environments
o Decode/Transform as unified format in Local area network
o Integration of transport part
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 20 -
Gwangju Institute of
Science & Technology
Thank you!
Send Inquiry to jykim@nm.gist.ac.kr
http://netmedia.gist.ac.kr
NETWORKed MEDIA LAB.
DEPT. OF INFO. & COMM., GIST
- 21 -