AMP`s Facilis TerraBlock Configuration Guide

www.asiamediaproducts.com
900 W. Alameda Ave.
Burbank, CA 91506
Tel. +1-818-441-5953, Fax +1-818-441-5199
AMP's Facilis TerraBlock Configuration Guide
TERRABLOCK ™ 24D
TERRABLOCK ™ 12D
TERRABLOCK ™ 8xs
Available in the following capacities
Available in the following capacities
Available in the following capacities
6 TB/ 7.2 TB/ 9.6 TB
3 TB/ 3.6 TB/ 4.8 TB
2 TB/ 2.4 TB/ 3.2 TB
Facilis TerraBlock. The TerraBlock from Facilis Technology is a “server direct”
SAN system. “Server Direct” indicates that the server volumes appear as local
SCSI drive to the client systems, instead of a network drive. The SAN is selfcontained (server, drives, and client connections) in one chassis, and does not
require a switch in most configurations. TerraBlock allows up to 250 volumes to
be dynamically created on top of server managed virtual allocation groups.
TerraBlock is a volume level locking SAN, with user-based access to read and
write permissions on a per-volume basis. A single client can write to a virtual
volume at any given time, but multiple clients can read from those same volumes
simultaneously. This allows for a very flexible workflow to be created in facilities
requiring both high quality and high bandwidth for multiple clients, at a low cost.
The challenge when recommending a SAN solution to a client is understanding
how to get the correct information from them to match their storage and
bandwidth needs with a compatible system. The following is a list of questions
and quick references to help match your client with the best Facilis configuration.
Step 1: Determine the client’s storage size requirements.
Resolution
2K (2048x1536)
1920x1080i HD
1920x1080i HD
1280x720P HD
1920x1080P HD
1920x1080i HD
1280x720P HD
1920x1080i Avid
DNxHD 220
1280x720P Avid
DNxHD 220
1920x1080P Avid
DNxHD 220
1920x1080i Avid
DNxHD 145
720x486 SD 1:1
720x486 SD 1:1
Avid 2:1
Avid 3:1
Avid 2:1s
Avid 4:1s
Avid 10:1s
Avid 20:1
Avid 15:1s
Sony IMX
MPEG2
Sony HDV
DV 50
DV 25
DVCPro HD (DV
100) 1920x1080i
DVCPro HD (DV
100) 1920x1080P
DVCPro HD (DV
100) 1280x720P
48.1 Khz Audio
96 Khz Audio
Frames per
second
Bits per
Sample
Storage per
Minute
Storage per
Hour
24
29.97
29.97
59.94
23.976
29.97
59.94
29.97
17 GB
14 GB
9.3 GB
8.3 GB
7.4 GB
7.2 GB
6.3 GB
1.6 GB
1.02 TB
840 GB
560 GB
498 GB
448 GB
439 GB
376 GB
100 GB
1.6 GB
100 GB
1.3 GB
79 GB
29.97
10 4:4:4
10 4:4:4
10 4:2:2
10 4:2:2
10 4:2:2
8 4:2:2
8 4:2:2
10 or 8
4:2:2
10 or 8
4:2:2
10 or 8
4:2:2
8
4:2:2
.93 GB
56 GB
29.97
29.97
29.97
29.97
29.97
29.97
29.97
29.97
29.97
29.97
10
8
8
8
8
8
8
8
8
8
4:2:2
4:2:2
4:2:2
4:2:2
4:2:2
4:2:2
4:2:2
4:2:2
4:2:2
4:2:0
1.5 GB
1.2 GB
660 MB
400 MB
300 MB
150 MB
120 MB
75 MB
40 MB
375 MB
91 GB
72 GB
39.6 GB
24 GB
18 GB
9GB
7.4 GB
4.5 GB
2.4 GB
22.5 GB
29.97
29.97
29.97
29.97
8
8
8
8
4:2:0
4:2:2
4:1:1
4:2:2
187 MB
375 MB
187.6 MB
840 MB
11.25 GB
22.5 GB
11.25 GB
50.4 GB
23.976
8
4:2:2
360 MB
21.6 GB
59.94
8
4:2:2
690 MB
41.4 GB
8 tracks
8 tracks
16
24
46.1 MB
138 MB
2.8 GB
8.2 GB
59.94
23.976
To determine the client’s storage requirements, use the above chart to work with
the client on their workflow, and total up the usage. Remember that when
moving to a shared storage solution from attached storage, duplication of media
for multiple systems is no longer required, but the client must also be made aware
that expansion of capacity in a SAN environment is more complex than a local
storage environment. Additionally, remember to take into account data protection.
Mirroring (raid 1) requires double the storage. (We will talk more about data
protection in step 4.)
*There are times that a larger system with more storage than is needed will need
to be specified to accommodate a client's bandwidth requirements. An example of
this could be an environment in which more than one uncompressed HD 1080i
client needs to be able to ingest media at the same time. Currently, this can only
be accomplished with a 24-drive system. The client’s total storage needs may be
less than 6 TB, but the larger system is required to accommodate the bandwidth.
Step 2: Determine what resolutions are required
Resolution requirements are crucial to the proper recommendation of a
TerraBlock system. Each system, (24D, 12D, and the 8xs) have
bandwidth limitations determined first by resolution, and second by total
number of clients.
TerraBlock 24D:
•24 clients at offline Resolutions, 2:1 or DV25
•6-8 clients at Dual Stream Uncompressed SD
•2 clients at 8bit or 10bit 1080i HD
TerraBlock 12D:
•8 clients at Dual Stream 2:1 or DV25
•3 clients Uncompressed 10bit SD
•1 client at dual stream 8bit, or single stream 10bit 1080i HD
TerraBlock 8xs
•8 clients at offline Resolutions, 2:1 or DV25
•4 clients at Uncompressed SD
•1 client at 8bit 1080i HD
These are examples that cover most applications, and are intended only as
a guide as there are many possible configurations.
Step 3: Determine total number of clients that need to be connected
As shown in Step 2, each of the TerraBlock systems have different client
load maximums, depending on what resolution and storage requirements
are needed.
Depending on the number of clients required, systems could be
integrated with up to 4 fiber controller cards to accommodate up to 12
direct fiber-connected clients with any combination of 4Gbit and 2Gbit
cards. More clients can be added with the integration of a Qlogic fiber
switch.
Why 2Gbit or 4Gbit? Fiber channel started out as a 1Gbit protocol in this
industry, but has since doubled twice and increased to 800MB/sec full
duplex when utilizing 4Gbit. This 800MB/sec is divided between the two
sides of the full duplex cable, providing a maximum data throughput
capacity of 400MB/sec read, and 400MB/sec write. This is of course the
maximum throughput capacity of the cable. The actual maximum
throughput of the storage device depends on many factors such as the
controller cards, the servers, the individual drives, the firmware etc. 2Gbit
fiber is ½ the bandwidth of 4Gbit, and has a maximum thoughput of
400MB/sec full duplex, or 200MB/sec read, and 200MB/sec write.
The advantage of moving up in speed is in the efficiency of using a
single cable on a single channel to produce the bandwidth you need,
without having to stripe volumes across multiple channels.
An easy rule of thumb to follow when determining if you will need
2Gbit or 4Gbit, is any HD or 2K client will need a 4Gbit
connection. SD clients can use 4Gbit cards, especially if future
upgrades are planned, but 4Gbit is not required for SD throughput.
Minimum Data Rates required for 2K depending on the application can be as high
as 300MB/sec. HD, depending on the resolution and the application, is around
240MB/sec. and SD, requires up to 40MB/sec.
As you can see, 4Gbit may not be necessary for SD projects but, but investing in
the architecture now future-proofs your facility for HD and beyond.
The following image shows the slot positions for the fiber controller cards in the
TerraBlock 24D. Shown are three U24XH 4-user cards for a total of 12 users.
The base TerraBlock system ships as a 2Gbit fiber, 2-user system. Each of the
cards listed below can be added depending on the facility requirements.
1. FTI-U22XH, TerraBlock 2Gbit 2-user Upgrade
$1090.00
(This is a 2 client 2Gbit card, for connecting up to 6 clients in a 24D,
or 8 clients in a 12D or 8xs.
When configuring or expanding your Terrablock system 1 or 2 SD
clients at a time, up to 6 total. This expansion option is a good choice.
(Note: the Terrablock comes with one FTI-U22XH installed unless ordered
otherwise.)
2. FTI-U24XH, TerraBlock 2Gbit 4-user Upgrade
$3400.00
(This is a 4 client 2Gbit card, for connecting up to 12 clients in a 24D as
shown above. This card is not supported in 12D or 8xs Models.
When expanding or configuring a Terrablock 24D (only) and more than
6 SD clients will be needed, order up to 3 of this card for a total of 12
SD clients.
3. FTI-U42XS, TerraBlock 4Gbit 2-user Upgrade
$1590.00
(This is a 2 client 4Gbit card, and can accommodate up to 6 clients with
3 cards)
Order this card when configuring a Terrablock server for HD or
2K clients. The base Terrablock server can be ordered with this card as
opposed to the FTI-U22XH for an additional $500.00 per server. If a
server is populated with only 4Gbit cards, a switch will be required to add
more than 6 clients.
Different controller cards can be used simultaneously for a combination of
4Gbit and 2Gbit clients depending on your requirements. 4Gbit cards are
required for the highest data rates such as uncompressed 1080i and 2K
2Gbit cards have more than enough bandwidth for multi-stream SD
clients.
Client fiber controller cards optional, and can be ordered separately.
Following is a list of approved fiber client cards.
*Note: apple fiber adapter cards will not work with TerraBlock.
1. AT-E3300, ATTO EPCI 3300 single 2Gbit Host Adapter Card
$1060.00
Order this card for SD Clients or high bandwidth push/pull clients
such as graphics stations or scanners. This is an approved card
when working with most Avid systems and integrating with
Unity.
2. AT-C2IPS, ATTO Celerity 21PS Single 2Gbit Host Adapter Card
$ 590.00
Order this card for SD Clients or high bandwidth push/pull clients
such as graphics stations or scanners. Non Avid clients, or Avid
clients not connecting to a Unity server.
3. AT-C41PS, ATTO Celerity 41PS Single 4Gbit Host Adapter Card
$1390.00
Order this card for clients requiring high-def throughput.
(Note: although a 4Gbit card will work when connected to a 2Gbit
server card or switch, a 4Gbit server card or switch is required
for the 4Gbit throughput.)
* In addition to this list, The Qlogic 2100F Fiber client is approved for
use with Macintosh based Avid systems running OS9.
When more than 12 fiber clients need to be connected to the system, or
future expandability is desired, a fiber switch can be used in place of, or in
addition to existing controller cards. The switch allows for fiber clients to
be connected without the use of additional server upgrade cards. Switches
are available in both 2Gbit and 4Gbit configurations, and fixed 8
channel as well as expandable units that can accommodate up to 16
clients on one switch. All the switches utilize SFP’s which are plug
in adaptors that allow the switch to accept the LC fiber connections. Each
switch comes with 8 SFP’s. If switch port upgrades are purchased
from Qlogic, additional, SFP’s can be purchased individually to
populate the expandable switches up to 16 ports. The switches are as
follows:
1. QL-SB2G8P, QLogic 8 Port 2Gbit Switch w/8SFP’s (non
expandable)
$4060.00
This switch is a good choice when no more than 8 SD clients will
ever need to be connected to the switch.
2. QL-SB2GE8, QLogic 8 Port 2Gbit Switch w/8 SFP’s (expandable to
16 ports)
$6120.00
This switch comes with 8 ports to connect SD clients. It can be
expanded up to 16 ports.
(Note: There may be bandwidth limitations when adding multiple
clients to a switch. Please verify your switch configurations and
requirements with Facilis or Asia Media Products before ordering.)
3. FTI-2GSFP, 2Gbit SFP for use with 2Gbit switches
$ 120.00
4. QL-SB4GE8 QLogic 8 Port 4Gbit Switch w/8 SFP’s (expandable to
16 ports
$8410.00
Like its 2Gbit counterpart, this is an expandable switch. This
switch can be used to configure multiple 4Gbit or 2Gbit clients. A
larger number of SD 2Gbit clients can be added to a 4Gbit switch
connected to the server through a 4Gbit card.
(Note: There may be bandwidth limitations when adding multiple
clients to a switch. Please verify your switch configurations and
requirements with Facilis or Asia Media Products before ordering.)
5. FTI-4GSFP, 4Gbit SFP for use with 4Gbit Switches
$ 150.00
A Gig-E Ethernet network can be used to connect offline clients, and
“push/pull clients (such as graphics/FX stations that use their own
local storage, but need to communicate with the SAN network. This
environment requires a fiber connected client be set up as a
“Ethernet server”, which means that the fiber connected client will be
sharing the mounted volumes out to the Ethernet network Facilis offers
a configured Ethernet server shown below, or any dual processor
Macintosh or PC
client can be configured to be an Ethernet server.
FTI-ESERV, Fiber Connected Ethernet Server
$3000.00
Step 4: Determine what level of data protection is desired
One of the many advantages of the Facilis TerraBlock is the many ways it
protects.
1. Selectable Raid Mirroring (Raid 1)
Raid 1 (Mirroring) is defined as duplicating the protected drive or media
100% with no parity. If a drive were ever to fail, an exact copy of the media
would exist in another location on the drive set, and would be used without
interruption, even if the other drive had a catastrophic failure.
The disadvantage to Mirroring is in addition to protecting your media
completely it does take up double the drive space. This space needs to be
accounted for when determining the total amount of storage needed for a
project or facility. For example, a 1-hour NTSC 10bit uncompressed piece
of media that would require 91GB of space, would require 182GB of space if
it were to be fully protected.
This is why the TerraBlock’s Selectable Raid Mirroring is such a powerful
feature, and also why this requires some thought. Selectable Mirroring allows
the user to choose which of the virtual volumes to protect and which to leave
unprotected. When a project becomes less crucial, or drive space is needed,
the client has the option to remove the protection from the virtual volume,
freeing up that space for other use. This of course will leave the unprotected
media vulnerable if a drive failure or other issue occurred. We recommend
Mirroring as much media as possible always.
A good way to look at the workflow is in terms of “Active Data” vs. “Passive
Data”. “ Active Data” is media that is in use at the time, and would cause
large issues if it went off line suddenly. “Passive Data” is Data that might be
needed, but is not actively being used (awaiting deletion, backup or archived
media) If you had to choose, always Mirror the “Active Data”.
2. Hot Swap Drive Replacement
On the rare occasion that a drive does fail, provided the Data in use is fully
mirrored, the drive could be changed out without shutting the system down.
The TerraBlock manager will help you to isolate the drive in question, and it
can be swapped with the included spare drive without bringing any of the
clients down Facilis requires that only factory-supplied drives be used with
the TerraBlock servers.
3. Server Independent Metadata Most Server based San systems utilize metadata
to keep track of information such as the virtual volumes, permissions, data
locations etc. Many San servers utilize the server as an integral part of the
metadata process. TerraBlock writes all metadata to multiple places on the
drive set several times a minute, but not the server’s hard drive or ram.
This allows the user to remove an entire drive set, and then replace it at a
later time maintaining not only the media, but the workflow environment,
users, permissions, and virtual volumes.
This can, for example, allow the user to archive an entire project simply by
pulling the drive set and setting it on a shelf. The drives can be replaced
with new drives. The old drive set can be put in the vault or on the shelf
until needed again so long as it is kept together as a set.
Step 5: Determine what platforms (Mac/PC) will be required
Although the TerraBlock works with virtual volumes, and is not platform
specific, the volumes must be formatted with a HFS+(Mac), NTFS(PC),
or FAT32(PC/Mac) format after creation.
As an example, although a PC based client may have permission to access
a volume that was formatted HFS+, unless the PC has an emulation
program such as “Mac Opener”, the PC will not be able to mount the
volume. When mounted, , the PC may experience issues with Avid media
drives due to limitations in the Avid software.
*Most OSX 10.3X Macintosh’s have the ability to mount NTFS formatted
drives. This can be used as a cross-platform solution in some cases. Earlier
versions of the Mac OS, are not able to mount NTFS volumes, but all are
able to mount FAT32.
Fat32 is a good alternative for volumes that must be used in cross platform
environments as transfer volumes. Fat32 is not an efficient partitioning
format, but is easily mounted by both Macintosh and PC. As such, it
makes a good transfer volume if needed for cross platform environments.
TerraBlock servers ship with a “tools” drive pre-formatted in “FAT32”.
This drive can be reformatted in platform specific environments in either
NTFS or HFS+, but is not intended to be a media drive. The TerraBlock
management software for the client is kept on this volume generally.
*Macintosh clients must have this small volume mounted at all times (it
will mount automatically when a Macintosh client is plugged into the
server), in order to establish a communication path to the server.
Although it can be helpful for accessing the client software, PC clients do
not need to mount the “Tools” drive to use the server. The management
software can be launched directly from the explorer desktop.
Step 6: Determine what Work Station will be used (Avid, Finalcut Pro, etc.)
TerraBlock servers can be used simultaneously by clients running Avid,
Finalcut Pro, Premiere, Pro Tools, and many others. Some applications
have special needs when connecting to shared storage.
Older Avid Meridian systems running Macintosh OS9 have special
requirements for client fiber cards. The newer ATTO fiber cards such as
the ATTO 3300 will not work in these versions of Avid unless a LVD
SCSI card is also installed. Due to slot limitations, this requires the
Avid to use an expansion chassis. This is a known compatibility issue with
OS9, local fiber channel storage.
The Qlogic 2100F (a card that many Avid customers may already own)
does not have this limitation, and is an approved host adapter for
TerraBlock. An adapter fiber cable must be used for these cards to go
between the Qlogic’s SC fiber connections, and the TerraBlock’s LC
connections
The TerraBlock is capable data throughput rates ranging between
275MB/sec to 380MB/sec depending on the client configurations. This
makes it a very good choice in the DI work environment, as it is capable
of sustaining 2K data throughput rates.
Step 7: Determine if the TerraBlock will be used as the primary storage, or
secondary storage solution.
The TerraBlock server can function on an Avid Unity network, and is a
very good solution for a cost effective Secondary Storage solution.
Utilizing the “Facilis Migration Tool”, an application that transfers
project-based Avid media files from Unity workspaces onto TerraBlock
volumes, an Avid client can effectively manage media between systems.
Plus, unlike other near-line or archive storage solutions, the TerraBlock
has the bandwidth to play any Avid files directly from the server without
transferring back to the Unity server.
Step 8: Establish a workflow for the client
When migrating a client from local storage to a San based shared storage
solution such as the TerraBlock, the most important service any reseller
can offer is the consultative design and training of the client in Shared
storage workflow. Every client is different, but workflow must be taken
into account when considering the proper equipment. A few things to
consider might be:
1. Infrastructure: Does the client have fiber currently? If so, is it fullduplex multimode, and terminated with LC connectors?
2. Has a workflow for ingest been created? Depending on how many
clients need to simultaneously ingest, appropriate volumes will need to
be created on the system.
3. Has client administration of the server been discussed? Who will have
access to create and delete volumes?
4. The TerraBlock manages permissions by OS log in name from the
client computer. The user log0ins can be based on User, room, or
project, but all users must have administrative rights to the local
computer.
5. Is this a cross platform environment (Macintosh and PC)? If so, do the
cross platform clients need to share files? If so, refer to Step 5, and
determine the specific file sharing needs.
6. What is the highest bandwidth requirement on the system? Is there a
7. HD finishing client with several offline clients? Are there 2 HD
finishing clients? This is crucial information when creating a
workflow for the client, and when specifying the correct server.
DV25/OFFLIN
E
14:1
24P/OFFLINE
ONLINE/1080i HD
GFX/ANI
ONLINE/1:1
M 8. What level of Data protection
SD does the client require? As discussed in
Step 4, a workflow for protecting and unprotecting media must be
established to make the best use of the selectable mirroring features.
9. How will the media be archived?
These questions will help you to establish a better understanding of your client’s storage
needs. SAN based storage solutions are generally the hub of any facility. As such,
establishing the proper workflow and equipment can mean long term stability for an
entire workgroup.
Asia Media Products will be more than happy to go over any configurations, and help
you decide what options are best for your client’s needs. Contact our CTO, Grady
Sellards, Grady3@asiamediaproducts.com with any questions regarding configurations.