Server Management Tools Enable Design Differentiation

Transcription

Server Management Tools Enable Design Differentiation
Intel
Server Management
Controllers, Sensors,
and Tools
Developer
Tom Slaight
Server Management Architect
Enterprise Platforms Group
Intel Corporation
March 1, 2001
Copyright © 2000 Intel Corporation.
Forum
Spring 2001
Intel
Introduction
Developer
Forum
Spring 2001

Audience:
Architects, Technical Managers, Firmware
Leads, and Hardware Designers
– Involved in architecture, component selection,
debug, test, or design of server baseboard and
peripheral management subsystems

Focus:
– IPMI-based implementations
– Hardware components
– Hardware and firmware development tools
Copyright © 2001 Intel Corporation.
Page 2
Intel
Disclaimers
Developer
Forum
Spring 2001

A good starting point.
– … but not a comprehensive list of vendors or
available technology

Listing of particular vendors and products
does not constitute a particular
endorsement by Intel or the IPMI Promoters

No guarantees on accuracy of information
provided

Contact vendors directly for complete
specifications and availability information
“Architect’s Pick”
Copyright © 2001 Intel Corporation.
Page 3
Intel
Agenda
Developer
Forum
Spring 2001

Server Management Architecture
Overview

Baseboard Management Controllers

Enclosure/Peripheral Controllers

Sensor Devices

Putting it all together design advice and tools

Summary and Call to Action
Copyright © 2001 Intel Corporation.
Page 4
IPMI
Intel
Developer
Forum
Spring 2001
• Defines a common, abstracted,
Intelligent
message-based interface to intelligent
Platform
platform management hardware
Management
• Defines common records for describing
Interface
common platform management devices
and their characteristics
• Supports OEM differentiation and value
added features
• Promoters: Intel, HP, NEC & Dell
IPMI Enables Cross-Platform Management Software
Copyright © 2001 Intel Corporation.
Page 5
IPMI Promoter, Contributor, and Adopter News




























Acer Inc.
Agilent Technologies GmbH
Alberta Microelectronics
American Megatrends Inc.
Arima Computer Corp.
ASUSTek Computer, Inc.
Blue Wave Systems
Bull S.A.
Celestica
CyberGuard Corporation
Data General Corporation
Dell Computer Corporation
Egenera, Inc.
ElanVital Corporation
Ericsson UAB
Evans & Sutherland
Eversys Corporation
Exabyte Corporation
FORCE Computers GmbH
Fujitsu, Ltd.
GoAhead Software, Inc.
HADCO Corporation
Hewlett-Packard Company
Hewlett-Packard GmbH
Hitachi Ltd.
Hybricon Corporation
InnoMediaLogic, Inc.
Intel Corporation
Copyright © 2001 Intel Corporation.











Interphase Corporation
InterWorks Computer Products
Inventec Corporation
Ipex ITG
JMC Products
L-3 Communications Corp.
Lynux Works, Inc.
Macrolink, Inc
Magnetek, Inc.
Micro-Star International
Mitsubishi Electric Corp.














National Semiconductor Corp.
NEC Corporation
Nematron Corporation
Network Engines, Inc.
NOCpulse, Inc.
Olivetti Computers Worldwide
Open Source Asia
PEP Modular Computers
Phoenix Technologies Ltd.
Praim, Inc.
Qlogic Corporation
Radisys Corporation
Reliance Computer Corporation
Sanera Systems, Inc.
Information Systems Engineering
Center
Page 6
Intel
Developer

SBS Technologies

Scenix
Semiconductor, Inc.
Siemens AG
Silicon Graphics, Inc.
Stratus Computer Systems
Ireland Ltd.
Sun Microsystems
Super Micro Computer, Inc.
Symphony Group Intl. Co.,
Ltd.
Synergy Microsystems
Teknor Applicom, Inc.
T-Netix, Inc.
Tatung Co.
Tektronix
Texas Micro Corporation
Toshiba Corporation
Trimm Technologies
Tyan Computer Corporation
Universal Scientific Industrial
Corp.
USAR Systems, Inc.
Vitesse Semiconductor Corp.
Vividon, Inc.
Vooha, Inc.
Winbond Electronics Corp.
Ziatech Corporation






















Forum
(Industrial Computers GmbH) Spring
2001
Initiative News
Intel
Developer
Forum
Spring 2001
developer.intel.com/design/servers/ipmi
Copyright © 2001 Intel Corporation.
Page 7
Example Architecture
Intel
Developer
Forum
LAN
MODEM
/ Serial
Spring 2001
Remote
Mgmt. Card
ICMB
ICMB
Bridge
Controller
Aux. IPMB
IPMB
RS-232
Baseboard
SMBus / PCI Mgmt. Bus
Mgmt.
Controller
2C / SMBus
I
SENSORs
(BMC)
PCI
& control
Mgmt
NIC
Enclosure
Mgmt.
Controller
NV Store
Monitoring
& control
circuitry
SDR,
SEL,
FRU
FRU SEEPROM
circuitry
Baseboard
Copyright © 2001 Intel Corporation.
System Interface
System Bus
Page 8
Chassis
IPMI Messages
Future:
Intel
PCI Management Bus

Developer
Forum
Spring 2001
Provides SMBus connection across the PCI
slots
– 3.3 V Bus with timing and electricals per SMBus
2.0 ‘high power’ specification
– Remains operative on standby power

Uses SMBus 2.0 Address Resolution
Protocol (ARP) to assign addresses to Addin cards
– Fixed address devices can still be used on
baseboard
Copyright © 2001 Intel Corporation.
Page 9
Future:
Intel
ASF Sensor Devices

Developer
ASF = Alert Standard Forum specification
– From DMTF Pre-OS Working Group
– Currently out for DMTF membership review

Defines SMBus interface for Sensor Devices
– Provides commands for retrieving event status in a
standardized, abstracted format
– Uses IPMI sensor and event enumerations
– Provides commands for providing asynchronous
notification w/o requiring SMBAlert line
– Data can be easily mapped to a Platform Event Trap or
IPMI Event

Designed to work with PCI Management Bus...
Copyright © 2001 Intel Corporation.
Page 10
Forum
Spring 2001
PCI Management Bus
Intel
Developer
Server/IPMI application
BMC Polls
Sensor Devices
ASF
Sensor
Device
ASF
Sensor
Device
Forum
Spring 2001
Events
Logged
BMC ‘pushes’ events out to NIC(s)
SEL
LAN
Controller B
LAN
Controller A
PCI
SMBus
BMC
System Bus
System Management Software
accesses abstracted sensors and
logged events during run-time
Copyright © 2001 Intel Corporation.
Page 11
Remote console
software accesses
BMC via NIC
= IPMI over LAN...
Intel
Agenda
Developer
Forum
Spring 2001

Server Management Architecture
Overview

Baseboard Management Controllers

Enclosure/Peripheral Controllers

Sensor Devices

Putting it all together design advice and tools

Summary
Copyright © 2001 Intel Corporation.
Page 12
BMC Features to look for…
Intel
Built-in System Interface

Developer
Forum
Spring 2001
For IPMI, three types possible:
– KCS (Keyboard Controller Style) most popular.
– BT (Block Transfer) is fastest.
– SMIC (Server Mgmt. Interface Chip) for
implementation via external ASIC or FPGA.

Look for “low glue” connection to chip set
– LPC or ISA “X-bus” interfaces commonly used
– IPMI specifications now support memory mapped
implementations as well as original I/O mapped

Look for System Interface interrupt support
Copyright © 2001 Intel Corporation.
Page 13
BMC Features to look for…
Intel
Built-in System Interfaces
 Multiple
Developer
Built-in System Interfaces
– KCS interface hardware can be used to
implement an ACPI EC (Embedded Controller)
interface
– Additional interface can support OEM
differentiation access, such as from an SMI
Handler
Copyright © 2001 Intel Corporation.
Page 14
Forum
Spring 2001
BMC Features to look for…
Intel
I2C/SMBus Support

Developer
Forum
Spring 2001
At least three Master-Slave interfaces recommended:
 5V Master-slave capable for IPMB
 3.3V Master-slave for PCI Mgmt. Bus
 Additional M/S interface for LAN / Future

Interfaces should support multiple slave addresses
 One fixed for I2C broadcast (00h)
 One programmable for device as IPMI target
 Second programmable for snoop/SMBus host target

SMBus and I2C-compatible timing
– Increases implementation options
[ More on this topic later…]
Copyright © 2001 Intel Corporation.
Page 15
BMC Features to look for…
Intel
I2C/SMBus Support
Developer
Forum
Spring 2001
Support for multiple private management
busses
– Multiple private busses can reduce need for
external I2C bus multiplexing
– Hardware-based m/s or slave-only hardwarebased interfaces are best
– Important for LAN Controller interface performance
– ‘Open drain’ or ‘quasi- bi-directional’ I/O can be
used to create ‘bit banged’ private busses
– Mainly useful for interfacing to sensor devices,
particularly ones that do not require extensive polling
Copyright © 2001 Intel Corporation.
Page 16
BMC Features to look for…
Intel
Processor & I/O Power

Developer
Low Power Consumption
– <50 mA is a pretty good target

3.3V operation with 5V tolerance
– 5V Standby being replaced by 3.3V Standby in
PC platforms
– 5V tolerance on at least one I2C interface
reduces cost of IPMB support
– 5V tolerance on I/O enables supports
– 5V-based status signals
– Bit-banged access to SEEPROMs that are spec’d on
5V, e.g. Power Supply FRU
Copyright © 2001 Intel Corporation.
Page 17
Forum
Spring 2001
BMC Features to look for…
Intel
Developer
Flexible I/O

Forum
Spring 2001
Option to select open-drain or driven
outputs
– Supports flexible allocation of I/O functions
across products
– Reduces need for external pullups
– Enables software to use I/O as ‘strapping’ inputs
for selecting f/w options

High-sink outputs (>12mA)
– Can be used for direct LED drive
Copyright © 2001 Intel Corporation.
Page 18
BMC Features to look for…
Intel
UARTs and Timers
 Internal
Forum
Spring 2001
UARTs w/hardware handshake
support
–Built-in UART for direct ICMB support
–Additional UART for IPMI-over-Modem
application
 Firmware
Timer
–Timer for firmware scheduler
Copyright © 2001 Intel Corporation.
Developer
Page 19
BMC Features to look for…
Intel
Interrupt Support
Developer
Multiple Interrupts
–Multiple external interrupts for
asynchronous event capture
–Multiple internal interrupts from
interfaces, timers, etc. for efficient code
performance
–Multi-level interrupts for deterministic
prioritization
Copyright © 2001 Intel Corporation.
Page 20
Forum
Spring 2001
BMC Features to look for...
Intel
FAN monitoring & control

Developer
Forum
Spring 2001
Timers or Counters for Tach FAN Speed
monitoring
– Tach FAN speed can be accumulated using a
single counter with a digital multiplexer
– FAN speed is calculated by accumulating counts per
unit time, e.g. 1 second.
– Time to accumulate FAN speeds scales with number of
FANs. I.e. monitoring 8 fans takes 8 seconds.

Pulse-width Modulator (PWM) or D/A
outputs for FAN Speed control
Copyright © 2001 Intel Corporation.
Page 21
BMC Features to look for…
Intel
Built-in Analog-to-Digital

Developer
Forum
Spring 2001
Need for at least 7 voltages is common
– E.g. Processor 1 & 2, 3.3V, 3.3Vaux, 5V, 12V, -12V

Many server systems require more
– >2 processors, SCSI terminations, bus, cache/chipset, etc.
– 19 or more is not uncommon!

Conversion rate usually not an issue...
– A single converter with analog multiplexing works well

But accuracy, tolerance, and resolution are
– Recommend at least 8-bit resolution, +/-1 bit tolerance, and
+/-1% accuracy
Low accuracy paid for with system margins
Copyright © 2001 Intel Corporation.
Page 22
BMC Features to look for…
Intel
Extensibility and Headroom

Developer
Forum
Spring 2001
ROM/RAM upgrade path
– Don’t want to run out of code space for new
features...

Performance headroom for new functions
such as LAN and Modem access
– Modem interfaces are likely to require protocols
such as PPP
– New LAN and Modem interfaces require
signature algorithms for security

External expansion capability for external
peripheral, I/O, and RAM/ROM
Copyright © 2001 Intel Corporation.
Page 23
BMC Features to look for…
Intel
Scalable and Maintainable
 Scalability
– Can one controller fit multiple products?
– ...Or is it part of a ‘family’ that can?
 Firmware
Support & Maintenance
– Commercial high-level language tools
– Commercial code debugging support
– Vendor-provided debug tools
– Test port or emulator support
– Commercial RTOS options
Copyright © 2001 Intel Corporation.
Page 24
Developer
Forum
Spring 2001
BMC Features to look for...
Intel
Low Bean Count
 Package
and Board Space
– BGA packaging can provide higher density
– Watch tradeoffs between package size and
overall solution cost
 Low
unit cost
– Need I say more?
Copyright © 2001 Intel Corporation.
Page 25
Developer
Forum
Spring 2001
BMC Features to look for...
Intel
Software Support
Developer
Forum
Spring 2001
IPMI Firmware / SDK
– Vendors such as Qlogic, Vitesse Semiconductor,
and Winbond offer IPMI firmware for their BMC
and/or Enclosure Controller offerings.
– Typical SDKs support customer-developed
extensions for ‘Value added’ features
– Vendors may also offer customization services
Firmware and SDKs yield faster TTM for
IPMI-based designs
Copyright © 2001 Intel Corporation.
Page 26
Management Controllers*
Intel
Developer
Intel
Forum
Developer
Spring 2001
Forum
Mfr.
Dallas
Semi.
Hitachi
product
DS80CH11
H8/3337Y
H8S/2148
Philips
80C652
80C552
Qlogic
Zircon
Qlogic
Vitesse Semi.
Zircon
Lite
VSC210
Vitesse Semi.
VSC215
Winbond
W83910F
Agilent
National Semi.
Copyright © 2001 Intel Corporation.
system
core
I/F
8032
3 KCS
compat.
via ISA
H8
1 KCS
8-bit
via ISA
H8S
4 KCS
16-bit
via ISA
8032
external
compat.
req'd
8032
external
compat.
req'd
ARM7/
3 KCS
TDMI
via LPC,
ISA
ARM7/ BT, 2 KCS
TDMI
LPC/ISA
R3000
3 KCS/
SMIC/ BT
via LPC
R3000
3 KCS/
SMIC/ BT
via LPC
8032
3 KCS/
compat. SMIC/ BT
via LPC
Contact vendor…
Contact vendor…
2
I C A/D serial type
App
2
Y
1
8051
BMC
m/s
1
Y
Y
SCI
BMC
m/s
2
Y
Y
SCI
BMC
m/s
1
no
1
8051
Sat /
m/s
Bridge
1
8
1
8051
Sat /
m/s ch
BMC
3
10
2
"16550" BMC
m/s ch
2
m/s
3
m/s
8
ch
no
1
4
m/s
Y
4
5
m/s
7
2
3
Page 27
LED
drv
special
features
D/A,
PWM
D/A,
PWM
yes
Spring 2001
IPMI
F/W Avail.
no now
no
now
no
now
no
now
no
now
8 PWM,
yes
ICMB assist,
12 fan tach
same BMC / yes 2 PWM, 8 fan yes
cPCI
tach
ICE/GP BMC 12mA
fan tach,
yes
FIFO'd / Sat
ICMB assist
ICMB
ICE/GP BMC 12mA
fan tach,
yes
FIFO'd / Sat
ICMB assist
ICMB
"16550" BMC
yes
PWM, LCD yes
Module I/F,
4 temp diode
now
now
now
now
now
* All other brands and names are the property
of their respective owners
Intel
Agenda
Developer
Forum
Spring 2001

Server Management Architecture
Overview

Baseboard Management Controllers

Enclosure/Peripheral Management
Controllers

Sensor Devices

Putting it all together - design advice
and tools

Summary
Copyright © 2001 Intel Corporation.
Page 28
Enclosure/Peripheral Controllers
Intel
Example Block Diagram
Developer
Forum
Spring 2001
ICMB
Chassis
Mgmt. Bd.
IPMI Messages
ICMB
Bridge
Virtual
IPMB
Drive LEDs &
Slot Status
SCSI BUS


Chassis
Mgmt.
Control
SCSI Interface
SEL
SDRs
FRU
SAF-TE
Commands
SAF-TE = SCSI Accessed Fault-Tolerant Enclosures
SES = ANSI SCSI Enclosure Services
Copyright © 2001 Intel Corporation.
Page 29
Enclosure/Peripheral Controllers
Features to look for…

Intel
Developer
Forum
Spring 2001
SAF-TE and SES Firmware
– Extensible / customizable?
– Configurable LED definitions?

IPMI Firmware / SDK
– IPMB Support?

Support for external sensors or FRU devices
– e.g. FAN & power monitoring
Firmware and SDKs yield faster TTM for
Enclosure/Peripheral Controllers
Copyright © 2001 Intel Corporation.
Page 30
Enclosure Controllers
Intel
Developer
Forum
Spring 2001
Vitesse Semiconductor
SSC200 Enclosure Management Controller*
– Fibre Channel and Parallel SCSI management
– Two SFF-8076 ESI Ports with DMA
– Manages up to Four Parallel SCSI Bus Controllers
–
–
–
–
–
–
–
Three Master/Slave Controllers
32-bit, 40Mhz R3000 RISC CPU with Debug Port
RS-232 Monitor Port, can support ICMB
Up to 28 Programmable, General Purpose I/Os
100-pin PQFP Package
Firmware support for SAF-TE and SES
Firmware support available for IPMB/ICMB
Copyright © 2001 Intel Corporation.
Page 31
* All other brands and names are the property
of their respective owners
Enclosure Controllers
Intel
Developer
Forum
Spring 2001
Vitesse Semiconductor
VSC205 Enclosure Management Controller*
–
–
–
–
–
Enhanced SSC200
Built-in LVD SCSI controller in place of SFF 8067 I/F’s
SAF-TE, SES, and IPMI firmware available
160 PQFP Package
Available: Now
Copyright © 2001 Intel Corporation.
Page 32
* All other brands and names are the property
of their respective owners
Enclosure Controllers
Intel
Developer
Forum
Spring 2001
Qlogic
GEM359 Enclosure Management Controller*
– Enhanced follow-on to GEM 354
– Built-in LVD SCSI I/Fs (Ultra 2 and Ultra 3)
– Two SFF-8067 interfaces provided for Fibre Channel
applications
– 54 GPIO pins provided for status and control signals
– Two Master/Slave I2C interfaces for IPMB support and
additional expansion
– UART for debug support
– SAF-TE, SES and IPMI firmware available
– 144 LQPF
– Available: Now
Copyright © 2001 Intel Corporation.
Page 33
* All other brands and names are the property
of their respective owners
Peripheral/Chassis
Controllers
Intel
Developer
Forum
Spring 2001
Qlogic
Zircon PM*
– Peripheral / Satellite Management Controller
– Targeted to CompactPCI I/O boards (PICMG spec.) and
IPMB-based server peripherals (satellite controller)
– 3 Master/Slave I2C interfaces
– F/W Support for IPMB
– up to 24 GPIO
– up to 6 A/D converters
– IPMI firmware available
– samples March '01, production targeted May '01
Copyright © 2001 Intel Corporation.
Page 34
* All other brands and names are the property
of their respective owners
Enclosure/Peripheral
Controllers*
Mfr.
QLogic
QLogic
product
GEM 359
core
8-bit
Zircon PM ARM 7
TDM
Periph. I/F
LVDS,
2 SFF-8067
n/a
Fibre Channel
2
I C A/D serial
2
1
m/s
3
6
m/s
Vitesse
Semi.
SSC100
R3000
3
m/s
N
2
Vitesse
Semi.
VSC200
R3000 Fibre Channel, 3
SFF-8067,
m/s
ESI
N
2
Vitesse
Semi.
VSC205
R3000
N
2
SCSI
3
m/s
Intel
Developer
Forum
Spring 2001
LED
special
IPMI
type
drv
features F/W
16550
4 @ 4 tach fan, yes
12mA
3 PWM
1@
yes
12 mA
Avail.
now
ICE/GP 12mA
ICMB
FIFO'd
Arbitration
ICMB
ICE/GP 12mA
ICMB
FIFO'd
Arbitration
ICMB
yes
samples
~e.o.
March**
now
yes
now
ICE/GP 12mA
ICMB
FIFO'd
Arbitration
ICMB
yes
now
** Preliminary information provided
courtesy of vendor. Please contact vendor for
latest information.
Copyright © 2001 Intel Corporation.
Page 35
* All other brands and names are the property
of their respective owners
Intel
Agenda
Developer
Forum
Spring 2001

Server Management Architecture
Overview

Baseboard Management Controllers

Enclosure/Peripheral Controllers

Sensor Devices

Putting it all together - design
advice and tools

Summary
Copyright © 2001 Intel Corporation.
Page 36
Temperature Monitoring
and Fan Control

Intel
Developer
Server system power increasing -Noise Reduction
becomes more difficult
– Need to meet ISO 7779 and BLUE ANGEL specs

Desire for more granular speed control
– Audible FAN Speed Cycling can be disconcerting to user

Need for per-fan or per-zone control
– Driving all fans to same speed usually produces higher
than needed noise level

Just one tool - not a panacea
– System Engineers still need to design mechanicals and
select low-noise fans
Copyright © 2001 Intel Corporation.
Page 37
Forum
Spring 2001
Automatic Fan Control
Intel
Developer
Forum
Spring 2001



Controls fans
speed
dependant on
temperature
No software
dependence
(BIOS or OS)
Allows for
quiet fans,
while still
provides
adequate
cooling
Copyright © 2001 Intel Corporation.
Page 38
Figure courtesy of Analog Devices
Board Temperature Sensors*
Intel
Developer
Forum
Spring 2001
Analog
Devices
Dallas
Semiconductor
National
Semiconductor
resol. acc
bits degC addr. dig. out
AD7416
+/- 2
10
1
AD7417B
+/- 2
10
1
AD7418
+/- 3
10
1
DS75
9
+/- 2
8
1
DS1621
DS1624
9
13
DS1721
DS1775
LM75
9
9
9
LM77
9
Copyright © 2001 Intel Corporation.
+/- 0.5
+/- 0.5
8
8
pins
8
16
8
8
1
0
8
8
+/- 1 mask
+/- 2
8
+/- 3
8
1
1
1
+/- 3
2
4
Page 39
temp +
1ch A/D
temp +
4ch A/D
-25 to 100
temp +
SEEPROM
+/- 2
8
SOT23-5
8
-25 to 100
+/- 2
8
10 to 65
+/- 1.5
* All other brands and names are the property
of their respective owners
Processor/ Remote Diode
Temperature Sensors*
Intel
Developer
Forum
Spring 2001
acc. Remote acc.
Local degC Diode degC pins special
Analog Devices ADM1021
1
+/- 1
1
+/- 3 16
Analog Devices ADM1028
1
+/- 2
2
+/- 3 16 FAN ctrl.
# Maxim
MAX1617A
1
+/- 2
1
+/- 3 16
# National
LM83
1
+/-3
3
+/- 3 16
# National
LM84
1
+/- 1
1
+/- 3 16
# Philips
NE1617
1
+/- 2
1
+/- 3 16
Texas Instr.
THMC10
1
+/- 2.5
1
+/- 3 16
Texas Instr.
THMC50
1
+/- 3
1
+/- 3 16 FAN ctrl., 2 A/D
# Pin Compatible
Copyright © 2001 Intel Corporation.
Page 40
* All other brands and names are the property
of their respective owners
Intel
Hardware Monitors*
Developer
Intel
Forum
Developer
Spring 2001
Analog
Devices
Dallas
Semiconductor
National
Semiconductor
Philips
Semiconductor
Winbond
ADM9240
volt. temp.
6 1 internal
ADM1024
8
ADM1025
5
DS1780
chassis POST add'l
fan VID
intr
RAM I/F
2 1x5
1
2
1x5
1
0
1x5
0
6
2 remt. diode,
1 internal
1 remote diode,
1 internal
1 internal
2
1x5
1
LM78/79
7
1 internal
3
1x4
1
LM80
7
2
0
1
LM81
LM87
6
8
2
2
1x5
1x5
1
1
Heceta-IV *
5
0
1x5
0
W83781D
W83782D
W83783S
W83L784R
W83L785R
7
9
5
5
4
1 remt. sensor,
1 internal
1 internal
2 remote diode,
1 internal
1 remt. diode,
1 internal
3 remt. diode
3 remt. diode
3 remt. diode
2 remt. diode
2 remt. diode
3
2
3
2
2
1x5
1x5
1x5
1x5
1x5
1
1
1
1
1
W83791D
9
3 remt. diode
2
1x5
1
Copyright © 2001 Intel Corporation.
Page 41
fan ctrl
/special
Analog out
Analog out
Analog out
yes
ISA
Forum
Spring data
2001
pins sheet
24
24
prelim.
16
prelim.
24
44
24
Analog out
Analog out
24
24
16
yes
ISA
ISA
beep out
3 PWM, beep
2 PWM, beep
FAN ctrl, beep
2 PWM,
9 GPIO
FAN Ctrl
ASF & Speech
48
48
24
24
24
prelim.
prelim.
48
* All other brands and names are the property
of their respective owners
Miscellaneous Sensors
Intel
Vitesse Semiconductor VSC055*
Developer
Forum
Spring 2001
I2C Enhanced Backplane Controller
– Designed as a companion component to enclosure
management processors
– I2C bus
– 8 Fan-speed monitor inputs
– 8 Programmable PWM outputs
– 64 12mA, programmable, bi-directional I/O pins with individually
selectable one of 7 LED flash rates
– 32 GPIO pins can be uses as FC-AL port bypass control pins
– Programmable interrupt control for 64 interrupt sources (I/O, bypass
input transitions, and fan speed thresholds)
– 100-pin PQFP pkg.
– SSC050 is a subset of the VSC055 (e.g. 4 fans & PWM, 40 GPIO, 52
interrupt sources)*
Copyright © 2001 Intel Corporation.
Page 42
* All other brands and names are the property
of their respective owners
Miscellaneous Sensors and Actuators
Intel
Analog Devices ADM1026*
Developer
Forum
Spring 2001
3
Channel
±1ºC Temp
Sensor
 19 voltage
channels
 8 x Fan Control
and Monitoring
 16 GPIO
 8k EEPROM
 48LQFP
Copyright © 2001 Intel Corporation.
Page 43
* All other brands and names are the property
of their respective owners
Miscellaneous Sensors and Actuators
Intel
Analog Devices ADM1029/31*
Developer
Forum
Spring 2001
ADM1029





3 Ch. ±1ºC Temp Sensor
2 voltage channels
Automatic Fan Control
and Monitoring
Supports Fan Hot Swap
24 QSOP
ADM1031



2 x Automatic Fan Control
and Monitoring
Fan Fault and Therm Fault
indications
16TSSOP
Copyright © 2001 Intel Corporation.
Page 44
* All other brands and names are the property
of their respective owners
Remote Management Cards
Intel
Developer
Forum
Spring 2001
Extend management
capabilities on top of IPMI
LAN
Serial /
Modem
Remote
Management
Card
– Remote access for systems
Future
that lack built-in interfaces
– Richer transport support
(e.g. tcp/ip, shttp)
Aux. IPMB
– Local User Interfaces
Baseboard
(e.g. html)
Monitoring
IPMB
– Support for new media
& control
circuitry
– Add’l local actions
SDR,
(e.g. email alerts)
Baseboard
Example: Agilent
Technologies Remote
Management Card*
Copyright © 2001 Intel Corporation.
Mgmt.
Controller
SEL,
FRU
Chassis
Enclosure
Mgmt.
Controller
Monitoring
& control
circuitry
FRU SEEPROM
System Interface
Page 45
* All other brands and names are the property
of their respective owners
Intel
Agenda
Developer
Forum
Spring 2001

Server Management Architecture
Overview

Baseboard Management Controllers

Enclosure/Peripheral Controllers

Sensor Devices

Putting it all together - design advice
and tools

Summary
Copyright © 2001 Intel Corporation.
Page 46
I2C/SMBus Application
Intel
Developer
Multiplexing
Forum
Spring 2001
Multiplexing may be required when dealing
with more than eight I2C slave devices of the
same type
– E.g. when handling serial presence data SEEPROMs
on DIMMs on an enterprise server memory board
– SSI Power Supplies also use A0h-AEh range !
AE
AC
AA
A8
A6
A4
A2
A0
Copyright © 2001 Intel Corporation.
AE
AC
AA
A8
A6
A4
A2
A0
Page 47
A0
Bonus FRU
SEEPROM
I2C/SMBus Application
Intel
Developer
Multiplexing
Simple analog Switch plus control = I2C bus
multiplexing
– e.g. CBT 3244 octal bus switch
with quad enables

Best on private busses
– Watch out for series resistance
effects
CBT 3244

Forum
Spring 2001
– CBT 3244 or compatible typically
<15 ohms, worst case
Can also be used for Isolation & Conversion
 But requires GPIO lines to control
multiplexing...

Copyright © 2001 Intel Corporation.
Page 48
I2C/SMBus Application
Intel
Developer
Multiplexing
Analog Switch plus I2C/SMBus Latch
= bus controllable multiplexing
Analog
Switch
+
Main
I2C
PCF 8574
CBT 3244

Forum
Spring 2001
=
I2C Latch
1:4
I2C
bus
mux
I2C A
I2C B
I2C C
I2C D
E.g. Philips PCA9544*
“4ch I2C Multiplexer
with Interrupts”
Off-the-shelf multiplexers available
Copyright © 2001 Intel Corporation.
Page 49
* All other brands and names are the property
of their respective owners
I2C/SMBus Application
Intel
Developer
Conversion & Isolation
Forum
Spring 2001

Conversion required when dealing with
different bus voltage levels

Isolation required when unpowered devices
‘short out’ bus
BMC
Copyright © 2001 Intel Corporation.
5V Standby
3.3 V
Power Supply
SEEPROM
Memory
SEEPROM
Level
Shift
Page 50
ISOL
I2C/SMBus Application
Intel
Conversion & Isolation
Developer
Forum
Spring 2001
Example: Conversion circuit described
in Philips Semiconductor’s I2C v2.0
specification
3.3V
Device
Copyright © 2001 Intel Corporation.
3.3V
Device
5V
BMC
Page 51
5V
Device
I2C/SMBus Application
Intel
Conversion & Isolation
Developer
Forum
Spring 2001
Philips Semiconductors
PCA9515 I2C Bus Repeater*
– Allows additional 400 pF bus
segment
– Can provide level translation
– Plus ability to isolate segment 1 from segment 0.
– Supports level translation (5V tolerant pins)
– Pins go “Hi-Z” when device is un-powered.
– Supports multi-master arbitration across the repeater
Possible application: Supporting PCI Mgmt. Bus
on >8 PCI Slots
Copyright © 2001 Intel Corporation.
Page 52
* All other brands and names are the property
of their respective owners
I2C/SMBus Application
Intel
Multiplexing & Isolation
Developer
Forum
Spring 2001
Philips Semiconductors
PCA9516 “5 channel I2C Hub”*
– Allows multiple additional
400 pF bus segments
– Segments can be individually isolated
– Supports level translation
(5V tolerant pins)
– Pins “Hi-Z” when device un-powered.
– Supports multi-master arbitration across the repeater
Possible applications:
Supporting PCI Management Bus on >8 PCI Slots,
isolating SMBus to ‘hot-plug PCI’ slots, driving I2C to
multiple system boards
Copyright © 2001 Intel Corporation.
Page 53
* All other brands and names are the property
of their respective owners
Mixing SMBus &
Intel
I2C
Developer
Forum
Spring 2001
SMBus 2.0 high-power I2C specifications are not
directly compatible:
2
VIL MAX
VIH MIN
VOL, MAX
THD; DAT
RISE TIME
FALL TIME*
I2C (Vdd-based)
SMBus
0.89V (=0.9 Vdd min)
2.54V (= 0.7 Vdd max)
0.4V at 3mA
0 ns
1000 ns from 0.89V to 2.54V
output stage:
250 ns from 2.54V to 0.89V
bus: 300 ns
0.80V
2. 1V
0.4V at 4mA
300 nS
1000 ns from 0.65V to 2.25V
300 ns from 2.25V to 0.65V
* I2C specifies a faster fall on the output stage in order to allow
for the possible inclusion of external series ESD protection
resistors
SMBus
Copyright © 2001 Intel Corporation.
Page 54
I2C
Mixing SMBus & I2C - design for interoperability
Controllers & Sensor Devices
Intel
Developer
Forum
Spring 2001

Design devices to sink 4mA, min.

Design devices to output I2C ‘1’ and SMBus ‘0’ levels.

Design devices to accept SMBus ‘1’ and I2C ‘0’ levels.

Output data with SMBus hold time [THD;DAT = 300 ns]

Accept data with I2C hold time [THD;DAT = 0 ns]

Recommended that new fixed-address sensor devices
be discoverable per the SMBus 2.0 specification
Support ‘Dual Protocol’ in new
Management Controllers and Sensor Devices
Copyright © 2001 Intel Corporation.
Page 55
Mixing SMBus & I2C - design for interoperability
Intel
Developer
Busses
Forum
Spring 2001
Can often use ‘I2C’ devices on PCI
Management bus
… if loading and rise times are compatible
with SMBus and I2C specs:
– Bus loading designed to work with I2C 3 mA sink
current [or all devices meet 4mA sink capability]
– Bus pullups and capacitance designed to meet
1000 ns Rise Time from 0.65V to 2.54V
I2C and SMBus devices can share
same bus. But Master needs to be
compatible with the target.
Copyright © 2001 Intel Corporation.
Page 56
SMBus & I2C
Intel
Design Recommendations
Developer
Forum
Spring 2001
Avoid using slave devices that lack data
integrity checks on the IPMB or PCI
Management Bus
– Many of today’s simple devices don’t have checksums or
error check codes
– Longer bus can have more noise
– A 3rd party firmware error could cause interrupts during
transfers
– ‘Public’ Bus traffic is not deterministic. Poorly behaved
masters could be ‘bus hogs’.
New devices should include SMBus PEC (Packet Error
Check CRC) or use checksums ala IPMI messaging
Copyright © 2001 Intel Corporation.
Page 57
SMBus & I2C
Intel
Design Recommendations
Developer
Forum
Spring 2001
Put simple, polled slave devices on Private
Management Busses behind ASIC or
Management Controller
– Private management busses have deterministic bandwidth
available for polling and device access
– Private management busses typically have well controlled
noise and loading
– Devices inherit Management Controller data integrity on
IPMB
– Management controllers provide checksummed interface to
private management bus
Copyright © 2001 Intel Corporation.
Page 58
SMBus & I2C
Design Recommendations
Intel
Developer
Forum
Spring 2001
Management Controller Support for
‘Stuck 0 clear’
– A simple slave that misses a clock on a read transaction
can be left holding the data line low
– Detection requires ability to monitor the bus for a stuck 0
data condition
– Therefore, useful for firmware to be able to directly read state
of bus pins
– Can free bus by clocking it until transfer completes or data
goes to ‘1’
– Requires ability for firmware to clock bus, outputting a ‘1’
until bus clears
– I2C/SMBus controller state machine must be able to be
‘overridden’ so that it ignores 0 already on bus.
– One approach: allow firmware to drive bus pins as GPIO
See SMBus 2.0 spec for more info
Copyright © 2001 Intel Corporation.
Page 59
I2C/SMBus Testing
Intel
Developer
Scopes
Forum
Spring 2001
‘Deep trace’ logic analyzer or scope for
capturing I2C real-time events.
– Should be able capture at 1 microsecond or
better for 100’s of milliseconds.
– We’ve had good luck with the Hewlett-Packard
HP54645D* mixed-signal oscilloscope
– 2-channel digital scope plus 16 logic channels
– 200 Msa/s on 16 channels with 2 MB of memory per
logic channel
– (Yields 2 seconds of capture at 1 Msa/s)
Copyright © 2001 Intel Corporation.
Page 60
* All other brands and names are the property
of their respective owners
I2C/SMBus Testing
Intel
Noise Tolerance

Developer
Forum
Spring 2001
Check for ‘mid-byte’ START and STOP
Conditions
– Devices should accept START or STOP during
any bit interval

Check for tolerance to runt pulses
– Most devices behave well under specified
operating conditions
– …but the IPMB may be subject to ‘noise’ or poorcitizen devices that could ‘glitch’ clock and data lines
– Try placing a pulse generator on the bus and
grounding the clock and data lines at various rates and
pulse widths.
Copyright © 2001 Intel Corporation.
Page 61
I2C/SMBus Testing
Intel
Testers & Monitors
Developer
Forum
Spring 2001
Microcomputer Control Corporation
http://www.mcc-us.com/
– MIIC-101K
– I2C/SMBus Standalone Monitor and I2C/SMBus Software
Analyzer Package Kit.
– MIIC-102/ISA I2C Bus Monitor Plus.
– Instrument for I2C and SMBus monitoring. Supports Message
Timing to 1uS, Low Voltage, 400KHz, and more.
– MIIC-202 iPort/AI
– RS-232 to I2C Host Adapter with ASCII Interface. I2C Bus Host
Adapter for serial port. Works with Windows or non-Windows
based Host Computers.
Copyright © 2001 Intel Corporation.
Page 62
I2C/SMBus Testing
Intel
Testers & Monitors
Developer
Calibre UK Ltd
http://www.calibreuk.com/
– ICA90 and ICA93LV
– ISA I2C-Bus adapters
– PICA90 and PICA93LV
– desk-top (parallel port) I2C-Bus adapters
– Software
– WINI2C ready-to-run I2C-Bus software
– ICADLL and PICADLL developers I2C-Bus windows
programming libraries
Copyright © 2001 Intel Corporation.
Page 63
Forum
Spring 2001
I2C/SMBus Testing
Intel
IPMI Messaging Testing
Developer

IPMITOOL simple messaging utility
available from IPMI Web Site

IPMI Conformance Test available from IPMI
Web Site

Debug tools from component vendors

IPMB message testing using software from
I2C tester vendors
– e.g. Microcomputer Control Corporation,
Calibre Ltd - UK
Copyright © 2001 Intel Corporation.
Page 64
Forum
Spring 2001
IPMI Conformance Test
Intel
Developer
Forum
Spring 2001


Available from IPMI Web Site
Performs System interface accessible testing
– KCS and SMIC interfaces, Watchdog Timer, BMC Sensors
– System event log (SEL) and sensor data record (SDR)
access


IPMB and ICMB test support
TCL/TK based
– Script-based testing is user extensible
– Examples provided

Also usable as debug and development aid
Copyright © 2001 Intel Corporation.
Page 65
Intel
Summary
Developer
Forum
Spring 2001
 New
initiatives and specifications
enable competitive server
management features
 Management controllers available to fit
your design and feature differentiation
 New sensor devices can reduce
system cost and design effort
 Help available today...
Copyright © 2001 Intel Corporation.
Page 66
Resource Information
Component & Tool Vendors*
Intel
Developer
Forum
Spring 2001

Agilent Technologies

Analog Devices, Inc.

Dallas Semiconductor

Hitachi Semiconductor (America), Inc.

Micro Computer Control Corporation

National Semiconductor Corporation

Philips Semiconductors

Qlogic Corporation

Texas Instruments
contact.tm.agilent.com/tmo/datasheets/English/PRMC_ERMC.html, Niki Haines, niki_haines@agilent.com
www.analog.com/pc & /temp-sensors, Paul Errico - paul.errico@analog.com
www.dalsemi.com
semiconductor.hitachi.com
www.mcc-us.com, Ed Thompson, ed.thompson@mcc-us.com
www.national.com/appinfo/tempsensors/ & /advancedio, Hezi Friedma, hezi.friedman@nsc.com
www.philipslogic.com/products/i2c, Joe Kochanski, joseph.kochanski@phlips.com
www.qlogic.com, Mark Byrne-Quinn, mark.byrne-quinn@qlogic.com
www.ti.com

Vitesse Semiconductor Corporation

Winbond Electronics Corporation
www.vitesse.com, Tom Brokaw,brokaw@vitesse.com
www.winbond.com.tw, Chad M.C. Wu, mcwu0@winbond.com.tw
Copyright © 2001 Intel Corporation.
Page 67
* All other brands and names are the property
of their respective owners
Resource Information
Intel
Organizations / Specifications

Developer
Forum
Spring 2001
IPMI (Intelligent Platform Management Interface)
Specifications
– http://developer.intel.com/design/servers/ipmi

SMBus Specifications
– System Management Bus (SMBus) Specification, Version 2.0,
August 3, 2000
http://www.smbus.org
 I 2C
Specifications
– The I2C-BUS Specification, Version 2.1, January 2000
http://semiconductors.philips.com/

DMTF Pre-OS Working Group / ASF Specifications*
– http://www.dmtf.org
Copyright © 2001 Intel Corporation.
Page 68
* All other brands and names are the property
of their respective owners
Call to Action
Intel
Developer
Forum
Spring 2001
Get the specs, contact the vendors,
and take advantage of these
technologies and components in
your designs.
Copyright © 2001 Intel Corporation.
Page 69
Server Management Controllers,
Sensors, and Tools
Tom Slaight
Intel Corporation
Questions?
Please remember to turn in
your session survey form.
Copyright © 2001 Intel Corporation.
Page 70
Intel
Developer
Forum
Spring 2001