Server Management Tools Enable Design Differentiation
Transcription
Server Management Tools Enable Design Differentiation
Intel Server Management Controllers, Sensors, and Tools Developer Tom Slaight Server Management Architect Enterprise Platforms Group Intel Corporation March 1, 2001 Copyright © 2000 Intel Corporation. Forum Spring 2001 Intel Introduction Developer Forum Spring 2001 Audience: Architects, Technical Managers, Firmware Leads, and Hardware Designers – Involved in architecture, component selection, debug, test, or design of server baseboard and peripheral management subsystems Focus: – IPMI-based implementations – Hardware components – Hardware and firmware development tools Copyright © 2001 Intel Corporation. Page 2 Intel Disclaimers Developer Forum Spring 2001 A good starting point. – … but not a comprehensive list of vendors or available technology Listing of particular vendors and products does not constitute a particular endorsement by Intel or the IPMI Promoters No guarantees on accuracy of information provided Contact vendors directly for complete specifications and availability information “Architect’s Pick” Copyright © 2001 Intel Corporation. Page 3 Intel Agenda Developer Forum Spring 2001 Server Management Architecture Overview Baseboard Management Controllers Enclosure/Peripheral Controllers Sensor Devices Putting it all together design advice and tools Summary and Call to Action Copyright © 2001 Intel Corporation. Page 4 IPMI Intel Developer Forum Spring 2001 • Defines a common, abstracted, Intelligent message-based interface to intelligent Platform platform management hardware Management • Defines common records for describing Interface common platform management devices and their characteristics • Supports OEM differentiation and value added features • Promoters: Intel, HP, NEC & Dell IPMI Enables Cross-Platform Management Software Copyright © 2001 Intel Corporation. Page 5 IPMI Promoter, Contributor, and Adopter News Acer Inc. Agilent Technologies GmbH Alberta Microelectronics American Megatrends Inc. Arima Computer Corp. ASUSTek Computer, Inc. Blue Wave Systems Bull S.A. Celestica CyberGuard Corporation Data General Corporation Dell Computer Corporation Egenera, Inc. ElanVital Corporation Ericsson UAB Evans & Sutherland Eversys Corporation Exabyte Corporation FORCE Computers GmbH Fujitsu, Ltd. GoAhead Software, Inc. HADCO Corporation Hewlett-Packard Company Hewlett-Packard GmbH Hitachi Ltd. Hybricon Corporation InnoMediaLogic, Inc. Intel Corporation Copyright © 2001 Intel Corporation. Interphase Corporation InterWorks Computer Products Inventec Corporation Ipex ITG JMC Products L-3 Communications Corp. Lynux Works, Inc. Macrolink, Inc Magnetek, Inc. Micro-Star International Mitsubishi Electric Corp. National Semiconductor Corp. NEC Corporation Nematron Corporation Network Engines, Inc. NOCpulse, Inc. Olivetti Computers Worldwide Open Source Asia PEP Modular Computers Phoenix Technologies Ltd. Praim, Inc. Qlogic Corporation Radisys Corporation Reliance Computer Corporation Sanera Systems, Inc. Information Systems Engineering Center Page 6 Intel Developer SBS Technologies Scenix Semiconductor, Inc. Siemens AG Silicon Graphics, Inc. Stratus Computer Systems Ireland Ltd. Sun Microsystems Super Micro Computer, Inc. Symphony Group Intl. Co., Ltd. Synergy Microsystems Teknor Applicom, Inc. T-Netix, Inc. Tatung Co. Tektronix Texas Micro Corporation Toshiba Corporation Trimm Technologies Tyan Computer Corporation Universal Scientific Industrial Corp. USAR Systems, Inc. Vitesse Semiconductor Corp. Vividon, Inc. Vooha, Inc. Winbond Electronics Corp. Ziatech Corporation Forum (Industrial Computers GmbH) Spring 2001 Initiative News Intel Developer Forum Spring 2001 developer.intel.com/design/servers/ipmi Copyright © 2001 Intel Corporation. Page 7 Example Architecture Intel Developer Forum LAN MODEM / Serial Spring 2001 Remote Mgmt. Card ICMB ICMB Bridge Controller Aux. IPMB IPMB RS-232 Baseboard SMBus / PCI Mgmt. Bus Mgmt. Controller 2C / SMBus I SENSORs (BMC) PCI & control Mgmt NIC Enclosure Mgmt. Controller NV Store Monitoring & control circuitry SDR, SEL, FRU FRU SEEPROM circuitry Baseboard Copyright © 2001 Intel Corporation. System Interface System Bus Page 8 Chassis IPMI Messages Future: Intel PCI Management Bus Developer Forum Spring 2001 Provides SMBus connection across the PCI slots – 3.3 V Bus with timing and electricals per SMBus 2.0 ‘high power’ specification – Remains operative on standby power Uses SMBus 2.0 Address Resolution Protocol (ARP) to assign addresses to Addin cards – Fixed address devices can still be used on baseboard Copyright © 2001 Intel Corporation. Page 9 Future: Intel ASF Sensor Devices Developer ASF = Alert Standard Forum specification – From DMTF Pre-OS Working Group – Currently out for DMTF membership review Defines SMBus interface for Sensor Devices – Provides commands for retrieving event status in a standardized, abstracted format – Uses IPMI sensor and event enumerations – Provides commands for providing asynchronous notification w/o requiring SMBAlert line – Data can be easily mapped to a Platform Event Trap or IPMI Event Designed to work with PCI Management Bus... Copyright © 2001 Intel Corporation. Page 10 Forum Spring 2001 PCI Management Bus Intel Developer Server/IPMI application BMC Polls Sensor Devices ASF Sensor Device ASF Sensor Device Forum Spring 2001 Events Logged BMC ‘pushes’ events out to NIC(s) SEL LAN Controller B LAN Controller A PCI SMBus BMC System Bus System Management Software accesses abstracted sensors and logged events during run-time Copyright © 2001 Intel Corporation. Page 11 Remote console software accesses BMC via NIC = IPMI over LAN... Intel Agenda Developer Forum Spring 2001 Server Management Architecture Overview Baseboard Management Controllers Enclosure/Peripheral Controllers Sensor Devices Putting it all together design advice and tools Summary Copyright © 2001 Intel Corporation. Page 12 BMC Features to look for… Intel Built-in System Interface Developer Forum Spring 2001 For IPMI, three types possible: – KCS (Keyboard Controller Style) most popular. – BT (Block Transfer) is fastest. – SMIC (Server Mgmt. Interface Chip) for implementation via external ASIC or FPGA. Look for “low glue” connection to chip set – LPC or ISA “X-bus” interfaces commonly used – IPMI specifications now support memory mapped implementations as well as original I/O mapped Look for System Interface interrupt support Copyright © 2001 Intel Corporation. Page 13 BMC Features to look for… Intel Built-in System Interfaces Multiple Developer Built-in System Interfaces – KCS interface hardware can be used to implement an ACPI EC (Embedded Controller) interface – Additional interface can support OEM differentiation access, such as from an SMI Handler Copyright © 2001 Intel Corporation. Page 14 Forum Spring 2001 BMC Features to look for… Intel I2C/SMBus Support Developer Forum Spring 2001 At least three Master-Slave interfaces recommended: 5V Master-slave capable for IPMB 3.3V Master-slave for PCI Mgmt. Bus Additional M/S interface for LAN / Future Interfaces should support multiple slave addresses One fixed for I2C broadcast (00h) One programmable for device as IPMI target Second programmable for snoop/SMBus host target SMBus and I2C-compatible timing – Increases implementation options [ More on this topic later…] Copyright © 2001 Intel Corporation. Page 15 BMC Features to look for… Intel I2C/SMBus Support Developer Forum Spring 2001 Support for multiple private management busses – Multiple private busses can reduce need for external I2C bus multiplexing – Hardware-based m/s or slave-only hardwarebased interfaces are best – Important for LAN Controller interface performance – ‘Open drain’ or ‘quasi- bi-directional’ I/O can be used to create ‘bit banged’ private busses – Mainly useful for interfacing to sensor devices, particularly ones that do not require extensive polling Copyright © 2001 Intel Corporation. Page 16 BMC Features to look for… Intel Processor & I/O Power Developer Low Power Consumption – <50 mA is a pretty good target 3.3V operation with 5V tolerance – 5V Standby being replaced by 3.3V Standby in PC platforms – 5V tolerance on at least one I2C interface reduces cost of IPMB support – 5V tolerance on I/O enables supports – 5V-based status signals – Bit-banged access to SEEPROMs that are spec’d on 5V, e.g. Power Supply FRU Copyright © 2001 Intel Corporation. Page 17 Forum Spring 2001 BMC Features to look for… Intel Developer Flexible I/O Forum Spring 2001 Option to select open-drain or driven outputs – Supports flexible allocation of I/O functions across products – Reduces need for external pullups – Enables software to use I/O as ‘strapping’ inputs for selecting f/w options High-sink outputs (>12mA) – Can be used for direct LED drive Copyright © 2001 Intel Corporation. Page 18 BMC Features to look for… Intel UARTs and Timers Internal Forum Spring 2001 UARTs w/hardware handshake support –Built-in UART for direct ICMB support –Additional UART for IPMI-over-Modem application Firmware Timer –Timer for firmware scheduler Copyright © 2001 Intel Corporation. Developer Page 19 BMC Features to look for… Intel Interrupt Support Developer Multiple Interrupts –Multiple external interrupts for asynchronous event capture –Multiple internal interrupts from interfaces, timers, etc. for efficient code performance –Multi-level interrupts for deterministic prioritization Copyright © 2001 Intel Corporation. Page 20 Forum Spring 2001 BMC Features to look for... Intel FAN monitoring & control Developer Forum Spring 2001 Timers or Counters for Tach FAN Speed monitoring – Tach FAN speed can be accumulated using a single counter with a digital multiplexer – FAN speed is calculated by accumulating counts per unit time, e.g. 1 second. – Time to accumulate FAN speeds scales with number of FANs. I.e. monitoring 8 fans takes 8 seconds. Pulse-width Modulator (PWM) or D/A outputs for FAN Speed control Copyright © 2001 Intel Corporation. Page 21 BMC Features to look for… Intel Built-in Analog-to-Digital Developer Forum Spring 2001 Need for at least 7 voltages is common – E.g. Processor 1 & 2, 3.3V, 3.3Vaux, 5V, 12V, -12V Many server systems require more – >2 processors, SCSI terminations, bus, cache/chipset, etc. – 19 or more is not uncommon! Conversion rate usually not an issue... – A single converter with analog multiplexing works well But accuracy, tolerance, and resolution are – Recommend at least 8-bit resolution, +/-1 bit tolerance, and +/-1% accuracy Low accuracy paid for with system margins Copyright © 2001 Intel Corporation. Page 22 BMC Features to look for… Intel Extensibility and Headroom Developer Forum Spring 2001 ROM/RAM upgrade path – Don’t want to run out of code space for new features... Performance headroom for new functions such as LAN and Modem access – Modem interfaces are likely to require protocols such as PPP – New LAN and Modem interfaces require signature algorithms for security External expansion capability for external peripheral, I/O, and RAM/ROM Copyright © 2001 Intel Corporation. Page 23 BMC Features to look for… Intel Scalable and Maintainable Scalability – Can one controller fit multiple products? – ...Or is it part of a ‘family’ that can? Firmware Support & Maintenance – Commercial high-level language tools – Commercial code debugging support – Vendor-provided debug tools – Test port or emulator support – Commercial RTOS options Copyright © 2001 Intel Corporation. Page 24 Developer Forum Spring 2001 BMC Features to look for... Intel Low Bean Count Package and Board Space – BGA packaging can provide higher density – Watch tradeoffs between package size and overall solution cost Low unit cost – Need I say more? Copyright © 2001 Intel Corporation. Page 25 Developer Forum Spring 2001 BMC Features to look for... Intel Software Support Developer Forum Spring 2001 IPMI Firmware / SDK – Vendors such as Qlogic, Vitesse Semiconductor, and Winbond offer IPMI firmware for their BMC and/or Enclosure Controller offerings. – Typical SDKs support customer-developed extensions for ‘Value added’ features – Vendors may also offer customization services Firmware and SDKs yield faster TTM for IPMI-based designs Copyright © 2001 Intel Corporation. Page 26 Management Controllers* Intel Developer Intel Forum Developer Spring 2001 Forum Mfr. Dallas Semi. Hitachi product DS80CH11 H8/3337Y H8S/2148 Philips 80C652 80C552 Qlogic Zircon Qlogic Vitesse Semi. Zircon Lite VSC210 Vitesse Semi. VSC215 Winbond W83910F Agilent National Semi. Copyright © 2001 Intel Corporation. system core I/F 8032 3 KCS compat. via ISA H8 1 KCS 8-bit via ISA H8S 4 KCS 16-bit via ISA 8032 external compat. req'd 8032 external compat. req'd ARM7/ 3 KCS TDMI via LPC, ISA ARM7/ BT, 2 KCS TDMI LPC/ISA R3000 3 KCS/ SMIC/ BT via LPC R3000 3 KCS/ SMIC/ BT via LPC 8032 3 KCS/ compat. SMIC/ BT via LPC Contact vendor… Contact vendor… 2 I C A/D serial type App 2 Y 1 8051 BMC m/s 1 Y Y SCI BMC m/s 2 Y Y SCI BMC m/s 1 no 1 8051 Sat / m/s Bridge 1 8 1 8051 Sat / m/s ch BMC 3 10 2 "16550" BMC m/s ch 2 m/s 3 m/s 8 ch no 1 4 m/s Y 4 5 m/s 7 2 3 Page 27 LED drv special features D/A, PWM D/A, PWM yes Spring 2001 IPMI F/W Avail. no now no now no now no now no now 8 PWM, yes ICMB assist, 12 fan tach same BMC / yes 2 PWM, 8 fan yes cPCI tach ICE/GP BMC 12mA fan tach, yes FIFO'd / Sat ICMB assist ICMB ICE/GP BMC 12mA fan tach, yes FIFO'd / Sat ICMB assist ICMB "16550" BMC yes PWM, LCD yes Module I/F, 4 temp diode now now now now now * All other brands and names are the property of their respective owners Intel Agenda Developer Forum Spring 2001 Server Management Architecture Overview Baseboard Management Controllers Enclosure/Peripheral Management Controllers Sensor Devices Putting it all together - design advice and tools Summary Copyright © 2001 Intel Corporation. Page 28 Enclosure/Peripheral Controllers Intel Example Block Diagram Developer Forum Spring 2001 ICMB Chassis Mgmt. Bd. IPMI Messages ICMB Bridge Virtual IPMB Drive LEDs & Slot Status SCSI BUS Chassis Mgmt. Control SCSI Interface SEL SDRs FRU SAF-TE Commands SAF-TE = SCSI Accessed Fault-Tolerant Enclosures SES = ANSI SCSI Enclosure Services Copyright © 2001 Intel Corporation. Page 29 Enclosure/Peripheral Controllers Features to look for… Intel Developer Forum Spring 2001 SAF-TE and SES Firmware – Extensible / customizable? – Configurable LED definitions? IPMI Firmware / SDK – IPMB Support? Support for external sensors or FRU devices – e.g. FAN & power monitoring Firmware and SDKs yield faster TTM for Enclosure/Peripheral Controllers Copyright © 2001 Intel Corporation. Page 30 Enclosure Controllers Intel Developer Forum Spring 2001 Vitesse Semiconductor SSC200 Enclosure Management Controller* – Fibre Channel and Parallel SCSI management – Two SFF-8076 ESI Ports with DMA – Manages up to Four Parallel SCSI Bus Controllers – – – – – – – Three Master/Slave Controllers 32-bit, 40Mhz R3000 RISC CPU with Debug Port RS-232 Monitor Port, can support ICMB Up to 28 Programmable, General Purpose I/Os 100-pin PQFP Package Firmware support for SAF-TE and SES Firmware support available for IPMB/ICMB Copyright © 2001 Intel Corporation. Page 31 * All other brands and names are the property of their respective owners Enclosure Controllers Intel Developer Forum Spring 2001 Vitesse Semiconductor VSC205 Enclosure Management Controller* – – – – – Enhanced SSC200 Built-in LVD SCSI controller in place of SFF 8067 I/F’s SAF-TE, SES, and IPMI firmware available 160 PQFP Package Available: Now Copyright © 2001 Intel Corporation. Page 32 * All other brands and names are the property of their respective owners Enclosure Controllers Intel Developer Forum Spring 2001 Qlogic GEM359 Enclosure Management Controller* – Enhanced follow-on to GEM 354 – Built-in LVD SCSI I/Fs (Ultra 2 and Ultra 3) – Two SFF-8067 interfaces provided for Fibre Channel applications – 54 GPIO pins provided for status and control signals – Two Master/Slave I2C interfaces for IPMB support and additional expansion – UART for debug support – SAF-TE, SES and IPMI firmware available – 144 LQPF – Available: Now Copyright © 2001 Intel Corporation. Page 33 * All other brands and names are the property of their respective owners Peripheral/Chassis Controllers Intel Developer Forum Spring 2001 Qlogic Zircon PM* – Peripheral / Satellite Management Controller – Targeted to CompactPCI I/O boards (PICMG spec.) and IPMB-based server peripherals (satellite controller) – 3 Master/Slave I2C interfaces – F/W Support for IPMB – up to 24 GPIO – up to 6 A/D converters – IPMI firmware available – samples March '01, production targeted May '01 Copyright © 2001 Intel Corporation. Page 34 * All other brands and names are the property of their respective owners Enclosure/Peripheral Controllers* Mfr. QLogic QLogic product GEM 359 core 8-bit Zircon PM ARM 7 TDM Periph. I/F LVDS, 2 SFF-8067 n/a Fibre Channel 2 I C A/D serial 2 1 m/s 3 6 m/s Vitesse Semi. SSC100 R3000 3 m/s N 2 Vitesse Semi. VSC200 R3000 Fibre Channel, 3 SFF-8067, m/s ESI N 2 Vitesse Semi. VSC205 R3000 N 2 SCSI 3 m/s Intel Developer Forum Spring 2001 LED special IPMI type drv features F/W 16550 4 @ 4 tach fan, yes 12mA 3 PWM 1@ yes 12 mA Avail. now ICE/GP 12mA ICMB FIFO'd Arbitration ICMB ICE/GP 12mA ICMB FIFO'd Arbitration ICMB yes samples ~e.o. March** now yes now ICE/GP 12mA ICMB FIFO'd Arbitration ICMB yes now ** Preliminary information provided courtesy of vendor. Please contact vendor for latest information. Copyright © 2001 Intel Corporation. Page 35 * All other brands and names are the property of their respective owners Intel Agenda Developer Forum Spring 2001 Server Management Architecture Overview Baseboard Management Controllers Enclosure/Peripheral Controllers Sensor Devices Putting it all together - design advice and tools Summary Copyright © 2001 Intel Corporation. Page 36 Temperature Monitoring and Fan Control Intel Developer Server system power increasing -Noise Reduction becomes more difficult – Need to meet ISO 7779 and BLUE ANGEL specs Desire for more granular speed control – Audible FAN Speed Cycling can be disconcerting to user Need for per-fan or per-zone control – Driving all fans to same speed usually produces higher than needed noise level Just one tool - not a panacea – System Engineers still need to design mechanicals and select low-noise fans Copyright © 2001 Intel Corporation. Page 37 Forum Spring 2001 Automatic Fan Control Intel Developer Forum Spring 2001 Controls fans speed dependant on temperature No software dependence (BIOS or OS) Allows for quiet fans, while still provides adequate cooling Copyright © 2001 Intel Corporation. Page 38 Figure courtesy of Analog Devices Board Temperature Sensors* Intel Developer Forum Spring 2001 Analog Devices Dallas Semiconductor National Semiconductor resol. acc bits degC addr. dig. out AD7416 +/- 2 10 1 AD7417B +/- 2 10 1 AD7418 +/- 3 10 1 DS75 9 +/- 2 8 1 DS1621 DS1624 9 13 DS1721 DS1775 LM75 9 9 9 LM77 9 Copyright © 2001 Intel Corporation. +/- 0.5 +/- 0.5 8 8 pins 8 16 8 8 1 0 8 8 +/- 1 mask +/- 2 8 +/- 3 8 1 1 1 +/- 3 2 4 Page 39 temp + 1ch A/D temp + 4ch A/D -25 to 100 temp + SEEPROM +/- 2 8 SOT23-5 8 -25 to 100 +/- 2 8 10 to 65 +/- 1.5 * All other brands and names are the property of their respective owners Processor/ Remote Diode Temperature Sensors* Intel Developer Forum Spring 2001 acc. Remote acc. Local degC Diode degC pins special Analog Devices ADM1021 1 +/- 1 1 +/- 3 16 Analog Devices ADM1028 1 +/- 2 2 +/- 3 16 FAN ctrl. # Maxim MAX1617A 1 +/- 2 1 +/- 3 16 # National LM83 1 +/-3 3 +/- 3 16 # National LM84 1 +/- 1 1 +/- 3 16 # Philips NE1617 1 +/- 2 1 +/- 3 16 Texas Instr. THMC10 1 +/- 2.5 1 +/- 3 16 Texas Instr. THMC50 1 +/- 3 1 +/- 3 16 FAN ctrl., 2 A/D # Pin Compatible Copyright © 2001 Intel Corporation. Page 40 * All other brands and names are the property of their respective owners Intel Hardware Monitors* Developer Intel Forum Developer Spring 2001 Analog Devices Dallas Semiconductor National Semiconductor Philips Semiconductor Winbond ADM9240 volt. temp. 6 1 internal ADM1024 8 ADM1025 5 DS1780 chassis POST add'l fan VID intr RAM I/F 2 1x5 1 2 1x5 1 0 1x5 0 6 2 remt. diode, 1 internal 1 remote diode, 1 internal 1 internal 2 1x5 1 LM78/79 7 1 internal 3 1x4 1 LM80 7 2 0 1 LM81 LM87 6 8 2 2 1x5 1x5 1 1 Heceta-IV * 5 0 1x5 0 W83781D W83782D W83783S W83L784R W83L785R 7 9 5 5 4 1 remt. sensor, 1 internal 1 internal 2 remote diode, 1 internal 1 remt. diode, 1 internal 3 remt. diode 3 remt. diode 3 remt. diode 2 remt. diode 2 remt. diode 3 2 3 2 2 1x5 1x5 1x5 1x5 1x5 1 1 1 1 1 W83791D 9 3 remt. diode 2 1x5 1 Copyright © 2001 Intel Corporation. Page 41 fan ctrl /special Analog out Analog out Analog out yes ISA Forum Spring data 2001 pins sheet 24 24 prelim. 16 prelim. 24 44 24 Analog out Analog out 24 24 16 yes ISA ISA beep out 3 PWM, beep 2 PWM, beep FAN ctrl, beep 2 PWM, 9 GPIO FAN Ctrl ASF & Speech 48 48 24 24 24 prelim. prelim. 48 * All other brands and names are the property of their respective owners Miscellaneous Sensors Intel Vitesse Semiconductor VSC055* Developer Forum Spring 2001 I2C Enhanced Backplane Controller – Designed as a companion component to enclosure management processors – I2C bus – 8 Fan-speed monitor inputs – 8 Programmable PWM outputs – 64 12mA, programmable, bi-directional I/O pins with individually selectable one of 7 LED flash rates – 32 GPIO pins can be uses as FC-AL port bypass control pins – Programmable interrupt control for 64 interrupt sources (I/O, bypass input transitions, and fan speed thresholds) – 100-pin PQFP pkg. – SSC050 is a subset of the VSC055 (e.g. 4 fans & PWM, 40 GPIO, 52 interrupt sources)* Copyright © 2001 Intel Corporation. Page 42 * All other brands and names are the property of their respective owners Miscellaneous Sensors and Actuators Intel Analog Devices ADM1026* Developer Forum Spring 2001 3 Channel ±1ºC Temp Sensor 19 voltage channels 8 x Fan Control and Monitoring 16 GPIO 8k EEPROM 48LQFP Copyright © 2001 Intel Corporation. Page 43 * All other brands and names are the property of their respective owners Miscellaneous Sensors and Actuators Intel Analog Devices ADM1029/31* Developer Forum Spring 2001 ADM1029 3 Ch. ±1ºC Temp Sensor 2 voltage channels Automatic Fan Control and Monitoring Supports Fan Hot Swap 24 QSOP ADM1031 2 x Automatic Fan Control and Monitoring Fan Fault and Therm Fault indications 16TSSOP Copyright © 2001 Intel Corporation. Page 44 * All other brands and names are the property of their respective owners Remote Management Cards Intel Developer Forum Spring 2001 Extend management capabilities on top of IPMI LAN Serial / Modem Remote Management Card – Remote access for systems Future that lack built-in interfaces – Richer transport support (e.g. tcp/ip, shttp) Aux. IPMB – Local User Interfaces Baseboard (e.g. html) Monitoring IPMB – Support for new media & control circuitry – Add’l local actions SDR, (e.g. email alerts) Baseboard Example: Agilent Technologies Remote Management Card* Copyright © 2001 Intel Corporation. Mgmt. Controller SEL, FRU Chassis Enclosure Mgmt. Controller Monitoring & control circuitry FRU SEEPROM System Interface Page 45 * All other brands and names are the property of their respective owners Intel Agenda Developer Forum Spring 2001 Server Management Architecture Overview Baseboard Management Controllers Enclosure/Peripheral Controllers Sensor Devices Putting it all together - design advice and tools Summary Copyright © 2001 Intel Corporation. Page 46 I2C/SMBus Application Intel Developer Multiplexing Forum Spring 2001 Multiplexing may be required when dealing with more than eight I2C slave devices of the same type – E.g. when handling serial presence data SEEPROMs on DIMMs on an enterprise server memory board – SSI Power Supplies also use A0h-AEh range ! AE AC AA A8 A6 A4 A2 A0 Copyright © 2001 Intel Corporation. AE AC AA A8 A6 A4 A2 A0 Page 47 A0 Bonus FRU SEEPROM I2C/SMBus Application Intel Developer Multiplexing Simple analog Switch plus control = I2C bus multiplexing – e.g. CBT 3244 octal bus switch with quad enables Best on private busses – Watch out for series resistance effects CBT 3244 Forum Spring 2001 – CBT 3244 or compatible typically <15 ohms, worst case Can also be used for Isolation & Conversion But requires GPIO lines to control multiplexing... Copyright © 2001 Intel Corporation. Page 48 I2C/SMBus Application Intel Developer Multiplexing Analog Switch plus I2C/SMBus Latch = bus controllable multiplexing Analog Switch + Main I2C PCF 8574 CBT 3244 Forum Spring 2001 = I2C Latch 1:4 I2C bus mux I2C A I2C B I2C C I2C D E.g. Philips PCA9544* “4ch I2C Multiplexer with Interrupts” Off-the-shelf multiplexers available Copyright © 2001 Intel Corporation. Page 49 * All other brands and names are the property of their respective owners I2C/SMBus Application Intel Developer Conversion & Isolation Forum Spring 2001 Conversion required when dealing with different bus voltage levels Isolation required when unpowered devices ‘short out’ bus BMC Copyright © 2001 Intel Corporation. 5V Standby 3.3 V Power Supply SEEPROM Memory SEEPROM Level Shift Page 50 ISOL I2C/SMBus Application Intel Conversion & Isolation Developer Forum Spring 2001 Example: Conversion circuit described in Philips Semiconductor’s I2C v2.0 specification 3.3V Device Copyright © 2001 Intel Corporation. 3.3V Device 5V BMC Page 51 5V Device I2C/SMBus Application Intel Conversion & Isolation Developer Forum Spring 2001 Philips Semiconductors PCA9515 I2C Bus Repeater* – Allows additional 400 pF bus segment – Can provide level translation – Plus ability to isolate segment 1 from segment 0. – Supports level translation (5V tolerant pins) – Pins go “Hi-Z” when device is un-powered. – Supports multi-master arbitration across the repeater Possible application: Supporting PCI Mgmt. Bus on >8 PCI Slots Copyright © 2001 Intel Corporation. Page 52 * All other brands and names are the property of their respective owners I2C/SMBus Application Intel Multiplexing & Isolation Developer Forum Spring 2001 Philips Semiconductors PCA9516 “5 channel I2C Hub”* – Allows multiple additional 400 pF bus segments – Segments can be individually isolated – Supports level translation (5V tolerant pins) – Pins “Hi-Z” when device un-powered. – Supports multi-master arbitration across the repeater Possible applications: Supporting PCI Management Bus on >8 PCI Slots, isolating SMBus to ‘hot-plug PCI’ slots, driving I2C to multiple system boards Copyright © 2001 Intel Corporation. Page 53 * All other brands and names are the property of their respective owners Mixing SMBus & Intel I2C Developer Forum Spring 2001 SMBus 2.0 high-power I2C specifications are not directly compatible: 2 VIL MAX VIH MIN VOL, MAX THD; DAT RISE TIME FALL TIME* I2C (Vdd-based) SMBus 0.89V (=0.9 Vdd min) 2.54V (= 0.7 Vdd max) 0.4V at 3mA 0 ns 1000 ns from 0.89V to 2.54V output stage: 250 ns from 2.54V to 0.89V bus: 300 ns 0.80V 2. 1V 0.4V at 4mA 300 nS 1000 ns from 0.65V to 2.25V 300 ns from 2.25V to 0.65V * I2C specifies a faster fall on the output stage in order to allow for the possible inclusion of external series ESD protection resistors SMBus Copyright © 2001 Intel Corporation. Page 54 I2C Mixing SMBus & I2C - design for interoperability Controllers & Sensor Devices Intel Developer Forum Spring 2001 Design devices to sink 4mA, min. Design devices to output I2C ‘1’ and SMBus ‘0’ levels. Design devices to accept SMBus ‘1’ and I2C ‘0’ levels. Output data with SMBus hold time [THD;DAT = 300 ns] Accept data with I2C hold time [THD;DAT = 0 ns] Recommended that new fixed-address sensor devices be discoverable per the SMBus 2.0 specification Support ‘Dual Protocol’ in new Management Controllers and Sensor Devices Copyright © 2001 Intel Corporation. Page 55 Mixing SMBus & I2C - design for interoperability Intel Developer Busses Forum Spring 2001 Can often use ‘I2C’ devices on PCI Management bus … if loading and rise times are compatible with SMBus and I2C specs: – Bus loading designed to work with I2C 3 mA sink current [or all devices meet 4mA sink capability] – Bus pullups and capacitance designed to meet 1000 ns Rise Time from 0.65V to 2.54V I2C and SMBus devices can share same bus. But Master needs to be compatible with the target. Copyright © 2001 Intel Corporation. Page 56 SMBus & I2C Intel Design Recommendations Developer Forum Spring 2001 Avoid using slave devices that lack data integrity checks on the IPMB or PCI Management Bus – Many of today’s simple devices don’t have checksums or error check codes – Longer bus can have more noise – A 3rd party firmware error could cause interrupts during transfers – ‘Public’ Bus traffic is not deterministic. Poorly behaved masters could be ‘bus hogs’. New devices should include SMBus PEC (Packet Error Check CRC) or use checksums ala IPMI messaging Copyright © 2001 Intel Corporation. Page 57 SMBus & I2C Intel Design Recommendations Developer Forum Spring 2001 Put simple, polled slave devices on Private Management Busses behind ASIC or Management Controller – Private management busses have deterministic bandwidth available for polling and device access – Private management busses typically have well controlled noise and loading – Devices inherit Management Controller data integrity on IPMB – Management controllers provide checksummed interface to private management bus Copyright © 2001 Intel Corporation. Page 58 SMBus & I2C Design Recommendations Intel Developer Forum Spring 2001 Management Controller Support for ‘Stuck 0 clear’ – A simple slave that misses a clock on a read transaction can be left holding the data line low – Detection requires ability to monitor the bus for a stuck 0 data condition – Therefore, useful for firmware to be able to directly read state of bus pins – Can free bus by clocking it until transfer completes or data goes to ‘1’ – Requires ability for firmware to clock bus, outputting a ‘1’ until bus clears – I2C/SMBus controller state machine must be able to be ‘overridden’ so that it ignores 0 already on bus. – One approach: allow firmware to drive bus pins as GPIO See SMBus 2.0 spec for more info Copyright © 2001 Intel Corporation. Page 59 I2C/SMBus Testing Intel Developer Scopes Forum Spring 2001 ‘Deep trace’ logic analyzer or scope for capturing I2C real-time events. – Should be able capture at 1 microsecond or better for 100’s of milliseconds. – We’ve had good luck with the Hewlett-Packard HP54645D* mixed-signal oscilloscope – 2-channel digital scope plus 16 logic channels – 200 Msa/s on 16 channels with 2 MB of memory per logic channel – (Yields 2 seconds of capture at 1 Msa/s) Copyright © 2001 Intel Corporation. Page 60 * All other brands and names are the property of their respective owners I2C/SMBus Testing Intel Noise Tolerance Developer Forum Spring 2001 Check for ‘mid-byte’ START and STOP Conditions – Devices should accept START or STOP during any bit interval Check for tolerance to runt pulses – Most devices behave well under specified operating conditions – …but the IPMB may be subject to ‘noise’ or poorcitizen devices that could ‘glitch’ clock and data lines – Try placing a pulse generator on the bus and grounding the clock and data lines at various rates and pulse widths. Copyright © 2001 Intel Corporation. Page 61 I2C/SMBus Testing Intel Testers & Monitors Developer Forum Spring 2001 Microcomputer Control Corporation http://www.mcc-us.com/ – MIIC-101K – I2C/SMBus Standalone Monitor and I2C/SMBus Software Analyzer Package Kit. – MIIC-102/ISA I2C Bus Monitor Plus. – Instrument for I2C and SMBus monitoring. Supports Message Timing to 1uS, Low Voltage, 400KHz, and more. – MIIC-202 iPort/AI – RS-232 to I2C Host Adapter with ASCII Interface. I2C Bus Host Adapter for serial port. Works with Windows or non-Windows based Host Computers. Copyright © 2001 Intel Corporation. Page 62 I2C/SMBus Testing Intel Testers & Monitors Developer Calibre UK Ltd http://www.calibreuk.com/ – ICA90 and ICA93LV – ISA I2C-Bus adapters – PICA90 and PICA93LV – desk-top (parallel port) I2C-Bus adapters – Software – WINI2C ready-to-run I2C-Bus software – ICADLL and PICADLL developers I2C-Bus windows programming libraries Copyright © 2001 Intel Corporation. Page 63 Forum Spring 2001 I2C/SMBus Testing Intel IPMI Messaging Testing Developer IPMITOOL simple messaging utility available from IPMI Web Site IPMI Conformance Test available from IPMI Web Site Debug tools from component vendors IPMB message testing using software from I2C tester vendors – e.g. Microcomputer Control Corporation, Calibre Ltd - UK Copyright © 2001 Intel Corporation. Page 64 Forum Spring 2001 IPMI Conformance Test Intel Developer Forum Spring 2001 Available from IPMI Web Site Performs System interface accessible testing – KCS and SMIC interfaces, Watchdog Timer, BMC Sensors – System event log (SEL) and sensor data record (SDR) access IPMB and ICMB test support TCL/TK based – Script-based testing is user extensible – Examples provided Also usable as debug and development aid Copyright © 2001 Intel Corporation. Page 65 Intel Summary Developer Forum Spring 2001 New initiatives and specifications enable competitive server management features Management controllers available to fit your design and feature differentiation New sensor devices can reduce system cost and design effort Help available today... Copyright © 2001 Intel Corporation. Page 66 Resource Information Component & Tool Vendors* Intel Developer Forum Spring 2001 Agilent Technologies Analog Devices, Inc. Dallas Semiconductor Hitachi Semiconductor (America), Inc. Micro Computer Control Corporation National Semiconductor Corporation Philips Semiconductors Qlogic Corporation Texas Instruments contact.tm.agilent.com/tmo/datasheets/English/PRMC_ERMC.html, Niki Haines, niki_haines@agilent.com www.analog.com/pc & /temp-sensors, Paul Errico - paul.errico@analog.com www.dalsemi.com semiconductor.hitachi.com www.mcc-us.com, Ed Thompson, ed.thompson@mcc-us.com www.national.com/appinfo/tempsensors/ & /advancedio, Hezi Friedma, hezi.friedman@nsc.com www.philipslogic.com/products/i2c, Joe Kochanski, joseph.kochanski@phlips.com www.qlogic.com, Mark Byrne-Quinn, mark.byrne-quinn@qlogic.com www.ti.com Vitesse Semiconductor Corporation Winbond Electronics Corporation www.vitesse.com, Tom Brokaw,brokaw@vitesse.com www.winbond.com.tw, Chad M.C. Wu, mcwu0@winbond.com.tw Copyright © 2001 Intel Corporation. Page 67 * All other brands and names are the property of their respective owners Resource Information Intel Organizations / Specifications Developer Forum Spring 2001 IPMI (Intelligent Platform Management Interface) Specifications – http://developer.intel.com/design/servers/ipmi SMBus Specifications – System Management Bus (SMBus) Specification, Version 2.0, August 3, 2000 http://www.smbus.org I 2C Specifications – The I2C-BUS Specification, Version 2.1, January 2000 http://semiconductors.philips.com/ DMTF Pre-OS Working Group / ASF Specifications* – http://www.dmtf.org Copyright © 2001 Intel Corporation. Page 68 * All other brands and names are the property of their respective owners Call to Action Intel Developer Forum Spring 2001 Get the specs, contact the vendors, and take advantage of these technologies and components in your designs. Copyright © 2001 Intel Corporation. Page 69 Server Management Controllers, Sensors, and Tools Tom Slaight Intel Corporation Questions? Please remember to turn in your session survey form. Copyright © 2001 Intel Corporation. Page 70 Intel Developer Forum Spring 2001