Cisco SFS 7008 Instrukcja Użytkownika

Part Number: OL-7725-01Cisco SFS 7008 InfiniBand Server Switch Hardware Guide (Topspin 270 Hardware Guide)Release 2.2.0 Update 1Product ID: 140265

x

100To view FRU errors on your Topspin 270, enter the show diagnostic fru-error command.ExampleError TypesThe following types of hardware errors are lo

1012 Power Supply Fan Fail Error3 Power Supply I2C Communication ErrorTable 6-2: Topspin 270 Power Supply Errors Error Number Description

102

1037Specifications and Compliance CertificationsThis chapter details the Topspin 270 specifications and compliance certifications. Chassis and Managem

104Electrical SpecificationsEMC/ImmunitySafetyAcousticsNon-Operating Vibration, random 2.09Grms, 3-axis, bottom/top, left/right, front/backMax. Operat

105Product Markings• UL, FCC Statement, VCCI, CE, ICES

106

IndexAactive controller card 11admin status 81Ccardoperational state 79reset 80card reset 80chassis IDabout 19LEDs 74chassis managerlaunching 32LEDs 7

Rrack-locator 89reload 92reset card 80reset controller card 59Ssafety information viisetup 32show card 11show diag chassis 93show diag fru-error 96, 9

111Features OverviewThe Topspin 270 Switched Computing System provides data center managers with a high-performance, low-latency interconnect. • “Syst

12ExampleThe oper code field of the command output identifies the controller card as the active card (normal) or the hot standby card (standby). By de

13FabricFor redundancy, InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redundant pair of Topspin 270s. In an InfiniBand fabric tha

14Figure 1-2: Back Chassis View

15Chassis Slot NumberingSlot numbers are printed on the chassis for easy identification. Figure 1-3: Chassis Slot Numbering in Front (Non-port Side)Po

16Figure 1-4: Chassis Slot Numbering in Back (Service Side)Dimensions• Height: 6U unit• Width: 17.04”• Depth: 8” - 23.7”• Weight: maximum 106 pounds (

17• The power supplies are 1U, 48V, 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self co

18Understanding the Core Slot to Mgmt Interface Module ConnectionEach Core slot in the chassis (refer to “The Core Slot” on page 18) is connected to 1

19• At least one Fabric Controller module must be installed in the Core slot for the chassis to boot. • When a module is installed in a Core slot, it

Copyright © 2004 - 2005 Topspin Communications, Inc. All rights reserved.The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin

20Administrative FeaturesReal-Time ClockThe Topspin 270 maintains correct time regardless of power conditions or connectivity.LatencyThe Topspin 270 h

212Installing the Topspin 270 SystemThis chapter describes how to install and manage the Topspin 270 system hardware.• “Prepare the Site” on page 21•

22Mount the Topspin 270 Chassis in a RackThis section describes how to install the Topspin 270 chassis in an equipment rack. The following procedure i

234. Determine the direction that the switch will be installed and justified in the rack. The direction that the switch will be justified will determi

247. Use 2 - 3 people to lift the switch into the rack.Figure 2-3: Chassis Set onto Shelf8. Push the chassis into the rack until the rack ears are flu

259. Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to RailsInstall

26Connect Management DevicesTo connect the management ports, use either a serial cable and/or an Ethernet cable. Figure 2-6: Serial and Ethernet Manag

27Connect an Ethernet Cable to the Ethernet Management Port3. Connect an Ethernet cable to the Ethernet port of the left Management Interface module (

285. Inspect the power cord and determine if it provides the proper plug and is appropriately certified for use with your electrical system. Discard t

29Assigning an Address StaticallyRefer to the static example below:a. When the system has completed booting, press <Enter> several times to disp

iiiRegulatory Notices... viiFCC Statement...

30b. Enter the user name and password. The default user name is super, and the default password is super.c. Enter the enable command.d. Enter the conf

31Connecting InfiniBand DevicesAttaching the IB Cable to the IB PortTo connect using InfiniBand to other workstations or switches, standard 4X InfiniB

32• Chassis Manager (GUI) - A web-based graphic user interface. • Element Manager (GUI) - An optionally available graphic interface installed on a wor

332. Type the Management IP address of your Server Switch in the address field of your browser and press Enter. (You configured the IP address in Step

34(Optional) Install the Element Manager GUIFor more information regarding the Element Manager tasks, refer to the InfiniBand User Guide.1. Check that

353Managing Individual ComponentsThis chapter describes how to install the Field Replaceable Units (FRUs) in the Topspin 270 system.About the Field Re

36In most cases, vital information can be recovered from the failed module. If you have the appropriate support agreement, you may want to return the

377. Pull the power cord from the chassis. Figure 3-1: Diagram of Power Supply to the Associated Power Cord 8. Use a #1 phillips screwdriver to unscre

389. Use the handle to pull the power supply module from the bay. Figure 3-3: Pulling the Power Supply Module from the Bay10. Install the blanking pan

397. Insert the new power supply unit into the open slot until it is fully seated. You may need to push the unit with your thumbs to get it completely

ivConnect Management Devices ...26Attac

404. Use a #1 phillips screw driver to unscrew the captive screws.Figure 3-5: Loosening Captive Screws 5. Carefully begin to pull the fan tray 1” out

41or Install a new fan module. Refer to “Installing a Fan Module” on page 41 if you are installing a new fan module. Installing a Fan Module1. Remove

429. Check the LEDs on the fan module to verify the status. Refer to “Fan LEDs” on page 69.Fabric ControllersAbout the Fabric ControllersRefer to “Fab

435. Use a #1 phillips screwdriver to unscrew the captive screws from both ends of the Fabric Controller card. Figure 3-9: Loosen Captive Screws Befor

44Installing a Fabric Controller1. Remove the new Fabric Controller module from the packaging. 2. Ground yourself appropriately. 3. Remove the bezel c

45Upgrade the Image with the CLITo upgrade the image of the Controller card with the Command Line Interface, refer to “Upgrading a Controller Card wit

463. Remove the InfiniBand cables from the ports. a. To remove a cable with a pinch connector, pinch both sides of the back of the connector and pull

474. Use a #1 phillips screwdriver to unscrew the captive screws on both sides of the LIM card. Figure 3-14: Loosen the Captive Screws5. Release the L

487. Install a blanking panel in place of the LIM module, or refer to “Installing a LIM Module” on page 48 for instructions on replacing the LIM modul

499. Connect the InfiniBand cables to the ports. a. To plug in an InfiniBand cable, push the connector into the interface until you hear/feel a click.

vUpgrading a Topspin 270 with Element Manager... 54Upgrading an Individual Contro

507. If the Master Management Interface module was removed, the standby module becomes active. The “Master” led becomes green. 8. Install a blanking p

513. Use a #1 phillips screwdriver to loosen and remove the screws from the left and right side of the Chassis ID module. Figure 3-20: Loosen the Capt

52Installing a Replacement Chassis ID Module1. Remove the new Chassis ID module from the package. 2. Ground yourself appropriately. 3. Remove the old

534Administrative TasksThis chapter describes administrative tasks that may be performed on the Topspin 270 system.• “Upgrade all Cards in a Chassis”

54Upgrading a Topspin 270 with Element ManagerThe following procedure describes the upgrade procedure using the Element Manager GUI. This procedure al

55Note: all cards in the chassis must have an oper-status of “up” for the upgrade to be effective on all components. a. Select Maintenance > File M

566. Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Yes at the prompt. 7. View the new image on the cards

57Upgrading a Controller Card with the CLIFor the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Reference Guide.

582. Show the standby Controller card. Example3. Check to see if you already have a .img file that can be installed. (Delete the .img file, if it not

595. Activate the image. After downloading the image file to the chassis controller, it must be installed to become active. The install command instal

vi7: Specifications and Compliance Certifications 103Chassis and Management Interface ...

60Upgrading a Node Card with Element ManagerThe following procedure describes the upgrade procedure for individual node cards using the Element Manage

61Note: all node cards in the must have an oper-status of “up” for the upgrade to be effective. a. Select Maintenance > File Management b. Click th

626. Activate the image on the node card(s) by enabling and disabling each node card. Do not reboot the chassis as this will not result in the image b

63Upgrading Node Card(s) with the Chassis ManagerFor the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Ma

64

655Monitoring the Topspin 270 SystemThis chapter describes how to install and manage the Topspin 270 system hardware.• “Interpreting the Front Panel L

66Figure 5-1: Front Panel LEDsSystem-Wide Status LEDLocating the System-Wide Status LEDThe system-wide status LED is located on the front of the chass

67Power Supply LEDsLocating the Power Supply LEDsThe Power Supply LEDs are located in the outside of each Power Supply module, if you are facing the f

68In addition, a Power Supply Identify LED is located on the outside of the chassis, next to the corresponding power supply. This LED allows the user

69Fan LEDsLocationThe Fan LEDs are located at the top of each Fan tray module. Refer to “Front Panel LEDs” on page 66.In addition, replicas of the Fan

viiRegulatory NoticesFCC StatementThis equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15

70Fabric Controller LEDsEach Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators (Table 5

71Interpreting the Back Panel LEDsThe back of the Topspin 270 chassis has the following types of LED indicators:• “Management Interface Module LEDs” o

72LocationThe Management Interface modules are located at the top of back the chassis. Refer to Figure 5-5 to view the chassis diagram. Figure 5-6: Ma

73Fan Tray Module Status LEDs Power Supply Module Status LEDs Green off No power to the Management Interface module, LED failure, or yellow LED is ON.

74Master Management Connection Status LED The Master Management Connection Status LED is a single LED that indicates whether that particular Managemen

75LIM Status LEDsLocationThe LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis). Refer to Figure 5

76LocationThe InfiniBand port LEDs are located to the right of each InfiniBand port (if you are facing the LIM card) in the back of the chassis. Figur

773. The Device Rear View and the Device Front View appear. Figure 5-10: Chassis Manager 270 Device Rear View

78Figure 5-11: Chassis Manager 270 Device Front View 4. View the information at the top of the window to quickly check the status color and the number

79• In the case of the fabric controller cards, the card that is currently on standby (not the master) will be grey. The master fabric controller will

viiiCAUTION: Grounding is supplied by the ground-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do

80normalbootFailedtooHotbootingcheckingBootImagewrongBootImagerebootingstandbyrecoveryImage9. Click the radio button next to the card that you want to

817. View the Admin Status and the Oper Status of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper S

82The Power Supplies view appears. Figure 5-15: Chassis Manager Power Supplies WindowMonitor the Fans1. Launch the Chassis Manager by entering the IP

83Monitor the Temperature1. Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser. 2. Press the Enter k

84Monitoring the System with Element ManagerFor information regarding installing the optionally licensed Element Manager GUI, refer to the InfiniBand

85Interpreting the Power Supplies TabUse the Health > Status > Power Supplies tab to view the operating status of the power supplies. Figure 5-1

86Figure 5-21: Element Manager Sensors Tab6. Note the OperStatus field. A status of “up” indicates that the sensor is functioning properly.7. Note the

87Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and wi

88

896Hardware Diagnostic TestsThis chapter describes how to run diagnostic tests on the Topspin 270 system hardware.• “About Diagnostic Tests” on page 8

ixCAUTION: Never place your hand inside an empty card or module bay. You should never have cause to place a hand anywhere inside the Topspin chassis.

90Run Card TestsReferences to “Cards” refers to fabric controllers, management I/O modules, node cards and the chassis ID module. Fans and power suppl

91Example of completed test Topspin-270(config-diag-card-11)# exitTopspin-270(config)# exitTopspin-270# show diagnostic card 11=======================

923. Use the more file-system:file-name command to display the log file and view the detailed results of the diag test. Example of log results4. Enter

93• Standard page 93• Extended• Extended MemoryRun a Chassis Standard TestThe chassis standard diag test runs a diagnostic test on all cards in the ch

943. Enter the show diag post command to show any errors on individual components. ExampleRun Fan TestsThe following tests are available to locate and

952. Enter the diag fan <id> command. Example3. Use the show diag fan command to show the progress of the test. ExampleTopspin-270# configTopspi

964. Use the show diag fru-error command to display any errors that appear in the result-string. Example5. Reboot the chassis when the self-test is co

97Run a Self-Test on a Power Supply1. Show the ID of the power supply that you want to diagnose, if you do not already know the number. a. Enter the s

985. Use the show diag fru-error command to display any errors that appear in the result-string. Example6. Reboot the chassis when the self-test is co

99Displaying Hardware ErrorsTo display POST results, non-fatal errors that can are recovered, informational logging (such as firmware updates), and ha