STOR03 How to integrate TSM 6.x Monitoring & Reporting into the... Christian Michaelski

STOR03 How to integrate TSM 6.x Monitoring & Reporting into the... Christian Michaelski

STOR03
How to integrate TSM 6.x Monitoring & Reporting into the real ITM world
Christian Michaelski
ACT IT-Consulting & Services AG
Agenda
 Overview TSM 6.x Monitoring & Reporting
 Deep Dive
 Integration of TSM 6.x Agent into IBM Tivoli Monitoring
COPYRIGHT ACT © 2010
OVERVIEW TSM 6.X
MONITORING & REPORTING
COPYRIGHT ACT © 2010
Enterprise Monitoring
 Enterprise monitoring is all about observing resources
that are crucial for your daily business operations.
 Use IBM Tivoli Monitoring to:
 View availability and performance data that provides
insight into the components, applications, and services in
your enterprise
 Be notified of incidents that require attention
 Diagnose problems
 Enterprise monitoring data can be available as:
 Incidents, displayed as situation events, which indicate
potential problems that require attention
 Real-time statistics about a particular resource or
application
 Historical statistics to provide insight into the long-term
behavior of components
COPYRIGHT ACT © 2010
ITM Positioning
 TSM 6.1 Monitoring & Reporting is a monitoring solution
based on IBM Tivoli Monitoring 6.2 FixPack 1.
 TSM 6.2 Monitoring & Reporting is a monitoring solution
based on IBM Tivoli Monitoring 6.2.1.
 IBM Tivoli Monitoring 6.2x is a systems monitoring solution.
 It allows you to monitor a variety of resources, including
distributed systems, mainframe systems, databases, and
applications.
 Many other IBM offerings have an option to interact
with IBM Tivoli Monitoring like Tivoli Storage Manager.
COPYRIGHT ACT © 2010
Architecture and Components
 ITM follows a client-server architecture.
 The Tivoli Monitoring infrastructure includes all
components needed in an enterprise monitoring
solution.
 Those components are called Tivoli Monitoring Services
(TMS). They include:




TEP (Tivoli Enterprise Portal)
TEPS (Tivoli Enterprise Portal Server)
TEMS (Tivoli Enterprise Monitoring Server)
TEMA (Tivoli Enterprise Monitoring Agent)
TEP
COPYRIGHT ACT © 2010
TEPS
Hub TEMS Remote TEMS
TEMA
Tivoli Enterprise Monitoring Agents
TEMA
 The data collectors, which gather data from one or
more systems that are critical for your business.
 Each collected parameter is called an attribute. These
are grouped in attribute groups to simplify managing
the large amount of data collected by some agents.
COPYRIGHT ACT © 2010
Tivoli Enterprise Monitoring Server
Hub TEMS Remote TEMS
 Each enterprise monitoring solution must contain one
Hub TEMS. It can include multiple remote Tivoli Enterprise
Monitoring Servers, which are used to scale large
installations.
 Stores the definitions for conditions, called situations,
that indicate a problem with a particular resource.
 Controls the security (user authentication) for your
monitoring solution.
 Can store historical data temporarily.
COPYRIGHT ACT © 2010
Tivoli Enterprise Portal Server
TEPS
 Functions as a repository for all user data, defining what
a user can access and how the data is displayed
 Connects to a hub TEMS and can be accessed by the
TEP clients
 Controls access to data and TEP functions by user ID
 Stores data in a Microsoft SQL Server or IBM DB2 UDB
COPYRIGHT ACT © 2010
TEP Client
TEP




Three TEP Client types:
TEP Desktop Client
TEP Browser Client
TEP WebStart Client
COPYRIGHT ACT © 2010
Tivoli Data Warehouse
TEP
TEPS
Hub TEMS Remote TEMS
Summarization &
Pruning Agent
Warehouse Proxy
Agent
Warehouse Database
Server
COPYRIGHT ACT © 2010
TEMA
Tivoli Data Warehouse Solution
 Tivoli Data Warehouse database
 Warehouse Proxy agent
 Summarization and Pruning agent
Source
Agent or
TEMS
Short-term
data
12
COPYRIGHT ACT © 2010
Warehouse
Proxy agent
Tivoli
Data
Warehouse
Summarization and
Pruning agent
Tivoli Data Warehouse Database
 Row-based relational database
 DB2 UDB
 Oracle
 Microsoft SQL Server
Tivoli
Data
Warehouse
 Detailed and summarized data within the same schema
 One warehouse database for multiple monitoring
environments
 Data served to the Tivoli Enterprise Portal (TEP) on
request
 Short-term and long-term data combined in single request
- Less than 24-hour-old data from TEMA or TEMS
- Greater than 24-hour-old data from Data Warehouse
13
COPYRIGHT ACT © 2010
Warehouse Proxy Agent
 Handles warehouse requests from all managed systems
in the monitoring environment
 Creates detailed data tables and indexes as required
 Multiple Warehouse Proxy agents supported
 Must be connected to the hub TEMS
 Product code: hd
 Various operating systems supported
 Windows and several UNIX and Linux options;
consult installation guide for details
Warehouse
Proxy
Warehouse
Proxy
14
COPYRIGHT ACT © 2010
Tivoli
Data
Warehouse
Summarization and Pruning Agent
 Manages the data in the Tivoli Data Warehouse
 Summarizes according to the configuration for an
attribute group
 Creates tables and indexes as required
Prunes old data by configuration
Must be connected to the hub TEMS and the TEPS
One agent for one warehouse
JDBC connection to warehouse database (regardless
of operating system)
 Various operating systems supported




 Windows and several UNIX and Linux options;
consult installation guide for details
Summarization and
Pruning Agent
15
COPYRIGHT ACT © 2010
Tivoli
Data
Warehouse
Tivoli Data Warehouse Database
Issues
 Dynamic table creation
 Tables, indexes, views
 Based on attribute groups and summarization levels
selected
 No user control
 No schema provided
 Database growth
 Can exceed database or disk capacity
 Planning spreadsheet
 Backup and recovery
 Normal database administrator procedures
 Logs required for recovery
16
COPYRIGHT ACT © 2010
Historical Data Collection Process





17
Short-term data collection and storage
Mapping attribute groups to table names
Warehousing
Summarization
Pruning
COPYRIGHT ACT © 2010
Tivoli Common Reporting
TEP
TEPS
Hub TEMS Remote TEMS
TEMA
Tivoli Common Reporting
Warehouse Database
Server
COPYRIGHT ACT © 2010
Report
Library
HTML
Reports
PDF
Reports
DEEP DIVE
COPYRIGHT ACT © 2010
Product Architecture
 Reporting consists of the following components
 ITM (IBM Tivoli monitoring)
- TEP (Tivoli Enterprise Portal)
- TDW (Tivoli Data Warehouse)
- TSM Reporting Agent
 TCR (Tivoli Common Reporting)
 ITM, along with the TSM reporting agent does the work
of collecting data from TSM server(s) and sending that
data to TDW for historical storage
 TEP is used to view near-live data from TSM
 TEP is used to configure historical data collection from
TSM
 TCR accesses the TDW historical data and reports it in
the TCR UI
COPYRIGHT ACT © 2010
Product Technonogy
 IBM Tivoli Monitoring is both native and Java based
technologies
 Tivoli Storage Manager Reporting Agent is JAVA based
 Tivoli Common Reporter is Web/ISC based
COPYRIGHT ACT © 2010
Agent on TSM Server
TSM
TSM Server
TSM Server
TSM
Activity Log
ITM Agent
Admin
API
TSM
Historical
Extraction
Derby
TSM/ITM
Agent
TSM
Operational
Database
ITM
ISC
Reports
COPYRIGHT ACT © 2010
TEP
Client /
Browser
TCR
Reporting
engine
ITM Server
TEPS / TEMS
WPA / S&P
Warehouse
DB/2
Agent on TSM Server
 TSM Monitoring and Reporting Agent installed on the
TSM server
 Sends the queried data from the TSM server to the ITM
server
 Install/Configurations steps
 Install TSM Monitoring and Reporting Agent on the TSM
server
 Install IBM Tivoli Monitoring (ITM) on a different system
 Create (instance) and configure the instance to query
data from the TSM server and send the data to the ITM
server
 TEP, TEMS, TDW and DB2 will be run/manage from the ITM
server
COPYRIGHT ACT © 2010
Agent on ITM Server
TSM Server
ITM Server
TSM Server
TSM Server
TSM
Activity Log
ISC
Reports
COPYRIGHT ACT © 2010
ITM Agent
Admin
API
TSM
Historical
Extraction
Derby
TSM/ITM
Agent
TSM
Operational
Database
TEP
Client /
Browser
TCR
Reporting
engine
ITM Server
TEPS / TEMS
WPA / S&P
Warehouse
DB/2
Agent on ITM Server
 TSM Monitoring and Reporting Agent installed on the
ITM server
 Pulls the queried data from the TSM server
 Install/Configurations steps
 Install ITM
- This will automatically install DB2, ITM and TSM Agent
 Create (instance) and configure the instance to query
data from the selected TSM server
COPYRIGHT ACT © 2010
Admin / Operator Console
 Admin Center (TCR Historical Reports)
 Can be installed on any system with network access and
a web browser
 User can changes the data source to point to the system
(ITM server) where the TDW (DB2) is installed
 Tivoli Enterprise Portal
 Client can be installed on every workstation
 To access ITM:
- TEP Client
- TEP Client Browser Mode
- TEP Client Java WebStart
COPYRIGHT ACT © 2010
Hints and tips
 Capacity issues:
 Large capacity TSM servers may encounter time-outs
during certain queries.
 ClientMissedFiles = contains the most possible data
 NodeActivity = depending on the number of nodes and
the number of operations done each day
 Equipment issues:
 The longer that historical data is collected, the more
storage space will be needed on the reporting server
 As with most products, the more memory and disk
capacity available, the better the reporting server will
work
COPYRIGHT ACT © 2010
Hints and tips
 Best Practices
 Install reporting on an independent server
 Install ONLY the TSM agent on a TSM server. Do not install
any other reporting components on an existing or new
TSM server installation.
 More than 10 TSM servers being monitored on a single ITM
server may cause performance and storage space issues
 Sizing, Scalability and performance tuning
 Performance and memory-out issues may occur on large
TSM servers monitored
COPYRIGHT ACT © 2010
ITM Connectivity implemented for TSM
Reporting
TEP Browser
Java WebStart
TEP Client
1920/tcp
15001/tcp
DB2 or MS SQL TEPS
Database
ODBC or native
connected
TEPS
S&P
1918/tcp
Internal TEMS
Database
Hub TEMS
WPA
1918/tcp
6014/tcp
DB2, MS SQL or
Oracle Warhouse
Database
ODBC or JDBC
connected
Reporting Server
Windows, Linux or AIX
(all on one)
Legend:
OS Agent
TSM Agent
TSM Server
29
COPYRIGHT ACT © 2010
IP.PIPE
WPA
TSM Java API
Other TCP
INTEGRATION OF TSM 6.X
AGENT INTO IBM TIVOLI
MONITORING
COPYRIGHT ACT © 2010
Versions
 The TSM Monitoring Agent 6.x can be integrated into an
IBM Monitoring 6.2 and above environment
 Integration in:
 IBM Tivoli Monitoring 6.2 FixPack 1 and above.
 IBM Tivoli Monitoring 6.21 and above.
 IBM Tivoli Monitoring 6.22 and above
 You need the Application Support Files for TSM 6.x
Monitoring Agent and the Agent Code.
COPYRIGHT ACT © 2010
TSM Reporting Install Images
 The TSM Monitoring agent is included in the download
package from Passport Advantage.
Description
Windows Installation Image for TSM Monitoring & Reporting
Linux 32 Bit Installation Image for TSM Monitoring & Reporting
Linux 64 Bit Installation Image for TSM Monitoring & Reporting
AIX 32/64 Bit Installation Image for TSM Monitoring & Reporting
(Monitoring Server)
AIX 32/64 Bit Installation Image for TSM Monitoring & Reporting
(Agent)
 These images contain the Monitoring, Reporting and
Console components for the monitoring solution.
 You have to extract the Agent from the given file sets if
you wish to use the Agent only in a given ITM
environment.
COPYRIGHT ACT © 2010
Extracting the TSM 6.1 Agent
 The following tree shows the main components from this
image:
+---COI
\ +---DeploymentSteps
|
+---DB2_9.1
|
+---eWAS
|
+---ISC
|
+---ITM_6.2
|
+---TSM_AdminCenter
\
+---TSM_Agent
 To use the TSM Agent for the ITM environment you have
to copy the code into a temporary directory:
 Change directory to
- .\COI\DeploymentSteps\TSM_Agent\FILES (Windows)
- ./COI/DeploymentSteps/TSM_Agent/FILES (AIX/Linux)
 Copy all files and directories from this path into a
temporary directory.
COPYRIGHT ACT © 2010
Adding Application Support
TEP
KSK
TEPS
KSK
Hub TEMS Remote TEMS
KSK
KSK
 Application Support must applied to:




Hub TEMS
Remote TEMS
TEPS
TEP Client
COPYRIGHT ACT © 2010
TEMA
Adding Application Support –
Unix/Linux
 Run install.sh on Unix/Linux Systems where TEMS or TEPS is
installed.
Product packages are available for this operating system and component support categories:
1)
2)
3)
4)
5)
6)
IBM Tivoli Monitoring components for this operating system
Tivoli Enterprise Portal Browser Client support
Tivoli Enterprise Portal Desktop Client support
Tivoli Enterprise Portal Server support
Tivoli Enterprise Monitoring Server support
Other operating systems
Type the number or type "q" to quit selection
[ number "1" or "IBM Tivoli Monitoring components for this operating system" is default ]:
 You must choose 5 on TEMS or 2,3,4 on TEPS. If you have
an all-in-one system you should choose 2,3,4,5.
 To seed the Application Support on TEMS run:
 Itmcmd support –t <TEMS> sk
 Itmcmd manage
COPYRIGHT ACT © 2010
Adding Application Support –
Windows
 Run setup.exe
COPYRIGHT ACT © 2010
Local Agent Installation
 Windows Installation
 Walk to the directory where the TSM Agent Code is stored.
 Change into the WINDOWS directory and run the
“setup.exe” command.
 During the installation you must choose the Agent and the
connection configuration to the ITM infrastructure Server
(TEMS).
 Configure the connections to the TSM Server you must
open the “Manage Tivoli Enterprise Monitoring Services”
console.
COPYRIGHT ACT © 2010
Local Agent Installation
COPYRIGHT ACT © 2010
Local Agent Installation
 Unix/Linux Installation
 Walk to the directory where the TSM Agent Code is stored.
 Run the “install.sh” script.
 Configure Agent with “Manage Tivoli Enterprise Monitoring
Services” or “/opt/IBM/ITM/bin/itmcmd config –A sk”.
./itmcmd config -A -o testtsm sk
Agent configuration started...
Enter instance name (default is: ): testtsm
Edit "Monitoring Agent for Tivoli Storage Manager" settings? [ 1=Yes, 2=No ]
(default is: 1):
Edit 'TSM Server Connection Information' settings? [ 1=Yes, 2=No ] (default is: 1):
Server Address (default is: ): testtsm
Port Number (default is: 1500):
TSM Administrator (default is: ): Admin
TSM Administrator Password (default is: ):
Type password:
Will this agent connect to a TEMS? [1=YES, 2=NO] (Default is: 1):
TEMS Host Name (Default is: tsmreport):
COPYRIGHT ACT © 2010
Prepare Remote Deployment
 To prepare your environment for a remote deployment
of the TSM Monitoring agent you must add the agent
bundle to your agent depot.
 At first you have to login to the HUB TEMS with the
command line interface using:
- /opt/IBM/ITM/bin/tacmd login -s <HUB hostname> -u
<username> -p <password> -t 1440
 To add the bundle run the following command:
- /opt/IBM/ITM/bin/tacmd addbundles -i
/mnt/TSM_Agent/FILES/unix/ -t sk
 Hint: You should add the bundle to all TEMS depots in
your environment.
 Now you will be able to deploy your agent remotely
over TEPS or CLI.
COPYRIGHT ACT © 2010
?
Kontakt:
Christian Michaelski
michaelski@act-online.de
41
COPYRIGHT ACT © 2010