ITCAM Implementation Case Study at Depository Trust and Clearing Corp'

1
ITCAM Implementation Case Study atDepository
Trust and Clearing Corp.

• by Jason Meiers, Sr. IT Architect of CAM Solutions

2
ITCAM at DTCC
Depository Trust and Clearing Corporation
3
ITCAM at DTCC
4
Agenda / Table of contents
IBM Tivoli Composite Application Manager for J2EE
_at_ DTCC
Welcome and scope of implementation
1
Depository Trust and Clearing Corporation CAM
2
Deployment, Configuration, Challenges Solutions
3
ITCAM application management tools and benefits
4
Monitoring-as-a-Service(TM)
5
5
Why Application Management?
6
Welcome
Scope of implementation

• Hundreds of application servers in development,
  staging and production environment
• 300 developers writing code, deploying
  applications, restarting application servers
• Transactions volumes over 1 trillion
• High value and high volume transactions for risk,
  fixed income, stocks and bonds clearing
• Distributed systems and management
• Highly secure access to building as well as
  development, staging and production systems

7
IBM Tivoli Composite Application Management at
DTCC
Challenges and solutions for DTCC Application
Management
Challenges
Solutions

• Heap dump and Thread analysis for composite
  applications
• Application Management down to the method level
  within the code of the application, correlation
  across multiple servers and applications
• Provide problem determination enterprise wide
  from one console
• Trend analysis for pre-emptive monitoring of JVM
  memory, CPU threads
• Provisioning and automation of data collector
  deployment

• Flying Blind the application is having problems
  in production
• Application specific problem determination and
  isolation of production incidents to the root
  cause
• Enterprise wide application management using SSH
• Reactive Fire-fighting production support
• Massive deployment across hundreds of application
  servers

8
Implementation Support
Application Management support goes beyond
install and configuration
Recommendation
Application monitoring as a service for our
enterprise applications is essential, especially
when working in a highly secure environment for
financial transactions. It is good to have
someone on your side who knows from experience
how to make IT Service Management/ITIL work. CAM
Solutions is a valuable asset to anyplace they
provide consulting services Depository Trust
and Clearing Corporation August
13, 2008
Support
9
Planning and Architecture
Ports, Servers, Applications, Scheduling and
Security
Architecture
Planing
Deployment

• Integration points with other groups and
  monitoring tools i.e. SNMP or TEC events
• Alerts and thresholds required by the operators,
  business and service levels
• Sizing of the ITCAM infrastructure and trend
  database

• Discovery of existing application servers and IT
  Operation environment
• Understand application specific architecture i.e.
  EJB, Web Services, SAP, Mainframe
• Communication protocols and connection points
• Server IP addresses and subnets
• Visual implementation of ITCAM

• Scheduling deployment times with operation team
• Development of automation processes and
  documentation
• Successful verification of deployment in
  production
• Hand-off and training

10
Architecture
Application infrastructure for financial
composite applications

• Discover existing applications
• Identify firewalls and gateways for change
  control process
• Build architecture diagram for logical ITCAM
  implementation

11
Planing
Scheduling, Sizing, Alerts and Thresholds

• What is the best time to deploy, restart and test
  application servers in development, staging and
  production?
• Who is going to be affected by this change and
  who is to notified?

• How many application servers are in our
  environment?
• What type of monitoring data would you like to
  collect?
• Number of end users of the application management
  console
• Integration into other monitoring systems?

• What type of metrics are to be monitored? i.e
  AppServer up/down, jvm heap sizes, response times
  for transactions
• Who is alerted for a specific threshold
  violation?
• What is the operator response for this event?

12
Deployment
Documentation and Roll-out

• The documentation of the deployment and roll-out
  process specifically for the Depository Trust and
  Clearing Corporation
• Each systems management deployment step was
  documented for reproduction purpose
• Known issues were documented with solutions in
  the case of reoccurrence

• The roll-out into production was testing in all
  critical stages including development and staging
• Challenges were to schedule accordingly even in
  development due to the high number of developers
  accessing the systems
• Zero down time was expected, failover of the
  application servers needed to be included into
  the process

13
ITCAM Best Practices
Application Management Tools
ITCAM
14
Application Management Example
Developer creates method for risk calculation
15
Application Management Example
Customer service has received an alert that risk
customer has an issue
16
Application Management Example
Application analyst sees there is a hanging risk
transaction from the customer
17
Application Management Example
Application analyst selects customer request for
more details
18
ITCAM In-flight Analysis
Tools for problem determination at the method
level, real-time
19
IT Operations Events Applications
Problems, Known Issues and Solutions
Application Events

• Depending on your infrastructure and enterprise
  applications the majority of alerts are from the
  application
• Without application management production
  incidents are not included in development to be
  fixed
• ITIL service support standard is to identify
  known issues and add incident fixes to change
  management and release

20
Application Management Events
From unqualified alerts to qualified events
Unqualified Alerts

• Single point where events are received
• All events are accepted at the top of the funnel

Filter

• Development of known issues and improved problem
  determination
• Correlation of incidents and events

Qualified Alerts

• Quality events with real IT Management value
• More sleep and less pager calls

21
CAM Solutions Strategy Value Add
From managing systems to managing services
Service Value

• Linking of IT to business metrics
• Service Level Management Service Management
• Capacity Management

Proactive

• Availability Management
• Problem Management Service Management
• Change Management
• Configuration Management

Reactive

• Tactical fire-fighting
• up/down Systems Management
• Service Desk
• Release Management

Chaotic

• Multiple Help Desks
• minimal standards Systems Management
• user call-driver
• Incident Management

22
J2EE WebSphere Best Practices
Application management usage guide for composite
applications

• Installation, Configuration, and Best Practices
• Distributed and Mainframe examples
• Tools ITCAM provides for application management

23
Old School vs. Application Mgmt Today
Beyond log file analysis
24
Monitoring-as-a-Serivce (TM)
Gartner Says 25 Percent of New Business Software
is SaaS
25 Enterprise Software to be SaaS
ITCAM as a Service

• CAM Solutions provides ITCAM as a Service
• Data Center SAS 70 certified
• Save implementation cost and management

25
Log file to application management
Workflow process to get to enterprise application
management
Logfile scraping
Contact IBM Tivoli
Live the dream
Participate in TUG
SME Deployment
26
The Composite Application Management Solution
Where rubber meets the road
IBM System x IBM System p IBM System z Blade
Center
ITCAM for WebSphere ITCAM for RTT ITM for
Applications
Software
Hardware
Services
Process
ITIL ITSM
CAM Solutions IBM
27
?
Do You Have Any Questions?
?
?
We would be happy to help.