NIIMS - Software AG

Bureau of Indian Affairs
National Irrigation Information Management System (NIIMS)
NIIMS V1.5 Accomplishments, Lessons Learned, NIIMS V1.6 and Future Phases
NIIMS MIGRATION CASE STUDY
Sensitive but Unclassified
4/17/2013
1
AGENDA
1.
Who
2.
What
3.
Why
4.
How
5.
Technical Details
6.
Questions?
Sensitive but Unclassified
4/17/2013
2
WHAT IS NIIMS?
Billing and Collection System for Tribal
Irrigation Projects
1.
16 Irrigation Projects in Central and Western U.S.
Ownership & Maintenance Costs by Owned/Leased Acres
$29MM Annually – Federal Debt
o
o
o
2.
Sensitive, Personally Identifiable Information
o
3.
Moderate Risk Categorization
U.S. Department of Interior Capital Investment
Sensitive but Unclassified
4/17/2013
3
NIIMS V1.5 HYBRID APPROACH
o
Waterfall Methodology
o
o
o
o
Incremental ReDevelopment
o
o
o
o
o
o
Software Engineering Foundation
Deliberate, Predictable, ↑ Confidence
Proof-of-Concept for Essential Functions
Reduce Risk to Field Business Operations
Perform Significant Enhancements ASAP
User Interface and Logic Layers Remain
Consistent – Underlying Layers Change
Eliminate/Avoid Schedule Risk of V2.0 App Layer
Deliver Fully-Tested Product by 9/1/2012
Enable FEA, Cloud First and Shared First Initiatives Sooner
Sensitive but Unclassified
4/17/2013
4
NIIMS V1.5 AS-BUILT INFRASTRUCTURE
o
VMware/ Private Cloud
o
o
o
o
Platform-a-a-Service (PaaS)
Production Application VM Server
Development and Test VM Servers
Verified HOT/COLD Failover 11/14/12
o
o
o
Albuquerque - Primary
Sioux Falls – Contingency Site
3 Hours Actual Recovery Time – 93.75%
of stated Recovery Time Objective (RTO)
o
High-Priority Enhancements NOW
o
o
o
Wapato Minimum Bill
Planned Pay.gov and OTCnet
Planned Excess Water
Sensitive but Unclassified
4/17/2013
5
NIIMS V1.5 ACCOMPLISHMENTS
NIIMS Off the Mainframe ($1.2MM Avoidance)
1.
Stopped V2.0 Re-Write
Accomplished Complete V1.5 Re-Platform within 120 days
o
o
o
o
Platform-as-a-Service (PaaS) hosting cost is 2.4% of previous
mainframe environment
o
Modernized, Conforms to IT Transformation
Standards and Federal Enterprise Architecture
2.
Active Directory Identity Mgmt and Authentication
o
3.
33% of V2.0 Planned Timeframe
22% of V2.0 Planned Budget
Streamline Business Workflow, Enable Mission
Achievement
o
V1.5 Major Issues have been Mitigated & FBMS Enabled
Sensitive but Unclassified
4/1/2013
6
NIIMS V1.5 LESSONS LEARNED
1. Streamline Acquisitions Processes!
2. Start Sooner!!
3. Congratulations to High-Performance Team!!!
Sensitive but Unclassified
4/17/2013
7
NIIMS V1.6.1 – BUSINESS RULE CHANGES
o
Pay.gov Accepts EVERY Valid Payment
=> Agency May Deploy Exception Processing to Accommodate
Specific Goals / Needs
o Treasury Referrals
o Duplicates
o Overages and shortages
o
Notify Customers
o
o
o
o
4/17/2013
Checks/Debits Must Clear FIRST TIME
Agency Office/CBO can access cleared Pay.gov credit card
or debit payment SAME DAY for clearance of water delivery
Other payments only ‘count when settled’ – 24 to 48 hours
Referrals to Treasury for Delinquency at $25 Threshold even if
no TIN on file, and at 120 days past due
Sensitive but Unclassified
9
NIIMS V1.6.1 – ENHANCED COLLECTIONS
o
o
o
Pay.gov
OTCnet Check Scanning
Enhanced Internal Controls
o
o
o
o
o
o
Segregation of Duties
Remediate Dual Access Weakness per
2008 KPMG Audit Finding
ACTION ITEM => Decide on Local or
Centralized Agency Collections – can
be centralized at an agency if desired
Significant, Measureable Cost Savings for 2013 Billing Season (Ready by
12/15/2012) 12/27/2012
95% Confidence Level
Anticipated Adoption Rate of 10% of transactions
Sensitive but Unclassified
4/17/2013
10
NIIMS V1.7 – DATABASE ‘STAIRSTEP’ TRANSFORMATION
o
o
Extract Land and Owner/Lessee and
Accounting Data and Import to
SQL/Server Nightly
Enable Schema Changes
o
o
Foundation for Data Independence
o
o
o
o
o
o
Owner D.O.B. (Minor Children)
Migrate to SQL/Server Relational DBMS
Relational Query and Reporting
‘Spin Off’ Data Assets for Other Purposes
(GeoSpatial DB)
Alignment with IT Modernization Framework
Extract and Transformation ‘Lessons Learned’ from V2.0
Deliver in 2013 for Fiscal Year 2014
Sensitive but Unclassified
4/17/2013
11
NIIMS V1.8 – REPORT CONSOLIDATION
o
Utilize COTS Tools
o
o
o
SQL Report Builder
Business Objects Enterprise
Needed Enhancements
o
o
5/24/2012
Ledger View (Query and Report)
Paid Ditch Rider Report
Sensitive but Unclassified
For Official Use Only
12
NIIMS V2.0 – RE-WRITE NIIMS MODULES
o Utilize Software Engineering Principles for Predictability
o Joint Application Requirements / Joint Application Design Workshops
Sensitive but Unclassified
4/17/2013
13
NIIMS V2.0 – RE-WRITE NIIMS MODULES
o
Process Descriptions
The Debtor receives a bill
The Payor connects and logs into Pay.gov
The Payor submits payment via the BIA DWP form on Pay.gov using:
o
o
o
o
o
o
o
o
o
o
o
o
o
o
Debit Card
Credit Card
ACH Debit
Pay.gov electronically deposits payment with the bank
Pay.gov generates transaction files / reports
Pay.gov receives a Deposit Ticket Number and updates the payment record
NIIMS receives the transaction files
A NIIMS batch job executes to enter the payment transaction information into
a workset and assign a schedule number
The Project / CBO approves and applies the payment into the accounts
The CBO / Project staff will review reports from DIRECT to reconcile credit card
transactions and watch for disputed charges
Additional Non Sufficient Funds Process Description…
Sensitive but Unclassified
4/17/2013
14
NIIMS V2.0 – RE-WRITE NIIMS MODULES
o
Process Actor Interaction Diagrams
Pay.gov
Payor
BIA NIIMS V1.6 Pay.gov By Bill
1
Receive Bill
Connect & Login
to Pay.gov
Submit Payment
By Bill via
Pay.gov BIA DWP
Form
Electronically
Deposit ACH Debit,
Credit Card or Debit
Card Payment With
Bank
Generate
Transaction Files
Automatically send
Transaction Files to
NIIMS
Add NSF to
Payment Record in
Transaction File
NIIMS
3.1
Receive Pay.gov
Transaction File
CBO / Project
3.2
3.2
Enter
Enter Transactions
Transactions
into
into Workset
Workset and
and
Setup
Setup Schedule
Schedule
Number
Number
(Options
(Options 13,
13, 14)
14)
4/17/2013
2.1.3
Approve and Apply
Payment to the
Accounts
(Option 15)
2.2.2
Back Out The
Payment For NSF
Transactions
Sensitive but Unclassified
For Official Use Only
DIRECT
Reporting
15
NIIMS V2.0 – RE-WRITE NIIMS MODULES
o
Logical Data Dictionary, Debtor
Sensitive but Unclassified
4/17/2013
16
FUTURE INITIATIVES
o
Land Buy Back Program – Interface to System of
Record
o
Key Performance Indicators – Metrics / Dashboard
o
Online Portal for Customers
Sensitive but Unclassified
4/17/2013
17
MIGRATION MANIA
BIA’s Migration of Mainframe Adabas/Natural
Application to Windows 2008 R2 Server
WHAT IS NIIMS?

National Irrigation Information Management
System

First Programs from the Late 80’s

Mainframe Application




Adabas/Natural
Online and Batch
Three Environments (Dev, Test, Prod)
Natural Security/CICS/Secure FTP’s
WHAT IS NIIMS?

Report Repository (32K+ Legacy Reports)

~50 Remote Users
THE BASICS
•
~600,00 Lines of Natural Code
•
~700 Programs, ~350 Subprograms, ~1200 Maps
•
60% Online, 40% Batch
•
Online Submitted Batch via Internal Reader
•
External Interfaces (other Federal Systems)
–
–
Secure FTP’s
Sneaker Net
THE BASICS
•
Legacy Report Repository (Document Direct)
•
External Batch Sorts (SYNCH Sort)
•
Mainframe Batch Scheduler (Control-M)
TO MIGRATE OR REWRITE?
THAT IS THE QUESTION!

Things to Consider
 Target
Platform?
 Unix?
 Linux?
 Windows?
 Something
 CPU
Else?
Power Needed?
 Collating Differences (EBCDIC to ASCII)
 Fat or Thin Client?
TO MIGRATE OR REWRITE?
THAT IS THE QUESTION!

Things to Consider cont.
 User
Interface?
 Browser
 Client/Server
(Citrix?)
 Something Else?
 Ease
of Deployment?
 Time Frame (time available?)
 $$ Cost?
PROOF OF CONCEPT
MIGRATION

Community Versions of Adabas/Natural
for Windows (2007 Desktop)

Community Version of NaturalOne

Migrate NIIMS Natural Code (DDMS too)
 Unload
Mainframe SYSOBJ Transfer Mode
 FTP to Desktop (convert EBCDIC to ASCII)
 Make
sure file extension is .SRC
PROOF OF CONCEPT
MIGRATION
 Reload
NIIMS into Natural for Windows
 Natural
- Development Tools/Object Handler
PROOF OF CONCEPT
MIGRATION
–
Catalog all Natural Objects (Fix Errors)
•
•
–
Input Using Map ‘mapname’ Mark * #fieldname
Input Using Map ‘mapname’ Mark *#fieldname
Write DOS Command Shell Routine
•
Online Submitted Batch
•
•
See appendix A
Migrate Most Important Adabas Tables
•
•
Unload/Decompress on Mainframe
FTP Files to Desktop (BIA uses BLUEZONE)
–
–
BINARY Mode
SITE RDW  FTP command for variable length records
PROOF OF CONCEPT
MIGRATION
 Compress/Load
Windows
Data into Adabas for
PROOF OF CONCEPT
MIGRATION

Convert JCL Table to DOS .bat Scripts
PROOF OF CONCEPT
MIGRATION
•
Solution for Report Repository
•
•
Route to shared folders
Solution for External Interfaces
–
FTP and Sneaker Net
•
•
SmartFTP
Sneaker Net no longer needed
PROOF OF CONCEPT
MIGRATION

Nightly Job Scheduling
 Windows
Job Scheduler
PROOF OF CONCEPT
MIGRATION

Solution for Remote Access(Need Easy to
Deploy)
 Browser
 Test
Application?
Concept with NaturalOne
PROOF OF CONCEPT
MIGRATION
 NIIMS
as a Windows Application?
 Requires
Citrix and/or Client/Server
MIGRATION PREPARATIONS

Identify/Archive Unused Programs (Natural
Engineer)

Identify/Archive Unused JCL/Procs

Remove Remaining Embedded JCL

Cleanup Report Repository

32K+ of legacy reports
MAKING IT HAPPEN


Choice of Platform?
 Windows 2008 R2 dictated by BIA/IT
RDP Access to Remote Server
 Administrator Privileges!!

Install Adabas/Natural for 2008 R2 – With NDV

Install NaturalOne Locally (DBA/Developers)
MAKING IT HAPPEN

Great “Free” External “Batch” Sort
Routine



CMSORT
http://www.chmaas.handshake.de/delphi/f
reeware/cmsort/cmsort.htm
Unload 32K+ of Legacy Reports (Doc
Direct)

Converted to .txt files
MAKING IT HAPPEN

Shared Folder Structure on Server for
Reports
MAKING IT HAPPEN

Shared Folder Structure on Server for
Reports
MAKING IT HAPPEN
Vfile Viewer - http://www.fileviewer.com/
1/31/2012 and 2/1/2012
Sensitive but Unclassified
For Official Use Only
39
MAKING IT HAPPEN
Vfile Viewer
1/31/2012 and 2/1/2012
Sensitive but Unclassified
For Official Use Only
40
MAKING IT HAPPEN

Convert Nightly Batch JCL to .bat scripts
MAKING IT HAPPEN

Download and Install an Application
Server
 Tomcat
6 (our choice)
 Deploy Natural for Ajax
MAKING IT HAPPEN
 Configure
NJX
MAKING IT HAPPEN
 Configure
NJX cont.
MAKING IT HAPPEN
 Configure
NJX cont.
MAKING IT HAPPEN
 Configure
NJX cont.
MAKING IT HAPPEN
 Make
it HTTPS – Secure Web App
 Tomcat’s
server.xml file
<!-- Define a SSL HTTP/1.1 Connector on port 443
This connector uses the JSSE configuration, when using APR, the
connector should be using the OpenSSL style configuration
described in the APR documentation -->
<Connector port="443" protocol="HTTP/1.1" SSLEnabled="true"
disableUploadTimeout="true"
keystoreFile="C:\path\Your.pfx" keystorePass=“**********"
keystoreType="PKCS12"
connectionTimeout="80000"
maxThreads="150" acceptCount="100" scheme="https" secure="true"
clientAuth="false" sslProtocol="TLS" />
SUCCESS!
SUCCESS!
LESSONS LEARNED

Allow Enough Time
 Conversion


of JCL to .bat can be slow at first
Good Preparation (don’t move what you
don’t need)
Don’t Try to Use a SAG Installed Tomcat
 Download
and Install Tomcat 6
LESSONS LEARNED

Make Adabas Containers Large
 Storage

is Cheap!
Expect a Shakeout Period
 Unexpected
Gotcha’s are Waiting!
COMMENTS/ QUESTIONS
o
o
o
Elizabeth (Betty) Pierce
(303) 231-5246
Elizabeth.Pierce@bia.gov
o
David Denbow
(303) 231-5247
David.Denbow@bia.gov
o
Thank You!
o
o
52