|
1. Report No.
FHWA-OP-03-XXX
| 2. Government Accession No. | 3. Recipient's Catalog No. | 4. Title and Subtitle
Hazardous Materials Safety and Security Technology
Field Operational Test Evaluation Final Report
| 5. Report Date
November 11, 2004
| | 6. Performing Organization Code | 7. Authors
D. Stock (SAIC), M. Jensen (SAIC), M. Carter (SAIC), E. Wik (SAIC),
C. Louisell (SAIC), and C. Mitchell (SAIC)
| 8. Performing Organization Report No. | 9. Performing Organization Name and Address
Science Applications International Corporation (SAIC)
1710 SAIC Drive
M/S T1-12-3
McLean, VA 22101
| 10. Work Unit No. (TRAIS)
11. Contract or Grant No.
DTFH61-96-C-00098; Task 9851
| 12. Sponsoring Agency Name and Address
Federal Motor Carrier Safety Administration
1200 New Jersey Avenue SE
Washington, D.C. 20590
| 13. Type of Report and Period Covered
14. Sponsoring Agency Code
HOIT-1
| 15. Supplementary Notes
Mr. Joseph DeLorenzo (FMCSA) (Task Manager)
Dr. Joseph I. Peters (COTR)
| 16. Abstract
This report provides the findings from SAIC’s 2-year independent evaluation of the
Hazardous Materials (HAZMAT) Safety and Security Technology Field Operational Test
for the USDOT. This comprehensive report consists of the following three volumes:
Volume I: Executive Summary - This volume presents the overriding results
generated from the evaluation of this FOT including overall benefit-cost results,
industry deployment potential for FOT technologies, and policy options
for consideration.
Volume II: Evaluation Final Report Synthesis - This volume provides information
synthesized from the detailed reference sections contained in Volume III. This volume
presents the "bottom line" results from the FOT activities.
Volume III: Evaluation Final Report Detail - This volume provides the five key
reference documents used to support the evaluation and results for the HAZMAT FOT under
one cover:
- Section 1: HAZMAT FOT Overview
- Section 2: HAZMAT FOT Technical Performance, Efficiency and Safety Benefits Assessments
- Section 3: HAZMAT FOT Security Benefits Assessment
- Section 4: Benefit-Cost Assessment and Industry Deployment Potential
- Section 5: Public Sector Component
| Key Words
Hazardous Materials, Intelligent Transportation Systems, ITS Deployment;
Security; National Test, Evaluation; Efficiency; ITS Technologies; Return on Investment;
Risk Assessment; Motor Carrier; Trucking
| 18. Distribution Statement
No restrictions. This document is available to the public from:
The National Technical Information Service, Springfield, VA 22161.
| 19. Security Classif. (of this report)
Unclassified
| 20. Security Classif. (of this page)
Unclassified
| 21.No of Pages
123
| 22. Price
N/A
|
Form DOT F 1700.7 (8-72) Reproduction of completed page authorized."
TABLE OF CONTENTS| FOREWORD |
IX
|
|---|
| ACKNOWLEDGEMENTS |
XI
|
|---|
| ABBREVIATIONS |
XIII
|
|---|
| | 2. FOT OVERVIEW |
4
|
|---|
|
2.1 PROJECT INTRODUCTION
|
4
|
|---|
|
2.2 FOT TECHNOLOGIES
|
5
|
|---|
|
2.3 SYSTEM ARCHICTECTURE
|
11
|
|---|
|
2.4 FOT SCENARIOS
|
12
|
|---|
| | | 4. TECHNICAL FOT PERFORMANCE |
20
|
|---|
|
4.1 TECHNOLOGY FOT PERFORMANCE
|
20
|
|---|
|
4.2 BASELINE PARTICIPANT INTERVIEWS
|
20
|
|---|
|
4.3 OVERALL BASELINE SITE VISIT RESULTS
|
21
|
|---|
|
4.4 TECHNOLOGY EXERCISES
|
21
|
|---|
|
4.5 STAGED EVENTS
|
22
|
|---|
|
4.6 FOT TECHNOLOGY USE AND PARTICIPANT TECHNOLOGY REACTIONS
|
23
|
|---|
| | 5. EFFICIENCY BENEFITS ASSESSMENT |
39
|
|---|
|
5.1 APPROACH TO DETERMINING TECHNOLOGY EFFICIENCY BENEFITS
|
39
|
|---|
|
5.1.1 Definition of Benefits
|
39
|
|---|
|
5.1.2 Analyses
|
39
|
|---|
|
5.2 INPUT FACTOR PRODUCTIVITY
|
40
|
|---|
|
5.2.1 Bulk Fuel Analysis
|
40
|
|---|
|
5.2.2 LTL-High Hazard (Non-Bulk) Analysis
|
41
|
|---|
|
5.3 PARTIAL BUDGETING
|
42
|
|---|
|
5.4 PARTIAL BUDGET ASSUMPTIONS, INPUTS, AND RESULTS
|
43
|
|---|
|
5.5 EFFICIENCY BENEFITS FINDINGS
|
45
|
|---|
| | 6. SECURITY BENEFITS ASSESSMENT |
47
|
|---|
|
6.1 SECURITY BENEFITS ASSESSMENT OVERVIEW
|
47
|
|---|
|
6.2 VULNERABILITIES AND TECHNOLOGY-ENABLED VULNERABILITY REDUCTIONS
|
51
|
|---|
|
6.3 SECURITY BENEFITS
|
57
|
|---|
|
6.4 SECURITY ASSESSMENT FINDINGS
|
60
|
|---|
| | 7. SAFETY BENEFITS ASSESSMENT |
62
|
|---|
|
7.1 MOTOR CARRIER EXPOSURE TO CRASH ANALYSIS
|
62
|
|---|
|
7.2 ENHANCED HAZMAT INCIDENCE RESPONSE BENEFITS
|
63
|
|---|
|
7.3 SAFETY BENEFITS ASSESSMENT FINDINGS
|
64
|
|---|
| | 8. BENEFIT-COST ASSESSMENT AND DEPLOYMENT POTENTIAL |
65
|
|---|
|
8.1 OVERVIEW
|
65
|
|---|
|
8.1.1 Benefit-Cost Assessment
|
65
|
|---|
|
8.1.2 Industry Deployment Potential
|
65
|
|---|
|
8.2 INDUSTRY DEMOGRAPHICS
|
66
|
|---|
|
8.2.1 Industry Topology by Size
|
66
|
|---|
|
8.2.2 Distribution of Fleets by Size and Relationship to Technology Adoption
|
66
|
|---|
|
8.3 MOTOR CARRIER TECHNOLOGY ADOPTION
|
67
|
|---|
|
8.3.1 Estimation of Current and Expected Annual Growth in Technology Usage
|
67
|
|---|
|
8.3.2 Estimated Current Use of Technology by HAZMAT Carriers
|
68
|
|---|
|
8.4 ESTIMATED EFFICIENCY BENEFITS AND COSTS
|
69
|
|---|
|
8.4.1 Benefits, Costs, and ROI Summary
|
69
|
|---|
|
8.4.2 Cost and ROI Summary
|
69
|
|---|
|
8.4.3 Industry Deployment and Potential ROI
|
71
|
|---|
|
8.5 ESTIMATED SECURITY BENEFITS AND COSTS
|
73
|
|---|
|
8.5.1 Benefits-Consequence Avoidance
|
73
|
|---|
|
8.5.2 Costs
|
74
|
|---|
|
8.5.3 Benefits Versus Costs
|
78
|
|---|
|
8.5.4 Breakeven Points
|
80
|
|---|
|
8.6 CONSOLIDATED BENEFITS AND COSTS
|
82
|
|---|
|
8.7 DISTRIBUTION OF BENEFITS AMONG PRIVATE AND PUBLIC STAKEHOLDERS
|
87
|
|---|
|
8.8 FINDINGS
|
90
|
|---|
| | 9. PUBLIC SECTOR FOT EVALUATION |
94
|
|---|
|
9.1 PUBLIC SECTOR FOT OVERVIEW
|
94
|
|---|
|
9.2 PUBLIC SECTOR REPORTING CENTER
|
94
|
|---|
|
9.3 PUBLIC SECTOR FOT EVALUATION TESTING
|
95
|
|---|
|
9.3.1 Public Sector Interviews
|
95
|
|---|
|
9.3.2 Field Testing
|
96
|
|---|
|
9.4 PUBLIC SECTOR EVALUATION FINDINGS
|
97
|
|---|
|
9.4.1 HAZMAT Response Time Improvements
|
97
|
|---|
|
9.4.2 HAZMAT Information Improvements
|
99
|
|---|
|
9.4.3 Conclusion
|
100
|
|---|
| | 10.POLICY OPTIONS TO REALIZE DEPLOYMENT |
101
|
|---|
|
10.1 ISSUES
|
101
|
|---|
|
10.1.1 Technology Cost
|
101
|
|---|
|
10.1.2 Technical Performance
|
101
|
|---|
|
10.1.3 Vendor/Product Stability
|
102
|
|---|
|
10.1.4 Liability Issues
|
102
|
|---|
|
10.1.5 Data Privacy Issues
|
102
|
|---|
|
10.2 POLICY OPTIONS FOR OVERCOMMING ISSUES AND REALIZING INDUSTRY DEPLOYMENT
|
103
|
|---|
|
10.2.1 Technology Cost
|
103
|
|---|
|
10.2.2 Technical Performance
|
103
|
|---|
|
10.2.3 Vendor/Product Stability
|
103
|
|---|
|
10.2.4 Potential Liability Issues
|
104
|
|---|
|
10.2.5 Data Privacy Issues
|
104
|
|---|
| | 11. CONCLUSIONS |
105
|
|---|
|
11.1 TECHNICAL EFFICACY
|
105
|
|---|
|
11.2 EFFICIENCY
|
105
|
|---|
|
11.3 SECURITY
|
106
|
|---|
|
11.4 SAFETY
|
106
|
|---|
|
11.5 DEPLOYMENT POTENTIAL
|
107
|
|---|
|
11.6 PUBLIC SECTOR Psrc CONCEPT
|
107
|
|---|
|
11.7 POLICY OPTIONS
|
107
|
|---|
| |
LIST OF FIGURES|
Figure 2-1
| CDMA BREW Phones | 6 |
|---|
|
Figure 2-2
| Dash-Mounted Panic Button and Wireless Panic Button | 7 |
|---|
|
Figure 2-3
| Biometric Fingerprint Reader | 7 |
|---|
|
Figure 2-4
| ESCM Screen with Manifest Details and Transfer Information | 8 |
|---|
|
Figure 2-5
| Internal Cargo Door Lock | 9 |
|---|
|
Figure 2-6
| Electronic Seal | 10 |
|---|
|
Figure 2-7
| Geofencing Dispatch Display Map | 11 |
|---|
|
Figure 3-1
| Evaluation Framework | 16 |
|---|
|
Figure 3-2
| Operational Efficiency Benefit-Cost Analysis Process Flows | 18 |
|---|
|
Figure 6-1
| Security Assessment Process | 51 |
|---|
|
Figure 6-2
| Average Percent Reduction in Overall Risk Across Load Types by Technology Combination | 57 |
|---|
|
Figure 8-1
| Deployment Costs and Benefits by Stakeholder Type for Bulk Fuel Loads (For 3 Years – In Millions of Dollars) | 88 |
|---|
|
Figure 8-2
| Deployment Costs and Benefits by Stakeholder Type for LTL High-Hazard Loads (For 3 Years – In Millions of Dollars) | 88 |
|---|
|
Figure 8-3
| Deployment Costs and Benefits by Stakeholder Type for Bulk Chemical Loads (For 3 Years – In Millions of Dollars) | 89 |
|---|
|
Figure 8-4
| Deployment Costs and Benefits by Stakeholder Type for Truckload Explosives Loads (For 3 Years – In Millions of Dollars) | 89 |
|---|
|
Figure 9-1
| HAZMAT Public Sector FOT System Architecture | 96 |
|---|
LIST OF TABLES|
Table 2-1
| FOT Task Order Timeframe | 4 |
|---|
|
Table 4-1
| Participant Responses to General Technology Reactions | 24 |
|---|
|
Table 4-2
| Vehicle Position Reports from Wireless Satellite/ Terrestrial Communications by Motor Carrier | 25 |
|---|
|
Table 4-3
| Forward Messages/Macros from Dispatch to Vehicle Transactions by Motor Carrier | 26 |
|---|
|
Table 4-4
| Return Messages/Macros from Vehicle to Dispatch Transactions by Motor Carrier | 26 |
|---|
|
Table 4-5
| Global Login/Biometric Login Transactions by Motor Carrier | 30 |
|---|
|
Table 4-6
| Global Login/Biometric Login Event Type Percentage Usage by Scenario | 31 |
|---|
|
Table 4-7
| Panic Button Message Events by Motor Carrier | 33 |
|---|
|
Table 5-1
| Average LTL (P&D) Driver Productivity Gains Following Deployment of Wireless Communications and GPS Positioning Systems | 42 |
|---|
|
Table 5-2
| Estimated Monthly Per Truck Benefits Derived Using Wireless Communications with GPS Vehicle Positioning System | 43 |
|---|
|
Table 5-3
| Minimum Estimated Monthly Per Truck Benefits Derived through the Use of Wireless Communications with GPS Vehicle Positioning System. | 45 |
|---|
|
Table 6-1
| Percent Reduction in Vulnerability of Theft by Load Type | 53 |
|---|
|
Table 6-2
| Percent Reduction in Vulnerability of Diversion by Load Type | 54 |
|---|
|
Table 6-3
| Percent Reduction in Vulnerability of Interception by Load Type | 55 |
|---|
|
Table 6-4
| Percent Reduction in Overall Vulnerability by Load Type and Technology | 56 |
|---|
|
Table 6-5
| Reasonable Worst-Case Per Attack Consequences | 58 |
|---|
|
Table 6-6
| Estimated Security Benefits by Load Type and Technology | 60 |
|---|
|
Table 8-1
| Per Truck-Specific Technology Costs (Wireless Communications with GPS Tracking Capabilities) | 70 |
|---|
|
Table 8-2
| Costs, Benefits, Benefit-Cost Ratios, and Payback Periods by Industry Segment (Wireless Communications with GPS Tracking Capabilities) | 70 |
|---|
|
Table 8-3
| Current Industry Deployment Levels Versus Unrealized Industry Market Potential (Wireless Communications with GPS Tracking Capabilities) | 72 |
|---|
|
Table 8-4
| Industry Efficiency Benefit and Cost Estimates/Investments Over 3 Years for Wireless Communications with GPS Tracking Capabilities (In Millions of Dollars) | 73 |
|---|
|
Table 8-5
| Estimated Security Benefits by Load Type and Technology (In Millions of Dollars) | 74 |
|---|
|
Table 8-6
| Estimated Per Truck Costs by Technology Over 3 Years | 75 |
|---|
|
Table 8-7
| Number of Trucks to be Equipped to Realize Full Deployment Potential | 76 |
|---|
|
Table 8-8
| Marginal Deployment Costs for Future Investment Above Current Levels Required to Reach Full Deployment By Technology Combination and Load Type Including 3 Years of Service Fees Millions of Dollars) | 77 |
|---|
|
Table 8-9
| Total Full Deployment Costs By Technology Combination and Load Type Including 3 Years of Service Fees (In Millions of Dollars) | 78 |
|---|
|
Table 8-10
| Estimated Total Security Benefits and Costs Over 3 Years by Technology and Load Type (In Millions of Dollars) | 79 |
|---|
|
Table 8-11
| Estimated Number of Successful Attacks to Be Prevented to Realize Breakeven with Deployments Costs | 81 |
|---|
|
Table 8-12
| Consolidated Annual Benefits and Costs by Technology for Bulk Fuel (In Millions of Dollars) | 83 |
|---|
|
Table 8-13
| Consolidated Annual Benefits and Costs by Technology for LTL (In Millions of Dollars) | 84 |
|---|
|
Table 8-14
| Consolidated Annual Benefits and Costs by Technology for Bulk Chemicals (In Millions of Dollars) | 85 |
|---|
|
Table 8-15
| Consolidated Annual Benefits and Costs by Technology for Truckload Explosives (In Millions of Dollars) | 86 |
|---|
|
Table 8-16
| Percentage of Benefits Realized by the Private Sector | 87 |
|---|
FOREWORDThe following volume content definitions are provided to aid the reader in reviewing this detailed, multivolume effort presented as the Hazardous Materials (HAZMAT) Safety and Security Technology Field Operational Test (FOT) Evaluation Final Report. Volume I: Executive Summary - This volume presents the overriding results generated from the evaluation of this FOT including overall benefit-cost results, industry deployment potential for FOT technologies, and policy options for consideration.
Volume II: Evaluation Final Report Synthesis - This volume provides information synthesized from the detailed reference sections contained in Volume III. This volume presents the "bottom line" results from the FOT activities, including the following topics, and concluding with potential policy options for consideration:
NOTE: Volume III is a Sensitive Security Information document and is not available for public distribution. Volume III: Evaluation Final Report Detail - This volume provides the five key reference documents used to support the evaluation and results for the HAZMAT FOT under one cover:
- Section 1: HAZMAT FOT Overview. This section provides the rationale behind this FOT, including a synopsis of FOT activities; identifies the FOT configuration; and describes the technologies deployed for this FOT.
- Section 2: HAZMAT FOT Technical Performance, Efficiency and Safety Benefits Assessments. This section outlines the baseline data collection effort and related technology prototype testing. This section presents quantitative and qualitative performance reviews of each of the individual deployed component technologies. The section includes the Efficiency and Safety Benefits Assessments that feeds into the Section 4 Benefit-Cost Assessment.
- Section 3: HAZMAT FOT Security Benefits Assessment. This section presents the Security Benefits Assessment and covers the analytical framework and Delphi process developed to support the Security Analysis and to feed the Benefit-Cost Assessment in Section 4.
- Section 4: Benefit-Cost Assessment and Industry Deployment Potential. This section presents the Efficiency, Safety and Security Benefit-Cost Assessments and Market Potential Analysis for Industry Deployment built upon the detailed Efficiency, Safety, and Security Benefits Assessments in Sections 2 and 3.
- Section 5: Public Sector Component. This section presents the evaluation of the Public Sector FOT, which is an add-on component to the larger HAZMAT FOT.
ACKNOWLEDGEMENTSThe Hazardous Materials (HAZMAT) Safety and Security Technology Field Operational Test evaluation was conducted in support of the U.S. Department of Transportation’s (USDOT’s) Intelligent Transportation System Joint Program Office (ITS-JPO) and the Federal Motor Carrier Safety Administration’s (FMCSA) Hazardous Materials Division. The project was managed by Mr. Joseph Delorenzo of FMCSA, and was conducted under the ITS-JPO’s Independent Evaluation Program, which is managed by Mr. Joseph Peters, Ph.D. This evaluation effort was improved significantly though input from the public sector experts on the HAZMAT Review Team. The following experts provided guidance to the SAIC Evaluation Team in the areas of HAZMAT Operations, Commercial Vehicle Operations (CVO) security, and Intelligent Transportation Systems:
- Bill Quade, Federal Motor Carrier Safety Administration
- Jeff Loftus, Federal Motor Carrier Safety Administration
- Kate Hartman, USDOT ITS Joint Program Office
- Deborah Freund, Federal Motor Carrier Safety Administration
- Amy Houser, Federal Motor Carrier Safety Administration
- John Lambert, Pipeline and Hazardous Materials Safety Administration
- Kevin Johnson, Transportation Security Administration
- Pierre Youssef, Mitretek
The SAIC Evaluation Team would also like to recognize the outstanding support provided the Deployment Team, managed by Mr. John Allen of Battelle, as well as the numerous industry and public sector stakeholders involved in this test. In particular, SAIC would like to recognize the outstanding data collection and logistical support provided to the Evaluation Team throughout this effort by Mr. Derrick Vercoe of QUALCOMM.
Finally, the SAIC Evaluation Team would like to also thank Mr. Kevin Johnson from the Department of Homeland Security’s
(DHS) Transportation Security Administration (TSA), who volunteered his time to serve as Co-Chairman of our HAZMAT
Security Expert Panel. SAIC would like to thank all of the members of this panel who are outlined as follows, as well
as a much larger set of security experts who participated in our Security Assessment Delphi Process.
These volunteers are from the FOT Deployment and Evaluation Teams; industry security and risk experts
from the American Trucking Associations (ATA); the National Tank Truck Carriers Association (NTTCA);
the Commercial Vehicle Safety Alliance (CVSA); International Association of Chiefs of Police; International
Association of Fire Chiefs; the USDOT; TSA; Great West Casualty Company; and the Kenan Advantage Group.
The following experts provided invaluable input and feedback to the Evaluation Team on methodology, recruitment of Delphi Panelists, and interpretation of findings and issues. Expert Panelists: - Kevin Johnson, Expert Panel Co-Chair, Transportation Security Administration
- Clifford Harveson, National Tank Truck Carriers Association
- Robert Pryor, Transportation Security Administration
- John Conely, National Tank Truck Carriers Association
- John Eversole, International Association of Chiefs of Police
- John Grant, International Association of Chiefs of Police
- Scott Claffey, Great West Casualty Company
- Richard Moskowitz, American Trucking Associations
- William Downey, Kenan Advantage Group
- Steve Keppler, Commercial Vehicle Safety Alliance
- Dan Murray, American Transportation Research Institute
- Jeff Beatty, Total Security Solutions International
- Mark Lepofsky, Battelle
- Joseph Hebert, Science Applications International Corporation
ABBREVIATIONS|
ANOVA
|
Analysis of Variance
|
|---|
|
ATA
|
American Trucking Association
|
|---|
|
ATRI
|
American Transportation Research Institute
|
|---|
|
BSG
|
Biometrics Solutions Group
|
|---|
|
BREW
|
Binary Runtime Environment for Wireless
|
|---|
|
CSI
|
Cambridge Systematics, Inc.
|
|---|
|
CMDA
|
Code Division Multiple Access
|
|---|
|
CPU
|
Central Processing Unit
|
|---|
|
CVSA
|
Commercial Vehicle Safety Alliance
|
|---|
|
CVO
|
Commercial Vehicle Operations
|
|---|
|
DHS
|
Department of Homeland Security
|
|---|
|
ESCM
|
Electronic Supply Chain Manifest
|
|---|
|
E-seal
|
Electronic Seal
|
|---|
|
FMCSA
|
Federal Motor Carrier Safety Administration
|
|---|
|
FMCSR
|
Federal Motor Carrier Safety Regulations
|
|---|
|
FOT
|
Field Operational Test
|
|---|
|
GPS
|
Global Positioning System
|
|---|
|
HAZMAT
|
Hazardous Materials
|
|---|
|
HMR
|
Hazardous Materials Regulations
|
|---|
|
IT
|
Information Technology
|
|---|
|
ITS
|
Intelligent Transportation Systems
|
|---|
|
JPO
|
Joint Program Office
|
|---|
|
LTL
|
Less-than-Truckload
|
|---|
|
MCMIS
|
Motor Carrier Management Information System
|
|---|
|
MCSAP
|
Motor Carrier Safety Assistance Program
|
|---|
|
NAITC
|
North American International Trade Corridor
|
|---|
|
NMC
|
Network Management Center
|
|---|
|
NTTCA
|
National Tank Truck Carrier Association
|
|---|
|
OBC
|
On-Board Computer
|
|---|
|
P&D
|
Pickup and Delivery
|
|---|
|
Psrc
|
Public Sector Reporting Center
|
|---|
|
TSA
|
Transportation Security Administration
|
|---|
|
QTRACS® |
QTRACS® is a registered trademark of QUALCOMM, for its fleet management messaging and vehicle tracking system.
|
|---|
|
ROI
|
Return on Investment
|
|---|
|
USDOT
|
U.S. Department of Transportation
|
|---|
Continue to:Table of Contents > Introduction >
Section 1 >
2 >
3 >
4 >
5 >
6 >
7 >
8 >
9 >
10 >
11
|
|
|
