Simulation-Based Acquisition Only a 'Slogan,' Says Survey.
A Pentagon-funded survey of major defense programs revealed what many had suspected all along: that simulation-based acquisition is more of a myth than a reality.
Simulation-based acquisition is a buzzword A term that refers to the latest technology or a term that sounds catchy. If not a flash in the pan, new technologies become mainstream. For example, Java was a hot buzzword in the 1990s, but should remain a major topic for decades. that illustrates the notion that weapon systems can be designed and developed entirely as digital models and that those models are accepted as valid prototypes.
The sponsor of the survey was James F. O'Bryon, deputy director of operational test and evaluation (testing) operational test and evaluation - (OT&E) Formal testing conducted prior to deployment to evaluate the operational effectiveness and suitability of the system with respect to its mission. at the office of the secretary of defense The Office of the Secretary of Defense (OSD) is part of the United States Department of Defense and includes the entire staff of the Secretary of Defense. It is the principal staff element of the Secretary of Defense in the exercise of policy development, planning, resource . The study covered 22 major defense acquisition programs. Each program office was asked whether it used simulation-based acquisition methods and, if so, to explain how it was implemented. The only program that did not provide data was the Joint Strike Fighter A strike fighter is a fighter aircraft which is also capable of attacking surface targets, including ships. It differs from an attack aircraft in that the aircraft remains a capable fighter. , because it's still in a competition, so any information on JSF (JavaServerFaces) A standard framework of components for building rich user interfaces for Java applications. JavaServer Faces run on the server, but are displayed on the client.
JSF - JavaServer Faces models was considered proprietary. Ironically, the JSF program is among those that most heavily have used modeling and simulation in the design and development phases.
Among the questions asked were how digital models are organized, who pays for the models and whether the models are validated and accredited accredited
recognition by an appropriate authority that the performance of a particular institution has satisfied a prestated set of criteria.
cattle herds which have achieved a low level of reactors to, e.g. .
"To ensure candor from the program managers, we agreed to not release information on specific programs, but rather service-wide," said O'Bryon in an interview.
The survey, he said, "paints a rather bleak picture."
Even though the Defense Department spends millions of dollars each year developing digital models for various applications, simulation-based acquisition is not pursued in any organized manner, O'Bryon said. "We really don't have SBA SBA
Small Business Administration
Noun 1. SBA - an independent agency of the United States government that protects the interests of small businesses and ensures that they receive a fair share of government . A lot of money is spent on models and simulation. But it's very disjointed. In some cases, it's spent multiple times on similar models," he said. "Most acquisition programs do not have modeling and simulation plans."
Industry executives either are being disingenuous dis·in·gen·u·ous
1. Not straightforward or candid; insincere or calculating: "an ambitious, disingenuous, philistine, and hypocritical operator, who ... exemplified ... or are fooling themselves when they say that SBA is "here and now," said O'Bryon.
During an August conference on testing and training in Orlando, Fla., the president of Lockheed Martin Missiles and Fire Control Lockheed Martin Missiles & Fire Control (LM MFC) is a Lockheed Martin business unit based in the Dallas suburb of Grand Prairie, Texas. The unit's offensive and defensive arsenal includes air-to-air and air-to-ground missiles, naval rockets and missiles, fire control and sensor , Stan Arthur, said that simulation-based acquisition "has arrived."
That is false, said O'Bryon. "SBA is here in name. It's only a slogan ... A bumper sticker bumper sticker
A sticker bearing a printed message for display on a vehicle's bumper.
bumper sticker n → Aufkleber m . ... It does not exist." Many people in the industry, he added, "want to declare success. It makes the industry people look good, because they don't spend money testing" the systems.
At the Defense Department, he said, "We are using simulation. But we don't have a simulation-based acquisition system, using simulation systematically. If that were the case, O'Bryon said, huge financial savings could be made.
"We are spending billions of dollars on models and it's not very well organized.
... On the training side, they are more organized than on the acquisition side." Models are used, for example, to replicate the terrain where a weapon system will operate, the atmospheric conditions, the radar signature, among others.
According to according to
1. As stated or indicated by; on the authority of: according to historians.
2. In keeping with: according to instructions.
3. the survey, more than 80 percent of the models used in the 22 programs were unique to that project, and not shared with others. In many cases, the models are owned by contractors, nor by the government.
The problem, said O'Bryon, is that program managers don't have an obvious motivation to invest in modeling and simulation. Most of them are in the job for two or three years, which means that, by the time the models and simulation work is completed, they have moved on to other assignments. "Program managers have a high turnover rate, so they don't want to invest that money, because it will not benefit them in the short term," he said.
Sometimes, program managers prefer to not have realistic models, because they can "make the program look worse," said O'Bryon. The performance of a weapon can deteriorate when factors such as turbulence, terrain or targets are factored in. If the models are "too realistic," said O'Bryon, "the estimates look worse.
Rarely do models help a program "look better," he added. "Realistic models are nor always viewed as a positive thing."
O'Bryon's office has submitted a proposal to the undersecretary of defense for acquisition, technology and logistics, which would help promote the use of SBA. The plan is called MASTER (modeling and simulation, test and evaluation reform).
The plan is built on the premise that there is "virtually no new money" for modeling and simulation. The funds would have to be taken from other areas within program budgets. The program managers, said O'Bryon, "control most of the money that could be spent on modeling and simulation."
O'Bryon is proposing the creation of a "modeling and simulation consortium," which would be funded by "negotiable NEGOTIABLE. That which is capable of being transferred by assignment; a thing, the title to which may be transferred by a sale and indorsement or delivery.
2. arrangements with program managers, who would contribute to the consortium." The consortium would help the program managers advance their projects through the use of SBA and would encourage them to share models, when possible.
"Program managers typically need modeling support," said O'Bryon. Most frequently, he said, they need models to simulate missile or aircraft aerodynamics aerodynamics, study of gases in motion. As the principal application of aerodynamics is the design of aircraft, air is the gas with which the science is most concerned. , atmospheric conditions, target signatures and vulnerability.
Under the current way of doing business, he said, the program manager typically pays for models that already have been paid for by someone else. "The consortium would help save money and duplication," said O'Bryon.
The government agency that would oversee the consortium, he said, is the Defense Modeling and Simulation Office The Defense Modeling and Simulation Office is "the catalyst organization for Department of Defense modeling and simulation and ensures that modeling and simulation technology development is consistent with other related initiatives." External links
Dimethyl sulfoxide; a colorless hygroscopic liquid obtained from lignin, used as a penetrant to convey medications into the tissues.
n. would maintain and chair the consortium," said O'Bryon. Currently, "DMSO can't do its job because the program managers control the money. There needs to be a revision of the acquisition policy."
O'Bryon, however, does not advocate the use of modeling and simulation as a substitute for live testing. "Modeling and simulation [technology] has been sold as a cost saver. We can't substitute models for testing, because we don't know Don't know (DK, DKed)
"Don't know the trade." A Street expression used whenever one party lacks knowledge of a trade or receives conflicting instructions from the other party. how to do models yet."
The current acquisition regulations require a modeling and simulation plan for every program, he said. "The money in SBA today is in stovepipes. They don't share" the technology. "They have a disincentive dis·in·cen·tive
Something that prevents or discourages action; a deterrent.
something that discourages someone from behaving or acting in a particular way
Noun 1. to share, because it's their neck. It's not their fault. It's the system."
O'Bryon noted that there is a law--which is not often enforced--that mandates congressional approval for any weapon system-related model that costs more than $50,000. "It's not being complied with," he said. "They are not tracking the law."
Currently, there are three pilot programs in place that will be used to determine whether SBA can work: the Air Force T-38 trainer aircraft avionics upgrade, the Army's common missile and the Navy extended range guided munition The Extended Range Guided Munition is a precision guided rocket-assisted 5-inch artillery shell under development by Raytheon for the U.S. Navy. The developmental round is designated EX 171. Specification
Frank Cappuccio, a Lockheed Martin For the former company, see .
Lockheed Martin (NYSE: LMT) is a leading multinational aerospace manufacturer and advanced technology company formed in 1995 by the merger of Lockheed Corporation with Martin Marietta. vice president who works on the Joint Strike Fighter program The Joint Strike Fighter (JSF) became synonymous with the later F-35 Lightning II, however until 2001 the term was applied to the competition between the Boeing X-32 and Lockheed Martin X-35. , agreed that there is "a lot of rhetoric" about simulation-based acquisition. However, he said, "the savings are there."
During an SBA conference sponsored by the National Defense Industrial Association, Cappuccio said that the Joint Strike Fighter program achieved a 50 percent savings in "engineering, acquisition life-cycle time and cost." The savings, he said, "were incorporated into our [JSF] proposal bid."
The implementation of SBA, he cautioned, is a process with "numerous minefields." The biggest obstacle, he said, comes from the financial department. "SBA will test everyone's resolve," said Cappuccio. "If you have the resolve, you can convince your finance people to pass the savings to the government."
For SBA to work, he said, "it takes a consistent vision from the government." In the JSF program, that was possible because the program manager, Marine Maj. Gen. Michael Hough n. 1. Same as Hock, a joint.
v. t. 1. Same as Hock, to hamstring.
imp. & p. p. os>
p. pr. & vb. n. os>
n. 1. An adz; a hoe.
v. t. 1. To cut with a hoe. , is an advocate of the use of simulation and made sure it was implemented.
"A good vision is not sufficient," said Cappuccio. "You need pressure for change. ... This is something you have to do to be competitive."
Government leaders must decide, he said, whether the replacement of hardware testing with simulations ever will be accepted.
"Which company will take the first step to tell the government to not shoot an aircraft with a 20 mm cannon, that I am going to do it with modeling and simulation?" Cappuccio asked the audience at the conference. "It's not enough for program managers to champion SBA."
In the JSF program, both contractors--Lockheed Martin and Boeing--had an incentive to use modeling and simulation to cut costs, because it would make their proposals more competitive. But unless there is a competition, said Cappuccio, there are "no financial rewards for industry to cut costs. ... In something that is not a competition, it would be a smaller bill and higher risk."
For SBA to take hold, he said, "the government has to be a partner" and accept that models can offer legitimate testing tools.
Another issue the government must address, he said, is how to protect industry's proprietary data. "There is no trust in our industry," he said, because "government people give away the data in competitions."
There is an "entrenched en·trench also in·trench
v. en·trenched, en·trench·ing, en·trench·es
1. To provide with a trench, especially for the purpose of fortifying or defending.
2. belief in the financial community that proprietary data is what makes a company unique," said Cappuccio. The JSF school of thought is different, because "we give up proprietary data" to the government.
It's an emotional issue to those who believe that if the government takes proprietary data, "it is going to take away from the identity of the company." However, "we do it for national security reasons."
In those programs that require interoperability, "it would make sense to develop a standard for SBA. Industry would rally to it quickly," said Cappuccio. "We have done it before, for avionics standards."
The 1553 data bus standard was developed, he noted, "because every company was fed up with incompatibility The inability of a Husband and Wife to cohabit in a marital relationship.
incompatibility n. the state of a marriage in which the spouses no longer have the mutual desire to live together and/or stay married, and is thus a ground for divorce . ... When it's in your best financial interest to share data and have common standards, you'll pull it off."
Philip W. Cheney, Raytheon vice president of engineering, said that SBA does not offer any significant return on investment. "It's a continuing squeeze on company resources," he told the conference. "SBA implementation is unique within each service, and at times, within individual program offices." The defense industry, he said, "lacks the ability and incentive to share proprietary data."
Air Force Lt. Gen. Leslie Kenne Lieutenant General Leslie F. Kenne, United States Air Force was up to her retirement on 1 September 2003 Deputy Chief of Staff for Warfighting Integration, for the United States Air Force. , commander of the Electronic Systems Center, said during the conference that she is a "zealot" about SBA. "If we don't really invest in it, we are not going to get where we need to be."
Predicting Network Performance Can Save Millions
Sandra I. Erwin
Organizations looking to invest millions of dollars in a new communications network The transmission channels interconnecting all client and server stations as well as all supporting hardware and software. would be wise to develop a digital model of the system before they commit to major hardware purchases. Although this advice seems common sense, an expert said, it is surprising how many companies and government agencies agree to buy new networks without really knowing if they will work properly and meet their needs.
"When you are spending hundreds of millions of dollars on a system, spending a small percentage on a simulation can help avoid making a large mistake," said Robert F. Brammer, chief technology office at TASC TASC The After School Corporation
TASC The American Surrogacy Center
TASC Treatment Accountability for Safer Communities
TASC The Analytic Sciences Corporation
TASC Transportation Administrative Service Center
TASC Total Administrative Services Corporation , a division of Northrop Grumman Northrop Grumman Corporation (NYSE: NOC) is an aerospace and defense conglomerate that is the result of the 1994 purchase of Grumman by Northrop. The company is the third largest defense contractor for the U.S. Corp.
The company specializes in government and defense-related information systems and analysis services. It has spent corporate research dollars recently to come up with modeling technologies to simulate communications networks and signals processing.
"There are several U.S. federal customers in sight" for this technology, Brammer said in an interview. Projects currently underway include communications network models for commercial satellite firms, he said. The modeling covers the network's basic physical layer-predicting signal-to-noise ratios The ratio of the power or volume (amplitude) of a signal to the amount of unwanted interference (the noise) that has mixed in with it. Measured in decibels, signal-to-noise ratio (SNR or S/N) measures the clarity of the signal in a circuit or a wired or wireless transmission channel. and achievable data rates in various types of environments. The communications take place via the Internet, by wireless terrestrial channels and by space-to-ground channels.
"We worry about the fundamental physical communications channel Also called a "circuit" or "line," it is a pathway over which data are transferred between remote devices. It may refer to the entire physical medium, such as a telephone line, optical fiber, coaxial cable or twisted wire pair, or, it may refer to one of several carrier frequencies and network issues [such as] computer-to-computer protocols and information security" that have to be included in the model, said Brammer.
Models are done for different purposes, he explained. "In some cases, you want to be able to predict the performance of a communications system In telecommunication, a communications system is a collection of individual communications networks, transmission systems, relay stations, tributary stations, and data terminal equipment (DTE) usually capable of interconnection and interoperation to form an integrated whole. or network that a customer wants to build." In other instances, customers want to predict the network's performance in various environmental conditions.
"In other cases, they already have a network, so we build a detailed model. In the event of an outage out·age
1. A quantity or portion of something lacking after delivery or storage.
2. A temporary suspension of operation, especially of electric power. or emergency, we can help with tactical planning of how to restore services," Brammer said. "There are number of reasons for the simulation models."
High-fidelity models can predict failures, such as bottlenecks in transmission, bandwidth availability and whether there is enough computational power, he said. "They may be interested in trading performance vs. security." That means they must decide how to transmit information at different levels of security through a network. "you have to make sure that only the people who are authorized to get the information can get it quickly and easily," said Brammer. "That is easy to say, but very difficult to do in practice."
Modeling of computer attacks is done frequently, he said. "Some of these attacks have been well coordinated, involving thousands of computers. So we have to be able to model what might happen and what to do about it."
The challenge for the industry, he said, is to "understand how threats to the performance of communications systems are changing as a result of rapid changes in computing and communications technology Noun 1. communications technology - the activity of designing and constructing and maintaining communication systems
engineering, technology - the practical application of science to commerce or industry ." At the same time, he added, "a lot of the technology is so new and relatively immature, so there are security issues that you have to be careful about."
In information security, Brammer said, "we have a lot of learning to do."