12.01.2013 Views

A Few Personal Remarks on the Evolution of

A Few Personal Remarks on the Evolution of

A Few Personal Remarks on the Evolution of

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Microwave Journal 50 Year Retrospective Series:<br />

A <str<strong>on</strong>g>Few</str<strong>on</strong>g> <str<strong>on</strong>g>Pers<strong>on</strong>al</str<strong>on</strong>g> <str<strong>on</strong>g>Remarks</str<strong>on</strong>g> <strong>on</strong> <strong>the</strong> Evoluti<strong>on</strong> <strong>of</strong> Computati<strong>on</strong>al<br />

Electromagnetics<br />

Introducti<strong>on</strong><br />

Zoltan J. Cendes<br />

Ans<strong>of</strong>t Corporati<strong>on</strong><br />

Pittsburgh, PA, USA<br />

I remember reading <strong>the</strong> Microwave Journal as a graduate student in <strong>the</strong> Microwave Lab at McGill University in<br />

M<strong>on</strong>treal in 1969. Then, as now, <strong>the</strong> Microwave Journal was filled with articles, observati<strong>on</strong>s and product informati<strong>on</strong><br />

<strong>on</strong> microwave and wireless hardware, although today <strong>the</strong>re are also articles <strong>on</strong> microwave s<strong>of</strong>tware. The graduate<br />

students around me were also building hardware – remote sensing devices, communicati<strong>on</strong> devices, antennas, and<br />

<strong>the</strong> like – but my project was different: I was writing a computer program to model microwave fields.<br />

Computers in 1969 were still primitive. This is an odd statement since <strong>the</strong> electr<strong>on</strong>ic computer was over two decades<br />

old by that time. Yet <strong>the</strong> basic procedure to program a computer had been unchanged for years: in 1969, <strong>on</strong>e still<br />

used punched paper cards to write a computer program and submitted this card deck to a central computer facility.<br />

The memory available <strong>on</strong> <strong>the</strong> mainframe computer was miniscule: <strong>the</strong> IBM 360 mainframe computer, figure 1 at<br />

McGill had 128 Kbytes <strong>of</strong> available main memory. I remember limiting my computati<strong>on</strong>s to solve about a 100 X 100<br />

matrix; anything larger was likely to cause a program overflow.<br />

Figure 1. Researchers (not <strong>the</strong> author) with <strong>the</strong> IBM 360 Mainframe Computer<br />

Since memory was small, <strong>the</strong> early work in computati<strong>on</strong>al electromagnetics focused <strong>on</strong> simple algorithms. Chief<br />

am<strong>on</strong>g <strong>the</strong>se was <strong>the</strong> finite difference method that was simple to program and avoided explicitly storing <strong>the</strong> coefficient<br />

matrix. K. Lee had published <strong>the</strong> finite difference time domain algorithm in 1966. This was all changed by <strong>the</strong> two<br />

pi<strong>on</strong>eering giants <strong>of</strong> computati<strong>on</strong>al electromagnetics, Roger Harringt<strong>on</strong> and Peet Silvester. Pr<strong>of</strong>essor Harringt<strong>on</strong><br />

developed <strong>the</strong> method <strong>of</strong> moments procedure for solving <strong>the</strong> integral form <strong>of</strong> Maxwell’s equati<strong>on</strong>s, while Pr<strong>of</strong>essor<br />

Silvester developed <strong>the</strong> finite element method for solving <strong>the</strong> differential form <strong>of</strong> Maxwell’s equati<strong>on</strong>s.<br />

I was fortunate to join Peet Silvester’s research group in 1969 as his third graduate student and <strong>the</strong> first <strong>on</strong>e to work<br />

<strong>on</strong> finite element methods for microwave engineering. Finite element methods had originated as an efficient procedure<br />

to solve structural engineering problems; Pr<strong>of</strong>essor Silvester was <strong>the</strong> first to apply this method in electrical<br />

1


engineering. In particular, he had just published <strong>the</strong> finite element soluti<strong>on</strong> <strong>of</strong> homogeneous waveguides; my research<br />

project was to extend this work to inhomogeneously loaded dielectric waveguides.<br />

The excitement <strong>of</strong> reaching bey<strong>on</strong>d <strong>the</strong> simple finite difference algorithm and developing new and more efficient<br />

computati<strong>on</strong>al algorithms propelled me forward. Pr<strong>of</strong>essor Silvester was a fountain <strong>of</strong> inspirati<strong>on</strong> and genius and<br />

developed several basic techniques still used in finite element analysis today. Never<strong>the</strong>less, my project failed; <strong>the</strong><br />

procedures I developed at that time are now known to generate unphysical soluti<strong>on</strong>s <strong>of</strong> Maxwell’s’ equati<strong>on</strong>s called<br />

spurious modes. While some <strong>of</strong> <strong>the</strong> soluti<strong>on</strong>s produced by <strong>the</strong> procedure were correct, o<strong>the</strong>rs were not, and since<br />

<strong>the</strong>re was no easy way to tell <strong>the</strong> difference, <strong>the</strong> method was useless. I moved <strong>on</strong> and did my PhD <strong>on</strong> a different topic.<br />

After graduati<strong>on</strong>, I went to work at <strong>the</strong> General Electric Corporate Research and Development Center in Schenectady,<br />

NY. My initial projects were to develop finite element computer programs to simulate <strong>the</strong> behavior <strong>of</strong> large steamturbine<br />

generators and power transformers. The finite element method worked well in <strong>the</strong>se cases, but <strong>on</strong>e day I was<br />

assigned to develop a program to simulate microwave ovens. GE had just come out with <strong>the</strong> Space Saver TM<br />

microwave oven to fit above <strong>the</strong> range in <strong>the</strong> space where <strong>the</strong> ventilati<strong>on</strong> fan used to be. The problem was that <strong>the</strong> thin<br />

vertical dimensi<strong>on</strong> <strong>of</strong> this microwave oven caused highly n<strong>on</strong>-uniform heating; hence <strong>the</strong> need for better understanding<br />

through simulati<strong>on</strong>.<br />

While simulating <strong>the</strong> fields in a 3D microwave oven was significantly different from 2D waveguide analysis, spurious<br />

modes were generated <strong>on</strong>ce again. I was intrigued: while I didn’t understand <strong>the</strong> reas<strong>on</strong> for <strong>the</strong> breakdown <strong>of</strong> <strong>the</strong><br />

applicati<strong>on</strong> <strong>of</strong> finite element methods to microwave engineering at <strong>the</strong> time, I knew <strong>the</strong> answer was important. After all,<br />

ma<strong>the</strong>maticians had proved that <strong>the</strong> finite element method had a higher rate <strong>of</strong> c<strong>on</strong>vergence than did <strong>the</strong> finite<br />

difference method and <strong>the</strong> method had already become <strong>the</strong> method <strong>of</strong> choice for solving structural engineering<br />

problems.<br />

The breakthrough came after I joined Carnegie Mell<strong>on</strong> University in <strong>the</strong> 1980. J. C. Nedelec published a tersely<br />

worded paper in 1980, which examined <strong>the</strong> c<strong>on</strong>tinuity c<strong>on</strong>diti<strong>on</strong>s <strong>on</strong> finite element approximati<strong>on</strong> functi<strong>on</strong> spaces and<br />

showed that <strong>the</strong> electromagnetic approximati<strong>on</strong> space was smaller than had been previously thought. To generate a<br />

practical finite element procedure, at CMU, my graduate student Mike Bart<strong>on</strong> and I developed new types <strong>of</strong> finite<br />

element within <strong>the</strong> Nedelec spaces called edge elements that interpolate to <strong>the</strong> tangential comp<strong>on</strong>ents <strong>of</strong> <strong>the</strong> field<br />

al<strong>on</strong>g <strong>the</strong> element edges as shown in Figure 2 (a). We applied <strong>the</strong>se new elements to <strong>the</strong> soluti<strong>on</strong> <strong>of</strong> 3D<br />

magnetostatic field problems in 1986 and showed that <strong>the</strong>y provide correct soluti<strong>on</strong>s. My graduate student Jin-Fa Lee<br />

and I also created <strong>the</strong> higher-order edge elements illustrated in Figure 2 (b).<br />

Figure 2 (a) Edge elements (b) High-order tangential vector finite elements<br />

It remained to show that edge elements solve <strong>the</strong> problem <strong>of</strong> spurious modes that had plagued <strong>the</strong> earlier attempts to<br />

solve microwave field problems with finite element methods. This was d<strong>on</strong>e by my graduate student Steve W<strong>on</strong>g; in<br />

1988 we published <strong>the</strong> key result that edge elements satisfied a property now called discrete compactness which<br />

correctly maps <strong>the</strong> nullspace and <strong>the</strong> range space <strong>of</strong> <strong>the</strong> finite element system. This proved that spurious modes were<br />

eliminated by using edge elements. Although it took many years, with edge elements we are able to model microwave<br />

ovens reliably and accurately.<br />

The 1980’s were also a period <strong>of</strong> entrepreneurial opportunity. The new numerical methods and <strong>the</strong> introducti<strong>on</strong> <strong>of</strong> <strong>the</strong><br />

IBM PC in 1981 led a number <strong>of</strong> my fellow pr<strong>of</strong>essors and researchers to start electromagnetic field simulati<strong>on</strong><br />

2


s<strong>of</strong>tware companies: S<strong>on</strong>net, MAFIA (now CST), Vector Fields, IES, Infolytica, Mags<strong>of</strong>t/Cedrat. I started Ans<strong>of</strong>t in<br />

1984; our first products were for <strong>the</strong> soluti<strong>on</strong> <strong>of</strong> 2D low frequency field problems. Memory was still small by today’s<br />

standards; <strong>the</strong> original PC was limited to 640 Kbytes. By 1988, we had also developed 2D microwave field simulati<strong>on</strong><br />

s<strong>of</strong>tware based <strong>on</strong> <strong>the</strong> new edge elements; we introduced this s<strong>of</strong>tware at a booth at <strong>the</strong> IEEE IMS event in Las Vegas<br />

in 1988. Shortly <strong>the</strong>reafter I was called to Santa Rosa by <strong>the</strong> Hewlett Packard Company to present our approach to<br />

microwave field simulati<strong>on</strong> s<strong>of</strong>tware. This led eventually to an OEM agreement whereby Ans<strong>of</strong>t Corporati<strong>on</strong> developed<br />

<strong>the</strong> High-Frequency Structure Simulator (HFSS) for sale by HP.<br />

Our initial excitement in signing <strong>the</strong> OEM agreement with HP turned into to a crisis for <strong>the</strong> young Ans<strong>of</strong>t. One <strong>of</strong> <strong>the</strong><br />

requirements in <strong>the</strong> agreement was to create s<strong>of</strong>tware that could be used by engineers having little or no experience<br />

with finite element analysis. Since <strong>the</strong> accuracy <strong>of</strong> all electromagnetic field simulati<strong>on</strong> methods depend up<strong>on</strong> <strong>the</strong><br />

discretizati<strong>on</strong> <strong>of</strong> <strong>the</strong> problem, <strong>the</strong> key to making finite element analysis easy to use is to automate <strong>the</strong> mesh generati<strong>on</strong><br />

process. At Carnegie Mell<strong>on</strong>, we had developed algorithms for adaptive mesh refinement that not <strong>on</strong>ly created <strong>the</strong><br />

mesh automatically but also c<strong>on</strong>centrated <strong>the</strong> mesh refinement according to <strong>the</strong> distributi<strong>on</strong> <strong>of</strong> <strong>the</strong> field. To provide an<br />

optimal allocati<strong>on</strong> <strong>of</strong> resources, and hence high accuracy with a minimal mesh, adaptive mesh refinement generates<br />

small elements in locati<strong>on</strong>s with high field gradients but allows large elements where <strong>the</strong> field is smooth. Figure 3<br />

shows an animati<strong>on</strong> <strong>of</strong> <strong>the</strong> adaptive mesh refinement process for a patch antenna. Not <strong>on</strong>ly is this process automatic<br />

and refines <strong>the</strong> mesh near <strong>the</strong> input trace and <strong>the</strong> edges <strong>of</strong> <strong>the</strong> patch as needed, it also provides a measure <strong>of</strong> <strong>the</strong><br />

error in <strong>the</strong> soluti<strong>on</strong>. As seen in Figure 3, <strong>the</strong> fast frequency sweep <strong>of</strong> <strong>the</strong> input admittance <strong>of</strong> <strong>the</strong> antenna c<strong>on</strong>verges<br />

to <strong>the</strong> exact soluti<strong>on</strong> as <strong>the</strong> mesh is refined.<br />

Figure 3. Adaptive mesh refinement for a patch antenna showing c<strong>on</strong>vergence <strong>of</strong> <strong>the</strong> input admittance as <strong>the</strong> mesh is<br />

refined.<br />

While <strong>the</strong> adaptive mesh refinement algorithm generates outstanding meshes and provides a way to measure soluti<strong>on</strong><br />

c<strong>on</strong>vergence, <strong>the</strong> resulting varying element sizes generate poorly c<strong>on</strong>diti<strong>on</strong>ed finite element matrices. To make HFSS<br />

efficient for shipment <strong>of</strong> HFSS by HP, we had counted <strong>on</strong> using an iterative matrix soluti<strong>on</strong> algorithm. Yet <strong>the</strong>se<br />

iterative matrix soluti<strong>on</strong> algorithms were unreliable with <strong>the</strong> combinati<strong>on</strong> <strong>of</strong> edge elements and adaptive refinement<br />

procedures we had devised. By <strong>the</strong> time we discovered <strong>the</strong> unreliability <strong>of</strong> <strong>the</strong> iterative matrix soluti<strong>on</strong> procedure, we<br />

had essentially bet <strong>the</strong> company <strong>on</strong> HFSS. Almost all <strong>of</strong> our resources were focused <strong>on</strong> developing this product and<br />

little revenue was coming in from o<strong>the</strong>r sources. Finally, after a delay <strong>of</strong> many m<strong>on</strong>ths, we managed to develop a<br />

direct solver that was efficient enough to ship with HFSS, although it was not as efficient as we would have liked.<br />

HFSS v1 shipped in October 1990.<br />

HFSS was introduced to <strong>the</strong> world in <strong>the</strong> Microwave Journal in February 1990 (Figure 4). I remember being thrilled in<br />

seeing <strong>the</strong> work that I had participated in being featured <strong>on</strong> <strong>the</strong> cover <strong>of</strong> <strong>the</strong> leading trade journal I had read since my<br />

graduate student days. The discerning HFSS user will notice that <strong>the</strong> mesh displayed in this cover picture is a regular<br />

mesh from our pre-direct solver days and not <strong>the</strong> adaptive mesh shipped with versi<strong>on</strong> 1 <strong>of</strong> <strong>the</strong> s<strong>of</strong>tware. Many <strong>of</strong><br />

today’s users would also be surprised to learn that <strong>the</strong> simple coax-to-waveguide adapter featured <strong>on</strong> <strong>the</strong> Microwave<br />

Journal cover required 16 hours to solve for a single frequency point <strong>on</strong> a 1990 HP computer. Using HFSS v11 and a<br />

3


modern computer, <strong>the</strong> same adapter solves for 10 frequency points in 3 sec<strong>on</strong>ds today. That’s a near 200,000 to 1<br />

speed-up!<br />

Figure 4. The February 1990 Microwave Journal cover announcing HFSS.<br />

How did HFSS get to be so much faster? Part <strong>of</strong> <strong>the</strong> answer lies in faster hardware – Moore’s Law states that <strong>the</strong><br />

number <strong>of</strong> transistors <strong>on</strong> an IC and c<strong>on</strong>sequently computer hardware performance doubles every 18 m<strong>on</strong>ths – but an<br />

even larger part <strong>of</strong> <strong>the</strong> answer lies in improvements in s<strong>of</strong>tware – we may formulate an analogous law to Moore’s Law<br />

for computati<strong>on</strong>al algorithms, namely <strong>the</strong> speed <strong>of</strong> electromagnetic s<strong>of</strong>tware algorithms doubles every 12 m<strong>on</strong>ths.<br />

HFSS has been made faster in every release. Significant speed improvements have been made in dozens <strong>of</strong><br />

algorithms within HFSS including better adaptive mesh refinement criteria, improved meshing algorithms, superior port<br />

soluti<strong>on</strong>s, and <strong>the</strong> ability to perform broadband fast frequency sweeps. Fast frequency sweeps first appeared in<br />

versi<strong>on</strong> 3 <strong>of</strong> HFSS and provide hundreds <strong>of</strong> frequency points for little more than <strong>the</strong> cost <strong>of</strong> a single frequency soluti<strong>on</strong>.<br />

Our latest HFSS speed-up is a result <strong>of</strong> 17 years <strong>of</strong> research. Ever since our failure to develop a reliable iterative<br />

solver for HFSS v1, we have pursued ideas for achieving this goal. Finally, HFSS v11 shipped last year with an<br />

iterative matrix solver. As Figure 5 shows, <strong>the</strong> growth rate in both computer time and memory grows nearly linearly<br />

with problem size. This means that as you double <strong>the</strong> size <strong>of</strong> a problem, computer time and memory also roughly<br />

doubles. Since storing twice as many numbers requires double <strong>the</strong> memory, this is near optimal performance.<br />

4


Figure 5 (a). FEM Time Scales as N1.0 to N1.3. (b) FEM Memory Scales as N1.0.<br />

The new iterative solver allows massive problems to be solved. Figure 6 shows <strong>the</strong> magnitude <strong>of</strong> <strong>the</strong> electric field in a<br />

dish antenna while Figure 7 shows <strong>the</strong> field and currents generated by a 4 GHz antenna <strong>on</strong> a dr<strong>on</strong>e aircraft. Solving<br />

such large problems is made possible by all <strong>of</strong> <strong>the</strong> speed improvements including <strong>the</strong> iterative solver in HFSS v11.<br />

Figure 6. The magnitude <strong>of</strong> <strong>the</strong> electric field in a dish antenna.<br />

Figure 7. (a) Field and (b) current <strong>on</strong> an airplane from a 4 GHz Antenna<br />

5


Electromagnetic field computati<strong>on</strong> c<strong>on</strong>tinues to evolve. The early days <strong>of</strong> computati<strong>on</strong>al electromagnetics were a<br />

fertile time <strong>of</strong> innovati<strong>on</strong> that set <strong>the</strong> stage for today’s innovati<strong>on</strong>s. While <strong>the</strong> basic algorithms in use today were<br />

developed twenty, thirty or even forty years ago, numerous improvements have been made to <strong>the</strong>se algorithms to<br />

make <strong>the</strong>m faster and more robust. Today’s engineers are used to solving for <strong>the</strong> electromagnetic fields from entire<br />

airplanes or complex antenna structures. Such soluti<strong>on</strong>s would have been impossible just 5 years ago. Microwave<br />

engineers now have <strong>the</strong> ability to solve 3D microwave field problems easily and efficiently. The world <strong>of</strong> high frequency<br />

design is forever changed and <strong>the</strong> Microwave Journal was <strong>the</strong>re from <strong>the</strong> beginning and c<strong>on</strong>tinues to communicate <strong>the</strong><br />

evoluti<strong>on</strong> <strong>of</strong> computati<strong>on</strong>al electromagnetics.<br />

6

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!