Abstract
Nonlinear dynamical system optimization problems exist in many scientific fields, ranging from computer vision to quantitative finance. In these problems, the underlying optimized parameters exhibit a certain degree of continuity, which can be formulated as a discrete sequence of nonlinear functions. Traditionally, such problems are either solved by ad-hoc algorithms or via independent optimization of the underlying functions. The former solutions are difficult to define and develop, requiring expertise in the field, while the latter approach does not take advantage of the inherent sequential properties of the functions. This paper presents a parallel spline-based algorithm for nonlinear optimization of function sequences, with emphasis on dataset sequences that represent dynamically evolving systems. The presented algorithm provides results that are more coherent with fewer evaluations than independent optimization of the sequence functions. We elaborate on the heuristic approach, the motivation behind using splines to model dynamical systems, and the various tiers of concurrency built into the algorithm. Furthermore, we present two distributed variants of the algorithm and compare their convergence with the serial version. The performance of the algorithm is demonstrated on benchmarks and real-world problems in audio signal decomposition, small angle X-ray scattering analysis, and video tracking of arbitrary objects.
Original language | American English |
---|---|
Pages (from-to) | 132-145 |
Number of pages | 14 |
Journal | Journal of Parallel and Distributed Computing |
Volume | 93-94 |
DOIs | |
State | Published - 1 Jul 2016 |
Bibliographical note
Funding Information:This research was supported by the Ministry of Science and Technology, Israel ; the Israel Science Foundation (Grant #1372/13 ); and the US-Israel Binational Science Foundation (Grant #2009271 ). The authors wish to thank the anonymous reviewers for their constructive comments and suggestions.
Publisher Copyright:
© 2016 Elsevier Inc.
Keywords
- Curve fitting
- Dynamical systems
- Nonlinear optimization
- Parallel optimization