Spline-based parallel nonlinear optimization of function sequences

Tal Ben-Nun*, Amnon Barak, Uri Raviv

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

Nonlinear dynamical system optimization problems exist in many scientific fields, ranging from computer vision to quantitative finance. In these problems, the underlying optimized parameters exhibit a certain degree of continuity, which can be formulated as a discrete sequence of nonlinear functions. Traditionally, such problems are either solved by ad-hoc algorithms or via independent optimization of the underlying functions. The former solutions are difficult to define and develop, requiring expertise in the field, while the latter approach does not take advantage of the inherent sequential properties of the functions. This paper presents a parallel spline-based algorithm for nonlinear optimization of function sequences, with emphasis on dataset sequences that represent dynamically evolving systems. The presented algorithm provides results that are more coherent with fewer evaluations than independent optimization of the sequence functions. We elaborate on the heuristic approach, the motivation behind using splines to model dynamical systems, and the various tiers of concurrency built into the algorithm. Furthermore, we present two distributed variants of the algorithm and compare their convergence with the serial version. The performance of the algorithm is demonstrated on benchmarks and real-world problems in audio signal decomposition, small angle X-ray scattering analysis, and video tracking of arbitrary objects.

Original languageAmerican English
Pages (from-to)132-145
Number of pages14
JournalJournal of Parallel and Distributed Computing
Volume93-94
DOIs
StatePublished - 1 Jul 2016

Bibliographical note

Funding Information:
This research was supported by the Ministry of Science and Technology, Israel ; the Israel Science Foundation (Grant #1372/13 ); and the US-Israel Binational Science Foundation (Grant #2009271 ). The authors wish to thank the anonymous reviewers for their constructive comments and suggestions.

Publisher Copyright:
© 2016 Elsevier Inc.

Keywords

  • Curve fitting
  • Dynamical systems
  • Nonlinear optimization
  • Parallel optimization

Fingerprint

Dive into the research topics of 'Spline-based parallel nonlinear optimization of function sequences'. Together they form a unique fingerprint.

Cite this