Intelligent Systems


2022


no image
On Constraints in First-Order Optimization: A View from Non-Smooth Dynamical Systems

Muehlebach, M., Jordan, M. I.

Journal of Machine Learning Research, 2022 (article)

Abstract
We introduce a class of first-order methods for smooth constrained optimization that are based on an analogy to non-smooth dynamical systems. Two distinctive features of our approach are that (i) projections or optimizations over the entire feasible set are avoided, in stark contrast to projected gradient methods or the Frank-Wolfe method, and (ii) iterates are allowed to become infeasible, which differs from active set or feasible direction methods, where the descent motion stops as soon as a new constraint is encountered. The resulting algorithmic procedure is simple to implement even when constraints are nonlinear, and is suitable for large-scale constrained optimization problems in which the feasible set fails to have a simple structure. The key underlying idea is that constraints are expressed in terms of velocities instead of positions, which has the algorithmic consequence that optimizations over feasible sets at each iteration are replaced with optimizations over local, sparse convex approximations. The result is a simplified suite of algorithms and an expanded range of possible applications in machine learning.

link (url) [BibTex]

2021


no image
Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives

Muehlebach, M., Jordan, M. I.

Journal of Machine Learning Research, 22(73):1-50, 2021 (article)

link (url) [BibTex]

2021

link (url) [BibTex]

2020


no image
Learning-based parametrized model predictive control for trajectory tracking

Sferrazza, C., Muehlebach, M., D’Andrea, R.

Optimal Control Application and Methods, 41(6):2225-2249, 2020 (article) In preparation

DOI [BibTex]

2020

DOI [BibTex]

2019


no image
A Method for Reducing the Complexity of Model Predictive Control in Robotics Applications

Muehlebach, M., D’Andrea, R.

IEEE Robotics and Automation Letters, 2019, 2019 (article)

link (url) [BibTex]

2019


no image
Accelerometer-Based Tilt Determination for Rigid Bodies with a Non-Accelerated Pivot Point

Muehlebach, M., D’Andrea, R.

IEEE Transactions on Control Systems Technology, 2018 (article)

[BibTex]

[BibTex]

2016


no image
Variational Integrators - A Continuous Time Approach

Muehlebach, M., Heimsch, T., Glocker, C.

International Journal for Numerical Methods in Engineering, 2016 (article)

[BibTex]

2016

[BibTex]


no image
Nonlinear Analysis and Control of a Reaction Wheel-based 3-D Inverted Pendulum

Muehlebach, M., D’Andrea, R.

IEEE Transactions on Control Systems Technology, 25(1): 235-246, 2016 (article)

[BibTex]

[BibTex]

2014


no image
A Fan-based Low-frequent Forced Oscillation Technique Apparatus

Maes, H., Vandersteen, G., Muehlebach, M., Ionescu, C.

IEEE Transactions on Instrumentation and Measurements, 2014 (article)

[BibTex]

2014

[BibTex]