Abstract
This paper analyzes optimal control problems with linear time-varying dynamics defined on a smooth manifold in addition to mixed constraints and pure control constraints. The main contribution is the identification of sufficient conditions for the optimal controls to be non-singular, which enables exact (or lossless) convex relaxations of the control constraints. The problem is analyzed in a geometric framework using a recent maximum principle on manifolds, and it is shown that strong observability of the dual system on the cotangent space is the key condition. Two minimum time problems are analyzed and solved. A minimum fuel planetary descent problem is then analyzed and relaxed to a convex form. Convexity enables its efficient solution in less than one second without any initial guess.
Similar content being viewed by others
References
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. (2013). Vision–based state estimation and trajectory control towards high–speed flight with a quadrotor. In: Proceedings of Robotics: Science and Systems. Berlin, Germany. https://doi.org/10.15607/RSS.2013.IX.032.
Watterson, M., Liu, S., Sun, K., Smith, T., & Kumar, V. (2018). Trajectory optimization on manifolds with applications to SO(3) and \(\mathbb{R}^3 \times S^2\). In: Proceedings of Robotics: Science and Systems. Pittsburgh, PA, USA. https://doi.org/10.15607/RSS.2018.XIV.023.
Augugliaro, F., Schoellig, A. P., & D’Andrea, R. (2012). Generation of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Vilamoura-Algarve, Portugal. https://doi.org/10.1109/IROS.2012.6385823.
Mellinger, D., Michael, N., & Kumar, V. (2012). Trajectory generation and control for precise aggresive maneuvers with quadrotors. International Journal of Robotics Research, 31(5), 664–674.
Dueri, D., Açıkmeşe, B., Scharf, D., & Harris, M. W. (2017). Customized real-time interior-point method for onboard powered descent guidance. Journal of Guidance, Control and Dynamics, 40(2), 197–212.
Harris, M. W., & Açıkmeşe, B. (2013). Maximum divert for planetary landing using convex optimization. Journal of Optimization Theory and Applications, 162(3), 975–995.
Lu, P., & Liu, X. (2013). Autonomous trajectory planning for rendezvous and proximity operations by conic optimization. Journal of Guidance, Control, and Dynamics, 36(2), 375–389.
Harris, M. W., & Açıkmeşe, B. (2014). Minimum time rendezvous of multiple spacecraft using differential drag. Journal of Guidance, Control, and Dynamics, 37(2), 365–373.
Shuster, S., Geller, D.K., & Harris, M.W.(2020). Analytic impulsive maneuver sequences for nominal safety ellipse reconfigurations. Journal of Guidance, Control, and Dynamics, 43(10). https://doi.org/10.2514/1.G005009.
Malyuta, D., & Açıkmeşe, B. (2020). Lossless convexification of optimal control problems with semi-continuous inputs. IFAC-PapersOnLine, 53(2), 6843–6850.
Krener, A. J. (1977). The high order maximal principle and its application to singular extremals. SIAM Journal on Control and Optimization, 15(2), 256–293.
Foroozandeh, Z., do rosário de Pinho, M., & Shamsi, M. (2019). On numerical methods for singular optimal control problems: An application to an auv problem. Discrete and Continuous Dynamical Systems - B, 24(5), 2219–2235.
Berkovitz, L. D., & Medhin, N. G. (2013). Nonlinear Optimal Control Theory. USA: CRC Press.
Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., & Mischenko, E. F. (1986). The Mathematical Theory of Optimal Processes. USA: Gordon and Breach Science Publishers.
Athans, M., & Falb, P. L. (1966). Optimal Control: An Introduction to the Theory and Its Applications. USA: McGraw-Hill.
Harris, W. M. (2021). Optimal control on disconnected sets using extreme point relaxations and normality approximations. IEEE Transactions on Automatic Control, 66(12), 6063–6070.
Woodford, N., & Harris, M.W. (2022). Geometric properties of time optimal controls with state constraints using strong observability. IEEE Transactions on Automatic Control, 67(12). https://doi.org/10.1109/TAC.2021.3134627.
Vandenberghe, L., & Boyd, S. (1996). Semidefinite programming. SIAM Review, 38(1), 49–95.
Nesterov, Y., & Nemirovsky, A. (1994). Interior-point Polynomial Methods in Convex Programming. USA: SIAM.
Boyd, S., & Vandenberghe, L. (2004). Convex Optimization. USA: Cambridge University Press.
Mattingley, J., & Boyd, S. (2012). Cvxgen-a code generator for embedded convex optimization. Optimization and Engineering, 13, 1–27.
Blackmore, L. (2016). Autonomous precision landing of space rockets. The Bridge, 4(46).
Açıkmeşe, B., & Ploen, S. R. (2007). Convex programming approach to powered descent guidance for mars landing. AIAA Journal of Guidance, Control and Dynamics, 30, 1353–1366.
Açıkmeşe, B., & Blackmore, L. (2011). Lossless convexification for a class of optimal control problems with nonconvex control constraints. Automatica, 47, 341–347.
Kunhippurayil, S., Harris, M.W., & Jansson, O. (2021). Lossless convexification of optimal control problems with annular control constraints. Automatica, 133. https://doi.org/10.1016/j.automatica.2021.109848.
Blackmore, L., Açıkmeşe, B., & Carson, J. M. (2012). Lossless convexification of control constraints for a class of nonlinear optimal control problems. Automatica, 61, 863–870.
Harris, M.W., & Açıkmeşe, B. (2013). Lossless convexification for a class of optimal control problems with linear state constraints. In: IEEE Conferencce on Decision and Control. Florence, Italy. https://doi.org/10.1109/CDC.2013.6761017.
Harris, M.W., & Açıkmeşe, B. (2013). Lossless convexification for a class of optimal control problems with quadratic state constraints. In: American Control Conference. Washington, DC, USA. https://doi.org/10.1109/ACC.2013.6580359.
Harris, M. W., & Açıkmeşe, B. (2014). Lossless convexification of non-convex optimal control problems for state constrained linear systems. Automatica, 50, 2304–2311.
Bonalli, R. (2018). Optimal Control of Aerospace Systems with Control-State Constraints and Delays. Sorbonne Université, UPMC University of Paris 6, ONERA–The French Aerospace Lab, Paris, France.
Tranninger, M., Seeber, R., Steinberger, M., & Horn, M. (2019). Exact state reconstruction for lti-systems with non-differentiable unknown inputs. In: 2019 18th European Control Conference (ECC), pp. 3096–3102. Naples, Italy.
Kratz, W., & Liebscher, D. (1998). A local characterization of observability. Linear Algebra and Its Applications, 269, 115–137.
Alenezi, B., Zhang, M., Hui, S., & Żak, S. H. (2021). Simultaneous estimation of the state, unknown input, and output disturbance in discrete-time linear systems. IEEE Transactions on Automatic Control, 66(12), 6115–6122.
Dai, L. (1989). Singular Control Systems. USA: Springer.
Zuo, Z., Luo, Q., & Wang, Y. (2017). Stabilization of linear systems with direct feedthrough term in the presence of output saturation. Automatica, 77, 254–258.
Hernandez, D., Bejarano, F. J., Davila, J., & Fridman, L. M. (2019). On the strong observability in linear time-varying singular systems. Automatica, 101, 60–65.
Rios, H., Davila, J., & Teel, A. R. (2020). Linear hybrid systems with periodic jumps: A notion of strong observability and strong detectability. IEEE Transactions on Automatic Control, 65(6), 2640–2646.
Martinelli, A. (2019). Nonlinear unknown input observability: Extension of the observability rank condition. IEEE Transactions on Automatic Control, 64, 222–237.
Falkensteiner, R., Seeber, R., & Horn, M. (2021). Distance measures for strong observability and strong detectability of systems with direct feedthrough. IEEE Control Systems Letters, 5(2), 565–570.
Falkensteiner, R., Seeber, R., & Horn, M. (2022). A trisection algorithm for estimating distance measures for strong observability and strong detectabiligy. IEEE Transactions on Automatic Control, 1–1. https://doi.org/10.1109/TAC.2022.3142120.
Lee, E. B., & Markus, L. (1967). Foundations of Optimal Control Theory. USA: John Wiley and Sons Inc.
Trentelman, H. L., Stoorvogel, A. A., & Hautus, M. (2001). Control Theory for Linear Systems. USA: Springer.
Milyutin, A. A., & Osmolovskii, N. P. (1998). Calculus of Variations and Optimal Control. USA: American Mathematical Society.
Hartl, R. F., Sethi, S. P., & Vickson, R. G. (1995). A survey of the maximum principles for optimal control problems with state constraints. SIAM Review, 37(2), 181–218.
Lofberg, J. (2004). Yalmip: A toolbox for modeling and optimization in MATLAB. In: IEEE International Conference on Robotics and Automation. Taipei, Taiwan. https://doi.org/10.1109/CACSD.2004.1393890.
Toh, K. C., Todd, M. J., & Tutuncu, R. H. (1999). SDPT3–A Matlab software package for semidefinite programming. Optimization Methods and Software, 11, 645–681.
MATLAB 2019a. The Mathworks, Inc. (2019)
Author information
Authors and Affiliations
Corresponding author
Additional information
The second author was partially funded by ONR Grant N00014-22-1-2131.
A Numerical solution method
A Numerical solution method
To numerically solve the infinite-dimensional problem P0, it is converted to a finite-dimensional parameter optimization problem. This is done by discretizing the problem and enforcing the constraints at the nodes. Note that the constraints in all of the examples are first or second-order cone constraints. Therefore, the resulting problems after discretization are finite-dimensional second-order cone programs that can be solved to global optimality using the powerful interior-point methods in convex optimization. We use a simple discretization method which is summarized below.
The time domain \([0,t_f]\) is discretized into \(N+1\) nodes separated by \(\Delta t\).
The states at time \(t_i\) are denoted by x[i] and they exist at all nodes \(i=1,\dots , N+1\). The controls at time \(t_i\) are denoted by u[i] and they exist at nodes \(i = 1,\dots ,N\). The controls are held constant over every interval. The system dynamics are discretized using the fundamental matrix resulting in
where \(\varPhi _i\) and \(\varGamma _i\) are matrices given by
The integral cost can be approximated by using any numerical integration technique, e.g., trapezoidal integration:
All other constraints are enforced at the nodes. For example, control constraints are written as
The result is a finite-dimensional approximation to the infinite-dimensional optimal control problem. For free final time problems, a line search is conducted to find the N giving the least objective.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kunhippurayil, S., Harris, M.W. Strong observability as a sufficient condition for non-singularity and lossless convexification in optimal control with mixed constraints. Control Theory Technol. 20, 475–487 (2022). https://doi.org/10.1007/s11768-022-00115-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11768-022-00115-w