Port-Hamiltonian Approach to Neural Network Training

Stefano Massaroli, Michael Poli, F. Califano, Angela Faragasso, Jinkyoo Park, Atsushi Yamashita, Hajime Asama

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Neural networks are discrete entities: subdivided into discrete layers and parametrized by weights which are iteratively optimized via difference equations. Recent work proposes networks with layer outputs which are no longer quantized but are solutions of an ordinary differential equation (ODE); however, these networks are still optimized via discrete methods (e.g. gradient descent). In this paper, we explore a different direction: namely, we propose a novel framework for learning in which the parameters themselves are solutions of ODEs. By viewing the optimization process as the evolution of a port-Hamiltonian system, we can ensure convergence to a minimum of the objective function. Numerical experiments have been performed to show the validity and effectiveness of the proposed methods.

Original languageEnglish
Title of host publication2019 IEEE 58th Conference on Decision and Control, CDC 2019
PublisherIEEE
Pages6799-6806
Number of pages8
ISBN (Electronic)9781728113982
DOIs
Publication statusPublished - Dec 2019
Event58th IEEE Conference on Decision and Control, CDC 2019 - Nice Acropolis, Nice, France
Duration: 11 Dec 201913 Dec 2019
Conference number: 58
https://cdc2019.ieeecss.org/

Publication series

NameProceedings of the IEEE Conference on Decision and Control
Volume2019-December
ISSN (Print)0743-1546

Conference

Conference58th IEEE Conference on Decision and Control, CDC 2019
Abbreviated titleCDC 2019
CountryFrance
CityNice
Period11/12/1913/12/19
Internet address

Fingerprint

Dive into the research topics of 'Port-Hamiltonian Approach to Neural Network Training'. Together they form a unique fingerprint.

Cite this