We study the problem of learning a binary classifier on the vertices of a graph. In particular, we consider classifiers given by monophonic halfspaces, partitions of the vertices that are convex in a certain abstract sense. Monophonic halfspaces, and related notions such as geodesic halfspaces, have recently attracted interest, and several connections have been drawn between their properties (e.g., their VC dimension) and the structure of the underlying graph G. We prove several novel results for learning monophonic halfspaces in the supervised, online, and active settings. Our main result is that a monophonic halfspace can be learned with near-optimal passive sample complexity in time polynomial in n = |V (G)|. This requires us to devise a polynomial-time algorithm for consistent hypothesis checking, based on several structural insights on monophonic halfspaces and on a reduction to 2-satisfiability. We prove similar results for the online and active settings. We also show that the concept class can be enumerated with delay poly(n), and that empirical risk minimization can be performed in time 2ω(G) poly(n) where ω(G) is the clique number of G. These results answer open questions from the literature (Gonz´alez et al., 2020), and show a contrast with geodesic halfspaces, for which some of the said problems are NP-hard (Seiffarth et al., 2023).

Efficient Algorithms for Learning Monophonic Halfspaces in Graphs / M. Bressan, E. Esposito, M. Thiessen (PROCEEDINGS OF MACHINE LEARNING RESEARCH). - In: The Thirty Seventh Annual Conference on Learning Theory / [a cura di] S. Agrawal, A. Roth. - [s.l] : ML Research Press, 2024. - pp. 669-696 (( Intervento presentato al 37. convegno Conference on Learning Theory tenutosi a Edmonton nel 2024.

Efficient Algorithms for Learning Monophonic Halfspaces in Graphs

M. Bressan;E. Esposito;
2024

Abstract

We study the problem of learning a binary classifier on the vertices of a graph. In particular, we consider classifiers given by monophonic halfspaces, partitions of the vertices that are convex in a certain abstract sense. Monophonic halfspaces, and related notions such as geodesic halfspaces, have recently attracted interest, and several connections have been drawn between their properties (e.g., their VC dimension) and the structure of the underlying graph G. We prove several novel results for learning monophonic halfspaces in the supervised, online, and active settings. Our main result is that a monophonic halfspace can be learned with near-optimal passive sample complexity in time polynomial in n = |V (G)|. This requires us to devise a polynomial-time algorithm for consistent hypothesis checking, based on several structural insights on monophonic halfspaces and on a reduction to 2-satisfiability. We prove similar results for the online and active settings. We also show that the concept class can be enumerated with delay poly(n), and that empirical risk minimization can be performed in time 2ω(G) poly(n) where ω(G) is the clique number of G. These results answer open questions from the literature (Gonz´alez et al., 2020), and show a contrast with geodesic halfspaces, for which some of the said problems are NP-hard (Seiffarth et al., 2023).
active learning; graph convexity; online learning; polynomial time
Settore IINF-05/A - Sistemi di elaborazione delle informazioni
Settore INFO-01/A - Informatica
2024
https://proceedings.mlr.press/v247/bressan24b.html
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
bressan24b.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 382.63 kB
Formato Adobe PDF
382.63 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1118635
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact