Lost and Found: How Self-Supervised Learning Helps GPS Coordinates Find Their Way

Nicolas Bougie, Daria Vazhenina, Narimasa Watanabe
Proceedings of the 15th Asian Conference on Machine Learning, PMLR 222:185-200, 2024.

Abstract

GPS coordinates are a fundamental aspect of location-based applications, yet prior methods for representing them do not fully capture the intricate relationships between different locations. In this paper, we propose a novel map-based approach to embedding GPS coordinates using self-supervised learning. Unlike most prior studies that directly embed GPS coordinates to a latent space, we leverage a map-based approach, allowing embeddings to capture geographical and economic features. Namely, we use a student-teacher architecture, where a student network is trained to mimic the outputs of the teacher, using two different augmented versions of the same input. To capture the rich underlying semantics of GPS coordinates, we further leverage auxiliary tasks including \textit{geo} prediction, high-level reconstruction, and intermediate clustering. The intermediate clustering loss facilitates learning features at different levels of granularity, while the high-level reconstruction loss encourages “local-to-global” correspondences. We evaluate our method on a large-scale dataset of GPS coordinates and demonstrate that it outperforms several baseline methods in terms of the quality of the learned embeddings. Moreover, we show the usefulness of our embeddings in various downstream tasks, such as predicting land price, land cover type, or water quality indice.

Cite this Paper


BibTeX
@InProceedings{pmlr-v222-bougie24a, title = {{Lost and Found}: {H}ow Self-Supervised Learning Helps {GPS} Coordinates Find Their Way}, author = {Bougie, Nicolas and Vazhenina, Daria and Watanabe, Narimasa}, booktitle = {Proceedings of the 15th Asian Conference on Machine Learning}, pages = {185--200}, year = {2024}, editor = {Yanıkoğlu, Berrin and Buntine, Wray}, volume = {222}, series = {Proceedings of Machine Learning Research}, month = {11--14 Nov}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v222/bougie24a/bougie24a.pdf}, url = {https://proceedings.mlr.press/v222/bougie24a.html}, abstract = {GPS coordinates are a fundamental aspect of location-based applications, yet prior methods for representing them do not fully capture the intricate relationships between different locations. In this paper, we propose a novel map-based approach to embedding GPS coordinates using self-supervised learning. Unlike most prior studies that directly embed GPS coordinates to a latent space, we leverage a map-based approach, allowing embeddings to capture geographical and economic features. Namely, we use a student-teacher architecture, where a student network is trained to mimic the outputs of the teacher, using two different augmented versions of the same input. To capture the rich underlying semantics of GPS coordinates, we further leverage auxiliary tasks including \textit{geo} prediction, high-level reconstruction, and intermediate clustering. The intermediate clustering loss facilitates learning features at different levels of granularity, while the high-level reconstruction loss encourages “local-to-global” correspondences. We evaluate our method on a large-scale dataset of GPS coordinates and demonstrate that it outperforms several baseline methods in terms of the quality of the learned embeddings. Moreover, we show the usefulness of our embeddings in various downstream tasks, such as predicting land price, land cover type, or water quality indice.} }
Endnote
%0 Conference Paper %T Lost and Found: How Self-Supervised Learning Helps GPS Coordinates Find Their Way %A Nicolas Bougie %A Daria Vazhenina %A Narimasa Watanabe %B Proceedings of the 15th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2024 %E Berrin Yanıkoğlu %E Wray Buntine %F pmlr-v222-bougie24a %I PMLR %P 185--200 %U https://proceedings.mlr.press/v222/bougie24a.html %V 222 %X GPS coordinates are a fundamental aspect of location-based applications, yet prior methods for representing them do not fully capture the intricate relationships between different locations. In this paper, we propose a novel map-based approach to embedding GPS coordinates using self-supervised learning. Unlike most prior studies that directly embed GPS coordinates to a latent space, we leverage a map-based approach, allowing embeddings to capture geographical and economic features. Namely, we use a student-teacher architecture, where a student network is trained to mimic the outputs of the teacher, using two different augmented versions of the same input. To capture the rich underlying semantics of GPS coordinates, we further leverage auxiliary tasks including \textit{geo} prediction, high-level reconstruction, and intermediate clustering. The intermediate clustering loss facilitates learning features at different levels of granularity, while the high-level reconstruction loss encourages “local-to-global” correspondences. We evaluate our method on a large-scale dataset of GPS coordinates and demonstrate that it outperforms several baseline methods in terms of the quality of the learned embeddings. Moreover, we show the usefulness of our embeddings in various downstream tasks, such as predicting land price, land cover type, or water quality indice.
APA
Bougie, N., Vazhenina, D. & Watanabe, N.. (2024). Lost and Found: How Self-Supervised Learning Helps GPS Coordinates Find Their Way. Proceedings of the 15th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 222:185-200 Available from https://proceedings.mlr.press/v222/bougie24a.html.

Related Material