Arnaud Pannatier

About me

Hi ! I'm Arnaud. I started my PhD in François Fleuret's Machine Learning group in March 2020. I am trying to forecast wind at high-altitude based on live data. Current forecasts given by National Weather agencies are too sparse in time and space to be reliable to manage air traffic. We are trying to solve that problem by nowcast the wind based on the last aircraft's measurements.

I worked recently on HyperMixer, which is based on Florian Mai's idea to use hypernetworks to enable MLPMixer to handle various length inputs. This allowed the model to handle inputs in a permutation-invariant manner, and we showed that it gave the model a kind of attention behavior which scales linearly with the input length.

I made a Bachelor in Physics followed by a Master in Computer Sciences and Engineering (CSE - MATH), both at EPFL. I recieved the Kudelski Award for my Master Thesis A control plane in time and space for locality preserving blockchains in the Decentralized Distributed Systems Laboratory .

Publications

F. Mai, A. Pannatier, F. Fehr, H. Chen, F. Marelli, F. Fleuret, J. Henderson HyperMixer: An MLP-based Green AI Alternative to Transformers.
arxiv

A. Pannatier, R. Picatoste, and F. Fleuret. Efficient Wind Speed Nowcasting with GPU-Accelerated Nearest Neighbors Algorithm. In Proceedings of the SIAM International Conference on Data Mining (SDM), 2022.
publication / arxiv / slides