/mapfe4mp

Official repository for vehicle motion prediction work presented at CVPR and ICRA Workshops 2022

Primary LanguagePython

[CVPRW 2022] Exploring Map-based Features for Efficient Attention-based Vehicle Vehicle Motion Prediction

Carlos Gómez-Huélamo, Marcos V. Conde, Miguel Ortiz.

Repo of the work presented at:

Check our paper here!

Motion prediction (MP) of multiple agents is a crucial task in arbitrarily complex environments, from social robots to self-driving cars. Current approaches tackle this problem using end-to-end networks, where the input data is usually a rendered top-view of the scene and the past trajectories of all the agents; leveraging this information is a must to obtain optimal performance. In that sense, a reliable Autonomous Driving (AD) system must produce reasonable predictions on time, however, despite many of these approaches use simple ConvNets and LSTMs, models might not be efficient enough for real-time applications when using both sources of information (map and trajectory history). Moreover, the performance of these models highly depends on the amount of training data, which can be expensive (particularly the annotated HD maps). In this work, we explore how to achieve competitive performance on the Argoverse 1.0 Benchmark using efficient attention-based models, which take as input the past trajectories and map-based features from minimal map information to ensure efficient and reliable MP. These features represent interpretable information as the driveable area and plausible goal points, in opposition to black-box CNN-based methods for map processing.


Please cite this work if you use our code or ideas.

@article{gomez2022mapfemp,
  author = {Gómez-Huélamo, Carlos and Conde, Marcos V. and Ortiz, Miguel},
  title  = {Exploring Map-based Features for Efficient Attention-based Vehicle Motion Prediction},
  journal= {ICRA 2022 Workshops},
  year = {2022}
}

Get Started and Usage

Tested in Ubuntu 16.04.

If available, check requirements.txt

conda create --name mapfe4mp_env python=3.8 \
conda install -n mapfe4mp ipykernel --update-deps --force-reinstall
python3 -m pip install --upgrade pip \
python3 -m pip install --upgrade Pillow \
pip install \
    prodict \
    torch \
    pyyaml \
    torchvision \
    tensorboard \
    glob2 \
    matplotlib \
    sklearn \
    gitpython \
    torchstat

Download argoverse-api (1.0) in another folder (out of this directory).
Go to the argoverse-api folder:

pip install -e . (N.B. You must have the conda environment activated in order to have argoverse as a Python package of your environment)

More details soon ...

Qualitative results

Check our paper here for more results.

Contact

Please add in the email subject "mapfe4mp" or "exploring map features paper"

Carlos Gómez-Huélamo. carlos.gomezh@edu.uah.es

Marcos Conde marcos.conde-osorio@uni-wuerzburg.de