Awesome-Trajectory-Prediction

本仓库由公众号【自动驾驶之心】团队整理,欢迎关注,一览最前沿的技术分享!

自动驾驶之心是国内首个自动驾驶开发者社区!这里有最全面有效的自动驾驶与AI学习路线(感知/定位/融合)和自动驾驶与AI公司内推机会!

Other awesomes

colorfulfuture/Awesome-Trajectory-Motion-Prediction-Papers (github.com)

一、Pedestrian trajectory prediction correlation

1. Summary of pedestrian trajectory prediction methods

Y-Net: From goals, waypoints & paths to long term human trajectory forecasting, ICCV 2021

[code]

MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian TrajectoryPrediction, ICCV 2021

[code]

Semantic Synthesis of Pedestrian Locomotion, ACCV 2020

Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction,ECCV2020

[code]

SimAug: Learning Robust Representations from 3D Simulation for Pedestrian Trajectory Prediction inUnseen Cameras

[code]

Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human TrajectoryPrediction,2020 CVPR,

[code]

Disentangling Human Dynamics for Pedestrian Locomotion Forecasting with Noisy Supervision

PIE:ALarge-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction

STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory Prediction, 2019 ICCV

Trajectory Prediction by Coupling Scene-LSTM with Human Movement LSTM, 2019 ISVC

SEABIG:A Deep Learning-Based Method for Location Prediction in Pedestrian Semantic Trajectories

A novel model based on deep learning for Pedestrian detection and Trajectory prediction

Pedestrian Trajectory Prediction Using a Social Pyramid, 2019 PRICAI

Human Trajectory Prediction using Adversarial Loss, 2019(from Alahi, conference unknown fornow

Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs

[code]

Peeking into the Future: Predicting Future Person Activities and Locations in Videos

[code]

Future Person Localization in First-Person Videos, 2018 CVPR

[code]

Move, Attend and Predict: Anattention-based neural model for people's movement prediction, 2018 PatternRecognition Letters

Group LSTM: Group Trajectory Prediction in Crowded Scenarios,2018 ECCV Workshop

Pedestrian Trajectory Prediction in Extremely Crowded Scenarios, 2019 Sensors (journal)

The Simpler the Better: Constant Velocity for Pedestrian Motion Prediction, 2019 SR-LSTM:State Refinement for LSTM towards Pedestrian Trajectory Prediction, 2019 CVPR

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model, 2019 ComputerVision Winter Workshop (cvw) Depth Information Guided Crowd Counting for Complex Crowd Scenes, 2018

GD-GAN: Generative Adversarial Networks for Trajectory Prediction and Group Detection in Crowds, 2018 ACCV

Tracking by Prediction: A Deep Generative Model for Mutli-Person Localisation and Tracking, 2018 WACV

“Seeing is Believing”: Pedestrian Trajectory Forecasting Using Visual Frustum of Attention, 2018 WACV

Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks, 2018 CVPR

[code]

Long-Term On-Board Prediction of People in Traffic Scenes under Uncertainty, 2018 CVPR

[code]

Encoding Crowd Interaction with Deep Neural Network for Pedestrian Trajectory Prediction, 2018 CVPR

[code]

Scene-LSTM: A Model for Human Trajectory Prediction, 2018 ArXiv

Bi-prediction: pedestrian trajectory prediction based on bidirectional LSTM classification, 2017 DICTA

Human Trajectory Prediction using Spatially aware Deep Attention Models, 2017 arxiv

Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection, 2017 arxiv

Forecasting Interactive Dynamics of Pedestrians with Fictitious Play, 2017 CVPR

Social LSTM: Human Trajectory Prediction in Crowded Spaces, 2016 CVPR

STF-RNN: Space Time Features-based Recurrent Neural Network for predicting People Next Location, 2016 SSCI

[code]

二、Summary of pedestrian trajectory prediction methods

1. Vehicle trajectory prediction

PTNet: Physically Feasible Vehicle Trajectory Prediction, NeurIPS ML4AD Workshop

Injecting Knowledge in Data-driven Vehicle Trajectory Predictors, 2021 Transportation research part C

[code]

Multiple Futures Prediction, 2019 NeurIPS

Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs, 2019 arXiv

[code]

RobustTP: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs, 2019 ACM CSCS

[code]

TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions, 2019 CVPR

[code]

Multi-Step Prediction of Occupancy Grid Maps with Recurrent Neural Networks, 2019 CVPR

Argoverse: 3D Tracking and Forecasting With Rich Maps, 2019 CVPR

Robust Aleatoric Modeling for Future Vehicle Localization, 2019 CVPR

Convolutional Social Pooling for Vehicle Trajectory Prediction

[code]

Trajectory-Prediction with Vision: A Survey

Spatio-Temporal Trajectory Similarity Measures: A Comprehensive Survey and Quantitative Study

Multimodal Trajectory Prediction: A Survey

三、methodology

1. Summary of classical methods (including physics-based, machine learning, deep learning, reinforcement learning)

Physics-based approach

Single track

Vehicle dynamics and external disturbance estimation for vehicle path prediction

Reducing navigation errors by planning with realistic vehicle model

Situation assessment of an autonomous emergency brake for arbitrary vehicle-to-vehicle collision scenarios

Cooperative path prediction in vehicular environments

Model-based threat assessment for avoiding arbitrary vehicle collisions

An adaptive peer-to-peer collision warning system

A multilevel collision mitigation approach-its situation assessment, decision making, and performance tradeoffs

Kalman filtering

Real time trajectory prediction for collision risk estimation between vehicles

Recognition of dangerous situations within a cooperative group of vehicles

IMM object tracking for high dynamic driving maneuvers

Switched kalman filterinteracting multiple model algorithm based on optimal autoregressive model for manoeuvring target trackin

Object tracking in urban intersections based on active use of a priori knowledge: Active interacting multi model filter

A method for connected vehicle trajectory prediction and collision warning algorithm based on v2v communication

Interaction-aware motion prediction for autonomous driving:Amultiple model Kalman filtering scheme

Monte Carlo

Monte Carlo road safety reasoning

Comparison of Markov chain abstraction and monte carlo simulation for the safety assessment of autonomous cars

Driver intention-based vehicle threat assessment using random forests and particle filtering

Trajectory planning and safety assessment of autonomous vehicles based onmotion prediction and model predictive control

Machine learning

Gaussian Process

A Bayesian nonparametric approach to modelingmobility patterns

A Bayesian nonparametric approach to modeling motion patterns

Online maneuver recognition and multimodal trajectory prediction for intersection assistance using non-parametric regression

Probabilistic analysis of dynamic scenes and collision risks assessment to improve driving safety

Unfreezing the robot: Navigation in dense, interacting crowds

Modeling multi-vehicle interaction scenarios using Gaussian random field

Motion prediction for moving objects: A statistical approach

Long-term vehicle motion prediction

SVM

Using support vector machines for lane-change detection

Learning-based approach for online lane change intention prediction

Using support vectormachines and Bayesian filtering for classifying agent intentions at road intersections

Threat assessment design for driver assistance system at intersections

Hidden Markov Model

Probabilistic analysis of dynamic scenes and collision risks assessment to improve driving safety

Next place prediction using mobility Markov chains

Improved driving behaviors prediction based on fuzzy logic-hidden Markov model (fl-hmm)

Continuous driver intention recognition with hiddenMarkov models

A self-adaptive parameter selection trajectory prediction approach via hidden Markov models

Decision-making and planning method for autonomous vehicles based on motivation and risk assessment

How would surround vehicles move? A unified framework for maneuver classification and motion prediction

Research on traffic vehicle behavior prediction method based on game theory and hmm

Dynamic Bayesian Network

Learning driver behavior models from traffic observations for decision making and planning

An integrated approach to maneuver-based trajectory prediction and criticality assessment in arbitrary road environments

A game-theoretic approach to replanning-aware interactive scene prediction and planning

Probabilistic intention prediction and trajectory generation based on dynamic Bayesian networks

A dynamic Bayesian network for vehicle maneuver prediction in highway driving scenarios: Framework and verification

Pedestrian trajectory prediction combining probabilistic reasoning and sequence learning

Deep Learning

Sequence Network

A recurrent neural network solution for predicting driver intention at unsignalized intersections

Long short termmemory for driver intent prediction

Generalizable intention prediction of human drivers at intersections

An LSTM network for highway trajectory prediction

Online vehicle trajectory prediction using policy anticipation network and optimization-based context reasoning

Naturalistic driver intention and path prediction using recurrent neural networks

Sequence-to-sequence prediction of vehicle trajectory via lstm encoder-decoder architecture

Personalized vehicle trajectory prediction based on joint time-series modeling for connected vehicles

Argoverse: 3D tracking and forecasting with rich maps

Multimodal trajectory predictions for urban environments using geometric relationships between a vehicle and lanes

Modeling vehicle interactions via modified lstm models for trajectory prediction

Predicting vehicle behaviors over an extended horizon using behavior interaction network

Intention-aware long horizon trajectory prediction of surrounding vehicles using dual lstm networks

Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMS

Rnn-based path prediction of obstacle vehicles with deep ensemble

Multiple futures prediction

A recurrent attention and interaction model for pedestrian trajectory prediction

Vehicle motion prediction at intersections based on the turning intention and prior trajectories model

Convolutional neural network for trajectory prediction

Covernet: Multimodal behavior prediction using trajectory sets

Deep kinematic models for kinematically feasible vehicle trajectory predictions

Multimodal trajectory predictions for autonomous driving using deep convolutional networks

Predicting motion of vulnerable road users using highdefinition maps and efficient convnets

Uncertainty-aware short-term motion prediction of traffic actors for autonomous driving

Multiple trajectory prediction with deep temporal and spatial convolutional neural networks

A lane-changing prediction method based on temporal convolution network

Mantra: Memory augmented networks for multiple trajectory prediction

Home: Heatmap output for future motion estimation

Tpcn: Temporal point cloud networks for motion forecasting

Convolutional social pooling for vehicle trajectory prediction

Traphic: Trajectory prediction in dense and heterogeneous traffic using weighted interactions

Motion trajectory prediction based on a CNN-LSTM sequential model

The importance of prior knowledge in precise multimodal prediction

Desire: Distant future prediction in dynamic scenes with interacting agents

Rules of the road: Predicting driving behavior with a convolutional model of semantic interactions

Multipath: Multiple probabilistic anchor trajectory hypotheses for behavior prediction

Multi-head attention based probabilistic vehicle trajectory prediction Attention based vehicle trajectory prediction

Trajectory prediction for autonomous driving based on multi-head attention with joint agent-map representatio

Transformer networks for trajectory forecasting

Multi-modal motion prediction with transformer-based neural network for autonomous driving

End-to-end contextual perception and prediction with interaction transformer

Scene transformer:A unified multi-task model for behavior prediction and planning

Multimodal motion prediction with stacked transformers

Trajectron: Dynamically-feasible trajectory forecasting with heterogeneous data

GNN

Graph neural networks for modelling traffic participant interaction

Grip: Graph-based interaction-aware trajectory prediction

Grip++: Enhanced graph-based interaction-aware trajectory prediction for autonomous driving SCALE-Net: Scalable vehicle trajectory prediction network under random number of interacting vehicles via edge-enhanced graph convolutional neural network

Social-STGCNN: A social spatio-temporal graph convolutional neural network for human trajectory prediction

Forecasting trajectory and behavior of road-agents using spectral clustering in graph-LSTMS

Gisnet: Graph-based information sharing network for vehicle trajectory prediction

Vectornet: Encoding hd maps and agent dynamics from vectorized representation

Learning lane graph representations for motion forecasting

Tnt: Target-driven trajectory prediction

Densetnt: End-to-end trajectory prediction from dense goal sets

Lanercnn: Distributed representations for graph-centric motion forecasting

Stgat: Modeling spatialtemporal interactions for human trajectory prediction

Stochastic trajectory predictionwith social graph network

Generative Model

Learning to predict vehicle trajectories with model-based planning

Sequence-to-sequence prediction of vehicle trajectory via lstm encoder decoder architecture

Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMS

Multiple futures prediction

Rules of the road: Predicting driving behavior with a convolutional model of semantic interactions

Social gan: Socially acceptable trajectories with generative adversarial networks

Tppo: A novel trajectory predictor with pseudo oracle

Conditional generative neural system for probabilistic trajectory prediction

Sophie: An attentive gan for predicting paths compliant to social and physical constraints

Vehicle trajectory prediction using gan

Multi-agent tensor fusion for contextual trajectory prediction

Multi-vehicle collaborative learning for trajectory prediction with spatio-temporal tensor fusion

R2p2: A reparameterized pushforward policy for diverse, precise generative path forecasting

Implicit latent variable model for scene-consistent motion forecasting

Reinforcement Learning

Inverse Reinforcement Learning

Maximum margin planning

Inverse reinforcement learning through structured classification

Learning autonomous driving styles and maneuvers from expert demonstration

Maximum entropy inverse reinforcement learning

Learning to drive using inverse reinforcement learning and deep q-networks

Probabilistic prediction of interactive driving behavior via hierarchical inverse reinforcement learning

Modeling driver behavior from demonstrations in dynamic environments using spatiotemporal lattices

Learning from naturalistic driving data for human-like autonomous highway driving

Efficient samplingbased maximum entropy inverse reinforcement learning with application to autonomous driving

Trajectory forecasts in unknown environments conditioned on grid-based plans

Accelerated inverse reinforcement learning with randomly pre-sampled policies for autonomous driving reward design

Learning trajectory prediction with continuous inverse optimal control via langevin sampling of energy-based models

Driving behavior modeling using naturalistic human driving data with inverse reinforcement learning

Generative Adversarial Imitation Learning

Imitating driver behavior with generative adversarial networks

Infogail: Interpretable imitation learning from visual demonstrations

Modeling human driving behavior through generative adversarial imitation learning

Trajgail: Generating urban vehicle trajectories using generative adversarial imitation learning

Deep Inverse Reinforcement Learning

Deep inverse reinforcement learning for behavior prediction in autonomous driving: Accurate forecasts of vehicle motion

Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning

Large-scale cost function learning for path planning using deep inverse reinforcement learning

Inverse reinforcement learning via neural network in driver behavior modeling

Off-road autonomous vehicles traversability analysis and trajectory planning based on deep inverse reinforcement learning

Incorporating multi-context into the traversability map for urban autonomous driving using deep inverse reinforcement learning

2022 Latest Trajectory Forecast Survey

A Survey on Trajectory-Prediction Methods for Autonomous Driving

四、Methods

CVPR 2023

  • Decompose More and Aggregate Better: Two Closer Looks at Frequency Representation Learning for Human Motion Prediction. Paper
  • DeFeeNet: Consecutive 3D Human Motion Prediction with Deviation Feedback. Paper arXiv
  • EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning. Paper arXiv Code
  • FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Prediction. Paper arXiv Code Website
  • FJMP: Factorized Joint Multi-Agent Motion Prediction over Learned Directed Acyclic Interaction Graphs. Paper arXiv
  • IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Prediction. Paper arXiv
  • Leapfrog Diffusion Model for Stochastic Trajectory Prediction. Paper arXiv Code
  • MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusion. Paper
  • Planning-oriented Autonomous Driving. Paper arXiv Code Website
  • ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals. Paper arXiv
  • Query-Centric Trajectory Prediction. Paper
  • Stimulus Verification is a Universal and Effective Sampler in Multi-modal Human Trajectory Prediction. Paper
  • Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion. Paper arXiv Website
  • Trajectory-Aware Body Interaction Transformer for Multi-Person Pose Forecasting. Paper arXiv Code
  • Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction. Paper arXiv Code
  • Unsupervised Sampling Promoting for Stochastic Human Trajectory Prediction. Paper arXiv Code
  • ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queries. Paper arXiv Website
  • Weakly Supervised Class-agnostic Motion Prediction for Autonomous Driving. Paper

ICLR 2023

  • Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network. OpenReview arXiv
  • Stochastic Multi-Person 3D Motion Forecasting. OpenReview

ICRA 2023

  • Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning. arXiv

arXiv 2022

  • Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting. arXiv
  • Wayformer: Motion Forecasting via Simple & Efficient Attention Networks. arXiv

CoRL 2022

  • SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Driving. arXiv Code

NeurIPS 2022

ECCV 2022

  • Action-based Contrastive Learning for Trajectory Prediction. arXiv
  • AdvDO: Realistic Adversarial Attacks for Trajectory Prediction. arXiv
  • Aware of the History: Trajectory Forecasting with the Local Behavior Data. arXiv Code
  • Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors arXiv Code Website
  • D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights. arXiv Code
  • Entry-Flipped Transformer for Inference and Prediction of Participant Behavior. arXiv
  • Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting. arXiv
  • Human Trajectory Prediction via Neural Social Physics. arXiv Code
  • Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction. arXiv Code Website
  • Overlooked Poses Actually Make Sense: Distilling Privileged Knowledge for Human Motion Prediction. arXiv
  • Polarimetric Pose Prediction. arXiv
  • PreTraM: Self-Supervised Pre-training via Connecting Trajectory and Map. arXiv Code
  • Skeleton-Parted Graph Scattering Networks for 3D Human Motion Prediction. arXiv Code
  • Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimatio. arXiv Code Website
  • Social ODE: Multi-Agent Trajectory Forecasting with Neural Ordinary Differential Equations.
  • Social-SSL: Self-Supervised Cross-Sequence Representation Learning Based on Transformers for Multi-Agent Trajectory Prediction. Paper Code
  • SocialVAE: Human Trajectory Prediction using Timewise Latents. arXiv Code
  • ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning. arXiv Code
  • View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrums. arXiv

CVPR 2022

Trajectory Prediction Related

  • Adaptive Trajectory Prediction via Transferable GNN. arXiv Paper
  • ATPFL: Automatic Trajectory Prediction Model Design Under Federated Learning Framework. Paper
  • Convolutions for Spatial Interaction Modeling. arXiv Paper
  • End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps. arXiv Paper Code
  • Forecasting from LiDAR via Future Object Detection. arXiv Paper Code
  • Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Prediction. Paper Code
  • GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoning. arXiv Paper Code
  • How Many Observations are Enough? Knowledge Distillation for Trajectory Forecasting. arXiv Paper
  • LTP: Lane-Based Trajectory Prediction for Autonomous Driving. Paper
  • M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction. arXiv Paper Code
  • Neural Prior for Trajectory Estimation. Paper Website
  • Non-Probability Sampling Network for Stochastic Human Trajectory Prediction. arXiv Paper Code
  • On Adversarial Robustness of Trajectory Prediction for Autonomous Vehicles. arXiv Paper Code
  • Remember Intentions: Retrospective-Memory-based Trajectory Prediction. arXiv Paper Code
  • ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning. Paper Code
  • Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion. arXiv Paper Code
  • Vehicle Trajectory Prediction Works, But Not Everywhere. arXiv Paper Code
  • Whose Track Is It Anyway? Improving Robustness to Tracking Errors With Affinity-Based Trajectory Prediction. Paper Code
  • Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction. (CVPR'22 Workshop Precognition: Seeing Through the Future) arXiv Paper
  • Importance Is in Your Attention: Agent Importance Prediction for Autonomous Driving. (CVPR'22 Workshop Precognition: Seeing Through the Future) arXiv Paper

Motion Prediction Related

  • BE-STI: Spatial-Temporal Integrated Network for Class-Agnostic Motion Prediction With Bidirectional Enhancement. Paper Code
  • Forecasting Characteristic 3D Poses of Human Actions. arXiv Paper Code
  • HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction. Paper Code
  • Human Trajectory Prediction With Momentary Observation. Paper
  • MotionAug: Augmentation With Physical Correction for Human Motion Prediction. arXiv Paper Code
  • Motron: Multimodal Probabilistic Human Motion Forecasting. arXiv Paper Code
  • Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation. Paper
  • Multi-Person Extreme Motion Prediction. arXiv Paper Code
  • Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction. arXiv Paper Code
  • Spatial-Temporal Gating-Adjacency GCN for Human Motion Prediction. arXiv Paper
  • Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective. arXiv Paper Code
  • Weakly-Supervised Action Transition Learning for Stochastic Human Motion Prediction. arXiv Paper Code

ICRA 2022

  • Path-Aware Graph Attention for HD Maps in Motion Prediction. arXiv

ICLR 2022

  • D-CODE: Discovering Closed-form ODEs from Observed Trajectories. Paper Code
  • Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Prediction. Paper Code
  • ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematics. Paper Website
  • Scene Transformer: A Unified Architecture for Predicting Multiple Agent Trajectories. Paper
  • THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling. Paper
  • You Mostly Walk Alone: Analyzing Feature Attribution in Trajectory Prediction. Paper