Multi-Modal Perception and Behavior Analysis for Autonomous Driving
As autonomous driving technology advances, its role in shaping smarter and safer transportation systems becomes increasingly vital. This project focuses on multi-modal perception and behavior analysis to address the challenges of autonomous driving in dynamic environments.
The research will cover various key areas:
Object Detection: Recognizing and localizing vehicles, obstacles, and other critical objects in the driving environment.
Pedestrian Recognition: Identifying pedestrians, analyzing their postures, and predicting their intent.
Pose Estimation: Analyzing human body postures to enhance pedestrian safety and predict behavior.
Group Behavior Recognition: Understanding the dynamics of groups (e.g., crowds near crossings) and predicting collective movement patterns.
Multi-Modal Data Fusion: Integrating data from cameras, LiDAR, radar, and other sensors to provide robust and accurate perception.
Real-Time Optimization: Ensuring efficient and real-time processing of perception data, suitable for autonomous driving systems.
This project provides hands-on experience in cutting-edge research in autonomous driving and AI.
Students are encouraged to select one or more areas of focus based on their interests and expertise. Proposals for related research topics within this domain are also welcome.
The applicant will use publicly available datasets and receive technical support from SZTAKI.
Required Skills:
Proficiency in Python programming and libraries like OpenCV, PyTorch, TensorFlow.
Knowledge of computer vision, machine learning, and deep learning models.
Experience with sensor data processing (e.g., LiDAR, radar, depth cameras) is a plus.
Learning Outcomes:
Practical experience in designing perception systems for autonomous vehicles.
Expertise in multi-modal data integration and real-time system optimization.
Contributing to innovative technologies in autonomous driving.
This project offers a valuable opportunity to work on real-world applications and gain skills sought after in the autonomous driving and AI industries.