Reinis Cimurs

About Me

Hey there! I’m a machine learning research engineer with a background in Intelligent Robot Engineering. I’m really into autonomous navigation and decision-making, and I’m passionate about finding ways to use A.I. in real-world scenarios.

I have hands-on experience with Deep Reinforcement Learning-based neural networks for navigation—taking sensor data and using it for robot navigation with ROS in real-life situations. As part of the automotive industry, I worked on attention-based neural networks for driver modeling using real-world data and Graph Neural Networks. Currently working on end-to-end navigation solutions for drone flight.

My primary programming language is Python, but I also use C and Matlab when needed. I’m comfortable building deep learning models with TensorFlow and PyTorch.

Projects

Goal Driven Autonomous Exploration A goal-driven autonomous exploration system combining reactive and planned navigation. [GitHub Repo]
DRL-robot-navigation Deep RL for mobile robot navigation in ROS Gazebo using TD3. [GitHub Repo]
DRL-robot-navigation-IR-SIM DRL navigation in IR-SIM using SAC, TD3, PPO, DDPG, RNN, MARL and other methods. [GitHub Repo]
Bezier Curve Path Smoothing Python methods for optimizing quadratic and cubic Bezier curves with curvature constraint.

[GitHub Repo]

Select Publications

Goal-Driven Autonomous Exploration Through Deep Reinforcement Learning ICRA 2021

[Paper Link]
Analyzing Closed-loop Training Techniques for Traffic Agent Models ICCV 2025 WDFM-AD (Workshop)

[Paper Link]
Goal-Oriented Obstacle Avoidance with Deep Reinforcement Learning in Continuous Action Space Electronics 2020

[Paper Link]
Time-optimized 3D Path Smoothing with Kinematic Constraints IJCAS 2020

[Paper Link]
Bezier Curve-Based Smoothing for Path Planner with Curvature Constraint IRC 2017

[Paper Link]
Information-Based Heuristics for Learned Goal-Driven Exploration and Mapping UR 2021

[Paper Link]

About Me

Projects

Select Publications

Patents