F25 Eve Quests

Eve Quest Book - Fall 2025 (F25)

The Great Objective: Level 5 Robo-taxi Around Campus

WATonomous aims to achieve a fully autonomous Level 5 robo-taxi capable of navigating the University of Waterloo campus by the end of Fall 2025. This involves integrating hardware, software, and cognition systems to enable decision-making directly within the car. Achieving this milestone establishes the groundwork for advanced autonomous vehicle research and real-world applications.

Term Objectives Summary

The objectives for Fall 2025 focus on integrating hardware, developing software modules, and preparing the platform for autonomous operation.

  1. Hardware Integration

    • Throttle Board
    • Steering Board
    • Brake Board
    • Gateway Board
    • Camera Firmware
    • Lidar Firmware
    • GPS/IMU Firmware
    • Joystick
    • ROS2CCO
    • Sensor Networking
    • Lidar Mount
    • Camera Mount
    • GPS/IMU Mount
    • OSCC Board Enclosures
    • Relay Enclosures
    • E-Stop
  2. Software Modules

    • Deep ROS
    • Camera Object Detection
    • 2D Tracking
    • 2D-3D Association
    • Lidar Costmap Migration
    • HD Map
    • Behavior Planner
    • Localization
    • Global Planner
    • Lattice Planner (builds IDEAL splines from behaviour)
    • Local Planner (builds a collision-aware spline)
    • Controller (MPPI, MPC, PID, Pure Pursuit)

Term Objectives and Scoring

Hardware Integration

  1. Throttle Board
ScoreCriteria
10/10Throttle board fully integrated - can send desired commands and car executes them correctly.
7/10Throttle board functional with minor issues or response delays.
4/10Throttle board installed and wired but not fully operational.
0/10No throttle board integration.

Minimum Requirements: Throttle board installed and wired for a score of 4/10.

  1. Steering Board
ScoreCriteria
10/10Steering board fully integrated - can send desired commands and car executes them correctly.
7/10Steering board functional with minor issues.
4/10Steering board installed and wired but not fully operational.
0/10No steering board integration.

Minimum Requirements: Steering board installed and wired for a score of 4/10.

  1. Brake Board
ScoreCriteria
10/10Brake board fully integrated - can send desired commands and car executes them correctly.
7/10Brake board functional with minor issues.
4/10Brake board installed and wired but not fully operational.
0/10No brake board integration.

Minimum Requirements: Brake board installed and wired for a score of 4/10.

  1. Gateway Board
ScoreCriteria
10/10Gateway board fully functional with all CAN communication working reliably.
7/10Gateway board operational with occasional communication issues.
4/10Gateway board installed and basic communication established.
0/10No gateway board integration.

Minimum Requirements: Gateway board installed with basic communication for a score of 4/10.

  1. Camera Firmware
ScoreCriteria
10/10All camera drivers in monorepo and functional - streaming synchronized data at expected framerates.
7/10Most camera drivers in monorepo and functional with minor synchronization or quality issues.
4/10At least one camera driver in monorepo and streaming data reliably.
0/10No functional camera firmware.

Minimum Requirements: At least one camera streaming data for a score of 4/10.

  1. Lidar Firmware
ScoreCriteria
10/10All lidar drivers in monorepo and functional - publishing synchronized point clouds at expected rates.
7/10Lidar drivers in monorepo and functional with minor configuration or timing issues.
4/10At least one lidar driver in monorepo and publishing point cloud data.
0/10No functional lidar firmware.

Minimum Requirements: At least one lidar publishing data for a score of 4/10.

  1. GPS/IMU Firmware
ScoreCriteria
10/10GPS/IMU drivers in monorepo and fully functional with RTK corrections.
7/10GPS/IMU drivers in monorepo and operational with standard GPS accuracy.
4/10GPS/IMU drivers in monorepo with basic data being published.
0/10No functional GPS/IMU firmware.

Minimum Requirements: Basic GPS/IMU data publishing for a score of 4/10.

  1. Joystick OSCC
ScoreCriteria
10/10Joystick interfaceable with OSCC boards directly without ROS.
0/10No joystick integration.

Minimum Requirements: Optional, but a quick way to get Joystick working (theoretically).

  1. Joystick Node
ScoreCriteria
10/10Joystick node in monorepo and controlling basic vehicle functions reliably.
4/10Joystick node in monorepo and publishing data to ROS2.
0/10No joystick integration.

Minimum Requirements: Joystick publishing data to ROS2 for a score of 4/10.

  1. ROS2CCO
ScoreCriteria
10/10ROS2CCO fully functional with all vehicle interfaces and safety checks.
7/10ROS2CCO operational with most interfaces working.
4/10Basic ROS2CCO communication established.
0/10No ROS2CCO implementation.

Minimum Requirements: Basic ROS2CCO communication for a score of 4/10.

  1. Sensor Networking
ScoreCriteria
10/10All sensors networked with proper bandwidth management and minimal latency.
7/10Sensor network functional with occasional bandwidth issues.
4/10Basic sensor networking established for critical sensors.
0/10No sensor networking implementation.

Minimum Requirements: Basic networking for critical sensors for a score of 4/10.

  1. Lidar Mount
ScoreCriteria
10/10Both lidars mounted and connected.
4/10Only one side lidar mounted and connected.
0/10No lidar mounting solution.

Minimum Requirements: Basic lidar mounting for a score of 4/10.

  1. Camera Mount
ScoreCriteria
10/10Camera mounts secure and functional.
4/10Basic camera mounting solution in place.
0/10No camera mounting solution.

Minimum Requirements: Basic camera mounting for a score of 4/10.

  1. GPS/IMU Mount
ScoreCriteria
10/10GPS/IMU mount secure and connected.
0/10Not complete.

Minimum Requirements: Basic GPS/IMU mounting for a score of 10/10.

  1. OSCC Board Enclosures
ScoreCriteria
10/10Functional enclosures protecting all boards installed.
4/10Basic enclosure solution for critical boards fabricated.
0/10No board protection.

Minimum Requirements: Basic enclosures for critical boards for a score of 4/10.

  1. Relay Enclosures
ScoreCriteria
10/10Functional relay enclosure installed.
4/10Basic enclosure solution for relay fabricated.
0/10No relay protection.

Minimum Requirements: Basic relay protection for a score of 4/10.

  1. E-Stop
ScoreCriteria
10/10Primary e-stop system functional with proper testing.
4/10Basic e-stop wired and partially functional.
0/10No e-stop implementation.

Minimum Requirements: Basic e-stop functionality for a score of 4/10.

Software Modules (All must be on the main branch)

  1. Deep ROS
ScoreCriteria
10/10Basic Deep ROS setup with initial integration with camera object detection.
0/10No Deep ROS implementation.

Minimum Requirements: Basic Deep ROS setup for a score of 10/10.

  1. Camera Object Detection
ScoreCriteria
10/10Multi-camera detection of all object types.
7/10Object detection functional.
0/10No object detection.

Minimum Requirements: Basic object detection on one camera for a score of 4/10.

  1. 2D Tracking
ScoreCriteria
10/10Robust multi-object tracking with consistent IDs across all cameras.
7/10Tracking functional.
4/10Basic tracking implementation.
0/10No tracking implementation.

Minimum Requirements: Basic tracking implementation for a score of 4/10.

  1. 2D-3D Association
ScoreCriteria
10/10Association functional with minimal accuracy issues.
4/10Basic 2D-3D association working.
0/10No 2D-3D association.

Minimum Requirements: Basic 2D-3D association for a score of 4/10.

  1. Lidar Costmap Migration (Patchworks++)
ScoreCriteria
10/10Full costmap generation from lidar with dynamic obstacle handling.
4/10Basic costmap generation from lidar data migrated to perception.
0/10No costmap implementation.

Minimum Requirements: Basic costmap generation for a score of 4/10.

  1. HD Map
ScoreCriteria
10/10Custom HD maps loaded with full regulatory element support.
7/10HD map functional with perception integration.
4/10Basic HD map loading and visualization.
0/10No HD map implementation.

Minimum Requirements: Basic HD map functionality for a score of 4/10.

  1. Behavior Planner
ScoreCriteria
10/10Behavior planner functional in monorepo for basic navigation.
4/10Initial behavior planner implementation.
0/10No behavior planner.

Minimum Requirements: Initial behavior planner for a score of 4/10.

  1. Localization
ScoreCriteria
10/10Multi-sensor localization functional in monorepo.
4/10Basic localization using GPS.
0/10No localization implementation.

Minimum Requirements: Basic GPS localization for a score of 4/10.

  1. Global Planner
ScoreCriteria
10/10Global planner in monorepo and generating optimal routes with traffic consideration.
4/10Basic global path planning.
0/10No global planner.

Minimum Requirements: Basic global planning for a score of 4/10.

  1. Lattice Planner
ScoreCriteria
10/10Lattice Planner in monorepo handling multiple different behaviors.
4/10Basic Lattice Planner implementation.
0/10No local planner.

Minimum Requirements: Basic local planning for a score of 4/10.

  1. Local Planner
ScoreCriteria
10/10Local planner in monorepo handling dynamic obstacles smoothly.
4/10Basic local planning implementation.
0/10No local planner.

Minimum Requirements: Basic local planning for a score of 4/10.

  1. Controller
ScoreCriteria
10/10Advanced controller in monorepo fully tuned and tested on vehicle.
4/10Basic controller implementation.
0/10No controller implementation.

Minimum Requirements: Basic controller for a score of 4/10.


Scoring Template

Hardware Integration

Quest NameDescriptionScore
Throttle BoardComplete throttle control integration
Steering BoardComplete steering control integration
Brake BoardComplete brake control integration
Gateway BoardEstablish CAN communication gateway
Camera FirmwareDeploy and configure all camera drivers
Lidar FirmwareDeploy and configure all lidar drivers
GPS/IMU FirmwareDeploy GPS/IMU with RTK capabilities
Joystick OSCCJoystick commanding directly with OSCC
Joystick NodeJoystick command with ROS -> ROS2CCO
ROS2CCOComplete ROS2 vehicle interface
Sensor NetworkingEstablish robust sensor network infrastructure
Lidar MountInstall professional lidar mounting system
Camera MountInstall weatherproof camera mounting system
GPS/IMU MountInstall GPS/IMU with proper ground plane
OSCC Board EnclosuresInstall weatherproof board enclosures
Relay EnclosuresInstall professional relay protection
E-StopImplement hard and soft emergency stop systems

Software Modules

Quest NameDescriptionScore
Deep ROSIntegrate Deep ROS for perception optimization
Camera Object DetectionMulti-camera object detection at 30+ fps
2D TrackingRobust multi-object tracking across cameras
2D-3D AssociationAccurate camera-lidar data fusion
Lidar Costmap MigrationDynamic costmap generation from lidar
HD MapLoad custom HD maps with regulatory elements
Behavior PlannerComplex scenario handling and traffic rules
LocalizationMulti-sensor localization with cm accuracy
Global PlannerOptimal route planning with traffic consideration
Lattice PlannerDynamic obstacle avoidance and smooth navigation
Local PlannerDynamic obstacle avoidance and smooth navigation
ControllerMPC/MPPI controller for precise vehicle control