In order to effectively design control and planning systems for an agent, we must clearly define the scenarios in which it will be evaluated and proven to be stable. What is described below is a comprehensive test suite and will likely be refined.
Generic obstacle scenario classes
- No obstacles
- Generic static obstacle test
- Static random sparse
- Static random dense
- Generic dynamic obstacle test (continuous heading)
- Other agent bow
- Other agent stern
- Other agent port
- Other agent starboard
- Multiple other agents, one from port and one from starboard
Core scenarios
Each of the following scenarios defines various parameterizations. All of the generic obstacle scenarios classes defined above are applied to each combination of the parameters listed below.
Let
- be the apparent wind angle relative to the stationary vessel’s heading at time .
- be the apparent wind angle to the waypoint.
- be half of the upwind no-go angle.
- be half of the downwind no-go angle.
Scenario 1: Reaching point to point
Scenario 2: Upwind point to point
Scenario 3: Downwind point to point
Test set caveats
Additional test sets must be defined for the following:
- Race course performance evaluation