Test report

Every tutorial is also an acceptance test, and generated tests reach the behaviour no tutorial does. This is what the last run found.

113 tests: 85 passed · 8 failed · 20 not supported yet · expectations: 144 verified 5 failed 25 not supported yet 25 untested

The tests use the states, actions and shorthand of the test vocabulary. The map shows which behaviour leads to which, and the theme shows the colours and type the docs are drawn in.

SIM001 › The simulator

Test	Kind	Result
Your first throw › Throttle up, then pick it back up	tutorial	passed
Watching from every view › Throw it, then step through the views	tutorial	passed
Crashing and starting again › Nose it in, then reset	tutorial	passed
Taking a break › Pause, read the help, carry on	tutorial	passed
Checking the controls before a flight › Open the help and close it again	tutorial	passed
Reaching «Space throws the plane»	generated	passed
Reaching «A pause holds the plane in your hand»	generated	passed
Reaching «A throw during a pause waits for the pause to end»	generated	passed
Reaching «Without a flight controller there is only one mode»	generated	passed
Reaching «Low rates for gentle flying»	generated	passed
Reaching «High rates for tight turns»	generated	passed
Reaching «Differential thrust off»	generated	passed
Reaching «Differential thrust on»	generated	passed
Reaching «Auto-zoom off»	generated	passed
Reaching «Auto-zoom on»	generated	passed
Reaching «V fits a fresh battery»	generated	passed

SIM001 › The simulator › Recreation

Test	Kind	Result
Your first pylon race › Start, throw at GO, fly five laps	tutorial	passed
A game of tag › Tag, then get tagged	tutorial	passed
Reaching «The key of the game stops it»	generated	passed
Reaching «A turn inside a pylon is a cut»	generated	passed
Reaching «A second cut disqualifies you»	generated	passed
Reaching «Out of the arena, you are it»	generated	passed
Reaching «Two minutes of tag»	generated	passed

SIM001 › Ground control station

Test	Kind	Result
From plan to flight › Plan, upload, arm, AUTO, throw	tutorial	not supported yet
Reaching «PLAN again goes back to panning»	generated	passed
Reaching «GOTO picks the fly-to tool»	generated	passed
Reaching «A GOTO click flies the plane there»	generated	passed
Reaching «AUTO with no mission asks first»	generated	not supported yet
Reaching «AUTO twice goes anyway»	generated	not supported yet

SIM001 › Ground control station › Planning a mission

Test	Kind	Result
Planning a hand-launched circuit › Takeoff, three waypoints, home	tutorial	passed
Fixing a misplaced waypoint › Two clicks and a right-click	tutorial	passed
Clearing the ridge › Raise the plan, add a waypoint, check it	tutorial	not supported yet
Keeping a mission for the field › Save, change, load	tutorial	not supported yet
Surveying a field › Draw a grid and upload it	tutorial	not supported yet
Planning at the altitude limit › ALT+ from 290 m	tutorial	passed
Reaching «Right-click on an empty plan does nothing»	generated	passed
Reaching «CLEAR empties the plan»	generated	passed
Reaching «ALT- lowers the plan altitude»	generated	passed
Reaching «ALT- stops at 10 m»	generated	passed
Reaching «Waypoints already planned keep their altitude»	generated	passed
Reaching «A new waypoint needs a new height check»	generated	not supported yet
Reaching «The plan has only one takeoff»	generated	passed
Reaching «Changing a command keeps the item in its place»	generated	not supported yet
Reaching «Changing a command makes the vehicle's copy out of date»	generated	not supported yet
Reaching «UPLOAD does not send an empty plan»	generated	passed
Reaching «Changing the plan makes the vehicle's copy out of date»	generated	passed
Reaching «DOWNLOAD only reads»	generated	passed
Reaching «EDIT brings the vehicle's mission back into the plan»	generated	not supported yet
Reaching «Before a save, there is nothing to load»	generated	not supported yet
Reaching «Measuring between two points shows the distance»	generated	not supported yet

SIM001 › Ground control station › Flying a mission

Test	Kind	Result
Flying the circuit and coming home › Three waypoints, then home	tutorial	not supported yet
Flying the circuit again › Back to the first waypoint	tutorial	not supported yet
Reaching «A mission that ends with a loiter keeps circling»	generated	not supported yet
Reaching «A mission that ends with a landing lands»	generated	not supported yet
Reaching «A mission that ends with RTL flies home in AUTO»	generated	not supported yet
Reaching «Disarming outside AUTO restarts the mission»	generated	not supported yet
Reaching «Disarming in AUTO keeps the plane's place»	generated	failed

SIM001 › Ground control station › Flying a VTOL

Test	Kind	Result
Flying a VTOL › Take off, fly forward, hover, land	tutorial	failed

SIM001 › Ground control station › Flying with a radio

Test	Kind	Result
Taking off with the TX15 › Arm, pick QLOITER, lift off and land	tutorial	failed
Flying a VTOL with self-levelling › Lift off, fly forward in FBWA, hover again and land softly	tutorial	failed
Trying the buttons of the radio › Lift off, try QHOVER and CRUISE, then fly home	tutorial	failed
Reaching «Taking the arm switch down disarms the vehicle»	generated	passed

SIM001 › Ground control station › Setting up the radio

Test	Kind	Result
Reaching «F2 calibrates the radio»	generated	not supported yet

SIM001 › Ground control station › Games with ArduPilot

Test	Kind	Result
Racing the computer pilots from the station › Wait for GO, then go	tutorial	passed

SIM001 › Ground control station › The TX15 on the serial line

Test	Kind	Result
Flying a VTOL with the TX15 › Arm, lift off, fly forward in FBWA, hover again and land softly	tutorial	failed

SIM001 › Flying with a flight controller

Test	Kind	Result
Your first hover › Arm, lift off, hold the hover and bring the plane home	tutorial	passed
Learning with self-levelling › Pick ANGLE mode and throw	tutorial	passed
Reaching «ACRO holds the attitude»	generated	passed
Reaching «MANUAL gives you the control surfaces»	generated	passed

SIM001 › Other aircraft

Test	Kind	Result
Seeing a friend who flies near you › A friend joins and leaves	tutorial	passed
Flying near a crowd of planes › Out of range, into range, into a crowd	tutorial	passed
Losing the radio link › The link drops	tutorial	passed
Reaching «Your own transmitter is not another plane»	generated	passed

SIM001 › Watching a real plane

Test	Kind	Result
Watching a flight from the pilot box › The plane takes off, turns and goes quiet	tutorial	passed

SIM001 › The flight computer

Test	Kind	Result
Flying with a TX15 on the serial line › Fly and watch the screen	tutorial	passed
Flying with a TX15 on the serial line › Full travel on the sticks	tutorial	passed
Flying with a TX15 on the serial line › Sticks centred	tutorial	passed
Flying with a TX15 on the serial line › A damaged line	tutorial	passed
Losing the TX15 and getting it back › Unplug	tutorial	passed
Losing the TX15 and getting it back › Plug in again	tutorial	passed
Commanding the plane from the ground station › Command through the line	tutorial	passed
Commanding the plane from the ground station › The line is narrow	tutorial	passed
Reading the flight display › Armed, banked and climbing	tutorial	passed
Reaching «Without the TX15 the ground station hears nothing»	generated	passed

SIM001 › Flying by plan

Test	Kind	Result
Watching a game of tag by plan › Play and watch	tutorial	passed
Sending your first plan › Send a plan	tutorial	passed
Letting a plan run out › Let a plan run out	tutorial	passed
Reaching «A repeated plan id changes nothing»	generated	failed
Reaching «Go to flies over the point, then circles it»	generated	passed
Reaching «Orbit holds its radius and its height»	generated	passed
Reaching «A band plan holds a height band»	generated	passed
Reaching «Band keeps the plane between its two heights»	generated	passed
Reaching «A loiter plan circles where the plane is»	generated	passed
Reaching «Loiter stays round the place where it began»	generated	passed
Reaching «A pursue plan chases another aircraft»	generated	passed
Reaching «Pursue closes on the target and stays on its tail»	generated	passed
Reaching «An evade plan breaks away from another aircraft»	generated	passed
Reaching «Evade opens the distance from a chaser»	generated	passed
Reaching «A target that goes silent ends the chase»	generated	passed
Reaching «The envelope leaves a safe plan alone»	generated	failed
Reaching «The plane stays inside the fence»	generated	passed
Reaching «The plane stays above the floor»	generated	passed
Reaching «The plane stays below the ceiling»	generated	passed
Reaching «Under the stall margin, the plane gets its airspeed back first»	generated	passed
Reaching «After a recovery, the plane flies on»	generated	passed
Reaching «The plane keeps clear of an aircraft that crosses its path»	generated	passed
Reaching «Bad input gives wings level and the throttle to the pilot»	generated	passed
Reaching «The plane flies again when the position estimate comes back»	generated	not supported yet
Reaching «With space to turn, planes on plans keep their separation»	generated	passed
Reaching «In a small fence, the fence wins over the separation»	generated	passed
Reaching «The plane that is it pursues the plane it can catch soonest»	generated	passed
Reaching «A plane that is not it holds its own height band»	generated	passed
Reaching «A plane that is not it breaks away from a chaser that comes near»	generated	passed

Not verified yet

A full plan takes no more waypoints untested
A height check raises waypoints above the terrain not supported yet
A new waypoint needs a new height check not supported yet
Changing a command keeps the item in its place not supported yet
Changing a command makes the vehicle's copy out of date not supported yet
EDIT brings the vehicle's mission back into the plan not supported yet
Saving keeps the plan in a file not supported yet
Changing the plan after saving not supported yet
Loading brings the saved plan back not supported yet
Before a save, there is nothing to load not supported yet
A survey grid fills the area with waypoints not supported yet
Measuring between two points shows the distance not supported yet
Each waypoint reached moves the mission on not supported yet
After the last waypoint the plane flies home not supported yet
A mission that ends with a loiter keeps circling not supported yet
A mission that ends with a landing lands not supported yet
A mission that ends with RTL flies home in AUTO not supported yet
WP1 restarts the mission not supported yet
Disarming outside AUTO restarts the mission not supported yet
Disarming in AUTO keeps the plane's place untested
DISARM disarms not supported yet
AUTO flies the vehicle's mission not supported yet
AUTO with no mission asks first not supported yet
AUTO twice goes anyway not supported yet
In AUTO, a throw starts the mission not supported yet
QLAND brings the plane straight down untested
CRUISE changes a hover into forward flight untested
QLOITER changes forward flight back into a hover untested
A hover draws 15 to 25 A failed
The load pulls the voltage down failed
Cruise draws 3 to 7 A untested
A raised throttle stick lifts the plane failed
A centred throttle stick holds the height untested
A lowered throttle stick brings the plane down untested
FBWA changes a hover into forward flight untested
In FBWA, the aileron stick banks the plane untested
In FBWA, the wings become level again untested
Button 2 brings the plane out of FBWA and back to a hover untested
QHOVER is a hover mode untested
CRUISE changes a hover into forward flight with the radio untested
QRTL brings the plane home and lands it softly untested
F2 calibrates the radio not supported yet
The screen shows that the plane is armed untested
The screen shows the flight mode untested
The throttle stick lifts the plane on the serial line untested
The screen shows forward flight untested
The aileron stick banks the plane on the serial line untested
The wings become level again on the serial line untested
The screen shows the plane back in a hover untested
The screen shows the plane landed and disarmed untested
The screen shows the climb with its sign untested
The screen counts the satellites untested
A repeated plan id changes nothing failed
The envelope leaves a safe plan alone failed
The plane flies again when the position estimate comes back not supported yet