Robonix Webots CI Report

All 15 scenarios passed — plan-control builtins verified

Provider: deepseek · Model: deepseek-chat · Generated On: 2026-07-03T12:21:14+00:00 · Stage: success · Confidence: high

This CI run tested the new `stop_plan_at`, `get_plan_status`, and `get_all_plans` executor builtins, along with existing capabilities and flows. All 15 scenarios passed (100% rate). The new plan-control builtins were exercised in the `plan_control_builtins` scenario, which successfully listed active plans, inspected a plan's status, armed a stop point, and verified the stop point was recorded. No regressions were observed in existing functionality.

PR Changes

Added `get_all_plans`, `get_plan_status`, and `stop_plan_at` builtin ops to the executor, including their MCP capability declarations and dispatch logic.
Implemented `stop_plan_at_builtin`, `get_plan_status_builtin`, and `get_all_plans_builtin` methods in `plan_runtime.rs`, with stop-point recording, op-state tracking, and plan metadata snapshotting.
Integrated stop-point checks (`should_stop_at`) and stop-point triggering (`trigger_stop`) into the execution loop in `service.rs`, supporting both `on_enter` and `on_complete` phases.
Updated the pilot planner to recognize the new builtins as control-only operations (not cancellable task trees) and to include instructions for using them in the in-flight trees system prompt.
Added a new test scenario `plan_control_builtins` and updated the executor README with documentation for the three new builtins.
Added unit tests for `stop_plan_at`, `get_plan_status`, `get_all_plans`, `is_control_only`, and `send_stop_on_enter`.

Test Result

Webots CI ran 15 scenarios across builtin, cap, and flow families. All passed. The new `plan_control_builtins` scenario verified: `get_all_plans` returned 1 plan with plan_id '1', `get_plan_status` returned the plan's ops with live states, `stop_plan_at` armed a stop point on op_id '1' with `on_complete`, and a subsequent `get_all_plans` confirmed `stop_points` incremented to 1. Existing scenarios (fault recovery, file roundtrip, run_command, camera/lidar snapshots, explore, mapping, memory, scene, speech, voiceprint, object navigation, patrol observe) all passed without issues.

Suggested Fix

No fix needed. Monitor the fake-VLM scene-graph-LLM failures (Expecting value errors) in future runs — they are non-fatal but indicate the fake VLM returns empty responses for relation extraction, which may affect scene graph quality.

Risks Or Watchouts

Scene graph LLM requests to fake-vlm consistently return empty responses (Expecting value errors), which may degrade scene relation extraction if a real VLM is used later.
The `stop_plan_at` builtin was tested only on a plan that arms a stop point on itself — testing on plans with external async calls would provide more coverage.
The `voiceprint_list` scenario returned 'db not initialised' — this is expected in CI but should be monitored for regressions.

Evidence

Source	Line	Excerpt
	5	"failed": 0,
	54	"id": "missing_read",
	650	"timeout_s": 5.0,
	1293	"error": "mcp tool error: Error executing tool save: 1 validation error for saveArguments\ndata\n Field required [type=missing, input_value={}, input_type=dict]"

Run Metadata

Test Environment

Scenarios

RTDL Plan Trees

Status	Suite	Scenario	Rounds	Dispatched contracts	Failures
PASS	builtin	fault_recovery_builtin	3	robonix/system/executor/builtin/read_file robonix/system/executor/builtin/write_file	-
PASS	builtin	file_roundtrip	1	robonix/system/executor/builtin/list_dir robonix/system/executor/builtin/read_file robonix/system/executor/builtin/write_file	-
PASS	builtin	plan_control_builtins	1	robonix/system/executor/builtin/get_all_plans robonix/system/executor/builtin/get_plan_status robonix/system/executor/builtin/stop_plan_at	-
PASS	builtin	run_command	1	robonix/system/executor/builtin/run_command	-
PASS	cap	camera_snapshot	1	robonix/primitive/camera/snapshot	-
PASS	cap	explore_smoke	2	robonix/skill/explore/explore robonix/skill/explore/explore/cancel robonix/skill/explore/explore/status	-
PASS	cap	lidar_snapshot	1	robonix/primitive/lidar/snapshot	-
PASS	cap	mapping_save	1	robonix/service/map/save_map	-
PASS	cap	memory_roundtrip	1	robonix/service/memory/save robonix/service/memory/search	-
PASS	cap	scene_object_fixture	1	robonix/system/scene/list_objects	-
PASS	cap	speech_speak	1	robonix/service/speech/speak	-
PASS	cap	voiceprint_list	1	robonix/service/voiceprint/list	-
PASS	flow	fault_recovery	4	robonix/service/memory/save	-
PASS	flow	object_navigation	4	robonix/service/navigation/navigate robonix/skill/explore/explore robonix/system/scene/goal_near robonix/system/scene/list_objects	-
PASS	flow	patrol_observe	3	robonix/primitive/camera/snapshot robonix/primitive/lidar/snapshot robonix/service/memory/save robonix/service/memory/search	-

Each scenario step is one VLM planning round. The tree below is the RTDL returned for that round; every do leaf has its own expected runtime contract and output checks.

PASSbuiltin/fault_recovery_builtin3 step(s), 3 leaf call(s)

step 0faulty read1 leaf

sequence faulty_read_step

do executor.builtin_read_file missing_read args {"path": "ci_never_created.txt"} expect robonix/system/executor/builtin/read_file failure

Observed plan round 0

FAIL1:0robonix/system/executor/builtin/read_fileargs {"path": "ci_never_created.txt"}No such file or directory (os error 2)

step 1recover by writing fallback1 leaf

sequence write_recovery_step

do executor.builtin_write_file write_recovery args {"content": "recovered charlie-3","path": "ci_recovered.txt"} expect robonix/system/executor/builtin/write_file success

Observed plan round 1

PASS2:0robonix/system/executor/builtin/write_fileargs {"content": "recovered charlie-3","path": "ci_recovered.txt"}wrote 19 bytes to /home/hanyulong/actions-runner/_work/robonix/robonix/examples/webots/ci_recovered.txt

step 2read fallback1 leaf

sequence read_recovery_step

do executor.builtin_read_file read_recovery args {"path": "ci_recovered.txt"} expect robonix/system/executor/builtin/read_file success

Observed plan round 2

PASS3:0robonix/system/executor/builtin/read_fileargs {"path": "ci_recovered.txt"}recovered charlie-3

PASSbuiltin/file_roundtrip1 step(s), 3 leaf call(s)

step 0write, read, and list probe file3 leafs

sequence file_roundtrip_tree

do executor.builtin_write_file write_probe args {"content": "robonix ci probe alpha-7","path": "ci_probe.txt"} expect robonix/system/executor/builtin/write_file success

do executor.builtin_read_file read_probe args {"path": "ci_probe.txt"} expect robonix/system/executor/builtin/read_file success

do executor.builtin_list_dir list_probe args {"path": "."} expect robonix/system/executor/builtin/list_dir success

Observed plan round 0

PASS1:0robonix/system/executor/builtin/write_fileargs {"content": "robonix ci probe alpha-7","path": "ci_probe.txt"}wrote 24 bytes to /home/hanyulong/actions-runner/_work/robonix/robonix/examples/webots/ci_probe.txt

PASS1:1robonix/system/executor/builtin/read_fileargs {"path": "ci_probe.txt"}robonix ci probe alpha-7

PASS1:2robonix/system/executor/builtin/list_dirargs {"path": "."}dir logs dir primitives dir rbnx-boot dir services dir sim file .gitignore file README.md file ci_probe.txt file ci_recovered.txt file robonix_manifest.ci.generated.yaml file robonix_manifest.yaml file start_rviz.sh

PASSbuiltin/plan_control_builtins1 step(s), 4 leaf call(s)

step 0inspect and stop current plan4 leafs

sequence inspect_and_stop_plan

do executor.builtin_get_all_plans list_active_plans args {} expect robonix/system/executor/builtin/get_all_plans success

do executor.builtin_get_plan_status inspect_current_plan args {"plan_id": "1"} expect robonix/system/executor/builtin/get_plan_status success

do executor.builtin_stop_plan_at stop_current_plan_on_complete args {"op_id": "1","plan_id": "1","when": "on_complete"} expect robonix/system/executor/builtin/stop_plan_at success

do executor.builtin_get_all_plans list_armed_stop_point args {} expect robonix/system/executor/builtin/get_all_plans success

Observed plan round 0

PASS1:0robonix/system/executor/builtin/get_all_plansargs {}{"count":1,"plans":[{"cancelled":false,"description":"inspect_and_stop_plan","op_count":5,"plan_id":"1","stop_points":0}]}

PASS1:1robonix/system/executor/builtin/get_plan_statusargs {"plan_id": "1"}{"cancelled":false,"ops":[{"description":"inspect_and_stop_plan","kind":"sequence","op_id":"16","state":"pending","stop_point":null},{"description":"list_active_plans","kind":"do","op_id":"17","state":"succeeded","stop_point":null},{"descr…

PASS1:2robonix/system/executor/builtin/stop_plan_atargs {"op_id": "1","plan_id": "1","when": "on_complete"}Stop point set: RTDL plan '1' will be cancelled on_complete op_id=1.

PASS1:3robonix/system/executor/builtin/get_all_plansargs {}{"count":1,"plans":[{"cancelled":false,"description":"inspect_and_stop_plan","op_count":5,"plan_id":"1","stop_points":1}]}

PASSbuiltin/run_command1 step(s), 1 leaf call(s)

step 0echo marker1 leaf

sequence echo_marker_step

do executor.builtin_run_command echo_marker args {"command": "echo robonix-ci-marker-bravo"} expect robonix/system/executor/builtin/run_command success

Observed plan round 0

PASS1:0robonix/system/executor/builtin/run_commandargs {"command": "echo robonix-ci-marker-bravo"}robonix-ci-marker-bravo

PASScap/camera_snapshot1 step(s), 1 leaf call(s)

step 0camera snapshot1 leaf

sequence camera_snapshot_step

do tiago_camera.camera_snapshot camera_snapshot args {} expect robonix/primitive/camera/snapshot success

Observed plan round 0

PASS1:0robonix/primitive/camera/snapshotargs {}{ "header": { "stamp": { "sec": 1783081024, "nanosec": 32957077 }, "frame_id": "head_front_camera_rgb_optical_frame" }, "height": 480, "width": 640, "encoding": "jpeg", "is_bigendian": 0, "step": 44511…

PASScap/explore_smoke2 step(s), 3 leaf call(s)

step 0start explore1 leaf

sequence start_explore_step

do explore.explore_explore start_explore args {"area_hint": "ci local room","max_speed_m_s": 0.1,"timeout_s": 5.0} expect robonix/skill/explore/explore failure

Observed plan round 0

FAIL1:0robonix/skill/explore/exploreargs {"area_hint": "ci local room","max_speed_m_s": 0.1,"timeout_s": 5.0}hit 5.0s ceiling

step 1poll and cancel explore2 leafs

sequence poll_cancel_explore

do explore.explore_status explore_status args {"run_id": ""} expect robonix/skill/explore/explore/status success

do explore.explore_cancel explore_cancel args {"run_id": ""} expect robonix/skill/explore/explore/cancel success

Observed plan round 1

PASS2:0robonix/skill/explore/explore/statusargs {"run_id": ""}{ "known": true, "state": "TIMEOUT", "area_m2": 0.9900000295042994, "frontiers_left": 17, "elapsed_s": 36.17975068092346, "eta_s": -1.0, "detail": "hit 5.0s ceiling" }

PASS2:1robonix/skill/explore/explore/cancelargs {"run_id": ""}{ "ok": true, "message": "task already in terminal state timeout (no-op)" }

PASScap/lidar_snapshot1 step(s), 1 leaf call(s)

step 0lidar snapshot1 leaf

sequence lidar_snapshot_step

do tiago_lidar.lidar_snapshot lidar_snapshot args {} expect robonix/primitive/lidar/snapshot success

Observed plan round 0

PASS1:0robonix/primitive/lidar/snapshotargs {}{ "header": { "stamp": { "sec": 148, "nanosec": 524207808 }, "frame_id": "hokuyo" }, "angle_min": -1.5700000524520874, "angle_max": 1.5700000524520874, "angle_increment": 0.0047647953033447266, "time_inc…

PASScap/mapping_save1 step(s), 1 leaf call(s)

step 0map save1 leaf

sequence map_save_step

do mapping.map_save_map map_save args {"map_id": "ci_test_map","note": "robonix ci"} expect robonix/service/map/save_map success

Observed plan round 0

PASS1:0robonix/service/map/save_mapargs {"map_id": "ci_test_map","note": "robonix ci"}{ "ok": true, "map_id": "ci_test_map", "database_path": "/mapping/maps/ci_test_map/rtabmap.db", "detail": "saved ci_test_map → /mapping/maps/ci_test_map" }

PASScap/memory_roundtrip1 step(s), 2 leaf call(s)

step 0memory save + search2 leafs

sequence memory_save_search

do memory.memory_save save_fact args {"data": "ci-fact: the test beacon is alpha-7"} expect robonix/service/memory/save success

do memory.memory_search search_fact args {"data": "test beacon"} expect robonix/service/memory/search success

Observed plan round 0

PASS1:0robonix/service/memory/saveargs {"data": "ci-fact: the test beacon is alpha-7"}{ "data": "Memory saved and indexed." }

PASS1:1robonix/service/memory/searchargs {"data": "test beacon"}{ "data": "Relevant memories:\n- ci-fact: the test beacon is alpha-7" }

PASScap/scene_object_fixture1 step(s), 1 leaf call(s)

step 0scene list objects1 leaf

sequence scene_objects_step

do scene.scene_list_objects list_scene_objects args {} expect robonix/system/scene/list_objects success

Observed plan round 0

PASS1:0robonix/system/scene/list_objectsargs {}{ "objects": [ { "id": "scene.object.robot_001", "label": "robot", "x": 0.8280445554521078, "y": 0.05867162907664661, "z": 0.0, "yaw": 0.029907980951148713, "last_seen_unix": 1783081152.43868…

PASScap/speech_speak1 step(s), 1 leaf call(s)

step 0speak1 leaf

sequence speech_speak_step

do speech.speech_speak speech_speak args {"target": "","text": "robonix continuous integration test"} expect robonix/service/speech/speak success

Observed plan round 0

PASS1:0robonix/service/speech/speakargs {"target": "","text": "robonix continuous integration test"}{ "ok": true, "detail": "spoke 35 chars on audio_driver" }

PASScap/voiceprint_list1 step(s), 1 leaf call(s)

step 0voiceprint list1 leaf

sequence voiceprint_list_step

do voiceprint.voiceprint_list voiceprint_list args {} expect robonix/service/voiceprint/list success

Observed plan round 0

PASS1:0robonix/service/voiceprint/listargs {}{ "users_json": "[]", "count": 0, "error": "db not initialised" }

PASSflow/fault_recovery2 step(s), 2 leaf call(s)

step 0faulty save1 leaf

sequence faulty_save_step

do memory.memory_save faulty_save args {} expect robonix/service/memory/save failure

Observed plan round 0

FAIL1:0robonix/service/memory/saveargs {}mcp tool error: Error executing tool save: 1 validation error for saveArguments data Field required [type=missing, input_value={}, input_type=dict] For further information visit https://errors.pydantic.dev/2.13/v/missing

step 1recover1 leaf

sequence recovery_save_step

do memory.memory_save recovery_save args {"data": "ci-flow recovered fact: beacon bravo-2"} expect robonix/service/memory/save success

Observed plan round 1

PASS2:0robonix/service/memory/saveargs {"data": "ci-flow recovered fact: beacon bravo-2"}{ "data": "Memory saved and indexed." }

PASSflow/object_navigation4 step(s), 4 leaf call(s)

step 0explore before object navigation1 leaf

sequence explore_before_navigation

do explore.explore_explore start_explore args {"area_hint": "ci local room","max_speed_m_s": 0.1,"timeout_s": 8.0} expect robonix/skill/explore/explore failure

Observed plan round 0

FAIL1:0robonix/skill/explore/exploreargs {"area_hint": "ci local room","max_speed_m_s": 0.1,"timeout_s": 8.0}hit 8.0s ceiling

step 1list scene objects during explored state1 leaf

sequence select_scene_object

do scene.scene_list_objects list_scene_objects args {} expect robonix/system/scene/list_objects success

Observed plan round 1

PASS2:0robonix/system/scene/list_objectsargs {}{ "objects": [ { "id": "scene.object.robot_001", "label": "robot", "x": -4.323866553444017, "y": 1.3900532369074154, "z": 0.0, "yaw": 0.0008550322651283621, "last_seen_unix": 1783081208.86620…

step 2resolve detected object approach pose1 leaf

sequence resolve_approach_pose

do scene.scene_goal_near goal_near_object args {"object_id": {"var": "object_id"}} expect robonix/system/scene/goal_near success

Observed plan round 2

PASS3:0robonix/system/scene/goal_nearargs {"object_id": "scene.object.potted_plant_001"}{ "reachable": true, "x": 0.4898980316246919, "y": 0.1915602034359455, "yaw": -0.003951716725162578, "reason": "approach pose for 'potted_plant' (scene.object.potted_plant_001)" }

step 3navigate to object approach pose1 leaf

sequence navigate_to_object

do nav2.navigation_navigate navigate_object_goal args {"goal": {"header": {"frame_id": "map","stamp": {"nanosec": 0,"sec": 0}},"pose": {"orientation": {"w": {"transform": "cos_half","var": "nav_yaw"},"x": 0.0,"y": 0.0,"z": {"transform": "sin_half","var": "nav_yaw"}},"position": {"x": {"var": "nav_x"},"y": {"var": "nav_y"},"z": 0.0}}}} expect robonix/service/navigation/navigate success

Observed plan round 3

PASS4:0robonix/service/navigation/navigateargs {"goal": {"header": {"frame_id": "map","stamp": {"nanosec": 0,"sec": 0}},"pose": {"orientation": {"w": 0.9999980479925006,"x": 0.0,"y": 0.0,"z": -0.001975857076951008},"position": {"x": 0.4898980316246919,"y": 0.1915602034359455,"z": 0.0}}}}{ "known": true, "state": "SUCCEEDED", "detail": "succeeded" }

PASSflow/patrol_observe3 step(s), 4 leaf call(s)

step 0parallel sensor capture2 leafs

parallel observe_step

do tiago_camera.camera_snapshot observe_snapshot args {} expect robonix/primitive/camera/snapshot success

do tiago_lidar.lidar_snapshot observe_lidar args {} expect robonix/primitive/lidar/snapshot success

Observed plan round 0

PASS1:0robonix/primitive/camera/snapshotargs {}{ "header": { "stamp": { "sec": 1783081231, "nanosec": 680050373 }, "frame_id": "head_front_camera_rgb_optical_frame" }, "height": 480, "width": 640, "encoding": "jpeg", "is_bigendian": 0, "step": 5012…

PASS1:1robonix/primitive/lidar/snapshotargs {}{ "header": { "stamp": { "sec": 280, "nanosec": 463969773 }, "frame_id": "hokuyo" }, "angle_min": -1.5700000524520874, "angle_max": 1.5700000524520874, "angle_increment": 0.0047647953033447266, "time_inc…

step 1remember1 leaf

sequence remember_step

do memory.memory_save remember_observation args {"data": "ci-flow observation: snapshot captured at waypoint 1"} expect robonix/service/memory/save success

Observed plan round 1

PASS2:0robonix/service/memory/saveargs {"data": "ci-flow observation: snapshot captured at waypoint 1"}{ "data": "Memory saved and indexed." }

step 2recall1 leaf

sequence recall_step

do memory.memory_search recall_observation args {"data": "waypoint 1"} expect robonix/service/memory/search success

Observed plan round 2

PASS3:0robonix/service/memory/searchargs {"data": "waypoint 1"}{ "data": "Relevant memories:\n- ci-fact: the test beacon is alpha-7\n\nci-flow recovered fact: beacon bravo-2\n\nci-flow recovered fact: beacon bravo-2\n\nci-flow recovered fact: beacon bravo-2\n\nci-flow observation: snapshot captured …

Logs

Runtime Contract Coverage

Contracts observed by the scenario runner in executor leaf results. This shows which runtime contract ids were exercised by this run; it is not a full API inventory.

Generated On	2026-07-03T20:21:14+08:00
Test Report Generated On	2026-07-03T20:20:35+08:00
Run Id	28659072549
Workflow	Robonix CI Bot
Event	issue_comment
Repository	syswonder/robonix
Tested Commit	b2967832e6fb
Tested Commit Subject	Merge 3dab2fd010f8d25733ae7889fa6695550e647996 into a04150331358cca635032be956b754631ffdc845
Tested Commit Author	wheatfox <wheatfox17@icloud.com>
Tested Commit Date	2026-07-03T19:50:18+08:00
Pr Number	#110
Pr Title	feat(executor): stop_plan_at — cancel an RTDL plan at a given op
Pr Author	enkerewpo
Pr Url	https://github.com/syswonder/robonix/pull/110
Pr Head Ref	feat/executor-stop-at-op
Pr Head Repo	syswonder/robonix
Triggered By	KouweiLee
Actor	KouweiLee
Triggering Actor	KouweiLee
Runner Name	robonix-runner-pku-rtx5090-x64
Runner Os	Linux
Runner Arch	X64
Origin Url	https://github.com/syswonder/robonix
Run Attempt	1
Ref	refs/heads/dev
Sha	a04150331358
Pr Head Sha	3dab2fd010f8d25733ae7889fa6695550e647996
Report Id	28659072549
Test Ref	refs/pull/110/merge

Hostname	user-NF5468M6
Os Pretty Name	Ubuntu 22.04.5 LTS
Kernel	Linux 6.8.0-124-generic x86_64 GNU/Linux
Arch	x86_64
Cpu Model	Intel(R) Xeon(R) Platinum 8368Q CPU @ 2.60GHz
Cpu Cores	152
Mem Total	125Gi
Gpu Summary	0, NVIDIA GeForce RTX 5090, 32607 MiB, 580.65.06;1, NVIDIA GeForce RTX 5090, 32607 MiB, 580.65.06;2, NVIDIA GeForce RTX 5090, 32607 MiB, 580.65.06;3, NVIDIA GeForce RTX 5090, 32607 MiB, 580.65.06
Nvidia Driver	580.65.06
Cuda Version	13.0
Docker Version	29.2.1
Docker Compose Version	5.0.2
Webots Version	webots package 2025a
Ros Distro	humble
Ros Domain Id	139
Sim Container	ci-28659072549-sim
Sim Image	ci-28659072549-sim
Webots Stream Port	23549
Webots Viewer Port	24549
Python Version	Python 3.10.12
Rustc Version	rustc 1.95.0 (59807616e 2026-04-14)
Rbnx Version	rbnx 0.1.0

Area	Contract id
robonix/primitive/camera	robonix/primitive/camera/snapshot
robonix/primitive/lidar	robonix/primitive/lidar/snapshot
robonix/service/map	robonix/service/map/save_map
robonix/service/memory	robonix/service/memory/save
robonix/service/memory	robonix/service/memory/search
robonix/service/navigation	robonix/service/navigation/navigate
robonix/service/speech	robonix/service/speech/speak
robonix/service/voiceprint	robonix/service/voiceprint/list
robonix/skill/explore	robonix/skill/explore/explore
robonix/skill/explore	robonix/skill/explore/explore/cancel
robonix/skill/explore	robonix/skill/explore/explore/status
robonix/system/executor	robonix/system/executor/builtin/get_all_plans
robonix/system/executor	robonix/system/executor/builtin/get_plan_status
robonix/system/executor	robonix/system/executor/builtin/list_dir
robonix/system/executor	robonix/system/executor/builtin/read_file
robonix/system/executor	robonix/system/executor/builtin/run_command
robonix/system/executor	robonix/system/executor/builtin/stop_plan_at
robonix/system/executor	robonix/system/executor/builtin/write_file
robonix/system/scene	robonix/system/scene/goal_near
robonix/system/scene	robonix/system/scene/list_objects

Robonix Webots CI Report

LLM-Assisted Analysis

PR Changes

Test Result

Suggested Fix

Risks Or Watchouts

Evidence

Run Metadata

Test Environment

Scenarios

RTDL Plan Trees

Logs

Runtime Contract Coverage