@@ -59,14 +59,64 @@ SlicerTMS is a 3DSlicer module for patient-specific transcranial stimulation. It
5959
6060
6161
62- ## Progress and Next Steps
63-
64- <!-- Update this section as you make progress, describing of what you have ACTUALLY DONE.
65- If there are specific steps that you could not complete then you can describe them here, too. -->
66-
67-
68- _ No response_
69-
62+ ## Progress
63+
64+ - SlicerTMS Navigation workflow automated by integrating Local LLM.
65+ - SlicerTMS Registration feature is controlled by cookbook: RAG router bypassing LLM logic for known tasks. Near zero-latency for defined commands.
66+ - LLM does not write raw Python code. System runs on deterministic medical API execution.
67+
68+ ``` text
69+ =========================================================================
70+ [ PHASE 1: IMPLEMENTED ] Zero-Hallucination Deterministic Flow
71+ =========================================================================
72+ Concept: Direct route bypasses LLM logic for safe, immediate execution.
73+
74+ [ User Input ] ➔ ( e.g., "Load Patient Data", "Open Registration" )
75+ ↓
76+ [ RAG Router ] ━━━ ( Semantic Similarity Calculation )
77+ ↓
78+ ┣━━━ [ Match > 0.35 ] ➔ [ Cookbook Execution ] ➔ ( 0s Latency )
79+ ┃ ↓
80+ ┃ Bypass LLM Logic
81+ ┃ ↓
82+ ┃ [ Strict JSON Payload ]
83+ ┃ ↓
84+ ┃ ( Safe Medical API Execution )
85+ ```
86+ Cookbook Matching </br >
87+ <img src =" ./Cookbook matching.png " width =" 400 " alt =" Description " >
88+
89+ Surface Registration
90+ <img src =" ./surface registration.png " width =" 700 " alt =" Description " > </br >
91+
92+
93+
94+ ## Next Steps
95+
96+ - AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
97+ - AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
98+ - Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
99+ ``` text
100+ [ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
101+ =========================================================================
102+ Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
103+
104+ [ Surgeon Input ] ➔ ( e.g., "F10 is off by 2mm, move it down" )
105+ ↓
106+ [ RAG Router ] ━━━ ( Semantic Similarity Calculation )
107+ ↓
108+ ┗━━━ [ Match < 0.35 ] ➔ [ LLM Deep Reasoning ]
109+ ↓
110+ [ Bi-Directional Query Loop ]
111+ ↓
112+ 1. READ ➔ Calls GetNodeCoordinate("F10")
113+ 2. RETURN ⬅ Slicer: {"F10": [x:45.2, y:12.1, z:55.0]}
114+ 3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
115+ 4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
116+ ```
117+
118+ Active AI Agent </br >
119+ <img src =" ./future_1.png " width =" 700 " alt =" Description " > </br >
70120
71121
72122# Illustrations
0 commit comments