Skip to content

Commit 72d60aa

Browse files
shkimmie-umbsjh26
authored andcommitted
update progress and future work for slicertms
1 parent abce8a7 commit 72d60aa

5 files changed

Lines changed: 58 additions & 8 deletions

File tree

56.9 KB
Loading

PW45_2026_Boston/Projects/AiDrivenInterfaceForSlicertms/README.md

Lines changed: 58 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -59,14 +59,64 @@ SlicerTMS is a 3DSlicer module for patient-specific transcranial stimulation. It
5959

6060

6161

62-
## Progress and Next Steps
63-
64-
<!-- Update this section as you make progress, describing of what you have ACTUALLY DONE.
65-
If there are specific steps that you could not complete then you can describe them here, too. -->
66-
67-
68-
_No response_
69-
62+
## Progress
63+
64+
- SlicerTMS Navigation workflow automated by integrating Local LLM.
65+
- SlicerTMS Registration feature is controlled by cookbook: RAG router bypassing LLM logic for known tasks. Near zero-latency for defined commands.
66+
- LLM does not write raw Python code. System runs on deterministic medical API execution.
67+
68+
```text
69+
=========================================================================
70+
[ PHASE 1: IMPLEMENTED ] Zero-Hallucination Deterministic Flow
71+
=========================================================================
72+
Concept: Direct route bypasses LLM logic for safe, immediate execution.
73+
74+
[ User Input ] ➔ ( e.g., "Load Patient Data", "Open Registration" )
75+
76+
[ RAG Router ] ━━━ ( Semantic Similarity Calculation )
77+
78+
┣━━━ [ Match > 0.35 ] ➔ [ Cookbook Execution ] ➔ ( 0s Latency )
79+
┃ ↓
80+
┃ Bypass LLM Logic
81+
┃ ↓
82+
┃ [ Strict JSON Payload ]
83+
┃ ↓
84+
┃ ( Safe Medical API Execution )
85+
```
86+
Cookbook Matching </br>
87+
<img src="./Cookbook matching.png" width="400" alt="Description">
88+
89+
Surface Registration
90+
<img src="./surface registration.png" width="700" alt="Description"> </br>
91+
92+
93+
94+
## Next Steps
95+
96+
- AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
97+
- AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
98+
- Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
99+
```text
100+
[ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
101+
=========================================================================
102+
Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
103+
104+
[ Surgeon Input ] ➔ ( e.g., "F10 is off by 2mm, move it down" )
105+
106+
[ RAG Router ] ━━━ ( Semantic Similarity Calculation )
107+
108+
┗━━━ [ Match < 0.35 ] ➔ [ LLM Deep Reasoning ]
109+
110+
[ Bi-Directional Query Loop ]
111+
112+
1. READ ➔ Calls GetNodeCoordinate("F10")
113+
2. RETURN ⬅ Slicer: {"F10": [x:45.2, y:12.1, z:55.0]}
114+
3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
115+
4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
116+
```
117+
118+
Active AI Agent </br>
119+
<img src="./future_1.png" width="700" alt="Description"> </br>
70120

71121

72122
# Illustrations
Binary file not shown.
4.73 MB
Loading
1.03 MB
Loading

0 commit comments

Comments
 (0)