|
1 | 1 | # Experiment Automation Agents (EAA) |
2 | 2 |
|
3 | | -EAA is a Python toolkit for building experiment-facing agents around shared |
4 | | -task-manager, tool, memory, skill, and WebUI primitives. The repository is a |
5 | | -`uv` workspace with three installable packages: |
| 3 | + |
| 4 | + |
| 5 | +EAA is a runtime and harness for agents and workflows, designed for running scientific experiments especially for those needing vision. EAA turns a multimodal LLM into an experiment operator with features including the following: |
| 6 | +- A built-in LLM chat loop |
| 7 | +- An image-followup mechanism allowing LLMs to "see" images yielded by tools, even if the LLM provider's API doesn't allow images in tool responses |
| 8 | +- Automatic image captioning |
| 9 | +- Support of MCP servers and external HTTP endpoints as tools |
| 10 | +- Support of agent skills |
| 11 | +- Built-in tools including |
| 12 | + - File read/write |
| 13 | + - Python/bash coding (including Bubblewrap sandboxing) |
| 14 | + - Local environment setup with `uv` |
| 15 | + - Image rendering tool allowing LLM to see floating point TIFFs |
| 16 | + - Subagent and sub-task manager spawning |
| 17 | +- Fully customizable "task manager" data structure |
| 18 | +- A WebUI for easy interaction and visualization of sessions |
| 19 | + |
| 20 | +**EAA is not only for LLM agents!** Fully logic-driven or rule-based workflows - such as Bayesian optimization - can be packaged as task managers. Use MCP servers as RPC calls through the built-in MCP-RPC wrapper, and display status and progress using the same WebUI. Logic-driven task managers can be added to the sub-task manager tool so that an LLM agent can launch them. |
| 21 | + |
| 22 | +Read (or let your agent read) the full documentation [here](https://AdvancedPhotonSource.github.io/EAA). |
| 23 | + |
| 24 | +This repository is a `uv` workspace with three installable packages: |
6 | 25 |
|
7 | 26 | - `eaa-core`: shared runtime, generic tools, memory, WebUI, MCP helpers, and |
8 | 27 | reusable task-manager infrastructure |
|
0 commit comments