- Python 3.6+
- CalypsoAI API access and credentials
-
Clone the repository:
git clone <repository-url> cd <repository-directory>
-
Install dependencies:
pip install -r requirements.txt
-
Set up environment variables: Create a
.envfile in the project root with the following content:CALYPSOAI_URL=https://calypsoai.app CALYPSOAI_TOKEN=your_api_token_here
Before running the evaluator, ensure you have configured the appropriate scanners in your CalypsoAI platform:
- Enable only the scanners relevant to your use case
- Consider running evaluations in isolation by enabling specific scanner sets
- This helps ensure accurate results and prevents cross-scanner interference
You can configure your scanners through the CalypsoAI platform's web interface under the Scanner Settings section.
To verify your installation, run:
python validate_setup.pyThis will check that all dependencies are installed and your environment variables are configured correctly.