mirror of
https://github.com/Xe138/AI-Trader.git
synced 2026-04-21 00:57:24 -04:00
Compare commits
12 Commits
v0.3.0-alp
...
80b22232ad
| Author | SHA1 | Date | |
|---|---|---|---|
| 80b22232ad | |||
| 2d47bd7a3a | |||
| 28fbd6d621 | |||
| 7d66f90810 | |||
| c220211c3a | |||
| 7e95ce356b | |||
| 03f81b3b5c | |||
| ebc66481df | |||
| 73c0fcd908 | |||
| 7aa93af6db | |||
| b9353e34e5 | |||
| d656dac1d0 |
206
API_REFERENCE.md
206
API_REFERENCE.md
@@ -14,13 +14,19 @@ Complete reference for the AI-Trader-Server REST API service.
|
||||
|
||||
Trigger a new simulation job for a specified date range and models.
|
||||
|
||||
**Supports three operational modes:**
|
||||
1. **Explicit date range**: Provide both `start_date` and `end_date`
|
||||
2. **Single date**: Set `start_date` = `end_date`
|
||||
3. **Resume mode**: Set `start_date` to `null` to continue from each model's last completed date
|
||||
|
||||
**Request Body:**
|
||||
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-17",
|
||||
"models": ["gpt-4", "claude-3.7-sonnet"]
|
||||
"models": ["gpt-4", "claude-3.7-sonnet"],
|
||||
"replace_existing": false
|
||||
}
|
||||
```
|
||||
|
||||
@@ -28,9 +34,10 @@ Trigger a new simulation job for a specified date range and models.
|
||||
|
||||
| Field | Type | Required | Description |
|
||||
|-------|------|----------|-------------|
|
||||
| `start_date` | string | Yes | Start date in YYYY-MM-DD format |
|
||||
| `end_date` | string | No | End date in YYYY-MM-DD format. If omitted, simulates single day (uses `start_date`) |
|
||||
| `models` | array[string] | No | Model signatures to run. If omitted, uses all enabled models from server config |
|
||||
| `start_date` | string \| null | No | Start date in YYYY-MM-DD format. If `null`, enables resume mode (each model continues from its last completed date). Defaults to `null`. |
|
||||
| `end_date` | string | **Yes** | End date in YYYY-MM-DD format. **Required** - cannot be null or empty. |
|
||||
| `models` | array[string] | No | Model signatures to run. If omitted, uses all enabled models from server config. |
|
||||
| `replace_existing` | boolean | No | If `false` (default), skips already-completed model-days (idempotent). If `true`, re-runs all dates even if previously completed. |
|
||||
|
||||
**Response (200 OK):**
|
||||
|
||||
@@ -86,7 +93,8 @@ Trigger a new simulation job for a specified date range and models.
|
||||
|
||||
- **Date format:** Must be YYYY-MM-DD
|
||||
- **Date validity:** Must be valid calendar dates
|
||||
- **Date order:** `start_date` must be <= `end_date`
|
||||
- **Date order:** `start_date` must be <= `end_date` (when `start_date` is not null)
|
||||
- **end_date required:** Cannot be null or empty string
|
||||
- **Future dates:** Cannot simulate future dates (must be <= today)
|
||||
- **Date range limit:** Maximum 30 days (configurable via `MAX_SIMULATION_DAYS`)
|
||||
- **Model signatures:** Must match models defined in server configuration
|
||||
@@ -96,12 +104,21 @@ Trigger a new simulation job for a specified date range and models.
|
||||
|
||||
1. Validates date range and parameters
|
||||
2. Determines which models to run (from request or server config)
|
||||
3. Checks for missing price data in date range
|
||||
4. Downloads missing data if `AUTO_DOWNLOAD_PRICE_DATA=true` (default)
|
||||
5. Identifies trading dates with complete price data (all symbols available)
|
||||
6. Creates job in database with status `pending`
|
||||
7. Starts background worker thread
|
||||
8. Returns immediately with job ID
|
||||
3. **Resume mode** (if `start_date` is null):
|
||||
- For each model, queries last completed simulation date
|
||||
- If no previous data exists (cold start), uses `end_date` as single-day simulation
|
||||
- Otherwise, resumes from day after last completed date
|
||||
- Each model can have different resume start dates
|
||||
4. **Idempotent mode** (if `replace_existing=false`, default):
|
||||
- Queries database for already-completed model-day combinations in date range
|
||||
- Skips completed model-days, only creates tasks for gaps
|
||||
- Returns error if all requested dates are already completed
|
||||
5. Checks for missing price data in date range
|
||||
6. Downloads missing data if `AUTO_DOWNLOAD_PRICE_DATA=true` (default)
|
||||
7. Identifies trading dates with complete price data (all symbols available)
|
||||
8. Creates job in database with status `pending` (only for model-days that will actually run)
|
||||
9. Starts background worker thread
|
||||
10. Returns immediately with job ID
|
||||
|
||||
**Examples:**
|
||||
|
||||
@@ -111,6 +128,7 @@ curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
}'
|
||||
```
|
||||
@@ -125,6 +143,41 @@ curl -X POST http://localhost:8080/simulate/trigger \
|
||||
}'
|
||||
```
|
||||
|
||||
Resume from last completed date:
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": null,
|
||||
"end_date": "2025-01-31",
|
||||
"models": ["gpt-4"]
|
||||
}'
|
||||
```
|
||||
|
||||
Idempotent simulation (skip already-completed dates):
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-20",
|
||||
"models": ["gpt-4"],
|
||||
"replace_existing": false
|
||||
}'
|
||||
```
|
||||
|
||||
Re-run existing dates (force replace):
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-20",
|
||||
"models": ["gpt-4"],
|
||||
"replace_existing": true
|
||||
}'
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### GET /simulate/status/{job_id}
|
||||
@@ -484,6 +537,15 @@ JOB_ID=$(echo $RESPONSE | jq -r '.job_id')
|
||||
echo "Job ID: $JOB_ID"
|
||||
```
|
||||
|
||||
Or use resume mode:
|
||||
```bash
|
||||
RESPONSE=$(curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"start_date": null, "end_date": "2025-01-31", "models": ["gpt-4"]}')
|
||||
|
||||
JOB_ID=$(echo $RESPONSE | jq -r '.job_id')
|
||||
```
|
||||
|
||||
2. **Poll for completion:**
|
||||
```bash
|
||||
while true; do
|
||||
@@ -507,9 +569,24 @@ curl "http://localhost:8080/results?job_id=$JOB_ID" | jq '.'
|
||||
|
||||
Use a scheduler (cron, Airflow, etc.) to trigger simulations:
|
||||
|
||||
**Option 1: Resume mode (recommended)**
|
||||
```bash
|
||||
#!/bin/bash
|
||||
# daily_simulation.sh
|
||||
# daily_simulation.sh - Resume from last completed date
|
||||
|
||||
# Calculate today's date
|
||||
TODAY=$(date +%Y-%m-%d)
|
||||
|
||||
# Trigger simulation in resume mode
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d "{\"start_date\": null, \"end_date\": \"$TODAY\", \"models\": [\"gpt-4\"]}"
|
||||
```
|
||||
|
||||
**Option 2: Explicit yesterday's date**
|
||||
```bash
|
||||
#!/bin/bash
|
||||
# daily_simulation.sh - Run specific date
|
||||
|
||||
# Calculate yesterday's date
|
||||
DATE=$(date -d "yesterday" +%Y-%m-%d)
|
||||
@@ -517,7 +594,7 @@ DATE=$(date -d "yesterday" +%Y-%m-%d)
|
||||
# Trigger simulation
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d "{\"start_date\": \"$DATE\", \"models\": [\"gpt-4\"]}"
|
||||
-d "{\"start_date\": \"$DATE\", \"end_date\": \"$DATE\", \"models\": [\"gpt-4\"]}"
|
||||
```
|
||||
|
||||
Add to crontab:
|
||||
@@ -652,6 +729,29 @@ Server loads model definitions from configuration file (default: `configs/defaul
|
||||
- `openai_base_url` - Optional custom API endpoint
|
||||
- `openai_api_key` - Optional model-specific API key
|
||||
|
||||
### Configuration Override System
|
||||
|
||||
**Default config:** `/app/configs/default_config.json` (baked into image)
|
||||
|
||||
**Custom config:** `/app/user-configs/config.json` (optional, via volume mount)
|
||||
|
||||
**Merge behavior:**
|
||||
- Custom config sections completely replace default sections (root-level merge)
|
||||
- If no custom config exists, defaults are used
|
||||
- Validation occurs at container startup (before API starts)
|
||||
- Invalid config causes immediate exit with detailed error message
|
||||
|
||||
**Example custom config** (overrides models only):
|
||||
```json
|
||||
{
|
||||
"models": [
|
||||
{"name": "gpt-5", "basemodel": "openai/gpt-5", "signature": "gpt-5", "enabled": true}
|
||||
]
|
||||
}
|
||||
```
|
||||
|
||||
All other sections (`agent_config`, `log_config`, etc.) inherited from default.
|
||||
|
||||
---
|
||||
|
||||
## OpenAPI / Swagger Documentation
|
||||
@@ -676,11 +776,19 @@ class AITraderServerClient:
|
||||
def __init__(self, base_url="http://localhost:8080"):
|
||||
self.base_url = base_url
|
||||
|
||||
def trigger_simulation(self, start_date, end_date=None, models=None):
|
||||
"""Trigger a simulation job."""
|
||||
payload = {"start_date": start_date}
|
||||
if end_date:
|
||||
payload["end_date"] = end_date
|
||||
def trigger_simulation(self, end_date, start_date=None, models=None, replace_existing=False):
|
||||
"""
|
||||
Trigger a simulation job.
|
||||
|
||||
Args:
|
||||
end_date: End date (YYYY-MM-DD), required
|
||||
start_date: Start date (YYYY-MM-DD) or None for resume mode
|
||||
models: List of model signatures or None for all enabled models
|
||||
replace_existing: If False, skip already-completed dates (idempotent)
|
||||
"""
|
||||
payload = {"end_date": end_date, "replace_existing": replace_existing}
|
||||
if start_date is not None:
|
||||
payload["start_date"] = start_date
|
||||
if models:
|
||||
payload["models"] = models
|
||||
|
||||
@@ -719,9 +827,19 @@ class AITraderServerClient:
|
||||
response.raise_for_status()
|
||||
return response.json()
|
||||
|
||||
# Usage
|
||||
# Usage examples
|
||||
client = AITraderServerClient()
|
||||
job = client.trigger_simulation("2025-01-16", models=["gpt-4"])
|
||||
|
||||
# Single day simulation
|
||||
job = client.trigger_simulation(end_date="2025-01-16", start_date="2025-01-16", models=["gpt-4"])
|
||||
|
||||
# Date range simulation
|
||||
job = client.trigger_simulation(end_date="2025-01-20", start_date="2025-01-16")
|
||||
|
||||
# Resume mode (continue from last completed)
|
||||
job = client.trigger_simulation(end_date="2025-01-31", models=["gpt-4"])
|
||||
|
||||
# Wait for completion and get results
|
||||
result = client.wait_for_completion(job["job_id"])
|
||||
results = client.get_results(job_id=job["job_id"])
|
||||
```
|
||||
@@ -733,13 +851,23 @@ class AITraderServerClient {
|
||||
constructor(private baseUrl: string = "http://localhost:8080") {}
|
||||
|
||||
async triggerSimulation(
|
||||
startDate: string,
|
||||
endDate?: string,
|
||||
models?: string[]
|
||||
endDate: string,
|
||||
options: {
|
||||
startDate?: string | null;
|
||||
models?: string[];
|
||||
replaceExisting?: boolean;
|
||||
} = {}
|
||||
) {
|
||||
const body: any = { start_date: startDate };
|
||||
if (endDate) body.end_date = endDate;
|
||||
if (models) body.models = models;
|
||||
const body: any = {
|
||||
end_date: endDate,
|
||||
replace_existing: options.replaceExisting ?? false
|
||||
};
|
||||
if (options.startDate !== undefined) {
|
||||
body.start_date = options.startDate;
|
||||
}
|
||||
if (options.models) {
|
||||
body.models = options.models;
|
||||
}
|
||||
|
||||
const response = await fetch(`${this.baseUrl}/simulate/trigger`, {
|
||||
method: "POST",
|
||||
@@ -787,9 +915,27 @@ class AITraderServerClient {
|
||||
}
|
||||
}
|
||||
|
||||
// Usage
|
||||
// Usage examples
|
||||
const client = new AITraderServerClient();
|
||||
const job = await client.triggerSimulation("2025-01-16", null, ["gpt-4"]);
|
||||
const result = await client.waitForCompletion(job.job_id);
|
||||
const results = await client.getResults({ jobId: job.job_id });
|
||||
|
||||
// Single day simulation
|
||||
const job1 = await client.triggerSimulation("2025-01-16", {
|
||||
startDate: "2025-01-16",
|
||||
models: ["gpt-4"]
|
||||
});
|
||||
|
||||
// Date range simulation
|
||||
const job2 = await client.triggerSimulation("2025-01-20", {
|
||||
startDate: "2025-01-16"
|
||||
});
|
||||
|
||||
// Resume mode (continue from last completed)
|
||||
const job3 = await client.triggerSimulation("2025-01-31", {
|
||||
startDate: null,
|
||||
models: ["gpt-4"]
|
||||
});
|
||||
|
||||
// Wait for completion and get results
|
||||
const result = await client.waitForCompletion(job1.job_id);
|
||||
const results = await client.getResults({ jobId: job1.job_id });
|
||||
```
|
||||
|
||||
@@ -7,6 +7,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
|
||||
|
||||
## [Unreleased]
|
||||
|
||||
### Fixed
|
||||
- **Dev Mode Warning in Docker** - DEV mode startup warning now displays correctly in Docker logs
|
||||
- Added FastAPI `@app.on_event("startup")` handler to trigger warning on API server startup
|
||||
- Previously only appeared when running `python api/main.py` directly (not via uvicorn)
|
||||
- Docker compose now includes `DEPLOYMENT_MODE` and `PRESERVE_DEV_DATA` environment variables
|
||||
|
||||
## [0.3.0] - 2025-10-31
|
||||
|
||||
### Added - Price Data Management & On-Demand Downloads
|
||||
|
||||
265
CHANGELOG_NEW_API.md
Normal file
265
CHANGELOG_NEW_API.md
Normal file
@@ -0,0 +1,265 @@
|
||||
# API Schema Update - Resume Mode & Idempotent Behavior
|
||||
|
||||
## Summary
|
||||
|
||||
Updated the `/simulate/trigger` endpoint to support three new use cases:
|
||||
1. **Resume mode**: Continue simulations from last completed date per model
|
||||
2. **Idempotent behavior**: Skip already-completed dates by default
|
||||
3. **Explicit date ranges**: Clearer API contract with required `end_date`
|
||||
|
||||
## Breaking Changes
|
||||
|
||||
### Request Schema
|
||||
|
||||
**Before:**
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-10-01", // Required
|
||||
"end_date": "2025-10-02", // Optional (defaulted to start_date)
|
||||
"models": ["gpt-5"] // Optional
|
||||
}
|
||||
```
|
||||
|
||||
**After:**
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-10-01", // Optional (null for resume mode)
|
||||
"end_date": "2025-10-02", // REQUIRED (cannot be null/empty)
|
||||
"models": ["gpt-5"], // Optional
|
||||
"replace_existing": false // NEW: Optional (default: false)
|
||||
}
|
||||
```
|
||||
|
||||
### Key Changes
|
||||
|
||||
1. **`end_date` is now REQUIRED**
|
||||
- Cannot be `null` or empty string
|
||||
- Must always be provided
|
||||
- For single-day simulation, set `start_date` == `end_date`
|
||||
|
||||
2. **`start_date` is now OPTIONAL**
|
||||
- Can be `null` or omitted to enable resume mode
|
||||
- When `null`, each model resumes from its last completed date
|
||||
- If no data exists (cold start), uses `end_date` as single-day simulation
|
||||
|
||||
3. **NEW `replace_existing` field**
|
||||
- `false` (default): Skip already-completed model-days (idempotent)
|
||||
- `true`: Re-run all dates even if previously completed
|
||||
|
||||
## Use Cases
|
||||
|
||||
### 1. Explicit Date Range
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-10-01",
|
||||
"end_date": "2025-10-31",
|
||||
"models": ["gpt-5"]
|
||||
}'
|
||||
```
|
||||
|
||||
### 2. Single Date
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-10-15",
|
||||
"end_date": "2025-10-15",
|
||||
"models": ["gpt-5"]
|
||||
}'
|
||||
```
|
||||
|
||||
### 3. Resume Mode (NEW)
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": null,
|
||||
"end_date": "2025-10-31",
|
||||
"models": ["gpt-5"]
|
||||
}'
|
||||
```
|
||||
|
||||
**Behavior:**
|
||||
- Model "gpt-5" last completed: `2025-10-15`
|
||||
- Will simulate: `2025-10-16` through `2025-10-31`
|
||||
- If no data exists: Will simulate only `2025-10-31`
|
||||
|
||||
### 4. Idempotent Simulation (NEW)
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-10-01",
|
||||
"end_date": "2025-10-31",
|
||||
"models": ["gpt-5"],
|
||||
"replace_existing": false
|
||||
}'
|
||||
```
|
||||
|
||||
**Behavior:**
|
||||
- Checks database for already-completed dates
|
||||
- Only simulates dates that haven't been completed yet
|
||||
- Returns error if all dates already completed
|
||||
|
||||
### 5. Force Replace
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-10-01",
|
||||
"end_date": "2025-10-31",
|
||||
"models": ["gpt-5"],
|
||||
"replace_existing": true
|
||||
}'
|
||||
```
|
||||
|
||||
**Behavior:**
|
||||
- Re-runs all dates regardless of completion status
|
||||
|
||||
## Implementation Details
|
||||
|
||||
### Files Modified
|
||||
|
||||
1. **`api/main.py`**
|
||||
- Updated `SimulateTriggerRequest` Pydantic model
|
||||
- Added validators for `end_date` (required)
|
||||
- Added validators for `start_date` (optional, can be null)
|
||||
- Added resume logic per model
|
||||
- Added idempotent filtering logic
|
||||
- Fixed bug with `start_date=None` in price data checks
|
||||
|
||||
2. **`api/job_manager.py`**
|
||||
- Added `get_last_completed_date_for_model(model)` method
|
||||
- Added `get_completed_model_dates(models, start_date, end_date)` method
|
||||
- Updated `create_job()` to accept `model_day_filter` parameter
|
||||
|
||||
3. **`tests/integration/test_api_endpoints.py`**
|
||||
- Updated all tests to use new schema
|
||||
- Added tests for resume mode
|
||||
- Added tests for idempotent behavior
|
||||
- Added tests for validation rules
|
||||
|
||||
4. **Documentation Updated**
|
||||
- `API_REFERENCE.md` - Complete API documentation with examples
|
||||
- `QUICK_START.md` - Updated getting started examples
|
||||
- `docs/user-guide/using-the-api.md` - Updated user guide
|
||||
- Client library examples (Python, TypeScript)
|
||||
|
||||
### Database Schema
|
||||
|
||||
No changes to database schema. New functionality uses existing tables:
|
||||
- `job_details` table tracks completion status per model-day
|
||||
- Unique index on `(job_id, date, model)` ensures no duplicates
|
||||
|
||||
### Per-Model Independence
|
||||
|
||||
Each model maintains its own completion state:
|
||||
```
|
||||
Model A: last_completed_date = 2025-10-15
|
||||
Model B: last_completed_date = 2025-10-10
|
||||
|
||||
Request: start_date=null, end_date=2025-10-31
|
||||
|
||||
Result:
|
||||
- Model A simulates: 2025-10-16 through 2025-10-31 (16 days)
|
||||
- Model B simulates: 2025-10-11 through 2025-10-31 (21 days)
|
||||
```
|
||||
|
||||
## Migration Guide
|
||||
|
||||
### For API Clients
|
||||
|
||||
**Old Code:**
|
||||
```python
|
||||
# Single day (old)
|
||||
client.trigger_simulation(start_date="2025-10-15")
|
||||
```
|
||||
|
||||
**New Code:**
|
||||
```python
|
||||
# Single day (new) - MUST provide end_date
|
||||
client.trigger_simulation(start_date="2025-10-15", end_date="2025-10-15")
|
||||
|
||||
# Or use resume mode
|
||||
client.trigger_simulation(start_date=None, end_date="2025-10-31")
|
||||
```
|
||||
|
||||
### Validation Changes
|
||||
|
||||
**Will Now Fail:**
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-10-01",
|
||||
"end_date": "" // ❌ Empty string rejected
|
||||
}
|
||||
```
|
||||
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-10-01",
|
||||
"end_date": null // ❌ Null rejected
|
||||
}
|
||||
```
|
||||
|
||||
```json
|
||||
{
|
||||
"start_date": "2025-10-01" // ❌ Missing end_date
|
||||
}
|
||||
```
|
||||
|
||||
**Will Work:**
|
||||
```json
|
||||
{
|
||||
"end_date": "2025-10-31" // ✓ start_date omitted = resume mode
|
||||
}
|
||||
```
|
||||
|
||||
```json
|
||||
{
|
||||
"start_date": null,
|
||||
"end_date": "2025-10-31" // ✓ Explicit null = resume mode
|
||||
}
|
||||
```
|
||||
|
||||
## Benefits
|
||||
|
||||
1. **Daily Automation**: Resume mode perfect for cron jobs
|
||||
- No need to calculate "yesterday's date"
|
||||
- Just provide today as end_date
|
||||
|
||||
2. **Idempotent by Default**: Safe to re-run
|
||||
- Accidentally trigger same date? No problem, it's skipped
|
||||
- Explicit `replace_existing=true` when you want to re-run
|
||||
|
||||
3. **Per-Model Independence**: Flexible deployment
|
||||
- Can add new models without re-running old ones
|
||||
- Models can progress at different rates
|
||||
|
||||
4. **Clear API Contract**: No ambiguity
|
||||
- `end_date` always required
|
||||
- `start_date=null` clearly means "resume"
|
||||
- Default behavior is safe (idempotent)
|
||||
|
||||
## Backward Compatibility
|
||||
|
||||
⚠️ **This is a BREAKING CHANGE** for clients that:
|
||||
- Rely on `end_date` defaulting to `start_date`
|
||||
- Don't explicitly provide `end_date`
|
||||
|
||||
**Migration:** Update all API calls to explicitly provide `end_date`.
|
||||
|
||||
## Testing
|
||||
|
||||
Run integration tests:
|
||||
```bash
|
||||
pytest tests/integration/test_api_endpoints.py -v
|
||||
```
|
||||
|
||||
All tests updated to cover:
|
||||
- Single-day simulation
|
||||
- Date ranges
|
||||
- Resume mode (cold start and with existing data)
|
||||
- Idempotent behavior
|
||||
- Validation rules
|
||||
@@ -54,7 +54,36 @@ JINA_API_KEY=your-jina-key-here
|
||||
|
||||
---
|
||||
|
||||
## Step 3: Start the API Server
|
||||
## Step 3: (Optional) Custom Model Configuration
|
||||
|
||||
To use different AI models than the defaults, create a custom config:
|
||||
|
||||
1. Create config directory:
|
||||
```bash
|
||||
mkdir -p configs
|
||||
```
|
||||
|
||||
2. Create `configs/config.json`:
|
||||
```json
|
||||
{
|
||||
"models": [
|
||||
{
|
||||
"name": "my-gpt-4",
|
||||
"basemodel": "openai/gpt-4",
|
||||
"signature": "my-gpt-4",
|
||||
"enabled": true
|
||||
}
|
||||
]
|
||||
}
|
||||
```
|
||||
|
||||
3. The Docker container will automatically merge this with default settings.
|
||||
|
||||
Your custom config only needs to include sections you want to override.
|
||||
|
||||
---
|
||||
|
||||
## Step 4: Start the API Server
|
||||
|
||||
```bash
|
||||
docker-compose up -d
|
||||
@@ -79,7 +108,7 @@ docker logs -f ai-trader-server
|
||||
|
||||
---
|
||||
|
||||
## Step 4: Verify Service is Running
|
||||
## Step 5: Verify Service is Running
|
||||
|
||||
```bash
|
||||
curl http://localhost:8080/health
|
||||
@@ -99,7 +128,7 @@ If you see `"status": "healthy"`, you're ready!
|
||||
|
||||
---
|
||||
|
||||
## Step 5: Run Your First Simulation
|
||||
## Step 6: Run Your First Simulation
|
||||
|
||||
Trigger a simulation for a single day with GPT-4:
|
||||
|
||||
@@ -108,6 +137,7 @@ curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
}'
|
||||
```
|
||||
@@ -119,15 +149,17 @@ curl -X POST http://localhost:8080/simulate/trigger \
|
||||
"job_id": "550e8400-e29b-41d4-a716-446655440000",
|
||||
"status": "pending",
|
||||
"total_model_days": 1,
|
||||
"message": "Simulation job created with 1 trading dates"
|
||||
"message": "Simulation job created with 1 model-day tasks"
|
||||
}
|
||||
```
|
||||
|
||||
**Save the `job_id`** - you'll need it to check status.
|
||||
|
||||
**Note:** Both `start_date` and `end_date` are required. For a single day, set them to the same value. To simulate a range, use different dates (e.g., `"start_date": "2025-01-16", "end_date": "2025-01-20"`).
|
||||
|
||||
---
|
||||
|
||||
## Step 6: Monitor Progress
|
||||
## Step 7: Monitor Progress
|
||||
|
||||
```bash
|
||||
# Replace with your job_id from Step 5
|
||||
@@ -172,7 +204,7 @@ curl http://localhost:8080/simulate/status/$JOB_ID
|
||||
|
||||
---
|
||||
|
||||
## Step 7: View Results
|
||||
## Step 8: View Results
|
||||
|
||||
```bash
|
||||
curl "http://localhost:8080/results?job_id=$JOB_ID" | jq '.'
|
||||
@@ -234,12 +266,32 @@ curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4", "claude-3.7-sonnet"]
|
||||
}'
|
||||
```
|
||||
|
||||
**Note:** Models must be defined and enabled in `configs/default_config.json`.
|
||||
|
||||
### Resume from Last Completed Date
|
||||
|
||||
Continue simulations from where you left off (useful for daily automation):
|
||||
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"start_date": null,
|
||||
"end_date": "2025-01-31",
|
||||
"models": ["gpt-4"]
|
||||
}'
|
||||
```
|
||||
|
||||
This will:
|
||||
- Check the last completed date for each model
|
||||
- Resume from the next day after the last completed date
|
||||
- If no previous data exists, run only the `end_date` as a single day
|
||||
|
||||
### Query Specific Results
|
||||
|
||||
```bash
|
||||
|
||||
116
ROADMAP.md
116
ROADMAP.md
@@ -132,7 +132,7 @@ curl -X POST http://localhost:5000/simulate/to-date \
|
||||
|
||||
#### Security & Best Practices
|
||||
- **Security Hardening** - Production security review
|
||||
- API authentication/authorization review (if applicable)
|
||||
- **⚠️ SECURITY WARNING:** v1.0.0 does not include API authentication. The server should only be deployed in trusted environments (local development, private networks). Documentation must clearly warn users that the API is insecure and accessible to anyone with network access. API authentication is planned for v1.1.0.
|
||||
- API key management best practices documentation
|
||||
- Input validation and sanitization review
|
||||
- SQL injection prevention validation
|
||||
@@ -167,7 +167,100 @@ All of the following must be met before v1.0.0 release:
|
||||
- [ ] At least 2 weeks of community testing (beta period)
|
||||
- [ ] Zero known data integrity issues
|
||||
|
||||
### v1.1.0 - Position History & Analytics (Planned)
|
||||
### v1.1.0 - API Authentication & Security (Planned)
|
||||
|
||||
**Focus:** Secure the API with authentication and authorization
|
||||
|
||||
#### Authentication System
|
||||
- **API Key Authentication** - Token-based access control
|
||||
- API key generation and management:
|
||||
- `POST /auth/keys` - Generate new API key (admin only)
|
||||
- `GET /auth/keys` - List API keys with metadata (admin only)
|
||||
- `DELETE /auth/keys/{key_id}` - Revoke API key (admin only)
|
||||
- Key features:
|
||||
- Cryptographically secure random key generation
|
||||
- Hashed storage (never store plaintext keys)
|
||||
- Key expiration dates (optional)
|
||||
- Key scoping (read-only vs. full access)
|
||||
- Usage tracking per key
|
||||
- Authentication header: `Authorization: Bearer <api_key>`
|
||||
- Backward compatibility: Optional authentication mode for migration
|
||||
|
||||
#### Authorization & Permissions
|
||||
- **Role-Based Access Control** - Different permission levels
|
||||
- Permission levels:
|
||||
- **Admin** - Full access (create/delete keys, all operations)
|
||||
- **Read-Write** - Start simulations, modify data
|
||||
- **Read-Only** - View results and status only
|
||||
- Per-endpoint authorization checks
|
||||
- API key metadata includes role/permissions
|
||||
- Admin bootstrap process (initial setup)
|
||||
|
||||
#### Security Features
|
||||
- **Enhanced Security Measures** - Defense in depth
|
||||
- Rate limiting per API key:
|
||||
- Configurable requests per minute/hour
|
||||
- Different limits per permission level
|
||||
- 429 Too Many Requests responses
|
||||
- Request logging and audit trail:
|
||||
- Log all API requests with key ID
|
||||
- Track failed authentication attempts
|
||||
- Alert on suspicious patterns
|
||||
- CORS configuration:
|
||||
- Configurable allowed origins
|
||||
- Secure defaults for production
|
||||
- HTTPS enforcement options:
|
||||
- Redirect HTTP to HTTPS
|
||||
- HSTS headers
|
||||
- API key rotation:
|
||||
- Support for multiple active keys
|
||||
- Graceful key migration
|
||||
|
||||
#### Configuration
|
||||
- **Security Settings** - Environment-based configuration
|
||||
- Environment variables:
|
||||
- `AUTH_ENABLED` - Enable/disable authentication (default: false for v1.0.0 compatibility)
|
||||
- `ADMIN_API_KEY` - Bootstrap admin key (first-time setup)
|
||||
- `KEY_EXPIRATION_DAYS` - Default key expiration
|
||||
- `RATE_LIMIT_PER_MINUTE` - Default rate limit
|
||||
- `REQUIRE_HTTPS` - Force HTTPS in production
|
||||
- Migration path:
|
||||
- v1.0 users can upgrade with `AUTH_ENABLED=false`
|
||||
- Enable authentication when ready
|
||||
- Clear migration documentation
|
||||
|
||||
#### Documentation Updates
|
||||
- **Security Documentation** - Comprehensive security guidance
|
||||
- Authentication setup guide:
|
||||
- Initial admin key setup
|
||||
- Creating API keys for clients
|
||||
- Key rotation procedures
|
||||
- Security best practices:
|
||||
- Network security considerations
|
||||
- HTTPS deployment requirements
|
||||
- Firewall rules recommendations
|
||||
- API documentation updates:
|
||||
- Authentication examples for all endpoints
|
||||
- Error responses (401, 403, 429)
|
||||
- Rate limit headers documentation
|
||||
|
||||
#### Benefits
|
||||
- **Secure Public Deployment** - Safe to expose over internet
|
||||
- **Multi-User Support** - Different users/applications with separate keys
|
||||
- **Usage Tracking** - Monitor API usage per key
|
||||
- **Compliance** - Meet security requirements for production deployments
|
||||
- **Accountability** - Audit trail of who did what
|
||||
|
||||
#### Technical Implementation
|
||||
- Authentication middleware for Flask
|
||||
- Database schema for API keys:
|
||||
- `api_keys` table (id, key_hash, name, role, created_at, expires_at, last_used)
|
||||
- `api_requests` table (id, key_id, endpoint, timestamp, status_code)
|
||||
- Secure key generation using `secrets` module
|
||||
- Password hashing with bcrypt/argon2
|
||||
- JWT tokens as alternative to static API keys (future consideration)
|
||||
|
||||
### v1.2.0 - Position History & Analytics (Planned)
|
||||
|
||||
**Focus:** Track and analyze trading behavior over time
|
||||
|
||||
@@ -207,7 +300,7 @@ All of the following must be met before v1.0.0 release:
|
||||
- Debug unexpected trading decisions
|
||||
- Compare trading styles across models
|
||||
|
||||
### v1.2.0 - Performance Metrics & Analytics (Planned)
|
||||
### v1.3.0 - Performance Metrics & Analytics (Planned)
|
||||
|
||||
**Focus:** Calculate standard financial performance metrics
|
||||
|
||||
@@ -264,7 +357,7 @@ All of the following must be met before v1.0.0 release:
|
||||
- Compare effectiveness of different AI models
|
||||
- Detect performance changes over time
|
||||
|
||||
### v1.3.0 - Data Management API (Planned)
|
||||
### v1.4.0 - Data Management API (Planned)
|
||||
|
||||
**Focus:** Price data operations and coverage management
|
||||
|
||||
@@ -318,7 +411,7 @@ All of the following must be met before v1.0.0 release:
|
||||
- Ability to fill gaps in historical data
|
||||
- Prevent simulations with incomplete data
|
||||
|
||||
### v1.4.0 - Web Dashboard UI (Planned)
|
||||
### v1.5.0 - Web Dashboard UI (Planned)
|
||||
|
||||
**Focus:** Browser-based interface for monitoring and control
|
||||
|
||||
@@ -391,7 +484,7 @@ All of the following must be met before v1.0.0 release:
|
||||
- Easy model comparison through charts
|
||||
- Quick access to results without API queries
|
||||
|
||||
### v1.5.0 - Advanced Configuration & Customization (Planned)
|
||||
### v1.6.0 - Advanced Configuration & Customization (Planned)
|
||||
|
||||
**Focus:** Enhanced configuration options and extensibility
|
||||
|
||||
@@ -526,11 +619,12 @@ To propose a new feature:
|
||||
- **v0.3.0** - REST API, on-demand downloads, database storage (current)
|
||||
- **v0.4.0** - Simplified simulation control (planned)
|
||||
- **v1.0.0** - Production stability & validation (planned)
|
||||
- **v1.1.0** - Position history & analytics (planned)
|
||||
- **v1.2.0** - Performance metrics & analytics (planned)
|
||||
- **v1.3.0** - Data management API (planned)
|
||||
- **v1.4.0** - Web dashboard UI (planned)
|
||||
- **v1.5.0** - Advanced configuration & customization (planned)
|
||||
- **v1.1.0** - API authentication & security (planned)
|
||||
- **v1.2.0** - Position history & analytics (planned)
|
||||
- **v1.3.0** - Performance metrics & analytics (planned)
|
||||
- **v1.4.0** - Data management API (planned)
|
||||
- **v1.5.0** - Web dashboard UI (planned)
|
||||
- **v1.6.0** - Advanced configuration & customization (planned)
|
||||
- **v2.0.0** - Advanced quantitative modeling (planned)
|
||||
|
||||
---
|
||||
|
||||
@@ -54,7 +54,8 @@ class JobManager:
|
||||
self,
|
||||
config_path: str,
|
||||
date_range: List[str],
|
||||
models: List[str]
|
||||
models: List[str],
|
||||
model_day_filter: Optional[List[tuple]] = None
|
||||
) -> str:
|
||||
"""
|
||||
Create new simulation job.
|
||||
@@ -63,6 +64,8 @@ class JobManager:
|
||||
config_path: Path to configuration file
|
||||
date_range: List of dates to simulate (YYYY-MM-DD)
|
||||
models: List of model signatures to execute
|
||||
model_day_filter: Optional list of (model, date) tuples to limit job_details.
|
||||
If None, creates job_details for all model-date combinations.
|
||||
|
||||
Returns:
|
||||
job_id: UUID of created job
|
||||
@@ -95,9 +98,10 @@ class JobManager:
|
||||
created_at
|
||||
))
|
||||
|
||||
# Create job_details for each model-day combination
|
||||
for date in date_range:
|
||||
for model in models:
|
||||
# Create job_details based on filter
|
||||
if model_day_filter is not None:
|
||||
# Only create job_details for specified model-day pairs
|
||||
for model, date in model_day_filter:
|
||||
cursor.execute("""
|
||||
INSERT INTO job_details (
|
||||
job_id, date, model, status
|
||||
@@ -105,8 +109,21 @@ class JobManager:
|
||||
VALUES (?, ?, ?, ?)
|
||||
""", (job_id, date, model, "pending"))
|
||||
|
||||
logger.info(f"Created job {job_id} with {len(model_day_filter)} model-day tasks (filtered)")
|
||||
else:
|
||||
# Create job_details for all model-day combinations
|
||||
for date in date_range:
|
||||
for model in models:
|
||||
cursor.execute("""
|
||||
INSERT INTO job_details (
|
||||
job_id, date, model, status
|
||||
)
|
||||
VALUES (?, ?, ?, ?)
|
||||
""", (job_id, date, model, "pending"))
|
||||
|
||||
logger.info(f"Created job {job_id} with {len(date_range)} dates and {len(models)} models")
|
||||
|
||||
conn.commit()
|
||||
logger.info(f"Created job {job_id} with {len(date_range)} dates and {len(models)} models")
|
||||
|
||||
return job_id
|
||||
|
||||
@@ -585,6 +602,67 @@ class JobManager:
|
||||
finally:
|
||||
conn.close()
|
||||
|
||||
def get_last_completed_date_for_model(self, model: str) -> Optional[str]:
|
||||
"""
|
||||
Get last completed simulation date for a specific model.
|
||||
|
||||
Args:
|
||||
model: Model signature
|
||||
|
||||
Returns:
|
||||
Last completed date (YYYY-MM-DD) or None if no data exists
|
||||
"""
|
||||
conn = get_db_connection(self.db_path)
|
||||
cursor = conn.cursor()
|
||||
|
||||
try:
|
||||
cursor.execute("""
|
||||
SELECT date
|
||||
FROM job_details
|
||||
WHERE model = ? AND status = 'completed'
|
||||
ORDER BY date DESC
|
||||
LIMIT 1
|
||||
""", (model,))
|
||||
|
||||
row = cursor.fetchone()
|
||||
return row[0] if row else None
|
||||
|
||||
finally:
|
||||
conn.close()
|
||||
|
||||
def get_completed_model_dates(self, models: List[str], start_date: str, end_date: str) -> Dict[str, List[str]]:
|
||||
"""
|
||||
Get all completed dates for each model within a date range.
|
||||
|
||||
Args:
|
||||
models: List of model signatures
|
||||
start_date: Start date (YYYY-MM-DD)
|
||||
end_date: End date (YYYY-MM-DD)
|
||||
|
||||
Returns:
|
||||
Dict mapping model signature to list of completed dates
|
||||
"""
|
||||
conn = get_db_connection(self.db_path)
|
||||
cursor = conn.cursor()
|
||||
|
||||
try:
|
||||
result = {model: [] for model in models}
|
||||
|
||||
for model in models:
|
||||
cursor.execute("""
|
||||
SELECT DISTINCT date
|
||||
FROM job_details
|
||||
WHERE model = ? AND status = 'completed' AND date >= ? AND date <= ?
|
||||
ORDER BY date
|
||||
""", (model, start_date, end_date))
|
||||
|
||||
result[model] = [row[0] for row in cursor.fetchall()]
|
||||
|
||||
return result
|
||||
|
||||
finally:
|
||||
conn.close()
|
||||
|
||||
def cleanup_old_jobs(self, days: int = 30) -> Dict[str, int]:
|
||||
"""
|
||||
Delete jobs older than threshold.
|
||||
|
||||
162
api/main.py
162
api/main.py
@@ -23,7 +23,7 @@ from api.simulation_worker import SimulationWorker
|
||||
from api.database import get_db_connection
|
||||
from api.price_data_manager import PriceDataManager
|
||||
from api.date_utils import validate_date_range, expand_date_range, get_max_simulation_days
|
||||
from tools.deployment_config import get_deployment_mode_dict
|
||||
from tools.deployment_config import get_deployment_mode_dict, log_dev_mode_startup_warning
|
||||
import threading
|
||||
import time
|
||||
|
||||
@@ -33,28 +33,36 @@ logger = logging.getLogger(__name__)
|
||||
# Pydantic models for request/response validation
|
||||
class SimulateTriggerRequest(BaseModel):
|
||||
"""Request body for POST /simulate/trigger."""
|
||||
start_date: str = Field(..., description="Start date for simulation (YYYY-MM-DD)")
|
||||
end_date: Optional[str] = Field(None, description="End date for simulation (YYYY-MM-DD). If not provided, simulates single day.")
|
||||
start_date: Optional[str] = Field(None, description="Start date for simulation (YYYY-MM-DD). If null/omitted, resumes from last completed date per model.")
|
||||
end_date: str = Field(..., description="End date for simulation (YYYY-MM-DD). Required.")
|
||||
models: Optional[List[str]] = Field(
|
||||
None,
|
||||
description="Optional: List of model signatures to simulate. If not provided, uses enabled models from config."
|
||||
)
|
||||
replace_existing: bool = Field(
|
||||
False,
|
||||
description="If true, replaces existing simulation data. If false (default), skips dates that already have data (idempotent)."
|
||||
)
|
||||
|
||||
@field_validator("start_date", "end_date")
|
||||
@classmethod
|
||||
def validate_date_format(cls, v):
|
||||
"""Validate date format."""
|
||||
if v is None:
|
||||
return v
|
||||
if v is None or v == "":
|
||||
return None
|
||||
try:
|
||||
datetime.strptime(v, "%Y-%m-%d")
|
||||
except ValueError:
|
||||
raise ValueError(f"Invalid date format: {v}. Expected YYYY-MM-DD")
|
||||
return v
|
||||
|
||||
def get_end_date(self) -> str:
|
||||
"""Get end date, defaulting to start_date if not provided."""
|
||||
return self.end_date or self.start_date
|
||||
@field_validator("end_date")
|
||||
@classmethod
|
||||
def validate_end_date_required(cls, v):
|
||||
"""Ensure end_date is not null or empty."""
|
||||
if v is None or v == "":
|
||||
raise ValueError("end_date is required and cannot be null or empty")
|
||||
return v
|
||||
|
||||
|
||||
class SimulateTriggerResponse(BaseModel):
|
||||
@@ -128,6 +136,11 @@ def create_app(
|
||||
app.state.db_path = db_path
|
||||
app.state.config_path = config_path
|
||||
|
||||
@app.on_event("startup")
|
||||
async def startup_event():
|
||||
"""Display DEV mode warning on startup if applicable"""
|
||||
log_dev_mode_startup_warning()
|
||||
|
||||
@app.post("/simulate/trigger", response_model=SimulateTriggerResponse, status_code=200)
|
||||
async def trigger_simulation(request: SimulateTriggerRequest):
|
||||
"""
|
||||
@@ -136,6 +149,12 @@ def create_app(
|
||||
Validates date range, downloads missing price data if needed,
|
||||
and creates job with available trading dates.
|
||||
|
||||
Supports:
|
||||
- Single date: start_date == end_date
|
||||
- Date range: start_date < end_date
|
||||
- Resume: start_date is null (each model resumes from its last completed date)
|
||||
- Idempotent: replace_existing=false skips already completed model-days
|
||||
|
||||
Raises:
|
||||
HTTPException 400: Validation errors, running job, or invalid dates
|
||||
HTTPException 503: Price data download failed
|
||||
@@ -151,12 +170,7 @@ def create_app(
|
||||
detail=f"Server configuration file not found: {config_path}"
|
||||
)
|
||||
|
||||
# Get end date (defaults to start_date for single day)
|
||||
end_date = request.get_end_date()
|
||||
|
||||
# Validate date range
|
||||
max_days = get_max_simulation_days()
|
||||
validate_date_range(request.start_date, end_date, max_days=max_days)
|
||||
end_date = request.end_date
|
||||
|
||||
# Determine which models to run
|
||||
import json
|
||||
@@ -180,13 +194,44 @@ def create_app(
|
||||
detail="No enabled models found in config. Either enable models in config or specify them in request."
|
||||
)
|
||||
|
||||
job_manager = JobManager(db_path=app.state.db_path)
|
||||
|
||||
# Handle resume logic (start_date is null)
|
||||
if request.start_date is None:
|
||||
# Resume mode: determine start date per model
|
||||
model_start_dates = {}
|
||||
|
||||
for model in models_to_run:
|
||||
last_date = job_manager.get_last_completed_date_for_model(model)
|
||||
|
||||
if last_date is None:
|
||||
# Cold start: use end_date as single-day simulation
|
||||
model_start_dates[model] = end_date
|
||||
else:
|
||||
# Resume from next day after last completed
|
||||
last_dt = datetime.strptime(last_date, "%Y-%m-%d")
|
||||
next_dt = last_dt + timedelta(days=1)
|
||||
model_start_dates[model] = next_dt.strftime("%Y-%m-%d")
|
||||
|
||||
# For validation purposes, use earliest start date
|
||||
earliest_start = min(model_start_dates.values())
|
||||
start_date = earliest_start
|
||||
else:
|
||||
# Explicit start date provided
|
||||
start_date = request.start_date
|
||||
model_start_dates = {model: start_date for model in models_to_run}
|
||||
|
||||
# Validate date range
|
||||
max_days = get_max_simulation_days()
|
||||
validate_date_range(start_date, end_date, max_days=max_days)
|
||||
|
||||
# Check price data and download if needed
|
||||
auto_download = os.getenv("AUTO_DOWNLOAD_PRICE_DATA", "true").lower() == "true"
|
||||
price_manager = PriceDataManager(db_path=app.state.db_path)
|
||||
|
||||
# Check what's missing
|
||||
# Check what's missing (use computed start_date, not request.start_date which may be None)
|
||||
missing_coverage = price_manager.get_missing_coverage(
|
||||
request.start_date,
|
||||
start_date,
|
||||
end_date
|
||||
)
|
||||
|
||||
@@ -203,7 +248,7 @@ def create_app(
|
||||
|
||||
logger.info(f"Downloading missing price data for {len(missing_coverage)} symbols")
|
||||
|
||||
requested_dates = set(expand_date_range(request.start_date, end_date))
|
||||
requested_dates = set(expand_date_range(start_date, end_date))
|
||||
|
||||
download_result = price_manager.download_missing_data_prioritized(
|
||||
missing_coverage,
|
||||
@@ -229,7 +274,7 @@ def create_app(
|
||||
|
||||
# Get available trading dates (after potential download)
|
||||
available_dates = price_manager.get_available_trading_dates(
|
||||
request.start_date,
|
||||
start_date,
|
||||
end_date
|
||||
)
|
||||
|
||||
@@ -237,11 +282,54 @@ def create_app(
|
||||
raise HTTPException(
|
||||
status_code=400,
|
||||
detail=f"No trading dates with complete price data in range "
|
||||
f"{request.start_date} to {end_date}. "
|
||||
f"{start_date} to {end_date}. "
|
||||
f"All symbols must have data for a date to be tradeable."
|
||||
)
|
||||
|
||||
job_manager = JobManager(db_path=app.state.db_path)
|
||||
# Handle idempotent behavior (skip already completed model-days)
|
||||
if not request.replace_existing:
|
||||
# Get existing completed dates per model
|
||||
completed_dates = job_manager.get_completed_model_dates(
|
||||
models_to_run,
|
||||
start_date,
|
||||
end_date
|
||||
)
|
||||
|
||||
# Build list of model-day tuples to simulate
|
||||
model_day_tasks = []
|
||||
for model in models_to_run:
|
||||
# Filter dates for this model
|
||||
model_start = model_start_dates[model]
|
||||
|
||||
for date in available_dates:
|
||||
# Skip if before model's start date
|
||||
if date < model_start:
|
||||
continue
|
||||
|
||||
# Skip if already completed (idempotent)
|
||||
if date in completed_dates.get(model, []):
|
||||
continue
|
||||
|
||||
model_day_tasks.append((model, date))
|
||||
|
||||
if not model_day_tasks:
|
||||
raise HTTPException(
|
||||
status_code=400,
|
||||
detail="No new model-days to simulate. All requested dates are already completed. "
|
||||
"Use replace_existing=true to re-run."
|
||||
)
|
||||
|
||||
# Extract unique dates that will actually be run
|
||||
dates_to_run = sorted(list(set([date for _, date in model_day_tasks])))
|
||||
else:
|
||||
# Replace mode: run all model-date combinations
|
||||
dates_to_run = available_dates
|
||||
model_day_tasks = [
|
||||
(model, date)
|
||||
for model in models_to_run
|
||||
for date in available_dates
|
||||
if date >= model_start_dates[model]
|
||||
]
|
||||
|
||||
# Check if can start new job
|
||||
if not job_manager.can_start_new_job():
|
||||
@@ -250,11 +338,13 @@ def create_app(
|
||||
detail="Another simulation job is already running or pending. Please wait for it to complete."
|
||||
)
|
||||
|
||||
# Create job with available dates
|
||||
# Create job with dates that will be run
|
||||
# Pass model_day_tasks to only create job_details for tasks that will actually run
|
||||
job_id = job_manager.create_job(
|
||||
config_path=config_path,
|
||||
date_range=available_dates,
|
||||
models=models_to_run
|
||||
date_range=dates_to_run,
|
||||
models=models_to_run,
|
||||
model_day_filter=model_day_tasks
|
||||
)
|
||||
|
||||
# Start worker in background thread (only if not in test mode)
|
||||
@@ -266,12 +356,26 @@ def create_app(
|
||||
thread = threading.Thread(target=run_worker, daemon=True)
|
||||
thread.start()
|
||||
|
||||
logger.info(f"Triggered simulation job {job_id} with {len(available_dates)} dates")
|
||||
logger.info(f"Triggered simulation job {job_id} with {len(model_day_tasks)} model-day tasks")
|
||||
|
||||
# Build response message
|
||||
message = f"Simulation job created with {len(available_dates)} trading dates"
|
||||
total_model_days = len(model_day_tasks)
|
||||
message_parts = [f"Simulation job created with {total_model_days} model-day tasks"]
|
||||
|
||||
if request.start_date is None:
|
||||
message_parts.append("(resume mode)")
|
||||
|
||||
if not request.replace_existing:
|
||||
# Calculate how many were skipped
|
||||
total_possible = len(models_to_run) * len(available_dates)
|
||||
skipped = total_possible - total_model_days
|
||||
if skipped > 0:
|
||||
message_parts.append(f"({skipped} already completed, skipped)")
|
||||
|
||||
if download_info and download_info["rate_limited"]:
|
||||
message += " (rate limit reached - partial data)"
|
||||
message_parts.append("(rate limit reached - partial data)")
|
||||
|
||||
message = " ".join(message_parts)
|
||||
|
||||
# Get deployment mode info
|
||||
deployment_info = get_deployment_mode_dict()
|
||||
@@ -279,7 +383,7 @@ def create_app(
|
||||
response = SimulateTriggerResponse(
|
||||
job_id=job_id,
|
||||
status="pending",
|
||||
total_model_days=len(available_dates) * len(models_to_run),
|
||||
total_model_days=total_model_days,
|
||||
message=message,
|
||||
**deployment_info
|
||||
)
|
||||
@@ -506,4 +610,8 @@ app = create_app()
|
||||
|
||||
if __name__ == "__main__":
|
||||
import uvicorn
|
||||
|
||||
# Display DEV mode warning if applicable
|
||||
log_dev_mode_startup_warning()
|
||||
|
||||
uvicorn.run(app, host="0.0.0.0", port=8080)
|
||||
|
||||
@@ -8,8 +8,13 @@ services:
|
||||
volumes:
|
||||
- ${VOLUME_PATH:-.}/data:/app/data
|
||||
- ${VOLUME_PATH:-.}/logs:/app/logs
|
||||
- ${VOLUME_PATH:-.}/configs:/app/configs
|
||||
# User configs mounted to /app/user-configs (default config baked into image)
|
||||
- ${VOLUME_PATH:-.}/configs:/app/user-configs
|
||||
environment:
|
||||
# Deployment Configuration
|
||||
- DEPLOYMENT_MODE=${DEPLOYMENT_MODE:-PROD}
|
||||
- PRESERVE_DEV_DATA=${PRESERVE_DEV_DATA:-false}
|
||||
|
||||
# AI Model API Configuration
|
||||
- OPENAI_API_BASE=${OPENAI_API_BASE}
|
||||
- OPENAI_API_KEY=${OPENAI_API_KEY}
|
||||
|
||||
249
docs/plans/2025-11-01-config-override-system-design.md
Normal file
249
docs/plans/2025-11-01-config-override-system-design.md
Normal file
@@ -0,0 +1,249 @@
|
||||
# Configuration Override System Design
|
||||
|
||||
**Date:** 2025-11-01
|
||||
**Status:** Approved
|
||||
**Context:** Enable per-deployment model configuration while maintaining sensible defaults
|
||||
|
||||
## Problem
|
||||
|
||||
Deployments need to customize model configurations without modifying the image's default config. Currently, the API looks for `configs/default_config.json` at startup, but volume mounts that include custom configs would overwrite the default config baked into the image.
|
||||
|
||||
## Solution Overview
|
||||
|
||||
Implement a layered configuration system where:
|
||||
- Default config is baked into the Docker image
|
||||
- User config is provided via volume mount in a separate directory
|
||||
- Configs are merged at container startup (before API starts)
|
||||
- Validation failures cause immediate container exit
|
||||
|
||||
## Architecture
|
||||
|
||||
### File Locations
|
||||
|
||||
- **Default config (in image):** `/app/configs/default_config.json`
|
||||
- **User config (mounted):** `/app/user-configs/config.json`
|
||||
- **Merged output:** `/tmp/runtime_config.json`
|
||||
|
||||
### Startup Sequence
|
||||
|
||||
1. **Entrypoint phase** (before uvicorn):
|
||||
- Load `configs/default_config.json` from image
|
||||
- Check if `user-configs/config.json` exists
|
||||
- If exists: perform root-level merge (custom sections override default sections)
|
||||
- Validate merged config structure
|
||||
- If validation fails: log detailed error and `exit 1`
|
||||
- Write merged config to `/tmp/runtime_config.json`
|
||||
- Export `CONFIG_PATH=/tmp/runtime_config.json`
|
||||
|
||||
2. **API initialization:**
|
||||
- Load pre-validated config from `$CONFIG_PATH`
|
||||
- No runtime config validation needed (already validated)
|
||||
|
||||
### Merge Behavior
|
||||
|
||||
**Root-level merge:** Custom config sections completely replace default sections.
|
||||
|
||||
```python
|
||||
default = load_json("configs/default_config.json")
|
||||
custom = load_json("user-configs/config.json") if exists else {}
|
||||
|
||||
merged = {**default}
|
||||
for key in custom:
|
||||
merged[key] = custom[key] # Override entire section
|
||||
```
|
||||
|
||||
**Examples:**
|
||||
- Custom has `models` array → entire models array replaced
|
||||
- Custom has `agent_config` → entire agent_config replaced
|
||||
- Custom missing `date_range` → default date_range used
|
||||
- Custom has unknown keys → passed through (validated in next step)
|
||||
|
||||
### Validation Rules
|
||||
|
||||
**Structure validation:**
|
||||
- Required top-level keys: `agent_type`, `models`, `agent_config`, `log_config`
|
||||
- `date_range` is optional (can be overridden by API request params)
|
||||
- `models` must be an array with at least one entry
|
||||
- Each model must have: `name`, `basemodel`, `signature`, `enabled`
|
||||
|
||||
**Model validation:**
|
||||
- At least one model must have `enabled: true`
|
||||
- Model signatures must be unique
|
||||
- No duplicate model names
|
||||
|
||||
**Date validation (if date_range present):**
|
||||
- Dates match `YYYY-MM-DD` format
|
||||
- `init_date` <= `end_date`
|
||||
- Dates are not in the future
|
||||
|
||||
**Agent config validation:**
|
||||
- `max_steps` > 0
|
||||
- `max_retries` >= 0
|
||||
- `initial_cash` > 0
|
||||
|
||||
### Error Handling
|
||||
|
||||
**Validation failure output:**
|
||||
```
|
||||
❌ CONFIG VALIDATION FAILED
|
||||
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
|
||||
|
||||
Error: Missing required field 'models'
|
||||
Location: Root level
|
||||
File: user-configs/config.json
|
||||
|
||||
Merged config written to: /tmp/runtime_config.json (for debugging)
|
||||
|
||||
Container will exit. Fix config and restart.
|
||||
```
|
||||
|
||||
**Benefits of fail-fast approach:**
|
||||
- No silent config errors during API calls
|
||||
- Clear feedback on what's wrong
|
||||
- Container restart loop until config is fixed
|
||||
- Health checks fail immediately (container never reaches "running" state with bad config)
|
||||
|
||||
## Implementation Components
|
||||
|
||||
### New Files
|
||||
|
||||
**`tools/config_merger.py`**
|
||||
```python
|
||||
def load_config(path: str) -> dict:
|
||||
"""Load and parse JSON with error handling"""
|
||||
|
||||
def merge_configs(default: dict, custom: dict) -> dict:
|
||||
"""Root-level merge - custom sections override default"""
|
||||
|
||||
def validate_config(config: dict) -> None:
|
||||
"""Validate structure, raise detailed exception on failure"""
|
||||
|
||||
def merge_and_validate() -> None:
|
||||
"""Main entrypoint - load, merge, validate, write to /tmp"""
|
||||
```
|
||||
|
||||
### Updated Files
|
||||
|
||||
**`entrypoint.sh`**
|
||||
```bash
|
||||
# After MCP service startup, before uvicorn
|
||||
echo "🔧 Merging and validating configuration..."
|
||||
python -c "from tools.config_merger import merge_and_validate; merge_and_validate()" || exit 1
|
||||
export CONFIG_PATH=/tmp/runtime_config.json
|
||||
echo "✅ Configuration validated"
|
||||
|
||||
exec uvicorn api.main:app ...
|
||||
```
|
||||
|
||||
**`docker-compose.yml`**
|
||||
```yaml
|
||||
volumes:
|
||||
- ./data:/app/data
|
||||
- ./logs:/app/logs
|
||||
- ./configs:/app/user-configs # User's config.json (not /app/configs!)
|
||||
```
|
||||
|
||||
**`api/main.py`**
|
||||
- Keep existing `CONFIG_PATH` env var support (already implemented)
|
||||
- Remove any config validation from request handlers (now done at startup)
|
||||
|
||||
### Documentation Updates
|
||||
|
||||
- **`docs/DOCKER.md`** - Explain user-configs volume mount and config.json structure
|
||||
- **`QUICK_START.md`** - Show minimal config.json example
|
||||
- **`API_REFERENCE.md`** - Note that config errors fail at startup, not during API calls
|
||||
- **`CLAUDE.md`** - Update configuration section with new merge behavior
|
||||
|
||||
## User Experience
|
||||
|
||||
### Minimal Custom Config Example
|
||||
|
||||
```json
|
||||
{
|
||||
"models": [
|
||||
{
|
||||
"name": "my-gpt-4",
|
||||
"basemodel": "openai/gpt-4",
|
||||
"signature": "my-gpt-4",
|
||||
"enabled": true
|
||||
}
|
||||
]
|
||||
}
|
||||
```
|
||||
|
||||
All other settings (`agent_config`, `log_config`, etc.) inherited from default.
|
||||
|
||||
### Complete Custom Config Example
|
||||
|
||||
```json
|
||||
{
|
||||
"agent_type": "BaseAgent",
|
||||
"date_range": {
|
||||
"init_date": "2025-10-01",
|
||||
"end_date": "2025-10-31"
|
||||
},
|
||||
"models": [
|
||||
{
|
||||
"name": "claude-sonnet-4",
|
||||
"basemodel": "anthropic/claude-sonnet-4",
|
||||
"signature": "claude-sonnet-4",
|
||||
"enabled": true
|
||||
}
|
||||
],
|
||||
"agent_config": {
|
||||
"max_steps": 50,
|
||||
"max_retries": 5,
|
||||
"base_delay": 2.0,
|
||||
"initial_cash": 100000.0
|
||||
},
|
||||
"log_config": {
|
||||
"log_path": "./data/agent_data"
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
All sections replaced, no inheritance from default.
|
||||
|
||||
## Backward Compatibility
|
||||
|
||||
**If no `user-configs/config.json` exists:**
|
||||
- System uses `configs/default_config.json` as-is
|
||||
- No merging needed
|
||||
- Existing behavior preserved
|
||||
|
||||
**Breaking change:**
|
||||
- Deployments currently mounting to `/app/configs` must update to `/app/user-configs`
|
||||
- Migration: Update docker-compose.yml volume mount path
|
||||
|
||||
## Security Considerations
|
||||
|
||||
- Default config in image is read-only (immutable)
|
||||
- User config directory is writable (mounted volume)
|
||||
- Merged config in `/tmp` is ephemeral (recreated on restart)
|
||||
- API keys in user config are not logged during validation errors
|
||||
|
||||
## Testing Strategy
|
||||
|
||||
**Unit tests (`tests/unit/test_config_merger.py`):**
|
||||
- Merge behavior with various override combinations
|
||||
- Validation catches all error conditions
|
||||
- Error messages are clear and actionable
|
||||
|
||||
**Integration tests:**
|
||||
- Container startup with valid user config
|
||||
- Container startup with invalid user config (should exit 1)
|
||||
- Container startup with no user config (uses default)
|
||||
- API requests use merged config correctly
|
||||
|
||||
**Manual testing:**
|
||||
- Deploy with minimal config.json (only models)
|
||||
- Deploy with complete config.json (all sections)
|
||||
- Deploy with invalid config.json (verify error output)
|
||||
- Deploy with no config.json (verify default behavior)
|
||||
|
||||
## Future Enhancements
|
||||
|
||||
- Deep merge support (merge within sections, not just root-level)
|
||||
- Config schema validation using JSON Schema
|
||||
- Support for multiple config files (e.g., base + environment + deployment)
|
||||
- Hot reload on config file changes (SIGHUP handler)
|
||||
@@ -49,11 +49,12 @@ curl "http://localhost:8080/results?job_id=$JOB_ID" | jq '.'
|
||||
|
||||
### Single-Day Simulation
|
||||
|
||||
Omit `end_date` to simulate just one day:
|
||||
Set `start_date` and `end_date` to the same value:
|
||||
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-d '{"start_date": "2025-01-16", "models": ["gpt-4"]}'
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"start_date": "2025-01-16", "end_date": "2025-01-16", "models": ["gpt-4"]}'
|
||||
```
|
||||
|
||||
### All Enabled Models
|
||||
@@ -62,9 +63,22 @@ Omit `models` to run all enabled models from config:
|
||||
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"start_date": "2025-01-16", "end_date": "2025-01-20"}'
|
||||
```
|
||||
|
||||
### Resume from Last Completed
|
||||
|
||||
Use `"start_date": null` to continue from where you left off:
|
||||
|
||||
```bash
|
||||
curl -X POST http://localhost:8080/simulate/trigger \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"start_date": null, "end_date": "2025-01-31", "models": ["gpt-4"]}'
|
||||
```
|
||||
|
||||
Each model will resume from its own last completed date. If no data exists, runs only `end_date` as a single day.
|
||||
|
||||
### Filter Results
|
||||
|
||||
```bash
|
||||
|
||||
@@ -41,7 +41,16 @@ echo "📊 Initializing database..."
|
||||
python -c "from api.database import initialize_database; initialize_database('data/jobs.db')"
|
||||
echo "✅ Database initialized"
|
||||
|
||||
# Step 2: Start MCP services in background
|
||||
# Step 2: Merge and validate configuration
|
||||
echo "🔧 Merging and validating configuration..."
|
||||
python -c "from tools.config_merger import merge_and_validate; merge_and_validate()" || {
|
||||
echo "❌ Configuration validation failed"
|
||||
exit 1
|
||||
}
|
||||
export CONFIG_PATH=/tmp/runtime_config.json
|
||||
echo "✅ Configuration validated and merged"
|
||||
|
||||
# Step 3: Start MCP services in background
|
||||
echo "🔧 Starting MCP services..."
|
||||
cd /app
|
||||
python agent_tools/start_mcp_services.py &
|
||||
@@ -50,11 +59,11 @@ MCP_PID=$!
|
||||
# Setup cleanup trap before starting uvicorn
|
||||
trap "echo '🛑 Stopping services...'; kill $MCP_PID 2>/dev/null; exit 0" EXIT SIGTERM SIGINT
|
||||
|
||||
# Step 3: Wait for services to initialize
|
||||
# Step 4: Wait for services to initialize
|
||||
echo "⏳ Waiting for MCP services to start..."
|
||||
sleep 3
|
||||
|
||||
# Step 4: Start FastAPI server with uvicorn (this blocks)
|
||||
# Step 5: Start FastAPI server with uvicorn (this blocks)
|
||||
# Note: Container always uses port 8080 internally
|
||||
# The API_PORT env var only affects the host port mapping in docker-compose.yml
|
||||
echo "🌐 Starting FastAPI server on port 8080..."
|
||||
|
||||
8
main.py
8
main.py
@@ -12,7 +12,8 @@ from prompts.agent_prompt import all_nasdaq_100_symbols
|
||||
from tools.deployment_config import (
|
||||
is_dev_mode,
|
||||
get_deployment_mode,
|
||||
log_api_key_warning
|
||||
log_api_key_warning,
|
||||
log_dev_mode_startup_warning
|
||||
)
|
||||
from api.database import initialize_dev_database
|
||||
|
||||
@@ -108,16 +109,13 @@ async def main(config_path=None):
|
||||
|
||||
# Initialize dev environment if needed
|
||||
if is_dev_mode():
|
||||
print("=" * 60)
|
||||
print("🛠️ DEVELOPMENT MODE ACTIVE")
|
||||
print("=" * 60)
|
||||
log_dev_mode_startup_warning()
|
||||
log_api_key_warning()
|
||||
|
||||
# Initialize dev database (reset unless PRESERVE_DEV_DATA=true)
|
||||
from tools.deployment_config import get_db_path
|
||||
dev_db_path = get_db_path("data/jobs.db")
|
||||
initialize_dev_database(dev_db_path)
|
||||
print("=" * 60)
|
||||
|
||||
# Get Agent type
|
||||
agent_type = config.get("agent_type", "BaseAgent")
|
||||
|
||||
@@ -50,8 +50,8 @@ class TestSimulateTriggerEndpoint:
|
||||
def test_trigger_creates_job(self, api_client):
|
||||
"""Should create job and return job_id."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16", "2025-01-17"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-17",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
@@ -61,56 +61,107 @@ class TestSimulateTriggerEndpoint:
|
||||
assert data["status"] == "pending"
|
||||
assert data["total_model_days"] == 2
|
||||
|
||||
def test_trigger_validates_config_path(self, api_client):
|
||||
"""Should reject nonexistent config path."""
|
||||
def test_trigger_single_date(self, api_client):
|
||||
"""Should create job for single date."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": "/nonexistent/config.json",
|
||||
"date_range": ["2025-01-16"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
assert response.status_code == 400
|
||||
assert "does not exist" in response.json()["detail"].lower()
|
||||
assert response.status_code == 200
|
||||
data = response.json()
|
||||
assert data["total_model_days"] == 1
|
||||
|
||||
def test_trigger_validates_date_range(self, api_client):
|
||||
"""Should reject invalid date range."""
|
||||
def test_trigger_resume_mode_cold_start(self, api_client):
|
||||
"""Should use end_date as single day when no existing data (cold start)."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": [], # Empty date range
|
||||
"start_date": None,
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
assert response.status_code == 422 # Pydantic validation error
|
||||
assert response.status_code == 200
|
||||
data = response.json()
|
||||
assert data["total_model_days"] == 1
|
||||
assert "resume mode" in data["message"]
|
||||
|
||||
def test_trigger_requires_end_date(self, api_client):
|
||||
"""Should reject request with missing end_date."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
assert response.status_code == 422
|
||||
assert "end_date" in str(response.json()["detail"]).lower()
|
||||
|
||||
def test_trigger_rejects_null_end_date(self, api_client):
|
||||
"""Should reject request with null end_date."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": None,
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
assert response.status_code == 422
|
||||
|
||||
def test_trigger_validates_models(self, api_client):
|
||||
"""Should reject empty model list."""
|
||||
"""Should use enabled models from config when models not specified."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16"],
|
||||
"models": [] # Empty models
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16"
|
||||
# models not specified - should use enabled models from config
|
||||
})
|
||||
|
||||
assert response.status_code == 422 # Pydantic validation error
|
||||
assert response.status_code == 200
|
||||
data = response.json()
|
||||
assert data["total_model_days"] >= 1
|
||||
|
||||
def test_trigger_enforces_single_job_limit(self, api_client):
|
||||
"""Should reject trigger when job already running."""
|
||||
# Create first job
|
||||
api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
# Try to create second job
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-17"],
|
||||
"start_date": "2025-01-17",
|
||||
"end_date": "2025-01-17",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
|
||||
assert response.status_code == 400
|
||||
assert "already running" in response.json()["detail"].lower()
|
||||
|
||||
def test_trigger_idempotent_behavior(self, api_client):
|
||||
"""Should skip already completed dates when replace_existing=false."""
|
||||
# This test would need a completed job first
|
||||
# For now, just verify the parameter is accepted
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"],
|
||||
"replace_existing": False
|
||||
})
|
||||
|
||||
assert response.status_code == 200
|
||||
|
||||
def test_trigger_replace_existing_flag(self, api_client):
|
||||
"""Should accept replace_existing flag."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"],
|
||||
"replace_existing": True
|
||||
})
|
||||
|
||||
assert response.status_code == 200
|
||||
|
||||
|
||||
@pytest.mark.integration
|
||||
class TestSimulateStatusEndpoint:
|
||||
@@ -120,8 +171,8 @@ class TestSimulateStatusEndpoint:
|
||||
"""Should return job status and progress."""
|
||||
# Create job
|
||||
create_response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
job_id = create_response.json()["job_id"]
|
||||
@@ -147,8 +198,8 @@ class TestSimulateStatusEndpoint:
|
||||
"""Should include model-day execution details."""
|
||||
# Create job
|
||||
create_response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16", "2025-01-17"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-17",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
job_id = create_response.json()["job_id"]
|
||||
@@ -182,8 +233,8 @@ class TestResultsEndpoint:
|
||||
"""Should filter results by job_id."""
|
||||
# Create job
|
||||
create_response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path,
|
||||
"date_range": ["2025-01-16"],
|
||||
"start_date": "2025-01-16",
|
||||
"end_date": "2025-01-16",
|
||||
"models": ["gpt-4"]
|
||||
})
|
||||
job_id = create_response.json()["job_id"]
|
||||
@@ -279,8 +330,8 @@ class TestErrorHandling:
|
||||
def test_missing_required_fields_returns_422(self, api_client):
|
||||
"""Should validate required fields."""
|
||||
response = api_client.post("/simulate/trigger", json={
|
||||
"config_path": api_client.test_config_path
|
||||
# Missing date_range and models
|
||||
"start_date": "2025-01-16"
|
||||
# Missing end_date
|
||||
})
|
||||
|
||||
assert response.status_code == 422
|
||||
|
||||
121
tests/integration/test_config_override.py
Normal file
121
tests/integration/test_config_override.py
Normal file
@@ -0,0 +1,121 @@
|
||||
"""Integration tests for config override system."""
|
||||
|
||||
import pytest
|
||||
import json
|
||||
import subprocess
|
||||
import tempfile
|
||||
from pathlib import Path
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def test_configs(tmp_path):
|
||||
"""Create test config files."""
|
||||
# Default config
|
||||
default_config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"date_range": {"init_date": "2025-10-01", "end_date": "2025-10-21"},
|
||||
"models": [
|
||||
{"name": "default-model", "basemodel": "openai/gpt-4", "signature": "default", "enabled": True}
|
||||
],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "base_delay": 1.0, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data/agent_data"}
|
||||
}
|
||||
|
||||
configs_dir = tmp_path / "configs"
|
||||
configs_dir.mkdir()
|
||||
|
||||
default_path = configs_dir / "default_config.json"
|
||||
with open(default_path, 'w') as f:
|
||||
json.dump(default_config, f, indent=2)
|
||||
|
||||
return configs_dir, default_config
|
||||
|
||||
|
||||
def test_config_override_models_only(test_configs):
|
||||
"""Test overriding only the models section."""
|
||||
configs_dir, default_config = test_configs
|
||||
|
||||
# Custom config - only override models
|
||||
custom_config = {
|
||||
"models": [
|
||||
{"name": "gpt-5", "basemodel": "openai/gpt-5", "signature": "gpt-5", "enabled": True}
|
||||
]
|
||||
}
|
||||
|
||||
user_configs_dir = configs_dir.parent / "user-configs"
|
||||
user_configs_dir.mkdir()
|
||||
|
||||
custom_path = user_configs_dir / "config.json"
|
||||
with open(custom_path, 'w') as f:
|
||||
json.dump(custom_config, f, indent=2)
|
||||
|
||||
# Run merge
|
||||
result = subprocess.run(
|
||||
[
|
||||
"python", "-c",
|
||||
f"import sys; sys.path.insert(0, '.'); "
|
||||
f"from tools.config_merger import DEFAULT_CONFIG_PATH, CUSTOM_CONFIG_PATH, OUTPUT_CONFIG_PATH, merge_and_validate; "
|
||||
f"import tools.config_merger; "
|
||||
f"tools.config_merger.DEFAULT_CONFIG_PATH = '{configs_dir}/default_config.json'; "
|
||||
f"tools.config_merger.CUSTOM_CONFIG_PATH = '{custom_path}'; "
|
||||
f"tools.config_merger.OUTPUT_CONFIG_PATH = '{configs_dir.parent}/runtime.json'; "
|
||||
f"merge_and_validate()"
|
||||
],
|
||||
capture_output=True,
|
||||
text=True,
|
||||
cwd="/home/bballou/AI-Trader/.worktrees/config-override-system"
|
||||
)
|
||||
|
||||
assert result.returncode == 0, f"Merge failed: {result.stderr}"
|
||||
|
||||
# Verify merged config
|
||||
runtime_path = configs_dir.parent / "runtime.json"
|
||||
with open(runtime_path, 'r') as f:
|
||||
merged = json.load(f)
|
||||
|
||||
# Models should be overridden
|
||||
assert merged["models"] == custom_config["models"]
|
||||
|
||||
# Other sections should be from default
|
||||
assert merged["agent_config"] == default_config["agent_config"]
|
||||
assert merged["date_range"] == default_config["date_range"]
|
||||
|
||||
|
||||
def test_config_validation_fails_gracefully(test_configs):
|
||||
"""Test that invalid config causes exit with clear error."""
|
||||
configs_dir, _ = test_configs
|
||||
|
||||
# Invalid custom config (no enabled models)
|
||||
custom_config = {
|
||||
"models": [
|
||||
{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": False}
|
||||
]
|
||||
}
|
||||
|
||||
user_configs_dir = configs_dir.parent / "user-configs"
|
||||
user_configs_dir.mkdir()
|
||||
|
||||
custom_path = user_configs_dir / "config.json"
|
||||
with open(custom_path, 'w') as f:
|
||||
json.dump(custom_config, f, indent=2)
|
||||
|
||||
# Run merge (should fail)
|
||||
result = subprocess.run(
|
||||
[
|
||||
"python", "-c",
|
||||
f"import sys; sys.path.insert(0, '.'); "
|
||||
f"from tools.config_merger import merge_and_validate; "
|
||||
f"import tools.config_merger; "
|
||||
f"tools.config_merger.DEFAULT_CONFIG_PATH = '{configs_dir}/default_config.json'; "
|
||||
f"tools.config_merger.CUSTOM_CONFIG_PATH = '{custom_path}'; "
|
||||
f"tools.config_merger.OUTPUT_CONFIG_PATH = '{configs_dir.parent}/runtime.json'; "
|
||||
f"merge_and_validate()"
|
||||
],
|
||||
capture_output=True,
|
||||
text=True,
|
||||
cwd="/home/bballou/AI-Trader/.worktrees/config-override-system"
|
||||
)
|
||||
|
||||
assert result.returncode == 1
|
||||
assert "CONFIG VALIDATION FAILED" in result.stderr
|
||||
assert "At least one model must be enabled" in result.stderr
|
||||
293
tests/unit/test_config_merger.py
Normal file
293
tests/unit/test_config_merger.py
Normal file
@@ -0,0 +1,293 @@
|
||||
import pytest
|
||||
import json
|
||||
import tempfile
|
||||
from pathlib import Path
|
||||
from tools.config_merger import load_config, ConfigValidationError, merge_configs, validate_config
|
||||
|
||||
|
||||
def test_load_config_valid_json():
|
||||
"""Test loading a valid JSON config file"""
|
||||
with tempfile.NamedTemporaryFile(mode='w', suffix='.json', delete=False) as f:
|
||||
json.dump({"key": "value"}, f)
|
||||
temp_path = f.name
|
||||
|
||||
try:
|
||||
result = load_config(temp_path)
|
||||
assert result == {"key": "value"}
|
||||
finally:
|
||||
Path(temp_path).unlink()
|
||||
|
||||
|
||||
def test_load_config_file_not_found():
|
||||
"""Test loading non-existent config file"""
|
||||
with pytest.raises(ConfigValidationError, match="not found"):
|
||||
load_config("/nonexistent/path.json")
|
||||
|
||||
|
||||
def test_load_config_invalid_json():
|
||||
"""Test loading malformed JSON"""
|
||||
with tempfile.NamedTemporaryFile(mode='w', suffix='.json', delete=False) as f:
|
||||
f.write("{invalid json")
|
||||
temp_path = f.name
|
||||
|
||||
try:
|
||||
with pytest.raises(ConfigValidationError, match="Invalid JSON"):
|
||||
load_config(temp_path)
|
||||
finally:
|
||||
Path(temp_path).unlink()
|
||||
|
||||
|
||||
def test_merge_configs_empty_custom():
|
||||
"""Test merge with no custom config"""
|
||||
default = {"a": 1, "b": 2}
|
||||
custom = {}
|
||||
result = merge_configs(default, custom)
|
||||
assert result == {"a": 1, "b": 2}
|
||||
|
||||
|
||||
def test_merge_configs_override_section():
|
||||
"""Test custom config overrides entire sections"""
|
||||
default = {
|
||||
"models": [{"name": "default-model", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30}
|
||||
}
|
||||
custom = {
|
||||
"models": [{"name": "custom-model", "enabled": False}]
|
||||
}
|
||||
result = merge_configs(default, custom)
|
||||
|
||||
assert result["models"] == [{"name": "custom-model", "enabled": False}]
|
||||
assert result["agent_config"] == {"max_steps": 30}
|
||||
|
||||
|
||||
def test_merge_configs_add_new_section():
|
||||
"""Test custom config adds new sections"""
|
||||
default = {"a": 1}
|
||||
custom = {"b": 2}
|
||||
result = merge_configs(default, custom)
|
||||
assert result == {"a": 1, "b": 2}
|
||||
|
||||
|
||||
def test_merge_configs_does_not_mutate_inputs():
|
||||
"""Test merge doesn't modify original dicts"""
|
||||
default = {"a": 1}
|
||||
custom = {"a": 2}
|
||||
result = merge_configs(default, custom)
|
||||
|
||||
assert default["a"] == 1 # Original unchanged
|
||||
assert result["a"] == 2
|
||||
|
||||
|
||||
def test_validate_config_valid():
|
||||
"""Test validation passes for valid config"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [
|
||||
{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": True}
|
||||
],
|
||||
"agent_config": {
|
||||
"max_steps": 30,
|
||||
"max_retries": 3,
|
||||
"initial_cash": 10000.0
|
||||
},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
validate_config(config) # Should not raise
|
||||
|
||||
|
||||
def test_validate_config_missing_required_field():
|
||||
"""Test validation fails for missing required field"""
|
||||
config = {"agent_type": "BaseAgent"} # Missing models, agent_config, log_config
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="Missing required field"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
def test_validate_config_no_enabled_models():
|
||||
"""Test validation fails when no models are enabled"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [
|
||||
{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": False}
|
||||
],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="At least one model must be enabled"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
def test_validate_config_duplicate_signatures():
|
||||
"""Test validation fails for duplicate model signatures"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [
|
||||
{"name": "test1", "basemodel": "openai/gpt-4", "signature": "same", "enabled": True},
|
||||
{"name": "test2", "basemodel": "openai/gpt-5", "signature": "same", "enabled": True}
|
||||
],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="Duplicate model signature"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
def test_validate_config_invalid_max_steps():
|
||||
"""Test validation fails for invalid max_steps"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": True}],
|
||||
"agent_config": {"max_steps": 0, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="max_steps must be > 0"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
def test_validate_config_invalid_date_format():
|
||||
"""Test validation fails for invalid date format"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"date_range": {"init_date": "2025-13-01", "end_date": "2025-12-31"}, # Invalid month
|
||||
"models": [{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="Invalid date format"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
def test_validate_config_end_before_init():
|
||||
"""Test validation fails when end_date before init_date"""
|
||||
config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"date_range": {"init_date": "2025-12-31", "end_date": "2025-01-01"},
|
||||
"models": [{"name": "test", "basemodel": "openai/gpt-4", "signature": "test", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
with pytest.raises(ConfigValidationError, match="init_date must be <= end_date"):
|
||||
validate_config(config)
|
||||
|
||||
|
||||
import os
|
||||
from tools.config_merger import merge_and_validate
|
||||
|
||||
|
||||
def test_merge_and_validate_success(tmp_path, monkeypatch):
|
||||
"""Test successful merge and validation"""
|
||||
# Create default config
|
||||
default_config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [{"name": "default", "basemodel": "openai/gpt-4", "signature": "default", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
default_path = tmp_path / "default_config.json"
|
||||
with open(default_path, 'w') as f:
|
||||
json.dump(default_config, f)
|
||||
|
||||
# Create custom config (only overrides models)
|
||||
custom_config = {
|
||||
"models": [{"name": "custom", "basemodel": "openai/gpt-5", "signature": "custom", "enabled": True}]
|
||||
}
|
||||
|
||||
custom_path = tmp_path / "config.json"
|
||||
with open(custom_path, 'w') as f:
|
||||
json.dump(custom_config, f)
|
||||
|
||||
output_path = tmp_path / "runtime_config.json"
|
||||
|
||||
# Mock file paths
|
||||
monkeypatch.setattr("tools.config_merger.DEFAULT_CONFIG_PATH", str(default_path))
|
||||
monkeypatch.setattr("tools.config_merger.CUSTOM_CONFIG_PATH", str(custom_path))
|
||||
monkeypatch.setattr("tools.config_merger.OUTPUT_CONFIG_PATH", str(output_path))
|
||||
|
||||
# Run merge and validate
|
||||
merge_and_validate()
|
||||
|
||||
# Verify output file was created
|
||||
assert output_path.exists()
|
||||
|
||||
# Verify merged content
|
||||
with open(output_path, 'r') as f:
|
||||
result = json.load(f)
|
||||
|
||||
assert result["models"] == [{"name": "custom", "basemodel": "openai/gpt-5", "signature": "custom", "enabled": True}]
|
||||
assert result["agent_config"] == {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0}
|
||||
|
||||
|
||||
def test_merge_and_validate_no_custom_config(tmp_path, monkeypatch):
|
||||
"""Test when no custom config exists (uses default only)"""
|
||||
default_config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [{"name": "default", "basemodel": "openai/gpt-4", "signature": "default", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
default_path = tmp_path / "default_config.json"
|
||||
with open(default_path, 'w') as f:
|
||||
json.dump(default_config, f)
|
||||
|
||||
custom_path = tmp_path / "config.json" # Does not exist
|
||||
output_path = tmp_path / "runtime_config.json"
|
||||
|
||||
monkeypatch.setattr("tools.config_merger.DEFAULT_CONFIG_PATH", str(default_path))
|
||||
monkeypatch.setattr("tools.config_merger.CUSTOM_CONFIG_PATH", str(custom_path))
|
||||
monkeypatch.setattr("tools.config_merger.OUTPUT_CONFIG_PATH", str(output_path))
|
||||
|
||||
merge_and_validate()
|
||||
|
||||
# Verify output matches default
|
||||
with open(output_path, 'r') as f:
|
||||
result = json.load(f)
|
||||
|
||||
assert result == default_config
|
||||
|
||||
|
||||
def test_merge_and_validate_validation_fails(tmp_path, monkeypatch, capsys):
|
||||
"""Test validation failure exits with error"""
|
||||
default_config = {
|
||||
"agent_type": "BaseAgent",
|
||||
"models": [{"name": "default", "basemodel": "openai/gpt-4", "signature": "default", "enabled": True}],
|
||||
"agent_config": {"max_steps": 30, "max_retries": 3, "initial_cash": 10000.0},
|
||||
"log_config": {"log_path": "./data"}
|
||||
}
|
||||
|
||||
default_path = tmp_path / "default_config.json"
|
||||
with open(default_path, 'w') as f:
|
||||
json.dump(default_config, f)
|
||||
|
||||
# Custom config with no enabled models
|
||||
custom_config = {
|
||||
"models": [{"name": "custom", "basemodel": "openai/gpt-5", "signature": "custom", "enabled": False}]
|
||||
}
|
||||
|
||||
custom_path = tmp_path / "config.json"
|
||||
with open(custom_path, 'w') as f:
|
||||
json.dump(custom_config, f)
|
||||
|
||||
output_path = tmp_path / "runtime_config.json"
|
||||
|
||||
monkeypatch.setattr("tools.config_merger.DEFAULT_CONFIG_PATH", str(default_path))
|
||||
monkeypatch.setattr("tools.config_merger.CUSTOM_CONFIG_PATH", str(custom_path))
|
||||
monkeypatch.setattr("tools.config_merger.OUTPUT_CONFIG_PATH", str(output_path))
|
||||
|
||||
# Should exit with error
|
||||
with pytest.raises(SystemExit) as exc_info:
|
||||
merge_and_validate()
|
||||
|
||||
assert exc_info.value.code == 1
|
||||
|
||||
# Check error output (should be in stderr, not stdout)
|
||||
captured = capsys.readouterr()
|
||||
assert "CONFIG VALIDATION FAILED" in captured.err
|
||||
assert "At least one model must be enabled" in captured.err
|
||||
228
tools/config_merger.py
Normal file
228
tools/config_merger.py
Normal file
@@ -0,0 +1,228 @@
|
||||
"""Configuration merging and validation for AI-Trader."""
|
||||
|
||||
import json
|
||||
import sys
|
||||
from pathlib import Path
|
||||
from typing import Dict, Any, Optional
|
||||
from datetime import datetime
|
||||
|
||||
|
||||
class ConfigValidationError(Exception):
|
||||
"""Raised when config validation fails."""
|
||||
pass
|
||||
|
||||
|
||||
def load_config(path: str) -> Dict[str, Any]:
|
||||
"""
|
||||
Load and parse JSON config file.
|
||||
|
||||
Args:
|
||||
path: Path to JSON config file
|
||||
|
||||
Returns:
|
||||
Parsed config dictionary
|
||||
|
||||
Raises:
|
||||
ConfigValidationError: If file not found or invalid JSON
|
||||
"""
|
||||
config_path = Path(path)
|
||||
|
||||
if not config_path.exists():
|
||||
raise ConfigValidationError(f"Config file not found: {path}")
|
||||
|
||||
try:
|
||||
with open(config_path, 'r') as f:
|
||||
return json.load(f)
|
||||
except json.JSONDecodeError as e:
|
||||
raise ConfigValidationError(f"Invalid JSON in {path}: {e}")
|
||||
|
||||
|
||||
def merge_configs(default: Dict[str, Any], custom: Dict[str, Any]) -> Dict[str, Any]:
|
||||
"""
|
||||
Merge custom config into default config (root-level override).
|
||||
|
||||
Custom config sections completely replace default sections.
|
||||
Does not mutate input dictionaries.
|
||||
|
||||
Args:
|
||||
default: Default configuration dict
|
||||
custom: Custom configuration dict (overrides)
|
||||
|
||||
Returns:
|
||||
Merged configuration dict
|
||||
"""
|
||||
merged = dict(default) # Shallow copy
|
||||
|
||||
for key, value in custom.items():
|
||||
merged[key] = value
|
||||
|
||||
return merged
|
||||
|
||||
|
||||
def validate_config(config: Dict[str, Any]) -> None:
|
||||
"""
|
||||
Validate configuration structure and values.
|
||||
|
||||
Args:
|
||||
config: Configuration dictionary to validate
|
||||
|
||||
Raises:
|
||||
ConfigValidationError: If validation fails with detailed message
|
||||
"""
|
||||
# Required top-level fields
|
||||
required_fields = ["agent_type", "models", "agent_config", "log_config"]
|
||||
for field in required_fields:
|
||||
if field not in config:
|
||||
raise ConfigValidationError(f"Missing required field: '{field}'")
|
||||
|
||||
# Validate models
|
||||
models = config["models"]
|
||||
if not isinstance(models, list) or len(models) == 0:
|
||||
raise ConfigValidationError("'models' must be a non-empty array")
|
||||
|
||||
# Check at least one enabled model
|
||||
enabled_models = [m for m in models if m.get("enabled", False)]
|
||||
if not enabled_models:
|
||||
raise ConfigValidationError("At least one model must be enabled")
|
||||
|
||||
# Check required model fields
|
||||
for i, model in enumerate(models):
|
||||
required_model_fields = ["name", "basemodel", "signature", "enabled"]
|
||||
for field in required_model_fields:
|
||||
if field not in model:
|
||||
raise ConfigValidationError(
|
||||
f"Model {i} missing required field: '{field}'"
|
||||
)
|
||||
|
||||
# Check for duplicate signatures
|
||||
signatures = [m["signature"] for m in models]
|
||||
if len(signatures) != len(set(signatures)):
|
||||
duplicates = [s for s in signatures if signatures.count(s) > 1]
|
||||
raise ConfigValidationError(
|
||||
f"Duplicate model signature: {duplicates[0]}"
|
||||
)
|
||||
|
||||
# Validate agent_config
|
||||
agent_config = config["agent_config"]
|
||||
|
||||
if "max_steps" in agent_config:
|
||||
if agent_config["max_steps"] <= 0:
|
||||
raise ConfigValidationError("max_steps must be > 0")
|
||||
|
||||
if "max_retries" in agent_config:
|
||||
if agent_config["max_retries"] < 0:
|
||||
raise ConfigValidationError("max_retries must be >= 0")
|
||||
|
||||
if "initial_cash" in agent_config:
|
||||
if agent_config["initial_cash"] <= 0:
|
||||
raise ConfigValidationError("initial_cash must be > 0")
|
||||
|
||||
# Validate date_range if present (optional)
|
||||
if "date_range" in config:
|
||||
date_range = config["date_range"]
|
||||
|
||||
if "init_date" in date_range:
|
||||
try:
|
||||
init_dt = datetime.strptime(date_range["init_date"], "%Y-%m-%d")
|
||||
except ValueError:
|
||||
raise ConfigValidationError(
|
||||
f"Invalid date format for init_date: {date_range['init_date']}. "
|
||||
"Expected YYYY-MM-DD"
|
||||
)
|
||||
|
||||
if "end_date" in date_range:
|
||||
try:
|
||||
end_dt = datetime.strptime(date_range["end_date"], "%Y-%m-%d")
|
||||
except ValueError:
|
||||
raise ConfigValidationError(
|
||||
f"Invalid date format for end_date: {date_range['end_date']}. "
|
||||
"Expected YYYY-MM-DD"
|
||||
)
|
||||
|
||||
# Check init <= end
|
||||
if "init_date" in date_range and "end_date" in date_range:
|
||||
if init_dt > end_dt:
|
||||
raise ConfigValidationError(
|
||||
f"init_date must be <= end_date (got {date_range['init_date']} > {date_range['end_date']})"
|
||||
)
|
||||
|
||||
|
||||
# File path constants (can be overridden for testing)
|
||||
DEFAULT_CONFIG_PATH = "configs/default_config.json"
|
||||
CUSTOM_CONFIG_PATH = "user-configs/config.json"
|
||||
OUTPUT_CONFIG_PATH = "/tmp/runtime_config.json"
|
||||
|
||||
|
||||
def format_error_message(error: str, location: str, file: str) -> str:
|
||||
"""Format validation error for display."""
|
||||
border = "━" * 60
|
||||
return f"""
|
||||
❌ CONFIG VALIDATION FAILED
|
||||
{border}
|
||||
|
||||
Error: {error}
|
||||
Location: {location}
|
||||
File: {file}
|
||||
|
||||
Merged config written to: {OUTPUT_CONFIG_PATH} (for debugging)
|
||||
|
||||
Container will exit. Fix config and restart.
|
||||
"""
|
||||
|
||||
|
||||
def merge_and_validate() -> None:
|
||||
"""
|
||||
Main entry point for config merging and validation.
|
||||
|
||||
Loads default config, optionally merges custom config,
|
||||
validates the result, and writes to output path.
|
||||
|
||||
Exits with code 1 on any error.
|
||||
"""
|
||||
try:
|
||||
# Load default config
|
||||
print(f"📄 Loading default config from {DEFAULT_CONFIG_PATH}")
|
||||
default_config = load_config(DEFAULT_CONFIG_PATH)
|
||||
|
||||
# Load custom config if exists
|
||||
custom_config = {}
|
||||
if Path(CUSTOM_CONFIG_PATH).exists():
|
||||
print(f"📝 Loading custom config from {CUSTOM_CONFIG_PATH}")
|
||||
custom_config = load_config(CUSTOM_CONFIG_PATH)
|
||||
else:
|
||||
print(f"ℹ️ No custom config found at {CUSTOM_CONFIG_PATH}, using defaults")
|
||||
|
||||
# Merge configs
|
||||
print("🔧 Merging configurations...")
|
||||
merged_config = merge_configs(default_config, custom_config)
|
||||
|
||||
# Write merged config (for debugging even if validation fails)
|
||||
output_path = Path(OUTPUT_CONFIG_PATH)
|
||||
output_path.parent.mkdir(parents=True, exist_ok=True)
|
||||
|
||||
with open(output_path, 'w') as f:
|
||||
json.dump(merged_config, f, indent=2)
|
||||
|
||||
# Validate merged config
|
||||
print("✅ Validating merged configuration...")
|
||||
validate_config(merged_config)
|
||||
|
||||
print(f"✅ Configuration validated successfully")
|
||||
print(f"📦 Merged config written to {OUTPUT_CONFIG_PATH}")
|
||||
|
||||
except ConfigValidationError as e:
|
||||
# Determine which file caused the error
|
||||
error_file = CUSTOM_CONFIG_PATH if Path(CUSTOM_CONFIG_PATH).exists() else DEFAULT_CONFIG_PATH
|
||||
|
||||
error_msg = format_error_message(
|
||||
error=str(e),
|
||||
location="Root level",
|
||||
file=error_file
|
||||
)
|
||||
|
||||
print(error_msg, file=sys.stderr)
|
||||
sys.exit(1)
|
||||
|
||||
except Exception as e:
|
||||
print(f"❌ Unexpected error during config processing: {e}", file=sys.stderr)
|
||||
sys.exit(1)
|
||||
@@ -119,6 +119,43 @@ def log_api_key_warning() -> None:
|
||||
print(" This is expected if you're testing dev mode with existing .env file")
|
||||
|
||||
|
||||
def log_dev_mode_startup_warning() -> None:
|
||||
"""
|
||||
Display prominent warning when server starts in DEV mode
|
||||
|
||||
Warns users that:
|
||||
- AI calls will be simulated/mocked
|
||||
- Data may not be retained between runs
|
||||
- This is a development environment
|
||||
"""
|
||||
if not is_dev_mode():
|
||||
return
|
||||
|
||||
preserve_data = should_preserve_dev_data()
|
||||
|
||||
print()
|
||||
print("=" * 70)
|
||||
print("⚠️ " + "DEVELOPMENT MODE WARNING".center(64) + " ⚠️")
|
||||
print("=" * 70)
|
||||
print()
|
||||
print(" 🚧 This server is running in DEVELOPMENT mode (DEPLOYMENT_MODE=DEV)")
|
||||
print()
|
||||
print(" 📌 IMPORTANT:")
|
||||
print(" • AI API calls will be SIMULATED (mock responses)")
|
||||
print(" • No real AI model costs will be incurred")
|
||||
if preserve_data:
|
||||
print(" • Dev data WILL BE PRESERVED between runs (PRESERVE_DEV_DATA=true)")
|
||||
else:
|
||||
print(" • Dev data WILL BE RESET on each startup (PRESERVE_DEV_DATA=false)")
|
||||
print(" • Using isolated dev database and data paths")
|
||||
print()
|
||||
print(" 💡 To use PRODUCTION mode:")
|
||||
print(" Set environment variable: DEPLOYMENT_MODE=PROD")
|
||||
print()
|
||||
print("=" * 70)
|
||||
print()
|
||||
|
||||
|
||||
def get_deployment_mode_dict() -> dict:
|
||||
"""
|
||||
Get deployment mode information as dictionary (for API responses)
|
||||
|
||||
Reference in New Issue
Block a user