[Senate] Design executor plugin architecture for external compute scaling
Quest: Resource Governance
Priority: P3
Status: open
Goal
Document and stub the architecture for offloading analyses to external compute. Define the interface contract: how analyses are packaged, submitted, monitored, and results collected. This prepares for AWS Batch, Lambda, or K8s integration without implementing the cloud side yet.
Acceptance Criteria
☐ Architecture design doc at docs/planning/external-compute-architecture.md
☐ Executor interface defined (same as Analysis Sandboxing quest)
☐ Job packaging: how analysis inputs are bundled for remote execution
☐ Result collection: how outputs come back and get committed to DB
☐ Cost tracking: how remote compute costs flow into resource_usage table
☐ Security: how credentials and data are handled in remote environments
Approach
Design the executor plugin interface (coordinate with Analysis Sandboxing quest)
Define job manifest format: inputs, tools needed, resource budget, timeout
Define result manifest format: outputs, logs, resource usage, cost
Document AWS Batch integration path (Dockerized analysis, S3 staging)
Document K8s integration path (pod spec, persistent volumes)
Write architecture doc with diagramsDependencies
_Identify during implementation._
Dependents
_Identify during implementation._
Work Log
_No entries yet._