Request queue

[luis-gasparschroeder]

Description

When vCache gets deployed, i.e. as a Docker container, the system should be able to handle multiple async requests.

Impact

• Who: End-unsers
• What: Async processing
• Why: Scalability

Proposed Solution

vCache should implement a new abstraction called the input queue. The user should be able to select between different request queues, i.e. FIFO, and set a max size of this queue.

Acceptance Criteria

• Followed coding conventions
• Implemented or updated tests
• Abstract class
• FIFO implementation
• LIFO implementation

Risks & Dependencies

Fairness between requests.

Additional Context

--