feat: implement submission file workflow with comprehensive testing

- Create Submission file model
- Add custom storage to use ORA bucket
- Develop SubmissionFileProcessor for create files in DB
- Add TestSubmissionFileProcessor with extensive test coverage
  - Verify complete file processing workflow
  - Validation tests for file addition in create_external_grader_detail

- Document architectural decisions with ADR
- Add test queue folder in .gitignore

Author: leoaulasneo98

.gitignore

@@ -63,3 +63,4 @@ test.txt.tmp
 
 # VSCode
 .vscode
+test_queue/*

docs/source/decisions/0002-add-submission-file-model.rst

@@ -0,0 +1,77 @@
+2. File Handling Implementation for Submission System
+#####################################################
+
+Status
+******
+
+**Provisional** *2025-02-14*
+
+Implemented by https://github.com/openedx/edx-submissions/pull/286
+
+Context
+*******
+
+As part of the XQueue migration effort detailed in ADR 0001, we need to implement a file handling system within edx-submissions. Currently, XQueue manages file submissions through a tightly coupled approach.
+
+### Current Limitations
+
+1. **Inadequate File Management**: XQueue's approach relies on JSON strings in character fields, with size constraints and manual URL manipulation for file handling.
+
+2. **Process Inefficiencies**: The current system uses synchronous HTTP for file retrieval, lacks proper validation, and tightly couples submission processing with file handling.
+
+3. **Integration Challenges**: External graders depend on specific URL formats with HTTP-based retrieval, embedding file information directly in submission payloads.
+
+Decision
+********
+
+We will implement a dedicated file management system for the assessment submission process, focusing on workflow and educational needs:
+
+1. **Centralized Storage**: Create a unified repository for student-submitted files, ensuring they are properly associated with their assessments and accessible throughout the grading process.
+
+2. **Streamlined Workflow**: Design a clear process where files are automatically processed during submission creation, securely stored, and efficiently delivered to grading systems.
+
+3. **Consistent Experience**: Maintain compatibility with existing systems to ensure a smooth transition, allowing instructors and external graders to access files without changes to their established workflows.
+
+Consequences
+************
+
+Positive:
+---------
+
+1. **Architecture**: Clean separation of concerns, improved maintainability, better error handling, optimized database access
+
+2. **Integration**: Seamless xqueue-watcher compatibility, support for existing workflows, minimal client code changes
+
+3. **Operations**: Robust file validation, improved tracking, better error visibility, simplified lifecycle management
+
+Negative:
+---------
+
+1. **Technical**: Additional database structures
+
+2. **Migration**: Temporary system complexity, additional testing needs
+
+3. **Performance**: File processing overhead
+
+References
+**********
+
+Current System Documentation:
+   * XQueue Repository: https://github.com/openedx/xqueue
+   * XQueue Watcher Repository: https://github.com/openedx/xqueue-watcher
+
+Related Repositories:
+   * edx-submissions: https://github.com/openedx/edx-submissions
+   * edx-platform: https://github.com/openedx/edx-platform
+   * XQueue Repository: https://github.com/openedx/xqueue
+
+Related Documentation:
+   * ADR 0001: Creation of ExternalGraderDetail Model for XQueue Migration
+
+Future Event Integration:
+   * Open edX Events Framework: https://github.com/openedx/openedx-events
+   * Event Bus Documentation: https://openedx.atlassian.net/wiki/spaces/AC/pages/124125264/Event+Bus
+
+Related Architecture Documents:
+   * Open edX Architecture Guidelines: https://openedx.atlassian.net/wiki/spaces/AC/pages/124125264/Architecture+Guidelines
+

requirements/base.txt

@@ -1,5 +1,5 @@
 #
-# This file is autogenerated by pip-compile with Python 3.12
+# This file is autogenerated by pip-compile with Python 3.11
 # by the following command:
 #
 #    make upgrade
@@ -8,7 +8,7 @@ asgiref==3.8.1
     # via django
 django==4.2.20
     # via
-    #   -c /home/runner/work/edx-submissions/edx-submissions/requirements/common_constraints.txt
+    #   -c /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/common_constraints.txt
     #   -r requirements/base.in
     #   django-model-utils
     #   djangorestframework

requirements/ci.txt

@@ -1,69 +1,69 @@
 #
-# This file is autogenerated by pip-compile with Python 3.12
+# This file is autogenerated by pip-compile with Python 3.11
 # by the following command:
 #
 #    make upgrade
 #
 cachetools==5.5.2
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
 certifi==2025.4.26
     # via requests
 chardet==5.2.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
 charset-normalizer==3.4.1
     # via requests
 colorama==0.4.6
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
 coverage[toml]==7.8.0
     # via coveralls
 coveralls==4.0.1
     # via -r requirements/ci.in
 distlib==0.3.9
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   virtualenv
 docopt==0.6.2
     # via coveralls
 filelock==3.18.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
     #   virtualenv
 idna==3.10
     # via requests
 packaging==25.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   pyproject-api
     #   tox
 platformdirs==4.3.7
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
     #   virtualenv
 pluggy==1.5.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
 pyproject-api==1.9.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox
 requests==2.32.3
     # via coveralls
 tox==4.25.0
-    # via -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    # via -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
 urllib3==2.2.3
     # via
-    #   -c /home/runner/work/edx-submissions/edx-submissions/requirements/common_constraints.txt
+    #   -c /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/common_constraints.txt
     #   requests
 virtualenv==20.30.0
     # via
-    #   -r /home/runner/work/edx-submissions/edx-submissions/requirements/tox.txt
+    #   -r /Users/leonardoberoes/Documents/Aulasneo/Projects/edx-submissions/requirements/tox.txt
     #   tox

requirements/common_constraints.txt

@@ -3,6 +3,21 @@
 # See BOM-2721 for more details.
 # Below is the copied and edited version of common_constraints
 
+# This is a temporary solution to override the real common_constraints.txt
+# In edx-lint, until the pyjwt constraint in edx-lint has been removed.
+# See BOM-2721 for more details.
+# Below is the copied and edited version of common_constraints
+
+# This is a temporary solution to override the real common_constraints.txt
+# In edx-lint, until the pyjwt constraint in edx-lint has been removed.
+# See BOM-2721 for more details.
+# Below is the copied and edited version of common_constraints
+
+# This is a temporary solution to override the real common_constraints.txt
+# In edx-lint, until the pyjwt constraint in edx-lint has been removed.
+# See BOM-2721 for more details.
+# Below is the copied and edited version of common_constraints
+
 # A central location for most common version constraints
 # (across edx repos) for pip-installation.
 #