Add chapter-level data counts to execution data

[Enkidu93]

Fixes #907

@ddaspit, my only outstanding question is how we'd like to count only pretranslated non-verse text. At the moment, they're all lumped together. We could either not count them at all or count them separately or just lump them in (current behavior). What do you think makes the most sense?

---

This change is 

[codecov-commenter]

Codecov Report

❌ Patch coverage is 72.50000% with 88 lines in your changes missing coverage. Please review.
✅ Project coverage is 65.87%. Comparing base (19a4d6b) to head (c96729a).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
...Shared/Services/WordAlignmentPreprocessBuildJob.cs	57.01%	44 Missing and 5 partials ⚠️
...e.Shared/Services/TranslationPreprocessBuildJob.cs	80.17%	16 Missing and 7 partials ⚠️
...l.Machine.Shared/Services/NmtPreprocessBuildJob.cs	70.58%	4 Missing and 1 partial ⚠️
...hared/Services/ServalTranslationPlatformService.cs	0.00%	5 Missing ⚠️
...red/Services/ServalWordAlignmentPlatformService.cs	0.00%	5 Missing ⚠️
...rval.Machine.Shared/Services/PreprocessBuildJob.cs	66.66%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #990      +/-   ##
==========================================
+ Coverage   65.47%   65.87%   +0.39%     
==========================================
  Files         387      388       +1     
  Lines       21747    21952     +205     
  Branches     2770     2782      +12     
==========================================
+ Hits        14238    14460     +222     
+ Misses       6472     6440      -32     
- Partials     1037     1052      +15     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[Enkidu93]

I guess I should add this to Echo as well. I'll add that.

[Enkidu93]

I guess I should add this to Echo as well. I'll add that.

I'm realizing that I'll need a Machine dependency in Echo in order to do that. Is that OK or would you prefer to just wait until we complete #987 and let it be resolved there?

[Enkidu93]

Our conclusion was that we will only count scripture segments in this new counts data structure.

[ddaspit]

@ddaspit reviewed 20 files and all commit messages, and made 1 comment.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on Enkidu93).

---

src/Machine/src/Serval.Machine.Shared/Models/BuildExecutionData.cs line 9 at r1 (raw file):

    public bool? IsTrainFilteredByChapter { get; init; }
    public bool? IsInferenceFilteredByChapter { get; init; }
    public Dictionary<string, Dictionary<string, int>>? TrainVerseCount { get; init; }

Can we use IReadOnlyDictionary? Does it cause issues?

[Enkidu93]

@Enkidu93 made 1 comment.
Reviewable status: 7 of 21 files reviewed, 1 unresolved discussion (waiting on ddaspit).

---

src/Machine/src/Serval.Machine.Shared/Models/BuildExecutionData.cs line 9 at r1 (raw file):

Previously, ddaspit (Damien Daspit) wrote…

Can we use IReadOnlyDictionary? Does it cause issues?

Done. No, I double-checked and I think we're fine to use it. It makes passing it through all the layers a little uglier is all - esp. since it is nested.

[Enkidu93]

I guess I should add this to Echo as well. I'll add that.

I'm realizing that I'll need a Machine dependency in Echo in order to do that. Is that OK or would you prefer to just wait until we complete #987 and let it be resolved there?

I decided to leave on Echo for now. I can add support if you prefer but hopefully we will do that work in this sprint as well anyways.

[Enkidu93]

Let me know what you think of my refactoring to be able to better test the preprocess row processing.