Skip to content

Commit bd5328a

Browse files
jrobblejrobble
authored
Add Azure Speech Detection component to R5.0.0. (#114)
1 parent c94f767 commit bd5328a

7 files changed

Lines changed: 45 additions & 30 deletions

File tree

‎docs/docs/Release-Notes.md‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,10 @@
132132

133133
- This new component replaces the old CaffeDetection component. It supports the same GoogLeNet and Yahoo Not Suitable For Work (NSFW) models as the old component, but removes support for the Rezafuad vehicle color detection model in favor of a custom TensorFlow vehicle color detection model. In our tests, the new model has proven to be more generalizable and provide more accurate results on never-before-seen test data. Refer to the [README](https://github.com/openmpf/openmpf-components/blob/master/cpp/OcvDnnDetection/README.md).
134134

135+
<h2>Azure Cognitive Services (ACS) Speech Detection Component</h2>
136+
137+
- This new component utilizes the [Azure Cognitive Services Batch Transcription REST endpoint](https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/batch-transcription) to transcribe speech from audio and video files. Refer to the [README](https://github.com/openmpf/openmpf-components/blob/master/python/AzureSpeechDetection/README.md).
138+
135139
<h2>Tesseract OCR Text Detection Component</h2>
136140

137141
- Text tagging has been simplified to only support regular expression searches. Whole keyword searches are a subset of regular expression searches, and are therefore still supported. Also, the `text-tags.json` file format has been updated to allow for specifying case-sensitive regular expression searches.
@@ -200,7 +204,7 @@
200204

201205
<h2>Updates</h2>
202206

203-
- Update JDK from `jdk-8u181-linux-x64.rpm` to `jdk-8u251-linux-x64.rpm`.
207+
- Updated JDK from `jdk-8u181-linux-x64.rpm` to `jdk-8u251-linux-x64.rpm`.
204208

205209
# OpenMPF 4.1.11: May 2020
206210

‎docs/docs/index.md‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ OpenMPF is a non-proprietary, scalable framework that permits practitioners and
88

99
For those developing new exploitation capabilities, OpenMPF exposes a set of Application Program Interfaces (APIs) for extending media analytics functionality. The APIs allow integrators to introduce new algorithms capable of detecting new targeted entity types. For example, a backpack detection algorithm could be integrated into an OpenMPF instance. OpenMPF does not restrict the number of algorithms that can operate on a given media file, permitting researchers, practitioners, and developers to explore arbitrarily complex composites of exploitation algorithms.
1010

11-
A list of open source algorithms currently integrated into the OpenMPF as distributed processing components is shown here:
11+
A list of algorithms currently integrated into the OpenMPF as distributed processing components is shown here:
1212

1313
| **Operation** | **Object Type** | **Framework**
1414
| --- | --- | ---
@@ -19,6 +19,7 @@ A list of open source algorithms currently integrated into the OpenMPF as distri
1919
| Detection/Tracking | Motion | SuBSENSE w/ STRUCK
2020
| Detection/Tracking | License Plate | OpenALPR
2121
| Detection | Speech | Sphinx
22+
| Detection | Speech | Azure Cognitive Services
2223
| Detection| Scene | OpenCV
2324
| Detection| Classification | OpenCV DNN
2425
| Detection/Tracking | Classification | Darknet

‎docs/site/Release-Notes/index.html‎

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -473,6 +473,11 @@ <h2>OpenCV Deep Neural Networks (DNN) Detection Component</h2>
473473
<ul>
474474
<li>This new component replaces the old CaffeDetection component. It supports the same GoogLeNet and Yahoo Not Suitable For Work (NSFW) models as the old component, but removes support for the Rezafuad vehicle color detection model in favor of a custom TensorFlow vehicle color detection model. In our tests, the new model has proven to be more generalizable and provide more accurate results on never-before-seen test data. Refer to the <a href="https://github.com/openmpf/openmpf-components/blob/master/cpp/OcvDnnDetection/README.md">README</a>.</li>
475475
</ul>
476+
<h2>Azure Cognitive Services (ACS) Speech Detection Component</h2>
477+
478+
<ul>
479+
<li>This new component utilizes the <a href="https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/batch-transcription">Azure Cognitive Services Batch Transcription REST endpoint</a> to transcribe speech from audio and video files. Refer to the <a href="https://github.com/openmpf/openmpf-components/blob/master/python/AzureSpeechDetection/README.md">README</a>.</li>
480+
</ul>
476481
<h2>Tesseract OCR Text Detection Component</h2>
477482

478483
<ul>
@@ -556,7 +561,7 @@ <h1 id="openmpf-4112-may-2020">OpenMPF 4.1.12: May 2020</h1>
556561
<h2>Updates</h2>
557562

558563
<ul>
559-
<li>Update JDK from <code>jdk-8u181-linux-x64.rpm</code> to <code>jdk-8u251-linux-x64.rpm</code>.</li>
564+
<li>Updated JDK from <code>jdk-8u181-linux-x64.rpm</code> to <code>jdk-8u251-linux-x64.rpm</code>.</li>
560565
</ul>
561566
<h1 id="openmpf-4111-may-2020">OpenMPF 4.1.11: May 2020</h1>
562567
<h2>Tesseract OCR Text Detection Component</h2>

‎docs/site/index.html‎

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -256,7 +256,7 @@ <h1 id="overview">Overview</h1>
256256
<p>There are numerous video and image exploitation capabilities available today. The Open Media Processing Framework (OpenMPF) provides a framework for chaining, combining, or replacing individual components for the purpose of experimentation and comparison.</p>
257257
<p>OpenMPF is a non-proprietary, scalable framework that permits practitioners and researchers to construct video, imagery, and audio exploitation capabilities using the available third-party components. Using OpenMPF, one can extract targeted entities in large-scale data environments, such as face and object detection.</p>
258258
<p>For those developing new exploitation capabilities, OpenMPF exposes a set of Application Program Interfaces (APIs) for extending media analytics functionality. The APIs allow integrators to introduce new algorithms capable of detecting new targeted entity types. For example, a backpack detection algorithm could be integrated into an OpenMPF instance. OpenMPF does not restrict the number of algorithms that can operate on a given media file, permitting researchers, practitioners, and developers to explore arbitrarily complex composites of exploitation algorithms.</p>
259-
<p>A list of open source algorithms currently integrated into the OpenMPF as distributed processing components is shown here:</p>
259+
<p>A list of algorithms currently integrated into the OpenMPF as distributed processing components is shown here:</p>
260260
<table>
261261
<thead>
262262
<tr>
@@ -303,6 +303,11 @@ <h1 id="overview">Overview</h1>
303303
</tr>
304304
<tr>
305305
<td>Detection</td>
306+
<td>Speech</td>
307+
<td>Azure Cognitive Services</td>
308+
</tr>
309+
<tr>
310+
<td>Detection</td>
306311
<td>Scene</td>
307312
<td>OpenCV</td>
308313
</tr>
@@ -393,5 +398,5 @@ <h1 id="overview">Overview</h1>
393398

394399
<!--
395400
MkDocs version : 0.16.0
396-
Build Date UTC : 2020-06-24 01:57:35
401+
Build Date UTC : 2020-07-03 18:38:48
397402
-->

‎docs/site/mkdocs/search_index.json‎

Lines changed: 3 additions & 3 deletions
Large diffs are not rendered by default.

‎docs/site/sitemap.xml‎

Lines changed: 20 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
<url>
66
<loc>/index.html</loc>
7-
<lastmod>2020-06-23</lastmod>
7+
<lastmod>2020-07-03</lastmod>
88
<changefreq>daily</changefreq>
99
</url>
1010

@@ -13,55 +13,55 @@
1313

1414
<url>
1515
<loc>/Release-Notes/index.html</loc>
16-
<lastmod>2020-06-23</lastmod>
16+
<lastmod>2020-07-03</lastmod>
1717
<changefreq>daily</changefreq>
1818
</url>
1919

2020
<url>
2121
<loc>/Install-Guide/index.html</loc>
22-
<lastmod>2020-06-23</lastmod>
22+
<lastmod>2020-07-03</lastmod>
2323
<changefreq>daily</changefreq>
2424
</url>
2525

2626
<url>
2727
<loc>/User-Guide/index.html</loc>
28-
<lastmod>2020-06-23</lastmod>
28+
<lastmod>2020-07-03</lastmod>
2929
<changefreq>daily</changefreq>
3030
</url>
3131

3232
<url>
3333
<loc>/Admin-Guide/index.html</loc>
34-
<lastmod>2020-06-23</lastmod>
34+
<lastmod>2020-07-03</lastmod>
3535
<changefreq>daily</changefreq>
3636
</url>
3737

3838
<url>
3939
<loc>/Node-Guide/index.html</loc>
40-
<lastmod>2020-06-23</lastmod>
40+
<lastmod>2020-07-03</lastmod>
4141
<changefreq>daily</changefreq>
4242
</url>
4343

4444
<url>
4545
<loc>/Object-Storage-Guide/index.html</loc>
46-
<lastmod>2020-06-23</lastmod>
46+
<lastmod>2020-07-03</lastmod>
4747
<changefreq>daily</changefreq>
4848
</url>
4949

5050
<url>
5151
<loc>/Contributor-Guide/index.html</loc>
52-
<lastmod>2020-06-23</lastmod>
52+
<lastmod>2020-07-03</lastmod>
5353
<changefreq>daily</changefreq>
5454
</url>
5555

5656
<url>
5757
<loc>/Development-Environment-Guide/index.html</loc>
58-
<lastmod>2020-06-23</lastmod>
58+
<lastmod>2020-07-03</lastmod>
5959
<changefreq>daily</changefreq>
6060
</url>
6161

6262
<url>
6363
<loc>/Acknowledgements/index.html</loc>
64-
<lastmod>2020-06-23</lastmod>
64+
<lastmod>2020-07-03</lastmod>
6565
<changefreq>daily</changefreq>
6666
</url>
6767

@@ -71,49 +71,49 @@
7171

7272
<url>
7373
<loc>/Component-API-Overview/index.html</loc>
74-
<lastmod>2020-06-23</lastmod>
74+
<lastmod>2020-07-03</lastmod>
7575
<changefreq>daily</changefreq>
7676
</url>
7777

7878
<url>
7979
<loc>/CPP-Batch-Component-API/index.html</loc>
80-
<lastmod>2020-06-23</lastmod>
80+
<lastmod>2020-07-03</lastmod>
8181
<changefreq>daily</changefreq>
8282
</url>
8383

8484
<url>
8585
<loc>/CPP-Streaming-Component-API/index.html</loc>
86-
<lastmod>2020-06-23</lastmod>
86+
<lastmod>2020-07-03</lastmod>
8787
<changefreq>daily</changefreq>
8888
</url>
8989

9090
<url>
9191
<loc>/Java-Batch-Component-API/index.html</loc>
92-
<lastmod>2020-06-23</lastmod>
92+
<lastmod>2020-07-03</lastmod>
9393
<changefreq>daily</changefreq>
9494
</url>
9595

9696
<url>
9797
<loc>/Python-Batch-Component-API/index.html</loc>
98-
<lastmod>2020-06-23</lastmod>
98+
<lastmod>2020-07-03</lastmod>
9999
<changefreq>daily</changefreq>
100100
</url>
101101

102102
<url>
103103
<loc>/GPU-Support-Guide/index.html</loc>
104-
<lastmod>2020-06-23</lastmod>
104+
<lastmod>2020-07-03</lastmod>
105105
<changefreq>daily</changefreq>
106106
</url>
107107

108108
<url>
109109
<loc>/Packaging-and-Registering-a-Component/index.html</loc>
110-
<lastmod>2020-06-23</lastmod>
110+
<lastmod>2020-07-03</lastmod>
111111
<changefreq>daily</changefreq>
112112
</url>
113113

114114
<url>
115115
<loc>/Feed-Forward-Guide/index.html</loc>
116-
<lastmod>2020-06-23</lastmod>
116+
<lastmod>2020-07-03</lastmod>
117117
<changefreq>daily</changefreq>
118118
</url>
119119

@@ -123,13 +123,13 @@
123123

124124
<url>
125125
<loc>/Workflow-Manager/index.html</loc>
126-
<lastmod>2020-06-23</lastmod>
126+
<lastmod>2020-07-03</lastmod>
127127
<changefreq>daily</changefreq>
128128
</url>
129129

130130
<url>
131131
<loc>/REST-API/index.html</loc>
132-
<lastmod>2020-06-23</lastmod>
132+
<lastmod>2020-07-03</lastmod>
133133
<changefreq>daily</changefreq>
134134
</url>
135135

‎index.html‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -63,13 +63,13 @@ <h3>Open Plugin API</h3>
6363

6464
<p><center><img src="img/plugins.png" height="200px"/></center></p>
6565

66-
OpenMPF includes open-source algorithms for detecting and tracking:<br/><br/>
66+
OpenMPF includes algorithms for detecting and tracking:<br/><br/>
6767
<ul>
6868
<li>Faces - LBP-Based OpenCV, Dlib</li>
6969
<li>People - HOG-Based OpenCV</li>
7070
<li>Motion - MOG with STRUCK, SuBSENSE with STRUCK</li>
7171
<li>License Plates - OpenALPR</li>
72-
<li>Speech - Sphinx</li>
72+
<li>Speech - Sphinx, Azure Cognitive Services</li>
7373
<li>Scenes - OpenCV</li>
7474
<li>Objects (Classification) - OpenCV DNN, Darknet</li>
7575
<li>Text Regions - EAST</li>

0 commit comments

Comments
 (0)