Skip to content

Commit fa58b11

Browse files
jimreganpre-commit-ci[bot]
jimregan
and
pre-commit-ci[bot]
authored
Swedish TN (#12)
* test now runs, but getting ordinal instead of cardinal Signed-off-by: Jim O'Regan <joregan@kth.se> * force ordinals to either have :a/:e or "." at the end Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: Jim O'Regan <joregan@kth.se> * add minimal ordinal data Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for ordinals, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * fix test case Signed-off-by: Jim O'Regan <joregan@kth.se> * add // to symbols Signed-off-by: Jim O'Regan <joregan@kth.se> * add test cases for electronic; transformed with sed from spanish, so I expect errors Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for electronic, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * fixes to make electronic verbaliser work (not yet) Signed-off-by: Jim O'Regan <joregan@kth.se> * fixes to make electronic verbaliser work (not yet) Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * move to graph_utils Signed-off-by: Jim O'Regan <joregan@kth.se> * add very minimal test case for fractions Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for fraction, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * fix language Signed-off-by: Jim O'Regan <joregan@kth.se> * fix graph construction to make pluralisation work Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for decimal, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for whitelist, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * add very minimal test case for whitelist Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for word, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for date, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for measure, adapted from es Signed-off-by: Jim O'Regan <joregan@kth.se> * fix a pair of test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * fix plurals Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix number, but this whole thing is only partially adapted Signed-off-by: Jim O'Regan <joregan@kth.se> * fix some test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * add usd$ Signed-off-by: Jim O'Regan <joregan@kth.se> * insert "komma" Signed-off-by: Jim O'Regan <joregan@kth.se> * "pund" is neuter Signed-off-by: Jim O'Regan <joregan@kth.se> * fix test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * towards proper graphs Signed-off-by: Jim O'Regan <joregan@kth.se> * GBP Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix a test case Signed-off-by: Jim O'Regan <joregan@kth.se> * make komma non-det Signed-off-by: Jim O'Regan <joregan@kth.se> * more money tagger fixes Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add more minor words Signed-off-by: Jim O'Regan <joregan@kth.se> * do a bit better with en/ett Signed-off-by: Jim O'Regan <joregan@kth.se> * fix another test case Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * use the correct list Signed-off-by: Jim O'Regan <joregan@kth.se> * fix more test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * fix more test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * make sure the numbers have no 1 Signed-off-by: Jim O'Regan <joregan@kth.se> * abbreviations for million and milliard Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add year suffixes Signed-off-by: Jim O'Regan <joregan@kth.se> * add minimal tests Signed-off-by: Jim O'Regan <joregan@kth.se> * expansions of era abbreviations Signed-off-by: Jim O'Regan <joregan@kth.se> * use eras Signed-off-by: Jim O'Regan <joregan@kth.se> * use eras in verbaliser Signed-off-by: Jim O'Regan <joregan@kth.se> * fix examples in comment Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix extension Signed-off-by: Jim O'Regan <joregan@kth.se> * fix separator Signed-off-by: Jim O'Regan <joregan@kth.se> * date verbaliser is broken, this does not fix it Signed-off-by: Jim O'Regan <joregan@kth.se> * load labels Signed-off-by: Jim O'Regan <joregan@kth.se> * right first time Signed-off-by: Jim O'Regan <joregan@kth.se> * missing space Signed-off-by: Jim O'Regan <joregan@kth.se> * fix year in test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * getting closer to getting dates working Signed-off-by: Jim O'Regan <joregan@kth.se> * add a (failing) test case Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * date working now Signed-off-by: Jim O'Regan <joregan@kth.se> * also handle decades Signed-off-by: Jim O'Regan <joregan@kth.se> * remove todo Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * years where -00 is -hundra Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test runner for telephone (adapted from es) Signed-off-by: Jim O'Regan <joregan@kth.se> * changes to telephone tagger/verbaliser Signed-off-by: Jim O'Regan <joregan@kth.se> * add partially incomplete test data Signed-off-by: Jim O'Regan <joregan@kth.se> * mostly fixed test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * more in progress changes to telephone parts Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * much prodding later, turns out I forgot a space Signed-off-by: Jim O'Regan <joregan@kth.se> * missed wrapping Signed-off-by: Jim O'Regan <joregan@kth.se> * no difference Signed-off-by: Jim O'Regan <joregan@kth.se> * Revert "no difference" This reverts commit 2968092. Signed-off-by: Jim O'Regan <joregan@kth.se> * telephone tagger works Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * try adding brackets Signed-off-by: Jim O'Regan <joregan@kth.se> * try adding more brackets Signed-off-by: Jim O'Regan <joregan@kth.se> * fix another test case Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add a comment, because I confused myself Signed-off-by: Jim O'Regan <joregan@kth.se> * move abbreviations Signed-off-by: Jim O'Regan <joregan@kth.se> * add in abbreviations Signed-off-by: Jim O'Regan <joregan@kth.se> * add a version for fraction that does what I intended: 2 & 3 digit numbers without leading 0 are read as cardinals, everything else as digits Signed-off-by: Jim O'Regan <joregan@kth.se> * single digit Signed-off-by: Jim O'Regan <joregan@kth.se> * more test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * add another test case/remove a duplicate Signed-off-by: Jim O'Regan <joregan@kth.se> * use the nice variable I just added to cardinal Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * this is not right; leading zeros fail Signed-off-by: Jim O'Regan <joregan@kth.se> * Revert "this is not right; leading zeros fail" This reverts commit 5997e95. Signed-off-by: Jim O'Regan <joregan@kth.se> * ok, this seems to work Signed-off-by: Jim O'Regan <joregan@kth.se> * drop the tests starting with comma Signed-off-by: Jim O'Regan <joregan@kth.se> * decimal tagger works Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add more test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * lower case Signed-off-by: Jim O'Regan <joregan@kth.se> * add klockan and variants as a prompt, so they are not silently deleted Signed-off-by: Jim O'Regan <joregan@kth.se> * add a very minimal test case for time Signed-off-by: Jim O'Regan <joregan@kth.se> * rewrite with less ambiguity Signed-off-by: Jim O'Regan <joregan@kth.se> * rewrite with less ambiguity, hms Signed-off-by: Jim O'Regan <joregan@kth.se> * add prompt Signed-off-by: Jim O'Regan <joregan@kth.se> * copy the roman handling from es Signed-off-by: Jim O'Regan <joregan@kth.se> * greek letters Signed-off-by: Jim O'Regan <joregan@kth.se> * some fixes to the time tagger Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test runner for time (adapted from es) Signed-off-by: Jim O'Regan <joregan@kth.se> * test runner for time (adapted from es) ((actually adapted)) Signed-off-by: Jim O'Regan <joregan@kth.se> * more work on time Signed-off-by: Jim O'Regan <joregan@kth.se> * |=, not = Signed-off-by: Jim O'Regan <joregan@kth.se> * adapt verbaliser a little Signed-off-by: Jim O'Regan <joregan@kth.se> * add some test cases from module comments Signed-off-by: Jim O'Regan <joregan@kth.se> * export some variables to check Signed-off-by: Jim O'Regan <joregan@kth.se> * small fix Signed-off-by: Jim O'Regan <joregan@kth.se> * comment some stuff that needs major changes Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove Signed-off-by: Jim O'Regan <joregan@kth.se> * try doing this here Signed-off-by: Jim O'Regan <joregan@kth.se> * Revert "try doing this here" This reverts commit ebdba0e. Signed-off-by: Jim O'Regan <joregan@kth.se> * fix errors in tests Signed-off-by: Jim O'Regan <joregan@kth.se> * minimal test cases for measure Signed-off-by: Jim O'Regan <joregan@kth.se> * sort|uniq everything, see what the difference is Signed-off-by: Jim O'Regan <joregan@kth.se> * merge different tsvs Signed-off-by: Jim O'Regan <joregan@kth.se> * fix casing to avoid conflicts Signed-off-by: Jim O'Regan <joregan@kth.se> * export some variables for testing Signed-off-by: Jim O'Regan <joregan@kth.se> * add a test case Signed-off-by: Jim O'Regan <joregan@kth.se> * need an en/ett split here too Signed-off-by: Jim O'Regan <joregan@kth.se> * fix decimal subgraph Signed-off-by: Jim O'Regan <joregan@kth.se> * remove todo, I've just done it Signed-off-by: Jim O'Regan <joregan@kth.se> * remove missing integer test, does not work elsewhere Signed-off-by: Jim O'Regan <joregan@kth.se> * remove unused imports Signed-off-by: Jim O'Regan <joregan@kth.se> * include greek letters in maths Signed-off-by: Jim O'Regan <joregan@kth.se> * include greek here too Signed-off-by: Jim O'Regan <joregan@kth.se> * minor sg/pl Signed-off-by: Jim O'Regan <joregan@kth.se> * dedup Signed-off-by: Jim O'Regan <joregan@kth.se> * fix a test case Signed-off-by: Jim O'Regan <joregan@kth.se> * put these under if, too Signed-off-by: Jim O'Regan <joregan@kth.se> * no; there are no minor neuters, so that is not relevant here Signed-off-by: Jim O'Regan <joregan@kth.se> * remove greek from here, interferes with delimeter Signed-off-by: Jim O'Regan <joregan@kth.se> * export variables to see what is happening Signed-off-by: Jim O'Regan <joregan@kth.se> * fix some test cases Signed-off-by: Jim O'Regan <joregan@kth.se> * here is one error Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * put ensure_space in graph_utils Signed-off-by: Jim O'Regan <joregan@kth.se> * handle cases where unit follows amount Signed-off-by: Jim O'Regan <joregan@kth.se> * export a variable Signed-off-by: Jim O'Regan <joregan@kth.se> * add a tesst case Signed-off-by: Jim O'Regan <joregan@kth.se> * remove unused imports Signed-off-by: Jim O'Regan <joregan@kth.se> * . is not a cardinal separator Signed-off-by: Jim O'Regan <joregan@kth.se> * fix case Signed-off-by: Jim O'Regan <joregan@kth.se> * add yen Signed-off-by: Jim O'Regan <joregan@kth.se> * final fixes Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix typo Signed-off-by: Jim O'Regan <joregan@kth.se> * fix typo Signed-off-by: Jim O'Regan <joregan@kth.se> * remove English roman tagger Signed-off-by: Jim O'Regan <joregan@kth.se> * add tokenize_and_classify_lm.py (adapted from en) Signed-off-by: Jim O'Regan <joregan@kth.se> * remove some unused pieces Signed-off-by: Jim O'Regan <joregan@kth.se> * add tokenize_and_classify_with_audio.py (adapted from en) Signed-off-by: Jim O'Regan <joregan@kth.se> * add test pieces for audio (recopied from es) Signed-off-by: Jim O'Regan <joregan@kth.se> * add audio test (adapted from es) Signed-off-by: Jim O'Regan <joregan@kth.se> * in non-deterministic mode, generate both en and ett Signed-off-by: Jim O'Regan <joregan@kth.se> * add very minimal non-deterministic test Signed-off-by: Jim O'Regan <joregan@kth.se> * remove commented pieces/things that will not be used Signed-off-by: Jim O'Regan <joregan@kth.se> * warnings about missing whitelist Signed-off-by: Jim O'Regan <joregan@kth.se> * add sv Signed-off-by: Jim O'Regan <joregan@kth.se> * remove commented pieces/things that will not be used Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * some Riksdag specific titles Signed-off-by: Jim O'Regan <joregan@kth.se> * add my copyright to the other files with non-trivial changes Signed-off-by: Jim O'Regan <joregan@kth.se> * fix year Signed-off-by: Jim O'Regan <joregan@kth.se> * add Swedish support in pynini_export Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add Swedish support for sparrowhark tests -- untested (: Signed-off-by: Jim O'Regan <joregan@kth.se> * address codeql comments Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * change decade to year; sparrowhawk enforces categories Signed-off-by: Jim O'Regan <joregan@kth.se> * shoehorn this stuff into the overly narrow sparrowhawk classes Signed-off-by: Jim O'Regan <joregan@kth.se> * Revert "shoehorn this stuff into the overly narrow sparrowhawk classes" This reverts commit a3cf3d5. Signed-off-by: Jim O'Regan <joregan@kth.se> * read out the AM/PM words, they are not read as letters anyway Signed-off-by: Jim O'Regan <joregan@kth.se> * change date verbaliser to manage isolated decades Signed-off-by: Jim O'Regan <joregan@kth.se> * redo changes to get rid of 'prompt' for 'klockan' Signed-off-by: Jim O'Regan <joregan@kth.se> * remove broken duplicate Signed-off-by: Jim O'Regan <joregan@kth.se> * add a test case Signed-off-by: Jim O'Regan <joregan@kth.se> * add a case for hours without minutes (which should not happen) Signed-off-by: Jim O'Regan <joregan@kth.se> * time tests now pass Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add a time test case that also passes here, but not in sparrowhawk Signed-off-by: Jim O'Regan <joregan@kth.se> * fix error in dates, add more tests Signed-off-by: Jim O'Regan <joregan@kth.se> * import delete_preserve_order Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * codeql feedback Signed-off-by: Jim O'Regan <joregan@kth.se> * add some ambiguous abbreviations for non-deterministic mode (more as a demonstration than anything deeply useful) Signed-off-by: Jim O'Regan <joregan@kth.se> * move to the correct subdirectory Signed-off-by: Jim O'Regan <joregan@kth.se> * add swedish Signed-off-by: Jim O'Regan <joregan@kth.se> * remove pynini checks Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix error with 1000 in non-deterministic cases Signed-off-by: Jim O'Regan <joregan@kth.se> * fix here also Signed-off-by: Jim O'Regan <joregan@kth.se> * also generate a string of digits if not deterministic Signed-off-by: Jim O'Regan <joregan@kth.se> * add a date case Signed-off-by: Jim O'Regan <joregan@kth.se> * remove duplication Signed-off-by: Jim O'Regan <joregan@kth.se> * boost n_tagged Signed-off-by: Jim O'Regan <joregan@kth.se> * also copyright this year Signed-off-by: Jim O'Regan <joregan@kth.se> * 1500 only fixes one, boost again Signed-off-by: Jim O'Regan <joregan@kth.se> * 2500 does nothing, going to -1 Signed-off-by: Jim O'Regan <joregan@kth.se> * remove audio normalisation; I do not have the time to get this working right now, and there was a bunch more to do for it anyway Signed-off-by: Jim O'Regan <joregan@kth.se> * Revert "remove audio normalisation; I do not have the time to get this working right now, and there was a bunch more to do for it anyway" This reverts commit 383a096. Signed-off-by: Jim O'Regan <joregan@kth.se> * try setting a low weight to everything non-default Signed-off-by: Jim O'Regan <joregan@kth.se> * put n_tagged back to 500 Signed-off-by: Jim O'Regan <joregan@kth.se> * remove unused import Signed-off-by: Jim O'Regan <joregan@kth.se> * days of the week Signed-off-by: Jim O'Regan <joregan@kth.se> * add more abbreviations Signed-off-by: Jim O'Regan <joregan@kth.se> * setting weights did not work for cardinals, but it did push the test from taking 11 minutes to something more than 40. Re-reverting Signed-off-by: Jim O'Regan <joregan@kth.se> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix typo Signed-off-by: Jim O'Regan <joregan@kth.se> * fix typo Signed-off-by: Jim O'Regan <joregan@kth.se> * remove blank line Signed-off-by: Jim O'Regan <joregan@kth.se> * forgot to remove this piece in the merge conflict Signed-off-by: Jim O'Regan <joregan@kth.se> * remove erroneously added copyright notice Signed-off-by: Jim O'Regan <joregan@kth.se> * change year of copyright in empty files, they aren't eligible anyway Signed-off-by: Jim O'Regan <joregan@kth.se> * add __init__.py in a few places it was missing Signed-off-by: Jim O'Regan <joregan@kth.se> * add the google notice required by the incoming contributing document Signed-off-by: Jim O’Regan <jaoregan@tcd.ie> --------- Signed-off-by: Jim O'Regan <joregan@kth.se> Signed-off-by: Jim O’Regan <jaoregan@tcd.ie> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
1 parent 310b18e commit fa58b11

116 files changed

Lines changed: 5248 additions & 2 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎nemo_text_processing/text_normalization/normalize.py‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -133,6 +133,9 @@ def __init__(
133133
elif lang == 'es':
134134
from nemo_text_processing.text_normalization.es.taggers.tokenize_and_classify import ClassifyFst
135135
from nemo_text_processing.text_normalization.es.verbalizers.verbalize_final import VerbalizeFinalFst
136+
elif lang == 'sv':
137+
from nemo_text_processing.text_normalization.sv.taggers.tokenize_and_classify import ClassifyFst
138+
from nemo_text_processing.text_normalization.sv.verbalizers.verbalize_final import VerbalizeFinalFst
136139
elif lang == 'zh':
137140
from nemo_text_processing.text_normalization.zh.taggers.tokenize_and_classify import ClassifyFst
138141
from nemo_text_processing.text_normalization.zh.verbalizers.verbalize_final import VerbalizeFinalFst
@@ -661,7 +664,7 @@ def parse_args():
661664
default="text",
662665
)
663666
parser.add_argument('--output_file', dest="output_file", help="Output file path", type=str)
664-
parser.add_argument("--language", help="language", choices=["en", "de", "es", "zh"], default="en", type=str)
667+
parser.add_argument("--language", help="language", choices=["en", "de", "es", "sv", "zh"], default="en", type=str)
665668
parser.add_argument(
666669
"--input_case",
667670
help="Input text capitalization, set to 'cased' if text contains capital letters."

‎nemo_text_processing/text_normalization/sv/__init__.py‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.

‎nemo_text_processing/text_normalization/sv/data/__init__.py‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.

‎nemo_text_processing/text_normalization/sv/data/abbreviations_nondet.tsv‎

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
betyd. betydning
2+
betyd. betydningen
3+
bl.a. bland annat
4+
bl.a. bland andra
5+
el. eller
6+
el. elektrisk
7+
s.ö. sydöst
8+
s.ö. sydöstra
9+
mån mån
10+
mån måndag
11+
mån månad
12+
ons ons
13+
ons onsdag
14+
AB AB
15+
AB aktiebolag
16+
s:a södra
17+
s:a stora
18+
st. stycke
19+
st. stycken
20+
st. stor
21+
st. stora
22+
st. sankt
23+
st. sankta
24+
n:o nummer
25+
n:o numero
26+
vanl. vanlig
27+
vanl. vanligen

‎nemo_text_processing/text_normalization/sv/data/dates/__init__.py‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.

‎nemo_text_processing/text_normalization/sv/data/dates/era_suffix.tsv‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
f.Kr. f.Kr.
2+
f.Kr f.Kr.
3+
f Kr f.Kr.
4+
f. Kr f.Kr.
5+
f.v.t. f.v.t.
6+
e.Kr. e.Kr.
7+
e.Kr e.Kr.
8+
e Kr e.Kr.
9+
e. Kr e.Kr.
10+
v.t. v.t.

‎nemo_text_processing/text_normalization/sv/data/dates/era_words.tsv‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
f.Kr. före Kristus
2+
f.v.t. före vår tideräkning
3+
e.Kr. efter Kristus
4+
v.t. vår tideräkning

‎nemo_text_processing/text_normalization/sv/data/dates/month_abbr.tsv‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
jan januari
2+
feb februari
3+
febr februari
4+
mar mars
5+
mars
6+
apr april
7+
april
8+
juni
9+
jun juni
10+
juli
11+
jul juli
12+
aug augusti
13+
sep september
14+
sept september
15+
okt oktober
16+
nov november
17+
dec december

‎nemo_text_processing/text_normalization/sv/data/dates/months.tsv‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
1 januari
2+
2 februari
3+
3 mars
4+
4 april
5+
5 maj
6+
6 juni
7+
7 juli
8+
8 augusti
9+
9 september
10+
10 oktober
11+
11 november
12+
12 december

‎nemo_text_processing/text_normalization/sv/data/electronic/__init__.py‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.

0 commit comments

Comments
 (0)