En names (#42)

* Add support for Financial year and for  years between 1000 BC and 1000AD

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Add support for product names and add abbreviations to whitelist

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Add weights for some sequences, exclude 'a' before numeric sequence

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Add tests

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Update cache folder for EN

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update FR Cache path

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Move text to TSV files, and some code cleanup

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add additional vocabulary, allow singular usage of units to support adjective phrases

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Fix issue with whitelist loader not handling weights correctly
Move cased loader file to graph_utils

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* insert space between value and unit

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Insert space between measurement and unit. Adjust weight for ordinal

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Update tests

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

---------

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Author: anand-nv

Jenkinsfile

@@ -10,9 +10,10 @@ pipeline {
     disableConcurrentBuilds(abortPrevious: true)
   }
   environment {
+
     AR_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
     DE_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
-    EN_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-16-23-0'
+    EN_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-18-23-1'
     ES_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
     FR_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-16-23-1'
     PT_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
@@ -21,6 +22,7 @@ pipeline {
     SV_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
     ZH_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
     DEFAULT_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/02-15-23-0'
+
   }
   stages {
 

nemo_text_processing/inverse_text_normalization/en/data/date_period.tsv

@@ -0,0 +1,10 @@
+Q1	first quarter
+Q1	q one
+Q2	second quarter
+Q2	q two
+Q3	third quarter
+Q3	q three
+Q4	fourth quarter
+Q4	q four
+H1	first half
+H2	second half

nemo_text_processing/inverse_text_normalization/en/data/measurements.tsv

@@ -14,8 +14,14 @@ km²	square kilometer
 ft	foot
 %	percent
 hz	hertz
-kw	kilowatt
+kW	kilowatt
+kW	kilo watt
+kWh	kilo watt hour
+kWh	kilowatt hour
+Wh	watt hour
+W	watt
 hp	horsepower
+hp	horse power
 mg	milligram
 kg	kilogram
 ghz	gigahertz
@@ -30,12 +36,12 @@ rpm	revolution per minute
 min	minute
 mA	milli ampere
 %	per cent
-kwh	kilo watt hour
 m³	cubic meter
 mph	mile per hour
-tw	tera watt
+tW	tera watt
 mv	milli volt
-mw	megawatt
+mW	megawatt
+mW	mega watt
 μm	micrometer
 "	inch
 cc	c c
@@ -86,6 +92,7 @@ kl	kilo liter
 tj	tera joule
 kv	kilo volt
 mv	mega volt
+kn	kilo newton
 kn	kilonewton
 mm	megameter
 au	astronomical unit
@@ -96,8 +103,12 @@ hs	hecto second
 mol	mole
 gpa	giga pascal
 ml	milliliter
-gw	gigawatt
-ma	mega ampere
+gW	gigawatt
+gW	gigaWatt
+A	ampere
+mA	mili ampere
+µA	micro ampere
+MA	mega ampere
 kt	knot
 kgf	kilogram force
 ng	nano gram
@@ -106,7 +117,7 @@ ms	mega siemens
 bar	bar
 gl	giga liter
 μs	microsecond
-da	deci ampere
+dA	deci ampere
 pa	pascal
 ds	deci second
 ms	milli second
@@ -126,7 +137,7 @@ tl	tera liter
 ms	mega second
 mpa	megapascal
 pm	peta meter
-gwh	giga watt hour
+gWh	giga watt hour
 kcal	kilo calory
 gy	gray
 sv	sievert