Skip to content

Add/Install Languages ? #485

Open
Open
Add/Install Languages ?#485
@luckylinux

Description

@luckylinux
luckylinux
opened on Jan 17, 2026

There seems to be a clear Mismatch between the Documentation and the Reality of the Application.

Documentation shows many Languages being supported:
Image

Yet it seems to be only possible to install 7 of them:
Image

Unfortunately there is no Documentation available on how to install the other Languages since obviously it's not possible via the official Procedure indicated (via the UI).

The only "Documentation" seems to be this Comment here:
#91 (comment)

Let's try that installing Danish ...

Enter the Container:

podman exec -it linguacafe-app /bin/bash

Then you need to fix the PATH because /home/laravel/.local/bin (needed for spacy) was not included in it 🙄:

laravel@linguacafe:/app$ echo $PATH  
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
laravel@linguacafe:/app$ PATH="/home/laravel/.local/bin/:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

Finally try to install Danish:

laravel@linguacafe:/app$ pip install --target=/var/www/html/storage/app/model $(spacy info da_core_news_sm --url)
Collecting da-core-news-sm==3.7.0
  Downloading https://github.com/explosion/spacy-models/releases/download/da_core_news_sm-3.7.0/da_core_news_sm-3.7.0-py3-none-any.whl (12.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 28.1 MB/s eta 0:00:00
Collecting spacy<3.8.0,>=3.7.0
  Using cached spacy-3.7.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.6 MB)
Collecting requests<3.0.0,>=2.13.0
  Using cached requests-2.32.5-py3-none-any.whl (64 kB)
Collecting spacy-loggers<2.0.0,>=1.0.0
  Using cached spacy_loggers-1.0.5-py3-none-any.whl (22 kB)
Collecting preshed<3.1.0,>=3.0.2
  Using cached preshed-3.0.12-cp310-cp310-manylinux1_x86_64.manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_5_x86_64.whl (780 kB)
Collecting pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4
  Using cached pydantic-2.12.5-py3-none-any.whl (463 kB)
Collecting wasabi<1.2.0,>=0.9.1
  Using cached wasabi-1.1.3-py3-none-any.whl (27 kB)
Collecting typer<1.0.0,>=0.3.0
  Using cached typer-0.21.1-py3-none-any.whl (47 kB)
Collecting numpy>=1.19.0
  Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting cymem<2.1.0,>=2.0.2
  Using cached cymem-2.0.13-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (229 kB)
Collecting catalogue<2.1.0,>=2.0.6
  Using cached catalogue-2.0.10-py3-none-any.whl (17 kB)
Collecting weasel<0.5.0,>=0.1.0
  Using cached weasel-0.4.3-py3-none-any.whl (50 kB)
Collecting murmurhash<1.1.0,>=0.28.0
  Using cached murmurhash-1.0.15-cp310-cp310-manylinux1_x86_64.manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_5_x86_64.whl (122 kB)
Collecting tqdm<5.0.0,>=4.38.0
  Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)
Collecting setuptools
  Using cached setuptools-80.9.0-py3-none-any.whl (1.2 MB)
Collecting packaging>=20.0
  Using cached packaging-25.0-py3-none-any.whl (66 kB)
Collecting thinc<8.3.0,>=8.2.2
  Using cached thinc-8.2.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (922 kB)
Collecting langcodes<4.0.0,>=3.2.0
  Using cached langcodes-3.5.1-py3-none-any.whl (183 kB)
Collecting srsly<3.0.0,>=2.4.3
  Using cached srsly-2.5.2-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.1 MB)
Collecting spacy-legacy<3.1.0,>=3.0.11
  Using cached spacy_legacy-3.0.12-py2.py3-none-any.whl (29 kB)
Collecting jinja2
  Using cached jinja2-3.1.6-py3-none-any.whl (134 kB)
Collecting pydantic-core==2.41.5
  Using cached pydantic_core-2.41.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB)
Collecting annotated-types>=0.6.0
  Using cached annotated_types-0.7.0-py3-none-any.whl (13 kB)
Collecting typing-extensions>=4.14.1
  Using cached typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting typing-inspection>=0.4.2
  Using cached typing_inspection-0.4.2-py3-none-any.whl (14 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.11-py3-none-any.whl (71 kB)
Collecting charset_normalizer<4,>=2
  Using cached charset_normalizer-3.4.4-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB)
Collecting urllib3<3,>=1.21.1
  Using cached urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2026.1.4-py3-none-any.whl (152 kB)
Collecting numpy>=1.19.0
  Using cached numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
Collecting blis<0.8.0,>=0.7.8
  Using cached blis-0.7.11-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (10.2 MB)
Collecting confection<1.0.0,>=0.0.1
  Using cached confection-0.1.5-py3-none-any.whl (35 kB)
Collecting rich>=10.11.0
  Using cached rich-14.2.0-py3-none-any.whl (243 kB)
Collecting click>=8.0.0
  Using cached click-8.3.1-py3-none-any.whl (108 kB)
Collecting shellingham>=1.3.0
  Using cached shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Collecting smart-open<8.0.0,>=5.2.1
  Using cached smart_open-7.5.0-py3-none-any.whl (63 kB)
Collecting typer-slim<1.0.0,>=0.3.0
  Using cached typer_slim-0.21.1-py3-none-any.whl (47 kB)
Collecting cloudpathlib<1.0.0,>=0.7.0
  Using cached cloudpathlib-0.23.0-py3-none-any.whl (62 kB)
Collecting MarkupSafe>=2.0
  Using cached markupsafe-3.0.3-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (20 kB)
Collecting pygments<3.0.0,>=2.13.0
  Using cached pygments-2.19.2-py3-none-any.whl (1.2 MB)
Collecting markdown-it-py>=2.2.0
  Using cached markdown_it_py-4.0.0-py3-none-any.whl (87 kB)
Collecting wrapt
  Using cached wrapt-2.0.1-cp310-cp310-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (113 kB)
Collecting mdurl~=0.1
  Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Installing collected packages: wrapt, wasabi, urllib3, typing-extensions, tqdm, spacy-loggers, spacy-legacy, shellingham, setuptools, pygments, packaging, numpy, murmurhash, mdurl, MarkupSafe, langcodes, idna, cymem, click, charset_normalizer, certifi, catalogue, annotated-types, typing-inspection, typer-slim, srsly, smart-open, requests, pydantic-core, preshed, markdown-it-py, jinja2, cloudpathlib, blis, rich, pydantic, typer, confection, weasel, thinc, spacy, da-core-news-sm
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
deprecated 1.2.18 requires wrapt<2,>=1.10, but you have wrapt 2.0.1 which is incompatible.
Successfully installed MarkupSafe-3.0.3 annotated-types-0.7.0 blis-0.7.11 catalogue-2.0.10 certifi-2026.1.4 charset_normalizer-3.4.4 click-8.3.1 cloudpathlib-0.23.0 confection-0.1.5 cymem-2.0.13 da-core-news-sm-3.7.0 idna-3.11 jinja2-3.1.6 langcodes-3.5.1 markdown-it-py-4.0.0 mdurl-0.1.2 murmurhash-1.0.15 numpy-1.26.4 packaging-25.0 preshed-3.0.12 pydantic-2.12.5 pydantic-core-2.41.5 pygments-2.19.2 requests-2.32.5 rich-14.2.0 setuptools-80.9.0 shellingham-1.5.4 smart-open-7.5.0 spacy-3.7.5 spacy-legacy-3.0.12 spacy-loggers-1.0.5 srsly-2.5.2 thinc-8.2.5 tqdm-4.67.1 typer-0.21.1 typer-slim-0.21.1 typing-extensions-4.15.0 typing-inspection-0.4.2 urllib3-2.6.3 wasabi-1.1.3 weasel-0.4.3 wrapt-2.0.1
WARNING: Target directory /var/www/html/storage/app/model/spacy_legacy-3.0.12.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/markupsafe-3.0.3.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/wasabi-1.1.3.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/numpy.libs already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pydantic-2.12.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/certifi already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/spacy_loggers-1.0.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/catalogue-2.0.10.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/markdown_it_py-4.0.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pydantic_core-2.41.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/weasel-0.4.3.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/jinja2-3.1.6.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/spacy_loggers already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/click already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/charset_normalizer-3.4.4.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/requests-2.32.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typer-0.21.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typing_extensions-4.15.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/tqdm already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/catalogue already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/annotated_types-0.7.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/blis already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/mdurl-0.1.2.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/mdurl already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/cymem already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/numpy already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/wrapt-2.0.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/rich already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/rich-14.2.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/packaging already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/thinc-8.2.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/spacy-3.7.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/cymem-2.0.13.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/distutils-precedence.pth already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/wasabi already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/annotated_types already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typing_extensions.py already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/click-8.3.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/confection already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/_distutils_hack already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/murmurhash-1.0.15.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/setuptools-80.9.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/certifi-2026.1.4.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/spacy already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pydantic already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pydantic_core already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/jinja2 already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/langcodes already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/idna already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/__pycache__ already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/preshed already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/murmurhash already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/cloudpathlib already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pygments already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/smart_open-7.5.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/setuptools already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/thinc already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typer already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/spacy_legacy already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typing_inspection already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/requests already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/wrapt already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/srsly already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/blis-0.7.11.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typing_inspection-0.4.2.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pygments-2.19.2.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/weasel already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/cloudpathlib-0.23.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/markdown_it already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/urllib3-2.6.3.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/confection-0.1.5.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/pkg_resources already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/numpy-1.26.4.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/urllib3 already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/typer_slim-0.21.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/smart_open already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/tqdm-4.67.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/langcodes-3.5.1.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/shellingham already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/charset_normalizer already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/idna-3.11.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/preshed-3.0.12.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/markupsafe already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/packaging-25.0.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/shellingham-1.5.4.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/srsly-2.5.2.dist-info already exists. Specify --upgrade to force replacement.
WARNING: Target directory /var/www/html/storage/app/model/bin already exists. Specify --upgrade to force replacement.

Great, now what, it's not listed in the WebUI 😕. Does the WebUI not support it at all then or what ?

EDIT 1: alternatively and trying to get a slightly more recent Version

laravel@linguacafe:/app$ pip install --target=/var/www/html/storage/app/model https://github.com/explosion/spacy-models/releases/download/da_core_news_sm-3.8.0/da_core_news_sm-3.8.0-py3-none-any.whl
Collecting da-core-news-sm==3.8.0
  Downloading https://github.com/explosion/spacy-models/releases/download/da_core_news_sm-3.8.0/da_core_news_sm-3.8.0-py3-none-any.whl (12.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 39.0 MB/s eta 0:00:00
Installing collected packages: da-core-news-sm
Successfully installed da-core-news-sm-3.8.0
WARNING: Target directory /var/www/html/storage/app/model/da_core_news_sm already exists. Specify --upgrade to force replacement.
laravel@linguacafe:/app$ pip install --target=/var/www/html/storage/app/model --upgrade https://github.com/explosion/spacy-models/releases/download/da_core_news_sm-3.8.0/da_core_news_sm-3.8.0-py3-none-any.whl
Collecting da-core-news-sm==3.8.0
  Using cached https://github.com/explosion/spacy-models/releases/download/da_core_news_sm-3.8.0/da_core_news_sm-3.8.0-py3-none-any.whl (12.4 MB)
Installing collected packages: da-core-news-sm
Successfully installed da-core-news-sm-3.8.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions