Add shared-mime-types as upstream source by rimmington · Pull Request #312 · jshttp/mime-db

rimmington · 2024-01-02T05:03:14Z

Adds Freedesktop.org's shared-mime-info repository as an upstream. shared-mime-info is used by common Linux desktop environments for MIME information, typically to identify which application to use to open a file. I've generally found sensible rationales for inclusion and changes in the commit messages of the repository.

There are quite a lot of x- types in this source, which reflects the upstream need for a file type for each format even if there is no IANA official or consensus type. Given that both Apache and Nginx also have a lot of x- types I think it's sensible to include them all.

jayvdb · 2024-11-22T23:38:30Z

  "application/dicom": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["dcm"]
  },


This is correct - I think the quotes in https://www.iana.org/assignments/media-types/application/dicom are causing this extension to be omitted from mime-db at the moment.

jayvdb · 2024-11-22T23:40:51Z

  "application/fits": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["fits","fit","fts"]
  },


correct per https://www.iana.org/assignments/media-types/application/fits

jayvdb · 2024-11-22T23:41:55Z

  "application/jrd+json": {
    "source": "iana",
-    "compressible": true
+    "compressible": true,
+    "extensions": ["jrd"]
  },


correct per https://www.iana.org/assignments/media-types/application/jrd+json

jayvdb · 2024-11-22T23:42:31Z

  "application/mathml+xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["mathml"]
+    "extensions": ["mathml","mml"]
  },


correct per https://www.iana.org/assignments/media-types/application/mathml+xml

jayvdb · 2024-11-22T23:43:53Z

  "application/rdf+xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["rdf","owl"]
+    "extensions": ["rdf","rdfs","owl"]
  },


.rdfs is not mentioned at https://www.iana.org/assignments/media-types/application/rdf+xml

It was added at https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/150637a3c0ec0b4f321bd49dc41650b8e71c559f - Closes: #8389 refers to https://bugs.freedesktop.org/show_bug.cgi?id=8389 , which is thankfully still operational. So in addition to commit messages, the background which led to each commit is likely also available.

fwiw, .rdfs is RDF Schema , and it is expressed as a RDF, and can be serialised as XML, so this addition is fine.

jayvdb · 2024-11-22T23:45:22Z

  "application/smil+xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["smi","smil"]
+    "extensions": ["smi","smil","sml","kino"]
  },


.sml correct per https://www.iana.org/assignments/media-types/application/smil , but .kino is not mentioned there

https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/aeec6ec3c98441db041e81274478c41dd9a38483 & https://bugs.freedesktop.org/show_bug.cgi?id=3141

This is about Linux only software discontinued in 2009 https://en.wikipedia.org/wiki/Kino_(software)

https://sourceforge.net/p/kino/code/HEAD/tree/trunk/smilutils/ and the manpage under that dont give any indication that .dino was a recommended extension.

However there are some hits on github for .kino being used for smil files https://github.com/search?q=path%3A*.kino&type=code

So this looks like a low value extension, but still valid.

jayvdb · 2024-11-22T23:46:03Z

  "application/sparql-query": {
    "source": "iana",
-    "extensions": ["rq"]
+    "extensions": ["rq","qs"]
  },


.qs not mentioned on https://www.iana.org/assignments/media-types/application/sparql-query

Added in https://gitlab.freedesktop.org/xdg/shared-mime-info/-/merge_requests/176 ; I cant see any evidence for .qs being used for this, and github results are drowned out with it being used for https://doc.qt.io/qt-5/qtscript-index.html and other scripting languages.

jayvdb · 2024-11-22T23:47:09Z

  "application/vnd.adobe.flash.movie": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["swf","spl"]
  },


https://www.iana.org/assignments/media-types/application/vnd.adobe.flash.movie mentions the commonly used .swf , but not .spl

Added in https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/298543c7e449165b46a85d71209faf42de508217 - .sql is added with the media type of Futuresplash

https://www.webdesignmuseum.org/software/futuresplash-animator-in-1996 lists "FutureSplash Player SPL (Export)" under image formats, not animation formats, so I suspect that they are two different formats.

https://en.wikipedia.org/wiki/SWF lists .spl as a "Related file formats and extension"

ruffle-rs/ruffle#18260 and https://github.com/ruffle-rs/ruffle/blob/295bd1062cfa281beeb4371f44b3cfb53c12171b/web/packages/core/src/swf-utils.ts#L24 says .spl is the same as .swf

First few pages of https://github.com/search?q=path%3A*.spl&type=code are not flash.

I am not 100% sure, but this seems to be ok.

jayvdb · 2024-11-22T23:47:56Z

  "application/vnd.amazon.mobi8-ebook": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["azw3","kfx"]
  },


.azw3 mentioned on https://www.iana.org/assignments/media-types/application/vnd.amazon.mobi8-ebook , but not .kfx

Added in https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/4bae2a489c52f8314a21a949223e846151bcccb9

which says

Alias from:
kovidgoyal/calibre@ddca079#diff-64773d34b80f6772011eb6c82d9fa5ddR37

That commit does include the media type alias, but does not contain .kfx

It seems .kfx is a very different format from the previous versions of Kindle files https://www.quora.com/What-is-Kindle-KFX

Only one github example https://github.com/midrare/krdsrw/blob/55f7eef3d23003f79dd55b17d3e78b6a663789bb/tests/the-tempest.kfx

A bit of background at https://en.wikipedia.org/wiki/Kindle_File_Format

jayvdb · 2024-11-22T23:48:32Z

  "application/vnd.apple.mpegurl": {
    "source": "iana",
-    "extensions": ["m3u8"]
+    "extensions": ["m3u8","m3u"]
  },


correct per https://www.iana.org/assignments/media-types/application/vnd.apple.mpegurl

jayvdb · 2024-11-22T23:49:00Z

  "application/vnd.chess-pgn": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["pgn"]
  },


correct per https://www.iana.org/assignments/media-types/application/vnd.chess-pgn

jayvdb · 2024-11-22T23:49:33Z

  "application/vnd.coffeescript": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["coffee"]
  },


correct per https://www.iana.org/assignments/media-types/application/vnd.coffeescript

jayvdb · 2024-11-22T23:50:05Z

  "application/vnd.comicbook-rar": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["cbr"]
  },


correct per https://www.iana.org/assignments/media-types/application/vnd.comicbook-rar

jayvdb · 2024-11-23T04:39:22Z

  "application/vnd.efi.iso": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["iso","iso9660"]
  },


Only .iso mentioned on https://www.iana.org/assignments/media-types/application/vnd.efi.iso

One hit for .iso9660 at https://github.com/search?q=path%3A*.iso9660&type=code

jayvdb · 2024-11-23T04:42:51Z

@@ -3727,7 +3814,7 @@
  },
  "application/vnd.lotus-1-2-3": {
    "source": "iana",
-    "extensions": ["123"]
+    "extensions": ["123","wk1","wk3","wk4","wks"]


.wks not mentioned on https://www.iana.org/assignments/media-types/application/vnd.lotus-1-2-3 , but it is an early version of the file format.

jayvdb · 2024-11-23T04:53:47Z

@@ -3826,7 +3913,8 @@
    "extensions": ["igx"]
  },
  "application/vnd.microsoft.portable-executable": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["exe","dll","cpl","drv","scr","efi","ocx","sys","lib"]


https://www.iana.org/assignments/media-types/application/vnd.microsoft.portable-executable only lists .exe and .dll

Long commit message at https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/d4c2ed1b62b51fed1f9fa003de6cfdc6a82df729

I think .lib may be misguided - they are COFF files on Windows.

It looks like they are getting that long list of file extensions from the infobox on http://fileformats.archiveteam.org/wiki/Portable_Executable

jayvdb · 2024-11-23T04:55:29Z

  "application/vnd.ms-excel": {
    "source": "iana",
    "compressible": false,
-    "extensions": ["xls","xlm","xla","xlc","xlt","xlw"]
+    "extensions": ["xls","xlm","xla","xlc","xlt","xlw","xll","xld"]
  },


The Microsoft ones like https://www.iana.org/assignments/media-types/application/vnd.ms-excel is very strange

jayvdb · 2024-11-23T05:51:52Z

  "application/vnd.oasis.opendocument.formula-template": {
    "source": "iana",
-    "extensions": ["odft"]
+    "extensions": ["odft","otf"]
  },


https://www.iana.org/assignments/media-types/application/vnd.oasis.opendocument.formula-template only lists .otf, not the pre-existing .otft

jayvdb · 2024-11-23T09:04:32Z

@@ -5274,7 +5419,7 @@
  },
  "application/vnd.smaf": {
    "source": "iana",
-    "extensions": ["mmf"]
+    "extensions": ["mmf","smaf"]


.smaf not on https://www.iana.org/assignments/media-types/application/vnd.smaf

Add in https://gitlab.freedesktop.org/xdg/shared-mime-info/-/commit/343b7b9a9304c322b3fc7dc60057de233f6e6662

None at https://github.com/search?q=path%3A*.smaf&type=code

I dont see a lot of evidence of .smaf being used

jayvdb · 2024-11-23T09:14:23Z

  "application/vnd.sqlite3": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["sqlite3"]
+  },


https://www.iana.org/assignments/media-types/application/vnd.sqlite3 suggests others also: .sqlite & .db

jayvdb · 2024-11-23T09:15:29Z

  "application/vnd.wordperfect": {
    "source": "iana",
-    "extensions": ["wpd"]
+    "extensions": ["wpd","wp","wp4","wp5","wp6","wpp"]
  },


https://www.iana.org/assignments/media-types/application/vnd.wordperfect only lists .wpd

jayvdb · 2024-11-23T09:18:01Z

  "application/x-x509-ca-cert": {
    "source": "iana",
-    "extensions": ["der","crt","pem"]
+    "extensions": ["der","crt","pem","cert"]
  },


https://www.iana.org/assignments/media-types/application/x-x509-ca-cert lists 0 extensions

jayvdb · 2024-11-23T09:21:22Z

  "application/xhtml+xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["xhtml","xht"]
+    "extensions": ["xhtml","xht","html","htm"]
  },


https://www.iana.org/assignments/media-types/application/xhtml+xml lists only "xhtml","xht"

This is one where I feel that adding "html","htm" probably makes this mime-db less useful, as those file extensions are very commonly used, and very unlikely to be XML most of the time.

jayvdb · 2024-11-23T09:22:24Z

@@ -6495,20 +7631,21 @@
  "application/xliff+xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["xlf"]
+    "extensions": ["xlf","xliff"]


https://www.iana.org/assignments/media-types/application/xliff+xml only lists xlf

But https://github.com/search?q=path%3A*.xliff&type=code shows a lot of positive hits

jayvdb · 2024-11-23T09:27:48Z

  "application/xml": {
    "source": "iana",
    "compressible": true,
-    "extensions": ["xml","xsl","xsd","rng"]
+    "extensions": ["xml","xsl","xbl","xsd","rng"]
  },


https://www.iana.org/assignments/media-types/application/xml only lists .xml

.xbl is part of XUL , a UI language which failed standardisation, and doesnt have a lot of usage these days (sob).

jayvdb · 2024-11-23T09:28:33Z

  "application/xml-external-parsed-entity": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["ent"]
  },


https://www.iana.org/assignments/media-types/application/xml-external-parsed-entity says ".xml" or ".ent" 👍

jayvdb · 2024-11-23T09:29:21Z

  "application/zip": {
    "source": "iana",
    "compressible": false,
-    "extensions": ["zip"]
+    "extensions": ["zip","zipx"]
  },


https://www.iana.org/assignments/media-types/application/zip doesnt mention zipx

jayvdb · 2024-11-23T09:29:52Z

  "application/zlib": {
-    "source": "iana"
+    "source": "iana",
+    "extensions": ["zz"]
  },


https://www.iana.org/assignments/media-types/application/zlib doesnt provide any file extensions

jayvdb · 2024-11-23T09:34:29Z

A bit of a marathon - I've reviewed all the application/ which currently have a source of "iana". Initially I commented on a few to indicate they matched IANA records, but that was too many so I switched to only commenting when there was a discrepancy. I have analysed most of the discrepancies - while a few I feel are adding too many extensions, in most cases these are harmless, as there are no other media/mime types using that extension.

.qs and .lib and .htm and .html seem like the most problematic. Overall I would suggest this PR is a good approach, and any problems can be solved by people working with the upstream project.

wesleytodd · 2025-01-12T17:33:53Z

Wow thanks @jayvdb for the review and @rimmington for the PR. I think we need to consider how we want to approach a new source in terms of semver-ness here. AFAIK this would be the first such additional source and therefore likely needs a bit more consideration than just the data changes (not to say those are not also critical, and thanks again for reviewing those @jayvdb). I am not sure I have a really strong opinion, but to be sure we get a few more eyes on this I will also ping in out @jshttp/express-tc.

bjohansebas · 2025-03-16T01:18:20Z

I see this PR for a future version 2 of mime-db, which I would think would be ideal, before adding it to version 1.

Add shared-mime-types as upstream source

bdf1680

jayvdb reviewed Nov 22, 2024

View reviewed changes

jayvdb reviewed Nov 23, 2024

View reviewed changes

UlisesGascon added the semver-major label Nov 19, 2025

Uh oh!

Conversation

rimmington commented Jan 2, 2024

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jayvdb Nov 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jayvdb Nov 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jayvdb commented Nov 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

wesleytodd commented Jan 12, 2025

Uh oh!

bjohansebas commented Mar 16, 2025

jayvdb Nov 23, 2024 •

edited

Loading

jayvdb Nov 23, 2024 •

edited

Loading

jayvdb commented Nov 23, 2024 •

edited

Loading