Skip to content

Commit 5daf520

Browse files
committed
Updated documentation
1 parent 3ecc675 commit 5daf520

4 files changed

Lines changed: 31 additions & 10 deletions

File tree

doc/ingest/api/index.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11

22
.. note::
33

4-
Information in this guide corresponds to the version **39** of the Qserv REST API. Keep in mind
4+
Information in this guide corresponds to the version **49** of the Qserv REST API. Keep in mind
55
that each implementation of the API has a specific version. The version number will change
66
if any changes to the implementation or the API that might affect users will be made.
77
The current document will be kept updated to reflect the latest version of the API.

doc/ingest/api/reference/rest/controller/db-table-management.rst

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,6 +46,8 @@ that has the following schema (of which only the database and database family-re
4646
"latitude_key" : "coord_dec",
4747
"create_time" : 1662774817703,
4848
"unique_primary_key" : 1,
49+
"charset_name" : "latin1",
50+
"collation_name" : "latin1_swedish_ci",
4951
"flag" : "",
5052
"name" : "Source",
5153
"director_database_name" : "",
@@ -221,7 +223,9 @@ the **partitioned** tables is presented below:
221223
"longitude_key" : <string>,
222224
"flag" : <string>,
223225
"ang_sep" : <double>,
224-
"unique_primary_key" : <number>
226+
"unique_primary_key" : <number>,
227+
"charset_name" : <string>,
228+
"collation_name" : <string>
225229
}
226230
227231
A description of the *regular* tables has a fewer number of attributes (attributes that which are specific to the *partitioned*
@@ -317,6 +321,13 @@ Where the attributes are:
317321
- ``0``: The primary key is not unique.
318322
- ``1``: The primary key is unique.
319323

324+
``charset_name`` : *part* = ``latin1``
325+
The optional parameter that affects the interpretation of the data in the CSV file when ingesting the contribution.
326+
The name will be also used for setting the ``CHARSET`` attribute of the relevant MySQL tables created by the service.
327+
328+
``collation_name`` : *part* = ``latin1_swedish_ci``
329+
The optional parameter is used for setting the ``COLLATE`` attribute of the relevant MySQL tables created by the service.
330+
320331
.. warning::
321332

322333
- The table schema does not include definitions of indexes. Those are managed separately after the table is published.

doc/user/http-frontend-ingest.rst

Lines changed: 17 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -79,9 +79,8 @@ Most services described in this document require user database and table names.
7979
This prefix is reserved for naming internal tables that Qserv places into user databases.
8080

8181
Depending on the version of the Qserv AOI, there are additional restrictions on the names of databases and tables.
82-
Before version number **46** of the API, database and table names could only container alphanumeric characters and underscores.
83-
This restriction was imposed to avoid issues with the MySQL server. This restriction was relaxed in version **46** of the API
84-
to allow the following special characters:
82+
Before version number **46** of the API, database and table names could only contain alphanumeric characters and underscores.
83+
This restriction is relaxed as of version **46** of the API to allow the following special characters:
8584

8685
- (white space)
8786
- ``-`` (hyphen)
@@ -140,6 +139,8 @@ to specify the operation to be performed. The object follows this schema:
140139
{ "database" : <string>,
141140
"table" : <string>,
142141
"binary_encoding" : <string>,
142+
"charset_name" : <string>,
143+
"collation_name" : <string>,
143144
"timeout" : <number>,
144145
"schema" : <array>,
145146
"indexes" : <array>,
@@ -159,6 +160,13 @@ Where:
159160

160161
- :ref:`ingest-general-binary-encoding` (REST)
161162

163+
``charset_name`` : *part* = ``latin1``
164+
The optional parameter that affects the interpretation of the data in the CSV file when ingesting the contribution.
165+
The name will be used for setting the ``CHARSET`` attribute of the relevant MySQL tables created by the service.
166+
167+
``collation_name`` : *part* = ``latin1_swedish_ci``
168+
The optional parameter is used for setting the ``COLLATE`` attribute of the relevant MySQL tables created by the service.
169+
162170
``schema`` : *array*
163171
The required schema definition. The schema must be a JSON array, where each entry represents a column specification.
164172
More information on the schema specification requirements can be found in the dedicated section of the document:
@@ -328,11 +336,11 @@ and files:
328336
The default value assumes the newline character.
329337

330338
``charset_name`` : *part* = ``latin1``
331-
The optional parameters specify the desired character set name to be assumed when ingesting
332-
the contribution. The default value may be also affected by the ingest services configuration.
333-
See the following document for more details:
339+
The optional parameter that affects the interpretation of the data in the CSV file when ingesting the contribution.
340+
The name will be also used for setting the ``CHARSET`` attribute of the relevant MySQL tables created by the service.
334341

335-
- :ref:`ingest-api-advanced-charset` (ADVANCED)
342+
``collation_name`` : *part* = ``latin1_swedish_ci``
343+
The optional parameter is used for setting the ``COLLATE`` attribute of the relevant MySQL tables created by the service.
336344

337345
``timeout`` : *part* = ``300``
338346
The optional timeout (in seconds) that limits the duration of the internal operations initiated by the service.
@@ -398,6 +406,8 @@ The request could be pushed to the service using:
398406
-F 'table=employee' \
399407
-F 'fields_terminated_by=,' \
400408
-F 'timeout=300' \
409+
-F 'charset_name=utf8mb4' \
410+
-F 'collation_name=utf8mb4_uca1400_ai_ci' \
401411
-F 'schema=@/path/to/schema.json' \
402412
-F 'indexes=@/path/to/indexes.json' \
403413
-F 'rows=@/path/to/employee.csv'

doc/user/http-frontend.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11

22
.. note::
33

4-
- This guide corresponds to version **47** of the Qserv REST API. Note that each API implementation has a specific version.
4+
- This guide corresponds to version **49** of the Qserv REST API. Note that each API implementation has a specific version.
55
The version number will change if any modifications to the implementation or API that might affect users are made.
66
This document will be updated to reflect the latest API version.
77
- All communications with the service are over SSL/TLS encrypted connections.

0 commit comments

Comments
 (0)