Skip to content

Commit 08d793b

Browse files
mauvorenetapopova
authored andcommitted
Clarify import memory controls
1 parent 07a0bd5 commit 08d793b

2 files changed

Lines changed: 21 additions & 2 deletions

File tree

modules/ROOT/pages/import.adoc

Lines changed: 19 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,21 @@ For information on `LOAD CSV`, see the link:{neo4j-docs-base-uri}/cypher-manual/
6161
For in-depth examples of using the command `neo4j-admin database import`, refer to the xref:tutorial/neo4j-admin-import.adoc[Tutorials -> Importing data].
6262
====
6363

64+
[[import-memory-controls]]
65+
=== Import memory controls
66+
67+
`neo4j-admin database import` uses two main memory controls:
68+
69+
* JVM heap, configured for the admin process through the usual configuration sources described in xref:neo4j-admin-neo4j-cli.adoc#_configuration[Neo4j Admin and Neo4j CLI -> Configuration].
70+
* Off-heap working memory, controlled by `--max-off-heap-memory`.
71+
If this option is not provided, the importer derives a budget from the available system resources.
72+
73+
The importer does not use the `server.memory.pagecache.size` configuration setting to size import memory.
74+
The off-heap budget is shared across page cache and other off-heap data structures used during import.
75+
In dry-run and verbose output, `Configured max memory` shows the effective off-heap memory budget available to the import command.
76+
77+
[[import-file-considerations]]
78+
=== Input file considerations
6479
These are some things you need to keep in mind when creating your input files:
6580

6681
* Fields are comma-separated by default but a different delimiter can be specified.
@@ -289,7 +304,8 @@ Possible values are:
289304
| {check-mark}
290305

291306
|--max-off-heap-memory=<size>
292-
|Maximum memory that the command can use for page cache and various caching data structures to improve performance.
307+
|Maximum off-heap memory that the command can use for page cache and various caching data structures to improve performance.
308+
Use this option to tune import memory usage; the importer does not use the `server.memory.pagecache.size` configuration setting for this purpose.
293309
Values can be plain numbers, such as 10000000, or, for example, 20G for 20 gigabytes, or 70%, which will amount to 70% of currently free memory on the machine.
294310
|90%
295311
| {check-mark}
@@ -981,7 +997,8 @@ Possible values are:
981997
| {check-mark}
982998

983999
|--max-off-heap-memory=<size>
984-
|Maximum memory that the command can use for page cache and various caching data structures to improve performance.
1000+
|Maximum off-heap memory that the command can use for page cache and various caching data structures to improve performance.
1001+
Use this option to tune import memory usage; the importer does not use the `server.memory.pagecache.size` configuration setting for this purpose.
9851002
Values can be plain numbers, such as 10000000, or, for example, 20G for 20 gigabytes, or 70%, which will amount to 70% of currently free memory on the machine.
9861003
|90%
9871004
| {check-mark}

modules/ROOT/pages/neo4j-admin-neo4j-cli.adoc

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -273,6 +273,8 @@ Administration operations use the configuration specified in the _neo4j.conf_ fi
273273
Sharing configuration between the DBMS and its administration tasks makes sense as most settings are the same.
274274
In some cases, however, it is better to override some settings specified in _neo4j.conf_ by configuring the tasks (instead of updating the config settings in the _neo4j.conf_ file) because administration tasks generally use fewer resources than the DBMS.
275275
For instance, if the page cache of your DBMS is configured to a very high value in _neo4j.conf_, and you want to override this because the admin tasks like backup do not need so much memory, you provide configuration for the admin tasks instead of updating the page cache setting in the _neo4j.conf_ file.
276+
`neo4j-admin database import` does not use `server.memory.pagecache.size` for import memory sizing.
277+
Instead, use `--max-off-heap-memory` to tune the command's off-heap working memory; see xref:import.adoc#import-memory-controls[Import -> Import memory controls].
276278

277279
There are several options for overriding settings specified in the _neo4j.conf_ file using administration tasks:
278280

0 commit comments

Comments
 (0)