Skip to content

Commit 2fbc400

Browse files
committed
Doc update
1 parent ab05070 commit 2fbc400

13 files changed

Lines changed: 235 additions & 185 deletions

docs/Demo.html

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -105,10 +105,9 @@ <h3>Two complete genomes: Demo-Seq to Demo-Seq2</h3>
105105
<img src="img/demoSum2.png" alt="demo Sum algo2" style="border: 1px solid black; width: 350px"></a>
106106
<td style="vertical-align: text-top;"><a href="img/demoDotplot2.png">
107107
<img src="img/demoDotplot2.png" alt="demoDotplot2" style="border: 1px solid black; width: 400px"></a>
108-
<tr><td colspan="2">There is very little difference between the <ttp>Dotplots</ttp>. The differences are
109-
more pronounced on the <ttp>Chromosome Explorer 2D</ttp> and <ttp>Queries</ttp>. The
108+
<tr><td colspan="2">There is very little difference between the <ttp>Dot Plots</ttp>. The
110109
difference in the synteny algorithm are obvious on the more complicated examples, as shown in
111-
<a href="SystemHelp.hmtl#synteny" target="_blank" class="ext">Synteny Results</a>.
110+
<a href="SystemHelp.html#synResults" target="_blank" class="ext">Synteny Results</a>.
112111
</table>
113112

114113
<!----------------------------------------------------------->
@@ -117,9 +116,12 @@ <h3>Two complete genomes: Demo-Seq to Demo-Seq2</h3>
117116
<h3>Draft: Demo-Draft to Demo-Seq2</h3>
118117

119118
<table style="width: 800px;">
120-
<tr><td colspan="2">The <tt>Demo-draft</tt> was run against the <tt>Demo-Seq2</tt> with its <ttx>order_against</ttx> parameter set to <tt>Demo_Seq2</tt>.
119+
<tr><td colspan="2">The <tt>Demo-draft</tt> was run against
120+
the <tt>Demo-Seq2</tt> with its <ttx>order_against</ttx> parameter set to <tt>Demo_Seq2</tt>;
121+
this is explained in detail in the <a href="SystemGuide.html#draft" target="_blank" class="ext">System Guide</a>.
121122
The resulting dot plot is shown on the right. Note that the 43 contigs
122123
are ordered, but still fragmented.
124+
<p>
123125
<tr><td style="vertical-align: text-top;">
124126
<a href="img/demoSumDraft.png">
125127
<img src="img/demoSumDraft.png" alt="demoSumDraft" style="border: 1px solid black; width: 340px"></a>

docs/MUMmer.html

Lines changed: 74 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -118,9 +118,10 @@ <h2>Finding the problem</h2>
118118
<ul>
119119
<li>Check that the sequences loaded correctly using the <ttb>View</ttb> option on the <ttp>Manager</ttp>.
120120
<li>If the files loaded correctly, check the <a href="#ext">Executables</a>.
121-
<li>If the executables are okay, inspect the log files. The log files are as follows:
121+
<li>If the executables are okay, inspect the log files.
122122
</ul>
123-
<p>&nbsp;&nbsp;<ttx>p1</ttx> = <ttx>project-name1</ttx> and <ttx>p2</ttx> = <ttx>project-name2</ttx>
123+
<h3>Log files</h3>
124+
<p>Using <tt>p1</tt> = <tt>project-name1</tt> and <tt>p2</tt> = <tt>project-name2</tt>
124125

125126
<pre>
126127
symap_5/
@@ -133,27 +134,29 @@ <h2>Finding the problem</h2>
133134
symap.log # keeps most of the SyMAP output shown on the terminal for this A&S
134135
</pre>
135136

136-
e.g. <ttx>p1</ttx> = <ttx>demo_seq</ttx> and <ttx>p2</ttx> = <ttx>demo_seq2</ttx>
137+
e.g. <tt>p1</tt> = <tt>demo_seq</tt> and <tt>p2</tt> = <tt>demo_seq2</tt>
137138
<pre>
138139
demo_seq_to_demo_seq2/
139-
demo_seq_cc.demo_seq2_f1.log # MUMmer output directed to this file
140-
demo_seq_cc.demo_seq2_f2.log # same for the second mummer execution
140+
demo_seq_cc.demo_seq2_f1.log # MUMmer output directed to this file for process 1
141+
demo_seq_cc.demo_seq2_f2.log # MUMmer output directed to this file for process 2
141142
symap.log # SyMAP terminal output
142143
</pre>
143144

144145
&rarr; If an alignment is listed as failed in the <tt>error.log</tt> file,
145146
the corresponding <tt>&lt;p1_cc.p2_fn&gt;.log</tt> file will contain the MUMmer error
146147
(see <a href="img/mummerLog.png">example mummer log</a>).
147148
<p>&rarr;
148-
If the error is not found in the log files or it is not clear, try the following:
149-
<br>Copy the command from the terminal (or log file), and paste it on a new terminal line to execute, e.g.
150-
(the following is one line wrapped around):
149+
If the error is not found in the log files or the error is not clear, try the following:
150+
Copy the command from the terminal (or log file), and paste to a terminal to execute.
151+
The command will look similar to the following, though it will all be on one line:
152+
<p>
151153
<pre>
152-
ext/mummer/mac/promer -p data/seq_results/demo_seq_to_demo_seq2/align/demo_seq_cc.demo_seq2_f2.promer
153-
data/seq_results/demo_seq_to_demo_seq2/tmp/demo_seq2/demo_seq2_f2.fa
154-
data/seq_results/demo_seq_to_demo_seq2/tmp/demo_seq/demo_seq_cc.fa
154+
> ext/mummer/mac/promer
155+
-p data/seq_results/demo_seq_to_demo_seq2/align/demo_seq_cc.demo_seq2_f2.promer
156+
data/seq_results/demo_seq_to_demo_seq2/tmp/demo_seq2/demo_seq2_f2.fa
157+
data/seq_results/demo_seq_to_demo_seq2/tmp/demo_seq/demo_seq_cc.fa
155158
</pre>
156-
This shows <tt>promer</tt> output directly on the terminal. Typically the problem is not enough memory.
159+
This shows <tt>promer</tt> output directly on the terminal and provides a better description of the problem.
157160

158161
<!----------------------------------------------------->
159162
<a id="mum4"></a>
@@ -168,7 +171,7 @@ <h3>Using MUMmer4</h3>
168171
<h3>Executables</h3>
169172

170173
The alignment programs are provided in the <tt>symap/ext</tt> directory. There are
171-
executables for 64-bit Linux and 64-bit MacOS. SyMAP will
174+
64-bit executables for Linux, MacOS x86_64, and MacOS M4. SyMAP will
172175
select the correct directory for the machine you are running from, i.e. you
173176
do not need to do anything. See <a href="SystemGuide.html#ext" class="ext" target="_blank">System Guide</a> for details.
174177

@@ -237,11 +240,12 @@ <h3>Limit CPUs and uncheck Concat</h3>
237240

238241
There is no straight-forward way to know if you have enough memory as it depends on the
239242
size and complexity of the two genomes being compared.
240-
If you think memory may be tight or MUMmer produced an error as shown in the section above,
241-
first try running again with reduced CPUs and unchecked <ttl>Concat</ttl>:
243+
If you think memory may be tight or MUMmer produced an error as shown in the above section,
244+
first try running again with reduced <ttl>CPUs</ttl> and unchecked <ttl>Concat</ttl>:
242245
<ol>
243246
<li>On the <ttb>Project Manager</ttb> panel, limit the number of CPUs, as each
244247
CPU uses a considerable amount of memory (e.g. 4 CPUs could collectively use 20GB of memory at once).
248+
See <a href="SystemHelp.html#cpu" class="ext" target="_blank">CPU</a> for further information.
245249
<p><li>
246250
In the <ttb>Project Parameters</ttb> panel, uncheck <ttl>Concat</ttl> to reduce the
247251
size of the input files to MUMmer.
@@ -252,8 +256,11 @@ <h3>Limit CPUs and uncheck Concat</h3>
252256
<a id="mask"></a>
253257
<h3>Not-masked or Soft-masked</h3>
254258
A memory problem can occur if the genome sequence is not masked or only soft-masked.
255-
Either: (1) change the sequence to hard-masked, or (2) set the
256-
<a href="SystemHelp.html#pairParams" class="ext" target="_blank">Pair Parameters</a> parameter <ttx>Mask</ttx>.
259+
Try either of the following:
260+
<ul><li>Change the sequence to hard-masked (see <a href="input/index.html#seqprep" class="ext" target="_blank">Sequence files</a>).
261+
<li>Set the <a href="SystemHelp.html#align2" class="ext" target="_blank">Pair Parameters</a> parameter to <ttx>Mask</ttx>
262+
all sequence but the genes.
263+
</ul>
257264

258265
<!----------------------------------------------------->
259266
<a id="fail2"></a>
@@ -280,7 +287,7 @@ <h3>One or more fails</h3>
280287
<ttb>Selected Pair</ttb> and it will complete the failed processes.
281288
</table>
282289

283-
<p><u>Incomplete alignment</u>
290+
<p><u>Incomplete alignment</u>:
284291
If SyMAP completed the alignment, e.g. the demo <tt>/align</tt> directory will have the following files:
285292
<p><pre>
286293
-rw-r--r--@ 1 cari staff 0B Apr 10 10:28 all.done
@@ -290,42 +297,58 @@ <h3>One or more fails</h3>
290297
-rw-r--r--@ 1 cari staff 0B Apr 10 10:27 demo_seq_cc.demo_seq2_f2.mum.done
291298
</pre>
292299
<ol>
293-
<li>The 'all.done' indicates that the all alignments completed.
294-
<li>If 'all.done' does not exist, SyMAP will perform any alignments that do NOT have a corresponding 'mum.done'.
300+
<li>The <tt>all.done</tt> indicates that the all alignments completed.
301+
<li>If <tt>all.done</tt> does not exist, SyMAP will perform any alignments that do NOT have a corresponding <tt>mum.done</tt>.
295302
If the <ttl>Concat</ttl> setting has been switched between the previous and current run, this will not work correctly.
296-
<li>If the user supplied the alignments (<a href="MUMmer.html#cmd" class="ext" target="_blank">Supply MUMmer files</a>),
297-
there may not be 'mum.done' files but there should be an 'all.done', so it is assumed they are all done.
303+
<li>If the user supplied the alignments (<a href="MUMmer.html#cmd">Supply MUMmer files</a>),
304+
there may not be <tt>mum.done</tt> files but there should be an <tt>all.done</tt>, so it is assumed they are all done.
298305
</ol>
299306
<!------------------------------------------------------------------>
300307
<a id="cmd"></a>
301308
<h2>Running MUMmer from the command line</h2>
302-
<table class="tz" style="width:70%"><tr>
309+
<table class="tz" style="width:40%"><tr>
310+
<td><a href="#cmd">Command line</a>
303311
<td><a href="#example">Example</a>
304312
<td class="colrt"><a href="#top">Go to top</a>
305313
</table>
306314

307-
If you need to run MUMmer using the command line from some other machine, do the following:
315+
<h3>Command line</h3>
316+
317+
If you need to run MUMmer using the terminal command line from some other machine, do the following:
318+
308319

309320
<ol>
321+
<li><u>The naming of your files and their order into MUMmer is VERY important.</u> Everything will mess up
322+
if this is done wrong!
323+
<ul>
324+
<li>It uses the <ttx>Directory</ttx> name of the two projects in the <tt>data/seq</tt> directory.
325+
<li>Say the projects are in <tt>data/seq/arab</tt> and <tt>data/seq/brap</tt>.
326+
<li>The directory name <tt>arab</tt>
327+
is <i>alphanumerically less</i> than <tt>brap</tt>, so it is <tt>proj1</tt> and <tt>brap</tt> is <tt>proj2</tt>.
328+
</ul>
329+
<p>
310330
<li>If your chromosomes are large, split the sequence file into chromosome files using <a href="input/index.html#sp" class="ext" target="_blank">xToSymap</a>.
311331
Process each chromosome file for the first genome with each chromosome file for the second genome.
312332
<p>
313-
<li>Create a directory <tt>data/seq_results/&lt;proj1-to-proj2&gt;/align</tt> where <tt>proj1</tt> is
314-
alphabetically less than <tt>proj2</tt>.
333+
<li>Create a directory <tt>data/seq_results/&lt;proj1-to-proj2&gt;/align</tt>.
315334
<p>
316335
<li>Running MUMmer: The query must be alphanumerically less than reference. For the <tt>promer</tt> command:
317336
<pre>
318337
USAGE: promer [options] &lt;Reference&gt; &lt;Query&gt;
319338
e.g. promer proj2 proj1
320339
</pre>
321340
<p>
322-
See the commands for the <u>Example</u> below. Replace the demo names with your project/chromosome names.
323-
If you have many chromosome pairs to process, put them in a script, e.g. <a href="input/logs/mummer.html">demo commands</a>.
341+
See the commands for the <b>Example</b> below. Replace the demo names with your project/chromosome names.
342+
If you have many chromosome pairs to process,
343+
put them in a script, e.g. <a href="input/logs/mummer.html">demo script</a>.
344+
Then execute the script from the main symap directory.
345+
346+
<p>To view the MUMmer parameters, see <a href="SystemHelp.html#mum" class="ext" target="_blank">MUMmer parameters</a>.
324347
<ul>
325348
<li>Promer: The output of promer is input to "show-coords -dlkT".
326349
<li>Nucmer: The output of nucmer is input to "show-coords -dlT".
327350
</ul>
328-
<p>To view the MUMmer parameters, see <a href="SystemHelp.html#mum" class="ext" target="_blank">MUMmer parameters</a>.
351+
329352
<p>
330353
<li>Result files:
331354
<ul>
@@ -345,29 +368,42 @@ <h2>Running MUMmer from the command line</h2>
345368
<a id="example"></a>
346369
<h3>Example</h3>
347370
This example will use MUMmer for the loaded projects <tt>demo_seq</tt> and <tt>demo_seq2</tt>.
348-
First, remove the directory <tt>data/seq_results/demo_seq_to_demo_seq2</tt>.
349-
350-
<p><tt>Demo_seq</tt> has chr3 and chr5 in the file <tt>genomic.a</tt> and
351-
<tt>demo_seq2</tt> has files <tt>chr1.seq.gz</tt> and <tt>chr3.seq</tt>. The commands are as follows:
371+
<br>If you want to try this and you have already run the demo, remove the synteny results
372+
from the database using the <ttp>symap</ttp>
373+
<ttb>Clear Pair</ttb> along with the directory <tt>data/seq_results/demo_seq_to_demo_seq2</tt>.
352374

375+
<p>Input:
376+
<ul>
377+
<li>Project <tt>demo_seq</tt> has file <tt>genomic.fa</tt> (containing 2 chromosomes).
378+
<li>Project <tt>demo_seq2</tt> has files <tt>chr1.seq.gz</tt> and <tt>chr3.seq</tt>.
379+
<li>Note that <tt>demo_seq</tt> is alphanumerically less than <tt>demo_seq2</tt>.
380+
</ul>
381+
<p>The commands are as follows:
382+
<p>
353383
<pre>
354384
gunzip data/seq/demo_seq2/sequence/chr1.seq.gz # MUMmer does not process zipped files
355385
cd data/seq_results
356386
mkdir demo_seq_to_demo_seq2
357387
mkdir demo_seq_to_demo_seq2/align
358388
touch demo_seq_to_demo_seq2/align/all.done
359-
cd ../..
389+
390+
# from symap directory, execute the following (the indented line are part of the previous line)
360391
ext/mummer/mac/promer -p data/seq_results/demo_seq_to_demo_seq2/align/results.promer
361392
data/seq/demo_seq2/sequence/chr1.seq data/seq/demo_seq/sequence/genomic.fa
362-
ext/mummer/mac/show-coords -dlkTH data/seq_results/demo_seq_to_demo_seq2/align/results.promer.delta
393+
ext/mummer/mac/show-coords
394+
-dlkTH data/seq_results/demo_seq_to_demo_seq2/align/results.promer.delta
363395
&gt;data/seq_results/demo_seq_to_demo_seq2/align/seq1chr1.mum
364396
</pre>
365-
See <a href="input/logs/mummer.html">script</a> for the full set of mummer command to process all sequence data.
397+
See <a href="input/logs/mummer.html">script</a> for the full set of MUMmer commands to process all sequence data.
398+
<br>It is easiest to run the demo by copying the contents of the script
399+
into a file (e.g. <tt>./symap/demo.txt</tt>),
400+
<br>then from the <tt>symap</tt> directory, execute it (e.g. <tt>sh demo.txt</tt>).
366401

367-
<p>When symap is started and <tt>demo_seq</tt> and <tt>demo_seq2</tt> selected, there will be a "A" in their cell; select it followed by
402+
<p>When <tt>./symap</tt> is started, select <tt>demo_seq</tt> and <tt>demo_seq2</tt>.
403+
There will be a "A" in their cell; select it followed by
368404
<ttb>Selected Pair</ttb> and it will load the alignments and compute the synteny.
369405

370-
<p>This demo has been fully tested with <ttp>symap</ttp> v5.6.9.
406+
<p>This demo has been fully tested with <ttp>symap</ttp> v5.7.9.
371407

372408
<!------------------------------------------------------------------------>
373409
<a id="mum"></a>

0 commit comments

Comments
 (0)