|
1 | | -# vizgen_data_transfer |
2 | | -Vizgen Data Transfer |
| 1 | +# Vizgen Data Transfer |
| 2 | + |
| 3 | +This repository contains tools and scripts for managing data transfer processes related to Vizgen projects. It is designed to streamline and automate the movement of data between systems. |
| 4 | + |
| 5 | + |
| 6 | +## Prerequisites |
| 7 | + |
| 8 | +- Python 3.11 or higher |
| 9 | +- Required Python packages listed in `pyproject.toml` |
| 10 | + |
| 11 | +## Installation |
| 12 | + |
| 13 | +1. Clone the repository: |
| 14 | + ```bash |
| 15 | + git clone https://github.com/EI-CoreBioinformatics/vizgen_data_transfer.git |
| 16 | + cd vizgen_data_transfer |
| 17 | + ``` |
| 18 | +2. Build and Install using [Poetry](https://python-poetry.org/docs/#installation): |
| 19 | + ```bash |
| 20 | + version=0.1.0 |
| 21 | + poetry build |
| 22 | + pip install --prefix=/path/to/vizgen_data_transfer/${version}/x86_64 -U dist/*whl |
| 23 | + ``` |
| 24 | +3. Set up the environment: |
| 25 | + ```bash |
| 26 | + export PATH=/path/to/vizgen_data_transfer/${version}/x86_64/bin:$PATH |
| 27 | + export PYTHONPATH=/path/to/vizgen_data_transfer/${version}/x86_64/lib/python3*/site-packages:$PYTHONPATH |
| 28 | + ``` |
| 29 | +4. Run the script: |
| 30 | + ```bash |
| 31 | + vizgen_data_transfer --help |
| 32 | + usage: vizgen_data_transfer [-h] [--copy_type COPY_TYPE [COPY_TYPE ...]] [--threads THREADS] [--disk] [--vizgen_config VIZGEN_CONFIG] [--debug] run_id |
| 33 | +
|
| 34 | + Script for Vizgen data transfer |
| 35 | +
|
| 36 | +
|
| 37 | + positional arguments: |
| 38 | + run_id Provide run name, for example: 202310261058_VZGEN1_VMSC10202 |
| 39 | +
|
| 40 | + options: |
| 41 | + -h, --help show this help message and exit |
| 42 | + --copy_type COPY_TYPE [COPY_TYPE ...] |
| 43 | + Provide copy type, for example: raw_data, analysis, output (default: ['raw_data', 'analysis', 'output']) |
| 44 | + --threads THREADS Number of threads to use for copying (default: 8) |
| 45 | + --disk Enable this option if run has to be copied from the Windows external Hard disk 'G:\Vizgen data Z drive' instead of the default Z: Drive on the analysis machine [default:False] |
| 46 | + --vizgen_config VIZGEN_CONFIG |
| 47 | + Path to vizgen config file [default:/path/to/vizgen_data_transfer/dev/x86_64/lib/python3*/site-packages/vizgen_data_transfer/etc/.vizgen_config.toml] |
| 48 | + --debug Enable this option for debugging [default:False] |
| 49 | +
|
| 50 | + Contact: Gemy George Kaithakottil (Gemy.Kaithakottil@earlham.ac.uk) |
| 51 | + ``` |
| 52 | +
|
| 53 | +## Usage |
| 54 | +
|
| 55 | +1. Configure the settings in `.vizgen_config.toml`. |
| 56 | +2. Run the main script: |
| 57 | + ```bash |
| 58 | + vizgen_data_transfer --vizgen_config /path/to/.vizgen_config.toml 202310261058_VZGEN1_VMSC10202 |
| 59 | + ``` |
| 60 | +
|
| 61 | +## Contributing |
| 62 | +
|
| 63 | +Contributions are welcome! Please fork the repository and submit a pull request. |
| 64 | +
|
| 65 | +## License |
| 66 | +
|
| 67 | +This project is licensed under the GNU General Public License. See the `LICENSE` file for details. |
| 68 | +
|
| 69 | +## Contact |
| 70 | +
|
| 71 | +For questions or support, please contact [Gemy.Kaithakottil@earlham.ac.uk] or [gemygk@gmail.com]. |
0 commit comments