You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+1-19Lines changed: 1 addition & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,8 +7,7 @@ These jobs are using _PySpark_ to process larger volumes of data and are suppose
7
7
8
8
**✅ Goals**
9
9
10
-
1.**Get a working environment**
11
-
Either local ([local](#local-setup), or using [gitpod](#gitpod-setup))
10
+
1.**Get a working environment** See local [local](#local-setup)
12
11
2.**Get a high-level understanding of the code and test dataset structure**
13
12
3. Have your preferred text editor or IDE setup and ready to go.
14
13
@@ -19,8 +18,6 @@ These jobs are using _PySpark_ to process larger volumes of data and are suppose
19
18
20
19
### Local Setup
21
20
22
-
> 💡 If you don't manage to run the local setup or you have restrictions to install software in your laptop, use the [gitpod](#gitpod-setup) one
23
-
24
21
#### Pre-requisites
25
22
26
23
Please make sure you have the following installed and can run them
@@ -35,26 +32,12 @@ We recommend using WSL 2 on Windows for this exercise, due to the [lack of suppo
35
32
36
33
Follow instructions on the [Windows official page](https://learn.microsoft.com/en-us/windows/wsl/setup/environment)
37
34
38
-
> 💡 In case of issues, like missing permissions on the machine, please use the [gitpod setup](#gitpod-setup)
39
-
40
35
#### Install all dependencies
41
36
42
37
```bash
43
38
poetry install
44
39
```
45
40
46
-
### Gitpod setup
47
-
48
-
Alternatively, you can setup the environment using
49
-
50
-
[](https://gitpod.io/#https://github.com/techops-recsys-lateral-hiring/dataengineer-transformations-python)
51
-
52
-
There's an initialize script setup that takes around 3 minutes to complete. Once you use paste this repository link in new Workspace, please wait until the packages are installed. After everything is setup, select Poetry's environment by clicking on thumbs up icon and navigate to Testing tab and hit refresh icon to discover tests.
53
-
54
-
Note that you can use gitpod's web interface or setup [ssh to Gitpod](https://www.gitpod.io/docs/references/ides-and-editors/vscode#connecting-to-vs-code-desktop) so that you can use VS Code from local to remote to Gitpod
55
-
56
-
Remember to stop the vm and restart it just before the interview.
57
-
58
41
### Verify setup
59
42
60
43
> All of the following commands should be running successfully
@@ -119,7 +102,6 @@ The following section provides context over them.
0 commit comments