Merge pull request #4 from DataTalksClub/first-steps

First steps

Author: kavaivaleri

_config.yml

@@ -146,7 +146,7 @@ liquid:
 back_to_top: true
 back_to_top_text: "Back to top"
 
-footer_content: 'Copyright &copy; 2017-2020 Patrick Marsceill. Distributed by an <a href="https://github.com/just-the-docs/just-the-docs/tree/main/LICENSE.txt">MIT license.</a> <a href="https://www.netlify.com/">This site is powered by Netlify.</a>'
+footer_content: ''
 
 # Footer last edited timestamp
 last_edit_timestamp: true # show or hide edit time - page must have `last_modified_date` defined in the frontmatter
@@ -155,7 +155,7 @@ last_edit_time_format: "%b %e %Y at %I:%M %p" # uses ruby's time format: https:/
 # Footer "Edit this page on GitHub" link text
 gh_edit_link: true # show or hide edit this page link
 gh_edit_link_text: "Edit this page on GitHub"
-gh_edit_repository: "https://github.com/just-the-docs/just-the-docs" # the github URL for your repo
+gh_edit_repository: "https://github.com/DataTalksClub/zoomcamps-notes-faq" # the github URL for your repo
 gh_edit_branch: "main" # the branch that your docs is served from
 # gh_edit_source: docs # the source that your files originate from
 gh_edit_view_mode: "tree" # "tree" or "edit" if you want the user to jump into the editor immediately

_includes/components/sidebar.html

@@ -25,8 +25,5 @@
   {% if nav_footer_custom != "" %}
     {{ nav_footer_custom }}
   {% else %}
-    <footer class="site-footer">
-      This site uses <a href="https://github.com/just-the-docs/just-the-docs">Just the Docs</a>, a documentation theme for Jekyll.
-    </footer>
   {% endif %}
 </div>

docs/data-engineering-zoomcamp/course-faq.md

@@ -0,0 +1,152 @@
+---
+title: "General FAQ"
+layout: default
+nav_order: 100
+parent: Data Engineering Zoomcamp
+has_children: false
+---
+
+# Frequently Asked Questions
+
+## Table of contents
+{: .no_toc .text-delta }
+
+1. TOC
+{:toc}
+
+## Course Basics
+
+**Q: When does the course start?**  
+A: The next cohort starts January 13th 2025. Register using [this link](https://airtable.com/shr6oVXeQvSI5HuWD). Join the [Telegram channel](https://t.me/dezoomcamp) and DataTalks.Club's Slack for announcements.
+
+**Q: What are the prerequisites?**  
+A: You should have:
+- Basic coding experience
+- Familiarity with SQL
+- Experience with Python (helpful but not required)
+No prior data engineering experience needed. See [prerequisites](https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/README.md#prerequisites).
+
+**Q: How many hours per week should I expect to spend?**  
+A: Typically 5-15 hours per week, depending on your background and experience.
+
+**Q: Can I join after the start date?**  
+A: Yes, you can still join and submit homework, but be mindful of assignment deadlines.
+
+**Q: Do I need a confirmation email after registering?**  
+A: No, you're automatically accepted. Registration is just to gauge interest.
+
+## Technical Setup
+
+**Q: Which Python version should I use?**  
+A: Python 3.9 is recommended for compatibility with course materials. Python 3.10 and 3.11 should also work.
+
+**Q: Should I use local machine, GCP, or GitHub Codespaces?**  
+A: You have three options:
+1. Local machine (may have challenges on Windows)
+2. GitHub Codespaces (pre-installed tools)
+3. Cloud VM (GCP recommended)
+
+**Q: Why use GCP instead of other cloud providers?**  
+A: GCP is recommended because:
+- Everyone has a Google account
+- $300 free credits for new users
+- BigQuery integration
+- Consistent with course materials
+
+**Q: What should I set up before starting?**  
+A: Install and configure:
+- Google Cloud account and SDK
+- Python 3 (with Anaconda)
+- Terraform
+- Git
+
+## Homework and Projects
+
+**Q: What are the homework deadlines?**  
+A: Check [courses.datatalks.club/de-zoomcamp-2025](https://courses.datatalks.club/de-zoomcamp-2025/) and the [Google Calendar](https://calendar.google.com/calendar/?cid=ZXIxcjA1M3ZlYjJpcXU0dTFmaG02MzVxMG9AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ).
+
+**Q: Are late submissions allowed?**  
+A: No, but you can submit while the form remains open. Check submission timestamp on the Course page.
+
+**Q: What should I submit as the homework URL?**  
+A: Your GitHub/GitLab/Bitbucket repository containing your work for that week.
+
+**Q: How does the points system work?**  
+A: Points are awarded for:
+- Homework completion
+- FAQ contributions (1 point/week max)
+- Learning in public (1 point/link, 7 points max)
+
+## Certificates
+
+**Q: Do I need to complete all homework for the certificate?**  
+A: No, only the peer-reviewed capstone projects are required.
+
+**Q: Can I get a certificate in self-paced mode?**  
+A: No, certificates require completing a "live" cohort due to peer review requirements.
+
+**Q: How do I get my certificate?**  
+A: After project grading:
+1. Verify your name in your profile
+2. Wait for grading completion announcement
+3. Follow [certificate generation instructions](https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/certificates.md)
+
+## Course Materials
+
+**Q: Which YouTube playlist should I follow?**  
+A: The main playlist is [Data Engineering Zoomcamp](https://www.youtube.com/playlist?list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb). Additional playlists for specific years are available.
+
+**Q: Can I follow the course after it finishes?**  
+A: Yes, all materials remain available. You can:
+- Study at your own pace
+- Review past homework
+- Prepare for next cohort
+- Work on projects
+
+**Q: What's different in the current cohort?**  
+A: 2025 edition uses Kestra instead of MageAI. See the [demo](https://www.youtube.com/watch?v=R0JAFvDCmSY) and [updated materials](https://www.youtube.com/playlist?list=PLEK3H8YwZn1oPPShk2p5k3E9vO-gPnUCf).
+
+## Support and Help
+
+**Q: How do I get help during the course?**  
+A: Multiple support channels:
+- Slack channel (search before asking)
+- FAQ documentation
+- @ZoomcampQABot for searches
+- Office hours via YouTube Live
+
+**Q: How should I ask questions in Slack?**  
+A: Include:
+- Your OS/environment
+- Commands you ran
+- Error messages (no screenshots)
+- What you've tried
+- Use code formatting (```)
+- Keep discussion in threads
+
+**Q: Will office hours be recorded?**  
+A: Yes, all sessions are recorded and available shortly after.
+
+## Common Issues
+
+**Q: What if I have trouble with Windows?**  
+A: Consider using WSL for better compatibility, especially for shell scripts.
+
+**Q: How do I fix VSCode connection issues to GCP VM?**  
+A: Try managing SSH fingerprints or deleting the known_hosts file.
+
+**Q: How do I open HTML files from WSL?**  
+A: Install wslu and use `wslview filename.html`
+
+## Additional Resources
+
+**Q: Where can I find more learning materials?**  
+A: Check [Awesome Data Engineering Resources](https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/awesome-data-engineering.md)
+
+**Q: How can I contribute to the course?**  
+A: You can:
+- Star the repository
+- Share with others
+- Create PRs for improvements
+- Update this FAQ
+- Help fellow students

docs/data-engineering-zoomcamp/final-project/faq.md

@@ -0,0 +1,26 @@
+---
+title: FAQ
+parent: Final Project
+nav_order: 2
+---
+
+# Module 6 FAQ
+
+Coming soon
+{: .label .label-yellow }
+
+## Contribute
+
+Contribute to this FAQ by transforming [existing FAQ from Google Docs](https://docs.google.com/document/d/19bnYs80DwuUimHM65UV3sylsCn2j1vziPOwzBwQrebw/edit?tab=t.0) to the requred format.
+
+### Contributing FAQ Best Practices
+
+Please include your FAQ in the following format:
+
+```
+**Q: Your Question**
+
+`Exact terminal error` if it exists
+
+A: answer
+```

docs/data-engineering-zoomcamp/final-project/index.md

@@ -0,0 +1,15 @@
+---
+title: Final Project
+parent: Data Engineering Zoomcamp
+nav_order: 7
+---
+
+# Final Project
+{: .fs-9 }
+
+The goal of this project is to apply everything we have learned in this course to build an end-to-end data pipeline.
+{: .fs-6 .fw-300 }
+
+## Module Materials
+
+[Read more](https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/projects){: .btn .btn-purple }

docs/data-engineering-zoomcamp/final-project/notes.md

@@ -0,0 +1,34 @@
+---
+title: Resources
+parent: Final Project
+nav_order: 1
+---
+
+# Resources
+
+## Datasets
+
+Refer to the provided [datasets](https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/dataset.md) for possible selection.
+
+## Helpful Links
+
+* [Unit Tests + CI for Airflow](https://www.astronomer.io/events/recaps/testing-airflow-to-bulletproof-your-code/)
+* [CI/CD for Airflow (with Gitlab & GCP state file)](https://engineering.ripple.com/building-ci-cd-with-airflow-gitlab-and-terraform-in-gcp)
+* [CI/CD for Airflow (with GitHub and S3 state file)](https://programmaticponderings.com/2021/12/14/devops-for-dataops-building-a-ci-cd-pipeline-for-apache-airflow-dags/)
+* [CD for Terraform](https://medium.com/towards-data-science/git-actions-terraform-for-data-engineers-scientists-gcp-aws-azure-448dc7c60fcc)
+* [Spark + Airflow](https://medium.com/doubtnut/github-actions-airflow-for-automating-your-spark-pipeline-c9dff32686b)
+
+
+## Projects Gallery
+
+Explore a collection of projects completed by members of our community. The projects cover a wide range of topics and utilize different tools and techniques. Feel free to delve into any project and see how others have tackled real-world problems with data, structured their code, and presented their findings. It's a great resource to learn and get ideas for your own projects.
+
+[![Streamlit App](https://static.streamlit.io/badges/streamlit_badge_black_white.svg)](https://datatalksclub-projects.streamlit.app/)
+
+## DE Zoomcamp 2023
+
+* [2023 Projects](https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2023/project.md)
+
+## DE Zoomcamp 2022
+
+* [2022 Projects](https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2022/project.md)