| description | How to choose appropriate hardware for your compute needs? Should you compute in the cloud or using your own GPUs? |
|---|
{% embed url="https://youtu.be/S8nLrIj7sM0" caption="Computing and GPUS - Infrastructure and Tooling" %}
- If you go with the GPU round, there are a lot of NVIDIA cards to choose from (Kepler, Maxwell, Pascal, Volta, Turing).
- If you go with a cloud provider, Amazon Web Services and Google Cloud Platform are the heavyweights, while startups such as Paperspace and Lambda Labs are also viable options.
- If you work solo or in a startup, you should build or buy a 4x recent-architecture PC for model development. For model training, if you run many experiments, you can either buy shared server machines or use cloud instances.
- If you work in a large company, you are more likely to rely on cloud instances for both model development and model training, as they provide proper provisioning and infrastructure to handle failures.