Optimizers: SGD vs Adam vs AdamW

← Courses›Data Science AppliedModule 6 · Deep Learning + MLOps›Optimizers: SGD vs Adam vs AdamWquiz83 / 100

Task

📝 **Question:** Default optimizer for a transformer fine-tune?

📋 Pick the right answer.

💡 **Hint:** Re-read the theory above if unsure.

Embeddings: cosine vs Euclidean

Loading a CSV

Selecting columns and rows

Prerequisites — what you should know before this track

Prerequisites — what you should know before this track

🎯 Quiz

Question

📝 **Question:** Default optimizer for a transformer fine-tune?

📋 Pick the right answer.

💡 **Hint:** Re-read the theory above if unsure.

💬 Discussion