Persistent and commitment are your best friends
After demonstrating level 1 (Juniority) to master the data engineering field, Now time to move to level 2 (Seniority).
I fear not the man who has practiced 10,000 kicks once, but I fear the man who has practiced one kick 10,000 times.
Source: Bruce Lee Foundation
You must realize that patience and persistence should be your best friends through this journey to mastery.
- Level 2
- Taking a data engineering certificate from any cloud provider will greatly strengthen your profile.
GCP: https://cloud.google.com/learn/certification/data-engineer
Azure: https://learn.microsoft.com/en-us/credentials/certifications/azure-data-engineer/?practice-assessment-type=certification
AWS: https://aws.amazon.com/certification/certified-data-engineer-associate/
Training is free: You could get training for any of the certificates from the provider’s website, for instance, https://www.cloudskillsboost.google/paths/16?locale=he ↩︎ - Real use cases/Projects are tricky, you could depend on the below sources to practice on real-world projects.
1 – Data Projects & Competitions :
– https://platform.stratascratch.com/data-projects
– https://www.datacamp.com/projects?page=1
2 – Ask Chatgpt: simple go to ChatGPT and ask “Create a use case with requirements from real example to practise specific tools on data engineering”
3 – Take interview tasks: The interview process might involve some issues that you have to solve, you should take it series and boost your learning.
4- Articles Projects: search for technical projects
Examples:
https://medium.com/@williamong1400/project-1-solving-problem-in-e-commerce-with-data-ac7ed38d7b4
https://medium.com/@essamabdelgaffar/data-engineering-e-commerce-use-cases-74a333ad5d03
And More
- Practicing data quality is challenging but you could break it up to 3 main tasks
a- Data Validation
b- Data Cleansing
c- Data Governance
you should understand each concept and practice it. ↩︎ - Join LinkedIn groups like This or groups in different platforms or subscribe to tech news and platform’s newsletters.
- Soft Skills : Start by learning best practices for better communication.
“Your attitude, not your aptitude, will determine your altitude.” — Zig Ziglar
Full Data Engineering Map:
Conclusion:
Seniority level takes time to accommodate experience, leveling up from level to level both depend on one single rule “Never Stop Learning”
“Thanks for reading! I’d love your feedback — what do you think? If you enjoyed this, please like and share!” ^_^