Job Brief
As a Senior Data Engineer, you’ll work in small Agile teams to deliver innovative solutions on Amazon Web Services, Azure, and Google Cloud using core cloud data warehouse tools, Hadoop, Spark, Event Stream platforms.
Responsibilities
- Work as part of a team to develop Cloud Data and Analytics solutions
- Participate in the development of cloud data warehouses and business intelligence solutions
- Data wrangling of heterogeneous data and explore and discover new insights
- Own your delivery of the quality product
- Gain hands-on experience with new data platforms and programming languages (e.g., Python, Hive, Spark)
Required skills and experience
- 5+ years of experience in Data Engineering or Data Warehousing
- Hands-on experience with leading commercial Cloud platforms, including AWS, Azure
- Proficient in Python, Java, C# or Swift
- Proven experience with data warehousing, data ingestion, and data profiling
- Ability to learn new technologies and analytics techniques
- Highly self-motivated and able to work independently as well as in a team environment
- Understanding of basic testing types
- Proficient in the Linux shell, including utilities such as SSH
Nice to Have:
- Experience with big data technologies (Apache Spark, Kafka, Presto)
- Experience with workflow orchestration platforms (Apache Airflow)
- Experience with container management systems (Kubernetes, Amazon ECS)
- Familiar with NoSQL databases (MongoDB, DynamoDB, etc.)
- Familiarity with streaming data ingestion
- Consulting experience