Position Summary
As a Senior member of our team your contributions will have a huge impact to continually keep up with advancements in our data engineering practices. We are looking for someone who has strong experience in building large-scale data and machine learning pipelines.
Major Areas of Responsibility
- You will help evolve and scale our data platform, towards growth
- Generate architecture recommendations and the ability to implement those
- Improve evolving current CI/CD strategy for current jobs and pipelines
- Work with analytics tasks where you need to pull together proof of concepts, that would need optimal extraction, transformation, and loading of data from a wide variety of data sources.
Qualifications/Experience/Knowledge Required
- A tertiary qualification in IT or related field is required.
- Critical to your success will be your experience developing production grade ETL batch and streaming pipelines.
- A solid understanding of the fundamentals in Software Engineering software engineering skills. Experience with at least one of Spark, Scala, Java, Python Proficient in SQL
- Hands on experience with orchestration such as Airflow, and data processing workflows like Apache Beam
- Experience implementing a DataOps framework. Experience with CI/CD highly preferred
- Appreciation of best in class ML infrastructure solutions and ecosystem such as Kubeflow, MLFlow, AWS Sagemaker, etc.
- Strong analytical skills and data-driven decision making. Ability to work with and analyse large amounts of data
- Advanced Knowledge of SQL. Awareness in AWS bigdata environment Athena, Glue, Redshift
Behavioural Competencies Required
- Good communication skills; both written and verbal.
- A good team player.
- Proactive and eager to take ownership.
- Flexible to the needs of the organization.
- A self-motivated leader.
Benefits
- Excellent remuneration package and flexible working in every sense.
- 100% Work from home
- 2 festival bonus, mobile bill, internet bill, health package
- You will be working with a global team of 350+ top notch engineers, cutting edge technologies and tools.