Senior Data Engineer - Automotive Mastermind
AST- 1 month ago
- Gurgaon, Haryana, India
- Full Time
Please verify your account first! Send OTP
Job Overview
Functional Area
Data
Work preferred
Work from Office
Experience
Min Experience
4 Years
Max Experience
6 Years
Description
Position title
- Build & support data ingestion and processing pipelines in cloud. This will entail extraction, load and transformation of ‘big data’ from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies
- Partner with product team to assemble large, complex data sets that meet functional and non-functional business requirements, ensure build out of Data Dictionaries/Data Catalogue and detailed documentation and knowledge around these data assets, metrics and KPIs.
- Warehouse this data, build data marts, data aggregations, metrics, KPIs, business logic that leads to actionable insights into our product efficacy, marketing platform, customer behaviour, retention etc.
- Build real-time monitoring dashboards and alerting systems.
- 4+ years of experience in Big Data and Data Engineering.
- Strong knowledge of advanced SQL, data warehousing concepts and DataMart designing.
- Have strong programming skills in SQL, Python/ PySpark etc.
- Experience in design and development of data pipeline, ETL/ELT process on-premises/cloud.
- Experience in one of the Cloud providers – GCP, Azure, AWS.
- Experience with relational SQL and NoSQL databases, including Postgres and MongoDB.
- Experience workflow management tools: Airflow, AWS data pipeline, Google Cloud Composer etc.
- Experience with Distributed Versioning Control environments such as GIT, Azure DevOps
- Building Docker images and fetch/promote and deploy to Production. Integrate Docker container orchestration framework using Kubernetes by creating pods, config Maps, deployments using terraform.
- Should be able to convert business queries into technical documentation.
- Strong problem solving and communication skills.
- Bachelors or an advanced degree in Computer Science or related engineering discipline.
- Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
- Agile software development methodologies.
- Working in multi-functional, multi-location teams
- Total Rewards. Monetary, beneficial and developmental rewards!
- Work Life Balance. You cant do a good job if your job is all you do!
- Prepare for the Future. Academy – we are all learners; we are all teachers!
- Employee Assistance Program. Confidential and Professional Counselling and Consulting.
- Diversity & Inclusion. HeForShe!
- Internal Mobility. Grow with us!
Skills
AgileAnalyticsBusiness IntelligenceCommunicationsConsultingDashboardsData WarehousingDesigningEtlFinancePower BiProblem SolvingPythonSoftware DevelopmentSqlTableauTechnical DocumentationTransformation