Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
10-15 years
Mumbai, Maharashtra, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Responsibilities
  • Lead the data engineering team and manage its growth and development. Define and own data science road map.
  • Manage, enhance and establish best data engineering practices for the team.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Enforce company policies and procedures to ensure quality and prevent discrepancies.
  • Communicate and track key performance metrics across departments.
  • Identify business opportunities and ensure customer satisfaction.
  • Manage cross-functional teams, review their performance, and manage schedules.
  • Generate reports of findings and present these to senior management.
  • Keep abreast of industry best practices and policies.
  • Achieve results and hold teams accountable to deliver on their own goals.
  • Regularly evaluate team structure to ensure the organization can move quickly
  • Devise methods to measure output and effectiveness week over week and present findings and bottlenecks
  • Inspire and motivate the team to strive for excellence
  • Develop and promote processes which ensure timely delivery of products
  • Fill in the blanks and verify that the data engineering team has the right tools, technology, and processes to build quality, scalable and reliable systems
  • Innovate and experiment to optimize team output
Requirements
  • Bachelors and or masters degree in analytics, computer science, or related field.
  • 7+ years of experience as a Data Engineer at senior level position or similar role.
  • Advanced working SQL knowledge and experience working with relational and nosql databases and query authoring (SQL)
  • Experience building and optimizing big data data pipelines, architectures and data sets.
  • Should have strong experience in Tableau
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
  • Excellent communication and presentation skills.
  • Results-driven and able to handle multiple projects.
  • Qualification: Engineering graduates from Tier I or II institutes.
  • B. E/ B. Tech/ MCA/ M. Tech in computer science.
  • Platforms/Stacks/Tools/Languages: Python, NoSQL, BigData, Cloud (AWS), Analytics, AI/ML, Data Engineering
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including MongoDB and MySql.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2 EMR, RDS, Redshift
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.
This job was posted by Piu Dey from ShopSe.

Skills

AnalyticsData ScienceMysqlPresentationPythonQualityRoot Cause AnalysisSqlTransformation

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Common Services Centers (CSC) are one of the crucial enablers of the Digital India Programme. They are the access points for delivery of various e-governance.Digital India is a flagship programme of the Government of India with a vision to transform India into a digitally empowered society and knowledge economy.

Similar Jobs

View all
Loading...
Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Mumbai.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.