Data Engineer

• Immediate joiners preferred
• Location: Bangalore
• Exp: 6-8 years

: We are seeking a skilled Data Engineer to join our team and take responsibility for designing and maintaining our data pipeline architecture. As a Data Engineer, you will work on assembling and transforming complex data sets to meet business requirements. You will have expertise in data modeling, dimensional schemas, and ETL/ELT processes. Additionally, you will be involved in automating processes, optimizing data delivery, and improving infrastructure scalability. Your role will also include building analytics tools and providing technical support to cross-functional teams.

Responsibilities:

• Create and maintain optimal data pipeline architecture, including ETL/ELT processes into structured data.
• Assemble large, complex data sets and implement multi-dimensional modeling techniques like Star Schema and Snowflake Schema.
• Develop Fact tables, Dimensional tables, and ensure seamless ingestion of datasets into cloud-based tools with job scheduling and automation.
• Identify and implement internal process improvements, such as automating manual processes and optimizing data delivery.
• Setup and maintain data ingestion, streaming, scheduling, and job monitoring automation, ensuring connectivity between data factory, blob storage, SQL, and Power BI.
• Build the infrastructure required for efficient extraction, transformation, and loading of data from various sources using SQL and "big data" technologies on Azure.
• Create analytics tools that leverage the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and key business metrics.
• Collaborate with cross-functional teams, including external consultants and IT, to address data-related technical issues and support data infrastructure needs.
• Develop data tools for analytics and data science teams to optimize product performance and drive innovation.

Desired Profile:

Required Skills:

• Hands-on experience in data warehousing (e.g., Synapse) to support business analytics and business intelligence (BI).
• Advanced knowledge of SQL and experience with relational databases, query authoring, and familiarity with various databases and cloud data warehouses.
• Proficiency in data model development, creating additional dimensions and facts, and building views and procedures for automation.
• Experience with data compression techniques for processing optimization and fine-tuning SQL programming skills.
• Strong analytical skills and the ability to perform root cause analysis on internal and external data to answer business questions and identify improvement opportunities.
• Solid expertise in working with structured and unstructured datasets, and manipulating, processing, and extracting value from large and unrelated datasets.
• Working knowledge of message queuing, stream processing, and scalable "big data" stores.
• Strong problem-solving skills and the ability to tackle open-ended business problems, with a preference for experience in the pharmaceutical industry.