Data Engineer

Acuity Knowledge Partners is hiring multiple SeniorData Engineers for its Data and Technology Services Team at Bengaluru (hybrid).

The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of Databricks (including core data engineering concepts)

Immediate Joiners are highly preferred!(0-30 days)

Required Skills:

• Candidates should have a Bachelors or masters in science or engineering disciplines (Computer Science, Engineering, Maths, Physics, etc.) or a related field.
• 5 to 10 years of strong hands-on experience in a data engineering role, preferably within the financial services industry.
• Strong experience with data pipeline tools and frameworks such as Python, SQL, and Spark.
• Proficiency in cloud platforms, particularly Azure, Snowflake, and Databricks.
• Experience with data integration from various sources including APIs and databases.
• Strong understanding of data warehousing concepts and practices.
• Familiarity with big data technologies and frameworks.
• Excellent communication skills, both written and verbal.

Responsibilities:

• Develop, optimize, and maintain scalable and reliable data pipelines using tools such as Python, SQL, and Spark.
• Integrate data from various sources including APIs, databases, and cloud storage solutions such as Azure, Snowflake, and Databricks.
• Implement data quality checks and ensure the accuracy and consistency of data.
• Manage and optimize data storage solutions, ensuring high performance and availability.
• Work closely with data scientists and DevOps engineers to ensure seamless integration of data pipelines and support machine learning model deployment.
• Monitor and optimize the performance of data workflows to handle large volumes of data efficiently.
• Implement security best practices and ensure compliance with industry standards.

Interested ones, please share your updated CV at [HIDDEN TEXT]