ADG Senior Analyst (Data Engineer-Databricks & Pyspark)
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsAn ADG Senior Analyst (Data Engineer-Databricks & Pyspark) role at Essex Lake Group in Delhi for people with 3–5 years of experience. You'll build scalable data pipelines, integrate multiple sources, and optimize Spark workloads using Databricks, PySpark, Python, and SQL.
- Delhi
- Work from office
- 3–7 years
What you'll do
- Develop data ingestion and transformation pipelines
- Integrate data from multiple sources
- Implement data-quality checks and reconciliation
Good fit if you
- Have strong hands-on experience with Databricks and PySpark
- Bring proficiency in Python and SQL
- Understand the banking domain and metrics
AI-generated from the job description. Check the full description before you apply.
Job Description
- ADG Senior Analyst (Data Engineer-Databricks & Pyspark)
- Company: Essex Lake Group
- Job Location: New Delhi, Delhi, India
- Employment Type: Full-time
- Experience Required: 3 - 5 years
- Salary: 1,25,0002,08,333 a month
- The Role
- Position: ADG Senior Analyst (Data Engineer-Databricks & Pyspark)
- Experience- 3-5 Years
- Location: Gurgaon, India
- Work Mode: Work from Office (Monday- Friday)
- Time: 2:00 PM 11:00 PM IST
- Role Summary
Design, build and maintain scalable data pipelines and curated datasets to support analytics, new capabilities and technology experimentation in the banking domain. Partner with analytics, business and technology teams to deliver reliable, reusable and governed data assets.
- Key Responsibilities
- Develop data ingestion and transformation pipelines using Databricks, PySpark, Python and SQL.
- Integrate data from multiple sources and prepare datasets for reporting, analytics and machine-learning use cases.
- Build reusable transformation components and analytical data models.
- Implement data-quality checks, reconciliation, exception handling and pipeline monitoring.
- Optimize Spark workloads for performance, reliability and cost.
- Apply data security, access controls, lineage and documentation standards.
- Support automated deployment, production troubleshooting and ongoing pipeline maintenance.
- Translate banking business requirements into sustainable data solutions.
- Required Skills & Experience
- Strong hands-on experience with Databricks and PySpark
- Proficiency in Python and SQL
- Experience building ETL/ELT pipelines and working with Data Lake
- Understanding of distributed processing, workflow orchestration and performance tuning
- Working knowledge of the banking domain, including banking data and metrics
- Understanding of data-quality requirements, including validation, completeness, accuracy and consistency
- Preferred Skills
- Experience with Azure-based data platforms
- Familiarity with enterprise data governance and sensitive-data handling
- Experience preparing data for Power BI and machine-learning applications
- About Essex Lake Group LLC
With global headquarters in New York, U.S.A. and operations in India, Canada, China and the United Kingdom, Essex Lake Group LLC (Essex) delivers transformative profit enhancing solutions, anchored on insights from Big Data, Advanced Analytics and its extensive executive and industry experience. Essex
customized battle-tested solutions deliver a measurable positive impact within 6 to 18 months. Essex solutions have created substantial profit increases for clients in the areas of revenue growth, cost reduction, consumer and enterprise risk management regulatory compliance.
Every
Essex solution is customized for the client and the specific problem or opportunity. Essex has proven success and specific experience in the Financial Services, Retail Banking, Telecommunications, Insurance, Healthcare and Media & Entertainment industries, as well as others. Essex delivers visibility in complex businesses to help clients make sound business decisions and its experienced industry experts work with clients through full implementation of its solutions to ensure the organization receives all the benefits from its solutions and methodologies. Further information on the company can be found on its website: www.essexlg.com .
Skills
Senior AnalystData EngineerAnalystDatabricksDataqualityPower BIData LakeELTAzurebased Data PlatformsSQLETLPySparkPythonDatabricksIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Delhi.
One email a day. Unsubscribe any time.

