An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
- You are a skilled Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL. You will lead and execute complex data migration projects by designing, developing, and implementing data migration solutions. Your primary goal is to move large volumes of data from legacy systems to modern cloud-based platforms while ensuring data integrity, accuracy, and minimal downtime.
- Bachelors degree in Computer Science, Engineering, Data Science, or a related field. Advanced degrees are a plus.
- 4 to 8 years of experience in Databricks and big data frameworks.
- Proficiency in AWS services and data migration.
- Experience in Unity Catalogue.
- Familiarity with batch and real-time processing.
- Data engineering skills with expertise in Python, PySpark, and SQL.
- Certifications such as AWS Certified Solutions Architect, Databricks Certified Professional, or similar are beneficial.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, agile environment.
Your responsibilities include software development where you will design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, and SQL. You will collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. Implementing efficient and maintainable code using best practices and coding standards is crucial.
You will work with the Databricks platform for big data processing and analytics, developing and maintaining ETL processes using Databricks notebooks. Implementing and optimizing data pipelines for data transformation and integration using AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks will be a key aspect of your role. Leveraging PySpark for large-scale data processing and transformation tasks is essential.
Continuous learning is encouraged where you need to stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks. Sharing knowledge with the team and contributing to a culture of continuous improvement is expected. Utilizing your expertise in SQL to design, optimize, and maintain relational databases and writing complex SQL queries for data retrieval, manipulation, and analysis is necessary.
Qualifications & Skills:
Soft Skills:
For additional details, please contact hidden_email is a full-time, permanent position requiring in-person work at Bangalore, Mumbai, or Pune locations.,
Skills
Big DataPythonData IntegrityData MigrationData ScienceEtlData ProcessingAnalyticsSqlPySparkDatabricksSQLPythonAWSIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Maharashtra.
One email a day. Unsubscribe any time.

