Sr. Data Analyst

– Senior Data Migration Engineer

About the Role

Key Responsibilities

1. Data Migration & ETL Development

• Independently design, develop, and execute end-to-end data migration workflows.
• Build scalable and reusable ETL pipelines using Python and SQL.
• Handle data extraction and migration across databases, CSV, Excel, JSON, and REST APIs.
• Develop complex data mapping, cleansing, transformation, and loading logic.
• Implement incremental migrations, delta updates, and bulk data processing.
• Optimize migration scripts for performance and reliability.
• Identify and resolve complex data migration issues.

2. Python Development & Automation

• Develop robust, modular, and maintainable Python applications.
• Build reusable components for data extraction, transformation, validation, and loading.
• Work extensively with Pandas and other Python data-processing libraries.
• Implement exception handling, logging, retry mechanisms, and error recovery.
• Optimize scripts for handling large datasets.
• Perform code reviews and guide junior engineers on development best practices.

3. API & Database Integrations

• Design and implement REST API-based migration and integration workflows.
• Handle API authentication, pagination, rate limiting, and bulk operations.
• Troubleshoot API failures, data inconsistencies, and integration challenges.
• Develop complex SQL queries for transformation, reconciliation, and validation.
• Work with relational databases such as PostgreSQL, MySQL, or MS SQL Server.

4. AI-Powered Migration Platform Development

• Contribute to the architecture, development, and enhancement of an AI-powered Data Migration Platform.
• Explore and implement AI-assisted data mapping, field matching, and transformation recommendations.
• Develop automation components to reduce manual migration efforts.
• Evaluate LLM-based approaches for intelligent data processing and validation.
• Integrate AI capabilities into existing Python-based migration workflows.
• Work with the team to improve platform scalability, reusability, and maintainability.
• Continuously learn and adopt emerging AI technologies and development practices.

5. Data Quality & Validation

• Design and implement automated data validation and reconciliation frameworks.
• Ensure accuracy, completeness, consistency, and integrity of migrated data.
• Develop reusable validation scripts and exception reports.
• Investigate and resolve source-to-target data mismatches.
• Establish quality checkpoints for migration execution.

6. Technical Ownership & Collaboration

• Take technical ownership of assigned customer migration projects.
• Analyze source and target systems and identify migration dependencies and risks.
• Participate in technical discussions, solution design, and estimation.
• Collaborate with Technical Leads, Project Managers, and implementation teams.
• Identify technical blockers early and communicate risks proactively.
• Prepare technical documentation, mapping specifications, and migration execution reports.
• Mentor junior engineers and support their technical development.

Required Technical Skills

• Python: Strong programming skills, modular development, scripting, automation, and exception handling.
• SQL: Advanced SQL queries, joins, subqueries, aggregations, data transformations, and performance optimization.
• ETL & Data Migration: Hands-on experience designing and executing end-to-end migration workflows.
• Pandas: Strong experience in data manipulation, transformation, and processing.
• REST APIs: API integrations, authentication, pagination, rate limiting, and error handling.
• Databases: PostgreSQL, MySQL, MS SQL Server, or equivalent relational databases.
• Data Processing: CSV, Excel, JSON, XML, and structured/semi-structured datasets.
• Data Validation: Reconciliation, data-quality checks, exception reporting, and troubleshooting.
• Git: Version control and collaborative development.
• Debugging & Optimization: Strong troubleshooting and performance-improvement capabilities.

Good to Have

• Experience in SaaS-to-SaaS or enterprise application data migration.
• Experience developing reusable ETL or migration frameworks.
• Knowledge of Docker, cloud platforms, and deployment practices.
• Familiarity with AI, LLMs, prompt engineering, and AI-assisted automation.
• Exposure to AI frameworks such as LangChain or LlamaIndex.
• Experience with fuzzy matching, intelligent data mapping, or schema matching.
• Understanding of data pipelines, scheduling, and workflow orchestration.
• Experience working with high-volume datasets and complex data structures.

Candidate Expectations

• Strong technical ownership and independent problem-solving capabilities.
• Ability to understand migration requirements and translate them into technical solutions.
• Experience independently handling complex migration tasks.
• Strong debugging, analytical, and troubleshooting skills.
• Ability to review code and mentor junior developers.
• Good communication and collaboration skills.
• Willingness to learn, experiment with, and contribute to AI-driven migration technologies.
• Ability to proactively identify project risks and technical dependencies.
• Commitment to code quality, documentation, and timely delivery.
• Willingness to work from the Chennai office during the 2:00 PM – 11:00 PM IST shift.

Educational Qualification