Data Warehouse Operations Engineer

Responsibilities:

Data Integrity and Updates:

• Ensure the accuracy, completeness, and timeliness of data in the data warehouse.
• Implement and maintain processes to validate and reconcile data from various sources.
• Collaborate with DWH, Data science, and BI teams to ensure timely and accurate data updates.
• Monitor data quality and proactively address any data issues.
• Run projects, requested by team members on production
• Do backfills

ETL monitoring:

• Monitor data workflows and pipelines using Apache Airflow.
• Identify and troubleshoot failed projects and tasks within Airflow.
• Assist in optimizing workflow performance and scheduling adjustments.

Incident Management and Troubleshooting:

• Investigate and resolve data-related incidents, ensuring minimal impact on data availability and quality.
  
• Identify root causes of issues and implement preventive measures.
• Collaborate with cross-functional teams to troubleshoot and resolve data integration or data pipeline problems.

PostgreSQL Database Monitoring and Maintenance:

• Monitor the performance of the PostgreSQL database.
• Implement monitoring and alerting mechanisms to identify and address database issues promptly.
• Assist in regular database maintenance tasks, such as backups, indexing, and performance tuning.
• Collaborate with database administrators to ensure database security and compliance.

New Project Onboarding:

• Take responsibility for obtaining credentials and testing the connections to the new source database.
• Coordinate with the IT team to establish secure and efficient data connections.
• Ensure seamless data integration for new projects and assist in troubleshooting any connectivity issues.

Requirements:

• Bachelors degree in Computer Science, Data Science, Information Systems, or a related field.

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired
• Proficiency in data warehousing concepts and ETL processes.
• Proficiency in SQL for data warehousing and analysis.
• Good level of Python scripting for data management and automation.
• Experience with Apache Airflow or other workflow management tools is a plus.
• Knowledge of PostgreSQL database monitoring and maintenance.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with data visualization tools (e.g., Tableau, Power BI).
• Understanding of cloud-based data storage and analytics services (e.g., AWS S3, Google Cloud Storage, Azure Data Lake).
• Knowledge of dimensional modeling and data governance.

All employees working for FXCM must be eligible to work in India.