Senior Data Engineer

We are seeking a highly skilled and motivated Senior Data Engineer with 5-7 years of experience to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience in Python, Spark, Airflow, SQL, and either BigQuery or Snowflake.

Responsibilities

• Design, construct, install, test and maintain highly scalable data management systems.
• Ensure systems meet business requirements and industry practices.
• Build high-performance algorithms, prototypes, predictive models and proof of concepts.
• Research opportunities for data acquisition and new uses for existing data.
• Develop data set processes for data modeling, mining and production.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.
• Install and update disaster recovery procedures.
• Recommend ways to improve data reliability, efficiency and quality.
• Collaborate with data architects, modelers and IT team members on project goals.

Requirements

• 5-7 years of experience in a Data Engineer role.
• Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
• Experience with big data tools: Spark, Hadoop, etc.
• Experience with relational SQL and NoSQL databases.
• Experience with data pipeline and workflow management tools: Airflow, etc.
• Experience with cloud services: BigQuery or Snowflake.
• Experience with object-oriented/object function scripting languages: Python, etc.
• Nice to Have
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.