Experience 5 -7 years

Work from office only and looking for immediate joiner

Recruiter Name: Sreerenjini Nair

APPLY HERE: https://forms.gle/MQR6NwBuGKqQyjxu9

YOUR JOB RESPONSIBILITIES

· Building robust data pipelines that can execute at scale

· Providing expertise to team and adapting best practices

· Optimising ETL pipelines for performance

· Solving problem with the use of Data Engineering

· Assist with the development of target-state data pipelines using big data technologies under appropriate governance and approved framework.

· Assist in the writing and maintenance of process, technical, and business rules documentation.

· Proactive application of continuous improvement in software quality

· Designing, developing, and implementing solutions to customers organizational problems

YOUR SKILLS AND EXPERIENCE

· 5+ years’ experience in software development, solution architecture and data engineering experience in multiple environments

· 3+ years professional experience of utilizing Apache Spark

· Experience using analytic tools including Jupyter Notebooks, Apache Superset or equivalent

· Strong language capabilities with Python and PySpark or SparkSQL

· Desirably experience or knowledge of Scala or Bash/Shell scripting

· Experience coaching integrated teams including developers to ensure systems are designed for testability.

· Experience in strategic development and implementation of Quality Engineering solutions (Automation Frameworks, Performance Validation)

· Proven thought leader & trusted advisor

· Technical acumen in technologies associated with complex and deeply integrated systems eg: e2e domain, business logic and technology

· Expert with CI/CD, TDD, BDD

· Cloud experience (AWS and Azure or GCP)

· Excellent communication skills