Senior Data Engineer
ION- 2 months ago
- India
- Full Time
Please verify your account first! Send OTP
Job Overview
Functional Area
Data
Work preferred
Work from Office
Experience
Min Experience
7 Years
Max Experience
9 Years
Description
Responsibilities
- Participate in the design and implementation of sophisticated software systems using either object-oriented or functional programming techniques implemented in Java or Python languages.
- Participate in software design and code reviews. Reviews include other Software Engineers and are held to ensure a high level of software quality and to share knowledge with team members.
- Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash
- Maintain a high level of proficiency with Computer Science/Software Engineering knowledge and contribute to the technical skills growth of other team members.
- Work well independently and as part of a team.
Knowledge
- Solid experience implementing high availability, scalable cloud solutions
- Strong understanding of data structures and algorithms
- Knowledge of functional programming languages and techniques
- Knowledge of object-oriented programming languages and techniques
- Solid understanding of concurrency and concurrent programming techniques
- Solid understanding of distributed computing techniques
- Knowledge and understanding of operating with data in large scale
Applicable Skills
- Bachelor’s degree in Computer Science, or 7+ years of comparable work experience
- 7+ years experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis and MSK.
- 7+ years experience with one or more of the following programming languages: Scala, Java, or Python.
- 7+ years experience with Big Data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
- Proficient with building data integrations using both API and file based protocols.
- Proficiency with test-driven development and unit testing.
- Proficiency with Git Version Control.
- Experience with CI/CD pipeline patterns and best practices
- Experience with alerting and monitoring tools like Grafana
- Must desire to learn new technologies and languages.
- Able to put together process documentation concisely and clearly.
- Excellent written and verbal communication skills.
- Able to work closely and effectively with peer developers and work on several active projects simultaneously.
Skills
AgileImplementationJiraPythonQualitySoftware Development