Junior Data Pipeline And Apache Nifi Integration Specialist

What role will you play in the team

You will serve as a critical technical contributor in our enterprise data engineering and integration division, specializing in designing and maintaining robust data pipelines. Your central mission will be ensuring seamless ingestion, transformation, and routing of massive data streams from disparate operational databases into centralized analytical data lakes.

What you will do

You will build, configure, and manage real-time data integration workflows utilizing Apache Nifi, Python, and SQL. Your typical workday involves establishing secure database connections, constructing scalable ETL routines, resolving data flow bottlenecks, and verifying data integrity across multi-tiered relational and NoSQL storage systems.

Key responsibility

• Design, implement, and maintain scalable data ingestion and processing pipelines using Apache Nifi and custom Python scripts.
• Perform complex extract, transform, and load (ETL) operations across PostgreSQL, MySQL, and MongoDB databases.
• Monitor pipeline execution logs, promptly troubleshooting connectivity issues, data schema mismatches, and processing latency.
• Integrate diverse APIs and webhooks to ingest third-party SaaS metrics into the enterprise data warehouse.
• Optimize SQL queries and database indexes to accelerate data retrieval and minimize transformation processing times.
• Maintain thorough documentation of data flow diagrams, schema mappings, and pipeline orchestration dependencies.

Required Qualification and Skills

• Bachelor's degree in Information Technology, Computer Engineering, Data Analytics, or equivalent quantitative discipline.
• Hands-on practical experience utilizing Apache Nifi, Python, SQL, and database management systems like PostgreSQL.
• Solid understanding of ETL principles, data warehousing concepts, and data governance best practices.
• Familiarity with big data storage formats, RESTful APIs, and basic version control using Git.
• Strong problem-solving abilities with meticulous attention to detail and data quality assurance.
• Ability to work effectively in a fast-paced, cross-functional engineering team environment.

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired

Benefits Included

• Competitive annual salary package with regular performance appraisals and transparent career progression tracks.
• Comprehensive health insurance benefits covering hospitalization, outpatient care, and wellness checkups.
• Flexible working hours, robust paid leaves, and dedicated wellness days to ensure work-life balance.
• Access to subsidized learning platforms, technical training modules, and company-sponsored certification exams.
• State-of-the-art office infrastructure equipped with modern ergonomic workstations and collaborative breakout spaces.

A Day in the Life

You start your morning by checking Apache Nifi cluster health metrics and reviewing automated alerts for any overnight pipeline failures. You spend the mid-morning designing a new data ingestion flow for a newly acquired client database using custom Python processors. After lunch, you collaborate with database administrators to optimize SQL indexing strategies and participate in an afternoon engineering sync meeting.