Job Description
About Company
Similar Jobs
Please verify your account first!
Send OTP
Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs
Job Description
Responsibilities
- Design and execute the data pipeline with both batch and real-time analytics capabilities to handle over 5 billion daily events and data in the petabyte scale.
- Engineer scalable, secure, and optimised data transformation pipelines while ensuring seamless integration with downstream systems.
- Implement large-scale data quality audits, develop alert mechanisms, and integrate anomaly detection.
- Flexibly adapt to evolving requirements and demonstrate willingness to explore diverse technologies
- Enhance data quality and ensure the utmost reliability of all data pipelines.
- Promote standards, best practices, and operational excellence for the data platform.
- Mentor and provide guidance to junior Data Engineers.
- Minimum of 6+ years experience
- Relevant experience of 5+ in Data Engineering.
- Proficiency in designing data platforms, covering aspects such as architecture, storage, query processing, and observability.
- Solid experience with Spark or Flink
- Robust Java/Scala programming skills with a demonstrable understanding of OOPs and functional programming principles.
- Familiarity with the Lakehouse architectural paradigm.
- In-depth expertise in constructing and refining data pipelines, architectures, and data sets.
- Hands-on experience with messaging systems like Kafka, Kinesis, or Rabbit MQ.
- Familiarity with orchestration tools such as Airflow, Oozie, or Luigi.
- Exposure with datastores such as Redis, Elasticsearch, or Cassandra.
- Proficiency in creating REST API endpoints for data extraction and consumption.
- Exposure to containerisation technologies like Docker or Kubernetes is a distinct advantage.
- Prior experience on prominent Public Cloud platforms is preferable.
Skills
AnalyticsData ExtractionData QualityDesigningInnovationOperational ExcellenceQualityTransformationIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Verse Innovation is the company behind Dailyhunt, India's #1 local language content application offering 1M+ news and entertainment content items in 15 languages. Dailyhunt serves over 350M+ users every month.
Important dates & deadlines?
Application Deadline
05 Oct 23, 09:53 AM IST
Similar Jobs
View All
Loading...
Don't Miss out any Updates
Subscribe now for the latest job alerts
and never miss an update
Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago
