Interesting Job Opportunity: GCP Data Engineer - Spark/Hive
Data Science Analytics & Machine Learning
Posted: 3 years ago
Posted: 3 years ago
Let Jobaaj One apply for you
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
Similar Jobs
Please verify your account first!
Send OTP
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
Must-Have :
- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.
- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure
- Strong technical expertise in Python and SQL
- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.
- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)
- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x
- Good Problem-Solving Skills
- Detail Oriented
- Strong Analytical skills working with a large store of Databases and Tables
- Ability to work with geographically diverse teams.
- Certification in GCP service.
- Experience with Kubernetes.
- Experience with Docker
- Experience with CircleCI for Deployment
- Experience with Great Expectations.
- Build Data and ETL pipelines in GCP.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Talend, Java
- Interact with customers on daily basis to ensure smooth engagement.
- Responsible for timely and quality deliveries.
- Fulfill organization responsibilities : Sharing knowledge and experience with the other groups in the organization, and conducting various technical training sessions.
Skills
Cloud InfrastructureDesigningEtlPythonQualitySqlTrainingIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View all
Loading...
Looking for something similar?
Get jobs like this by email
New Data Science Analytics & Machine Learning roles in Greater Kolkata Area.
Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago
One email a day. Unsubscribe any time.
