GCP Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 1 week ago
2-5 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 2 Jan 2027

Posted: 1 week ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

About the job Dear Aspirants, Greetings from ValueLabs! We are hiring for GCP Data engineer Role: GCP Data engineer Experience: 6+ Years NP: Immediate Location : Hyderabad - Hybrid : Data Engineers build, test and run the data pipelines and models on our GCP platform. You will work with the Data Architect to turn designs into reliable, cost-efficient production pipelines that feed analytics, reporting and ML. Key responsibilities

  • Build batch and streaming pipelines using Dataflow (Apache Beam), Dataproc (PySpark), Pub/Sub and Datastream.
  • Develop and optimise BigQuery datasets, tables, views and stored procedures; apply partitioning and clustering.
  • Ingest data from databases, APIs, files and SaaS sources into Cloud Storage and BigQuery.
  • Orchestrate and schedule workflows with Cloud Composer (Apache Airflow).
  • Implement transformations and data models with SQL, Python, dbt or Dataform.
  • Build data-quality checks, validation and reconciliation; monitor pipelines with Cloud Monitoring and Logging.
  • Support migration of legacy ETL (Informatica, SSIS, Talend, Hadoop) workloads to GCP.
  • Write infrastructure as code with Terraform and deploy through CI/CD pipelines.
  • Apply security and governance standards: IAM roles, PII masking, Dataplex / Data Catalog metadata.
  • Troubleshoot production issues, tune performance and reduce cost.
  • Write technical documentation and take part in code reviews and Agile ceremonies. Required skills
  • Hands-on experience with BigQuery, Dataflow or Dataproc, Pub/Sub, Cloud Storage and Cloud Composer.
  • Strong SQL (complex joins, window functions, performance tuning).
  • Strong Python; PySpark experience.
  • Understanding of data warehousing, dimensional modelling and ETL / ELT patterns.
  • Experience with Git and CI/CD (Cloud Build, GitHub Actions or Jenkins).
  • Familiarity with Linux shell scripting and REST APIs.
  • Good problem-solving and communication skills; comfortable working in Agile teams. Nice to have
  • Java or Scala for Apache Beam.
  • Experience with Kafka, Cloud Functions / Cloud Run, or Bigtable / Spanner / Cloud SQL.
  • Exposure to Looker / Looker Studio, BigQuery ML or Vertex AI.
  • Experience on AWS or Azure data services.

Skills

PythonJavaScalaShell ScriptingSQLLookerPySparkHadoopKafkaAirflowDbtBigQueryETLData WarehousingInformatica

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

ValueLabs, founded in 1996, is headquartered in Hyderabad, India and operates in IT consulting, software development, and data analytics. It operates as information technology and services under private ownership, with a global workforce of approximately 10000+, with offices in Multiple locations globally.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.