Senior Data Engineer

JD-1127

3 Nov, 2026 to 31 Mar, 2027

India (Onsite)

Role: Senior Data Engineer
Job Ref Id: JD-1127
Competence level: Not stated
Start date: 2026-11-03
End date: 2027-03-31
Extension option: 100%
Scope: Not stated
Location: India
Remote work: Office-first with some flexibility
Language: English
Application deadline: 2026-10-29
Number of consultants: 1
Security clearance: No

About the assignment

We are looking for a Senior Data Engineer to design and build scalable data pipelines and infrastructure that power Smart SMS features such as SMS categorization, fraud detection, spam intelligence, and AI-driven capabilities. You will collaborate with data scientists, data analysts and product teams to enable feature engineering for ML models, deliver reliable datasets for product insights, and support productionization for millions of daily users. The role focuses on improving ingestion pipelines, building ETL and streaming use cases, and establishing best practices for software and data development.

Responsibilities

Maintain and improve the ingestion pipeline to reliably deliver billions of events daily within defined SLAs
Provide support for teams in building and optimizing their complex pipelines
Work with other teams to identify platform pain points and resolve problems
Develop new tools and frameworks to improve the data platform
Facilitate a company-wide data-driven culture
Collaborate closely with data scientists and data analysts to support production work
Work on large-scale projects such as building an ML platform and streaming use cases
Set up best practices and processes around software and data development

Requirements

Mandatory

Experience working with an orchestration tool (e.g., Airflow)
Experience working with large data sets
Experience building complex ETL pipelines
Experience working with cloud providers such as GCP
Strong programming skills in Spark with Scala and Python
Experience working with CI/CD tools like Jenkins and Git
Strong understanding of software engineering practices and principles
Excellent problem-solving and communication skills
Self-motivated with a proven ability to take initiative to own and solve problems as they come up

Nice-to-have

Experience working with messaging systems like Kafka
Knowledge of Kubernetes
Hands-on experience with any streaming platform
Experience managing a data warehouse in BigQuery or Redshift