Urgent opening for big data engineer for bangalore/chennai

HCLTech · Bengaluru, India

About the Company

Hi, We have an urgent opening for Big Data Engineer for Bangalore/Chennai location.
Location- Bangalore/Chennai
About the Role

Experience- 6 to 10 Years

Responsibilities
Mandatory Skills
Core Big Data Platform Skills
Strong programming experience in Python
Hands-on expertise with Apache Spark (Py Spark preferred)
Strong SQL development and query optimization skills
Apache Airflow for workflow orchestration and scheduling
Kubernetes (AKS/SKE) for container orchestration and deployment. AKS/EKS/GKE also fine.
Min IO / S3 Compatible Object Storage like AWS S3 or other S3-compatible object storage experience
Apache Iceberg/Delta Lake / Apache Hudi
Technical Competencies
Data Pipeline Development
ETL/ELT Processing
Data Modelling
Performance Tuning
Version Control (Git)
Agile/Scrum Delivery Model