Hadoop Developer
Arkhya Tech Inc. · Scottsdale, Arizona, United States
FULL TIME
Job Description
Hadoop DeveloperScottsdale AZ - Day1 OnsiteContract
Read on to find out what you will need to succeed in this position, including skills, qualifications, and experience.
Note: This role focuses strictly on the core Apache Big Data ecosystem running on bare metal. Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.
Core Responsibilities• Develop and optimize robust data pipelines using native HDFS, MapReduce, and YARN.• Write high-performance distributed processing jobs using Apache Spark (Core/SQL) and Hive.• Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level.•Hands-on experience with build tools like Maven and/or Gradle.•Strong understanding of distributed systems and big data architecture.•Experience with streaming frameworks such as Spark Streaming and Kafka Streams.
Required Skills & Qualifications• Proven experience as a dedicated Big Data / Hadoop Developer.• Mastery of the core Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Oozie).• Strong proficiency in Apache Spark using Java, Scala, or Python.• Deep understanding of distributed storage, cluster performance tuning, and Linux environments. xzbcwsv • Note: Cloud-native engineers (AWS EMR/Glue, Azure Synapse/ADF) will not be considered for this specific on-premise role.
Read on to find out what you will need to succeed in this position, including skills, qualifications, and experience.
Note: This role focuses strictly on the core Apache Big Data ecosystem running on bare metal. Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.
Core Responsibilities• Develop and optimize robust data pipelines using native HDFS, MapReduce, and YARN.• Write high-performance distributed processing jobs using Apache Spark (Core/SQL) and Hive.• Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level.•Hands-on experience with build tools like Maven and/or Gradle.•Strong understanding of distributed systems and big data architecture.•Experience with streaming frameworks such as Spark Streaming and Kafka Streams.
Required Skills & Qualifications• Proven experience as a dedicated Big Data / Hadoop Developer.• Mastery of the core Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Oozie).• Strong proficiency in Apache Spark using Java, Scala, or Python.• Deep understanding of distributed storage, cluster performance tuning, and Linux environments. xzbcwsv • Note: Cloud-native engineers (AWS EMR/Glue, Azure Synapse/ADF) will not be considered for this specific on-premise role.
Details
| Company | Arkhya Tech Inc. |
| Location | Scottsdale, Arizona, United States |
| Type | FULL TIME |
| Niche | tech |