Bigdata DevOps Engineer
Dedicated Project

Job Description

• 5-plus years of DevOps experience managing the Big Data application stack including
HDFS, YARN, Spark, Hive and Hbase
• Deeper understanding of all the configurations required for installing and maintaining the
infrastructure in the long run
• Experience setting up high availability, configuring resource allocation, setting up
capacity schedulers, handling data recovery tasks
• Experience with middle-layer technologies including web servers (httpd, ningx),
application servers (Jboss, Tomcat) and database systems (postgres, mysql)
• Experience setting up enterprise security solutions including setting up active directories,
firewalls, SSL certificates, Kerberos KDC servers, etc.
• Experience maintaining and hardening the infrastructure by regularly applying required
security packages and patches
• Experience supporting on-premise solutions as well as on AWS cloud
• Experience working with and supporting Spark-based applications on YARN
• Experience with one or more automation tools such as Ansible, Teraform, etc
• Experience working with CI/CD tools like Jenkins and various test report and coverage
• Experience defining and automating the build, versioning and release processes for
complex enterprise products
• Experience supporting clients remotely and on-site
• Experience working with and supporting Java- and Python-based tech stacks would be a

Must have:

Shell Scripting - 1 yrs, Hadoop (Apache, CDH), yarn, hive deployment - 3 years
Security understanding of Hadoop
AWS/GCP Cloud computing - 1 yr
Application server deployment - 1 yr

Good to have:

Spark, yarn, hive, hbase deployment
LDAP setup
Docker understanding


Experience (Min) : 5.0 Years
Experience (Max) : 10.0 Years
Location: Remote

Mandatory Skills

DevOps Hadoop Big Data HDFS Web Servers HTTPD ningx Jboss Tomcat Database Postgresql MySQL Security Solutions AWS Cloud Ansible Terraform CI/CD Jenkins Shell scripting Apache CDH Yarn Hive GCP Cloud Application Server

Optional Skills

Spark Hbase LDAP Docker Java Python

Refer and Earn

Learn More