Bigdata DevOps Engineer
Dedicated Project

Job Description

Job Title: Bigdata DevOps Engineer
A Senior Big-Data DevOps engineer to join the engineering team and help us automate the build, release, packaging and infrastructure provisioning and support processes. The candidate is expected to own the full life-cycle of provisioning,configuration management, monitoring, maintenance and support for cloud as well as on-premise deployments.

Responsibilities
• 5-plus years of DevOps experience managing the Big Data application stack including
HDFS, YARN, Spark, Hive and Hbase
• Deeper understanding of all the configurations required for installing and maintaining the
infrastructure in the long run
• Experience setting up high availability, configuring resource allocation, setting up
capacity schedulers, handling data recovery tasks
• Experience with middle-layer technologies including web servers (httpd, ningx),
application servers (Jboss, Tomcat) and database systems (postgres, mysql)
• Experience setting up enterprise security solutions including setting up active directories,
firewalls, SSL certificates, Kerberos KDC servers, etc.
• Experience maintaining and hardening the infrastructure by regularly applying required
security packages and patches
• Experience supporting on-premise solutions as well as on AWS cloud
• Experience working with and supporting Spark-based applications on YARN
• Experience with one or more automation tools such as Ansible, Teraform, etc
• Experience working with CI/CD tools like Jenkins and various test report and coverage
Plugins
• Experience defining and automating the build, versioning and release processes for
complex enterprise products
• Experience supporting clients remotely and on-site
• Experience working with and supporting Java- and Python-based tech stacks would be a
plus

Details

Experience (Min) : 5.0 Years
Experience (Max) : 8.0 Years
Location: Remote

Skills

Big Data DevOps HDFS YARN Spark Hive Hbase Configuration HTTPD ningx Jboss Tomcat postgres MySQL Database Systems Application Servers Web Servers Firewall SSL Kerberos KDC AWS Cloud Ansible Terraform CI/CD Jenkins Java Python

Refer and Earn

Learn More