BIG DATA DEVELOPER - II
The Judge Group Inc.

Grand Prairie, Texas

Posted in IT


This job has expired.

Job Info


Location: Grand Prairie, TX
Description: Our client is currently seeking a BIG DATA DEVELOPER - II

JOB TITLE:

Description

BigData Architect with a minimum of 6+ years of experience to join our Datalake team. They will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure Data Platform runs 24/7.

• Possess extensive analysis, design and development experience in Hadoop and AWS Big Data platforms

• Able to critically inspect and analyze large, complex, multi-dimensional data sets in Big Data platforms

• Experience with Big Data technologies, distributed file systems, Hadoop, HDFS, Hive, and Hbase

• Define and execute appropriate steps to validate various data feeds to and from the organization

• Collaborate with business partners to gain in-depth understanding of data requirements and desired business outcomes

• Create scripts to extract, transfer, transform, load, and analyze data residing in Hadoop and RDBMS including Oracle and Teradata

• Design, implement, and load table structures in Hadoop and RDBMS including Oracle and Teradata to facilitate detailed data analysis

• Participate in user acceptance testing in a fast-paced Agile development environment

• Troubleshoot data issues and work creatively and analytically to solve problems and design solutions

• Create documentation to clearly articulate designs, use cases, test results, and deliverables to varied audiences

• Create executive-level presentations and status reports

• Under general supervision, manage priorities for multiple projects simultaneously while meeting published deadlines

• Bachelor's degree or Master's degree in Computer Science or equivalent work experience

• Highly proficient and extensive experience working with relational databases, particularly Oracle and Teradata

• Excellent working knowledge of UNIX-based systems

• Excellent Interpersonal, written, and verbal communication skills

• Very proficient in the use of Microsoft Office or G Suite productivity tools

• Experience with designing solutions and implementing IT projects

• Exposure to DevOps, Agile Methodology, CI/CD methods and tools, e.g. JIRA, Jenkins, is a huge plus

• Prior work experience in a telecommunications environment is a huge plus

• Experience with Spark, Scala, R, and Python is a huge plus

• Experience with BI visualization tools such as Tableau and Qlik is a plus

• Background in financial reporting, financial planning, budgeting, ERP (Enterprise Resource Planning) is a plus

• Exposure to advanced analytics tools and techniques e.g. machine learning, predictive modeling is a plus.

MUST HAVE SKILLS (Most Important):

• Experience with Hadoop Data Platforms Experience with Relational databases like Oracle

• SQL/PLSQL

• Unix Shell Script

• CRONJOB

• HIVE

DESIRED SKILLS:

• Python

• Java

• Hive and Spark cluster environments

• Qlik Sense

JOB DUTIES:

Install and configure Hadoop clusters, Sqoop,Python & Spark packages Expertise in administration of Hive, Kafka, Python, Hbase, Spark, Sqoop Manage Hadoop,Kafka,hbase, Sqoop,Hive and Spark cluster environments Apply proper architecture guidelines to ensure highly available services Plan and execute major platform software and operating system upgrades and maintenance across physical environments Develop and automate processes for maintenance of the environment Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access) Ensure proper resource utilization between the different development teams and processes Design and implement a toolset that simplifies provisioning and support of a

large cluster environment Review performance stats and query execution/explain plans; recommend changes for tuning Create and maintain detailed, up-to-date technical documentation Ability to shell script with Linux Integration to other Hadoop platforms

EDUCATION/CERTIFICATIONS:

Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or Mathematics preferred.

Contact: ateotia@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com


This job has expired.

More IT jobs


Gdh Consulting, Inc.
Birmingham, Alabama
Posted about 1 hour ago

Gdh Consulting, Inc.
Allen, Texas
Posted about 1 hour ago

Gdh Consulting, Inc.
San Jose, California
Posted about 1 hour ago

Get Hired Faster

Subscribe to job alerts and upload your resume!

*By registering with our site, you agree to our
Terms and Privacy Policy.