Data Lake Engineer

Job Number:

21-00084

Location:

Columbia, SC

Onsite Flexibility:

Job Description

Qualifications:

  • Bachelor’s degree in computer science, information technology, or related degree OR associate degree in computer science, information technology, or related degree plus 2 additional years of related work experience OR 4 years of combined education and experience with systems analysis, design, and/or programming
  • 6 years of technical experience with systems analysis, design, and/or programming
  • 5 years of data engineer/data lake storage experience
  • Must have experience with the following:
    • Spark
    • Scala (preferred); Python (required if no Scala)
    • Hive (including modeling and performance tuning)
    • Ranger with Kerberos
    • HBase
    • NiFi
    • Oozie
    • Sqoop

Responsibilities:

  • Provide expertise regarding the integration of applications across the business
  • Conceive, design, and implement structures and programs to business systems software
  • Act as an internal consultant, advocate, mentor, and change agent providing expertise and technical guidance on complex projects
  • Work closely with customers, business analysts, and team members to determine business requirements that drive the analysis and design of quality technical solutions
  • Ensure solutions are aligned with business and IT strategies and comply with the organization’s architectural standards
  • Provide design recommendations based on long-term IT organization strategy
  • Make recommendations towards the development of new code or reuse of existing code
  • Responsibilities may also include participation in component and data architecture design, performance monitoring, product evaluation, and buy versus build recommendations
  • Perform analysis, design, programming, and implementation on systems and procedures to solve complex business or scientific problems
  • Develop enterprise-level applications and custom integration solutions
  • Evaluate complex interrelationships in immediate programming area to determine how changes in one program will affect another related area
  • Develop programming and development standards
  • Devise new sources of data and develop new approaches and techniques
  • Participate in the full systems life cycle and responsible for designing, coding, testing, implementing, maintaining, and supporting application software that is delivered on time and within budget
  • Provide guidance to lower-level programmers/analysts
  • Lead, plan, organize, and/or coordinate complex projects or phases of large projects
  • Determine and resolve problems with other systems analysts, programmers, and systems users
  • Test designed programs, verify logic, perform any necessary debugging, and write the documentation

Location: Columbia, SC
Data Lake Engineer
21-00084

TM Floyd & Company offers a generous array of benefits, depending on the length of assignment. We also offer a referral bonus of up to $1,000. Ask us for more details!

TM Floyd & Company participates in E-VERIFY
AAP, EEO

Share Job Post

Share on facebook
Share on twitter
Share on linkedin

Job Application

  • Drop files here or
    Accepted file types: pdf, doc, docx, pages.
  • This field is for validation purposes and should be left unchanged.