Hadoop Data Engineer
Company: Select Computing, Inc. (SCi)
Location: Baltimore
Posted on: February 25, 2021
|
|
Job Description:
Hadoop Data EngineerSelect Computing, Inc. (SCi) is a privately
held full-service provider of information technology solutions. We
have been catering to Fortune 1000 companies and Government
Agencies around the United States since 1996. We are currently
seeking an experienced Microsoft SQL Server DBA for an IBM
mainframe conversion effort. The IBM mainframe system supports
multiple financial applications that must be replatformed to SPARK
Solaris systems running Oracle, Micro Focus COBOL, and Cold Fusion.
Once the migration is complete, the services will transition to an
operations and maintenance phase for the remainder of the period of
performance.Technical Responsibilities* Advise the customer on best
practices * Interface and communicate with customers* Install and
configure Hadoop cluster and integration with other open Source
tools like Kafka and Nifi etc* Establish a working pipeline using
Nifi and Kafka* Ability to code in any of the programming languages
like Python or Java.* Implement best practices on Hadoop
environment and its integrated components. * Document processes and
procedures.* Participate in upgrades.* Ensure we have appropriate
maintenance in place including backups, maintenance, cluster
monitoring.* Support adhoc solutions.* Performance tuning.*
Familiarity with API's.* Ability to build and test solution in
agile delivery mannerSkills* High level problem determination and
resolution skills.* Backup and recovery, high availability/Cluster,
monitor the cluster.* Assisting, troubleshooting, and guiding
technical and non-technical resources with any issues* Ability to
provide configuration, monitoring and on-call support for
development, test, and production environments* Ability to install
and configure Kafka and other open source tools* Knowledgeable in
techniques for designing Hadoop-based file layout optimized to meet
business needsExperience* MINIMUM 6 years of experience in IT (Sr.
level)* Must communicate clearly and effectively both verbally and
written* Must be able to demonstrate ability to troubleshoot and
research technical issues.* Experience with Cloudera or Hortonworks
distribution* Optimizing loads of large volumes of data into a
database a plus* Migrations experience from mainframe to HIVE data
lake is a plus* Experience in Big Data processing using Apache
Hadoop ecosystem applications like Hadoop, Hive, Spark, Kafka and
HDFS preferable.* Must be able to demonstrate ability with hands on
experience with Hadoop administration, configuring the cluster and
integration with other open Source tools* Candidate must be a
self-starter, dependable and team player.* This is an ongoing
project should be willing to get hands dirty right away.* Any
scripting experience is a plus.Powered by JazzHRoFOi16r41F
Keywords: Select Computing, Inc. (SCi), Baltimore , Hadoop Data Engineer, Engineering , Baltimore, Maryland
Click
here to apply!
|
Didn't find what you're looking for? Search again!
Other Engineering JobsMac Tools Seeking Mechanics - Automotive Technicians - Full Training Description: Job title: Mac Tools Seeking Mechanics - Automotive Technicians - Full Training br br Job description: br br Build a Great Career and a Quality Life with Mac Tools. br br Feel the freedom (more...) Company: Mac Tools Location: Potomac Posted on: 03/8/2021 Service Engineer II Description: This functional role is responsible for management tasks within the Identity services function, specifically around management of servers, roles, and any associated incidents. Supplier resources for this (more...) Company: Orion Consortium Location: Reston Posted on: 03/8/2021 Cisco / Avaya Engineer Description: Vaxcom Services Inc. an Xator Corporation National Security Solutions Company is a niche provider of intelligence related support services. We are recognized experts in Intelligence Community with (more...) Company: Xator Corporation Location: Chantilly Posted on: 03/8/2021 SYGMA Fleet Technician 3 - $35/hr $5k Sign on Bonus & Quarterly Safety Bonus Description: br br br Company: br US3063 Sygma Pennsylvania, a Division of The Sygma Network, Inc br br Zip Code: br 17110 br br Minimum Level of Education: br High School or Equivalent br (more...) Company: The SYGMA Network Location: Harrisburg Posted on: 03/8/2021 DevOps Engineer Description: We are seeking a DevOps Engineer to join our team. In this role, your strong analytic skills and ability to solve challenges with technology will make an impact on our government clients' critical missions, (more...) Company: REI Systems Location: Sterling Posted on: 03/8/2021 Big Data Workflow Engineer Description: Category: Information TechnologyLocation: Chantilly, VirginiaUS Citizenship Required for this Position: YesClearance Type: PolygraphTelecommute: No -Teleworking not available for this positionShift: 1st (more...) Company: Northrop Grumman Location: Chantilly Posted on: 03/8/2021 Auto Mechanic Description: 7132 - Dulles - 45210 Towlern Pl, Sterling, Virginia, 20166 CarMax, the way your Company: Carmax Location: Sterling Posted on: 03/8/2021 DevSecOps Engineer Description: OverviewAt REI Systems, our work makes a difference in the lives of millions of people every day. Do you want the opportunity to contribute, grow and learn every day We're looking to hire individuals (more...) Company: REI Systems Location: Sterling Posted on: 03/8/2021 Plumber- Well Technician Description: Want to work for a company who has been in business for over 40 years but is still dynamic and growing quickly Do you want to be part of a company with a fun family culture where we work hard and play (more...) Company: Carroll Water Systems, Inc. Location: Chantilly Posted on: 03/8/2021 Network Security Engineer Description: We are seeking a Network Security Engineer to support our client ASM Research. This resource will be responsible for the planning, design, implementation, testing, and deployment of network systems. Determines (more...) Company: Dunhill Professional Search & Government Solutions Location: Chantilly Posted on: 03/8/2021 |