MontgomeryRecruiter Since 2001
the smart solution for Montgomery jobs

Bigdata Developer

Company: e IT Professionals Corp.
Location: Montgomery
Posted on: November 20, 2020

Job Description:

Job Description 8 years of development experience in object oriented applications with 2-4 years of experience in scala. In depth understandingknowledge of Hadoop spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params. Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must Hands on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions. Experience in code optimize to fine tune the applications. Expertise in writing Hadoopspark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently. Integration with HadoopHDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes. Strong database, SQL, ETL and data analysis skills. Knowledge in Maintaining the Log and Audit information in HiveSQL tables, Experienced in providing Logging, Error Handling Analyzed large amounts of data sets to determine optimal way to aggregate and report on it. Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala. Experienced Scheduling jobs using AirflowESP. Experienced in developing scripts for doing transformations using Scala. Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS. Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability. To be able to understand existing business logic implement the business changes Working with business and peers to define, estimate, and deliver functionality. Should have gone through entire development life cycle including system integration testing Provide Production Support for any issues raised by the Business and experience on ProductionIntegration release management Experience with GIT, Jenkins, test frameworks. Agile skills Experienced in Agile development methodology. Create the required technical tasks in backlog and update status regularly. Participate in all Agile ceremony meetings and update task status and adher to timelines and quality standards for the task. TECHNICAL SKILLS HadoopBig Data HDFS Scala Spark Hive Python Kafka Zookeeper Shell Scripting Java experience is a plus GIT Version control tool knowledge, Jenkins and Scheduling tools Airflow ESP Soft skills Right communication skills to be able to work with Business. Good logical reasoning, analytical abilities. Recommend changes to client software based on information such as client feedback, language changes and new technology. Experience working with remote teams. Work to become the trusted partner of the Architects by regular engagement and proposals on best development practices which can be implemented and would bring change to the process Excellent Performance and Technical Skills, Attend required training and support peers by sharing knowledge and mentoring. Taking up training programs within your team to ensure understanding of BDF.

Keywords: e IT Professionals Corp., Montgomery , Bigdata Developer, Other , Montgomery, Alabama

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Other Jobs


Remote Experienced Tax Preparer - Seasonal
Description: Overview If you're a highly motivated individual with a business background and
Company: Intuit
Location: Dothan
Posted on: 11/28/2020

Delivery Driver / Courier
Description: Your time. Your Goals. What is DoorDash Available in over 4,000 cities in the U.S., Canada, and Australia, DoorDash is about connecting people with possibilities: bigger savings accounts, wider nets, (more...)
Company: Doordash
Location: Dothan
Posted on: 11/28/2020

Hair Stylist (License Required) - Eagle Crossing
Description: StylistAt Great Clips, we know that stylists like you are most happy when they're cutting hair, so at a Great Clips salon, that's exactly what you get to do Want to be the best stylist
Company: Great Clips
Location: Auburn
Posted on: 11/28/2020


CDL-A OTR Truck Driver
Description: Suit The Company that makes everyone feel like a somebody Make your decision to join Suit based
Company: Suit, LLC
Location: Dothan
Posted on: 11/28/2020

Remote Experienced Tax Preparer - Seasonal
Description: Overview If you''re a highly motivated individual with a business background and
Company: Intuit
Location: Dothan
Posted on: 11/28/2020

Permanent General Practice Physician in Auburn, Alabama
Description: General Practice physician employment in Alabama : Auburn, AL needs
Company: Enterprise Medical Recruiting
Location: Auburn
Posted on: 11/28/2020

CDL-A Experienced OTR Truck Drivers
Description: Job Description: VARIANT OFFERS INDUSTRY LEADING PAY AND MANY MORE
Company: Variant
Location: Auburn
Posted on: 11/28/2020

CDL-A OTR Driving Jobs - 2 Yrs. OTR EXP Req'd - Avg. $75k/Year
Description: What We Offer: Most drivers average 75,000 per Year 6,000 sign-on bonus for qualified drivers Generous home time Home when you want, for as long as you need 100 no-touch freight 95 drop (more...)
Company: Tri-National Inc
Location: Auburn
Posted on: 11/28/2020

Permanent Rheumatology Physician in Auburn, Alabama
Description: Rheumatology physician employment in Alabama : Private Practice Rheumatology Opportunity in Alabama A Private Practice Rheumatologist is looking for an additional Rheumatology Physician to join them. (more...)
Company: Curative
Location: Auburn
Posted on: 11/28/2020

Company Truck Driver CDL A
Description: Job Description CDL-A Drivers: Earn 1,500/Week and be Home Weekends CDL-A
Company: Brown Trucking
Location: Auburn
Posted on: 11/28/2020

Log In or Create An Account

Get the latest Alabama jobs by following @recnetAL on Twitter!

Montgomery RSS job feeds