Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

VUw1YUd6c0hVVkk2d2ZXNUxrMHljRXJ5a0E9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Everlight Solar

Personal Assistant Job at Everlight Solar

 ...Everlight Solar is seeking a Personal Assistant to perform a variety of administrative tasks including data entry, assisting in the planning and execution of company-wide events, and personal errand-based tasks. This is a In-person, full-time, entry level position. Travel... 

Jimmy John's

Delivery Driver/Inshop Job at Jimmy John's

 ...This is for MICHIGAN CITY, IN. Starting rate for Delivery Driver is $12/hr while at the store, and $9/hr on the road. With tips and...  ...These hours may vary from time to time.) Must be available weekends. Will be cross-training as in-store employee as well which... 

The Eye Group

Optometrist Job - Fort Myers - Join Ophthalmology Practice#5723 Job at The Eye Group

Join a well-established private, family oriented ophthalmology practice. Monday through Thursday with a half day on Friday. Utilize state of the art technology to perform exams. Fort Myers, Florida a great place to vacation, it is also a wonderful place to live. With a... 

Placements USA LLC

Emergency Medicine Physician Job at Placements USA LLC

 ...Emergency Medicine Physician Permanent / full time / employed Altoona, PA We have an exciting opportunity available for aBC/BE Emergency...  ...insurance ** $50K sign on bonus ** Relocation assistance is available ** Loan repayment assistance if needed *... 

Gotham Enterprises Ltd

Pediatric Nurse Practitioner (PNP) Job at Gotham Enterprises Ltd

 ...Now Hiring: Pediatric Nurse Practitioner (PNP) Location: Valley Stream, New York Employment Type: Full-Time Salary: $120,000 to $150,000 per year + benefits Position Overview : The Pediatric Nurse Practitioner will provide comprehensive healthcare services...