Skip to content

 

Costa Mesa, California - USD Full Time Posted: Thursday, 11 July 2019
 
 

Position: AWS Big Data Engineer
Experience: 4-6 Years
Location: Wayne, PA

An AWS Big Data Engineer builds Big Data solutions on AWS Cloud platform as per project requirements. The AWS Big Data Engineer is a technical, customer-facing role that is accountable for the development of ETL data pipelines.
Desired Experience:
1. Overall 4-6 years of experience and 2-4 years in a building ETL data pipelines on AWS
2. Well adept in AWS Cloud services including EC2, EMR, CloudWatch, AWS Glue, Redshift, S3, EBS, Glacier, etc.,
3. Must have experience working on data lakes, ingesting and transforming large datasets with EMR or other big data processing tools/frameworks on AWS like Spark/PySpark/SparkSQL
4. Expertise building ETL pipelines with structured (SQL Server, Teradata, HP Vertica) & unstructured data sources
5. Expertise in SQL queries, complex joins, partitioning and performance tuning
6. Good to have Java or Python skills
Job Description
1. Responsible for building and testing ETL data ingestion pipelines and transformations with EMR and big data tools/frameworks like Spark/PySpark/SparkSQL
2. Implement data pipelines using structured (SQL Server, Teradata, HP Vertica) and unstructured data sources
3. Proficient in writing SQL queries, complex joins, partitioning and performance tuning
4. Implement best practices for managing high volume data and efficient storage for a high-performance solution
Education:
Education in engineering, Computer Science or equivalent work experience required from a reputed school
Others:
Excellent verbal and written communications skills (mandatory)
Media domain knowledge is a plus

- provided by Dice

Costa Mesa, California, United States of America
IT
USD
Bloom Consulting Services, Inc.
Bloom Consulting Services, Inc.
JS6874_BF87418E659F5C78DBCC574E584D68FC/728438404
7/11/2019 6:00:58 PM

We strongly recommend that you should never provide your bank account details to an advertiser during the job application process. Should you receive a request of this nature please contact support giving the advertiser's name and job reference.

Other jobs like this

Beverly Hills, California
USD
Santa Monica, California
USD
Santa Monica, California
USD
Newport Beach, California
USD
Newport Beach, California
USD
See more