Job Description
We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.
Key Responsibilities
Perform technical assessment across Glue ETL and Lambda functions Build the Python programs across the Glue ETL and Lambda functions Build PySpark based data pipeline resources on AWS EMR Clusters & Glue ETL requiring in-depth knowledge on majority of Hadoop and NoSQL databases as well Optimize performance of Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD’s Create documentation for user adoption, deployments, runbook, and support client users forenablement or for any issues enco...