- This role will be responsible for design and development of complex data pipelines on AWS using AWS big
data stack. This individual will work with external data providers to source data, build data pipelines and
transform the data for consumption by business analysts. - Must have 3+ years of hands-on experience on AWS big data tech stack and 5+ years of years of experience
in data wrangling, data munging and ETL. Should be able to source data from anywhere and transform data
to any shape using SQL or Spark with minimal direction. - In-depth knowledge of the following technologies – SQL (expert level), Python (intermediate level), Spark
(intermediate level), Visualization (beginner level) - Familiarity with concepts such as data lineage, data validation, CI/CD pipelines, DataOps, ML Ops, etc.
- Strong understanding of Agile.
- Ability to communicate with technical as well as non-technical audience
- Ability to work in a fast-paced environment with a ‘can-do’ attitude
Job Type: Full Time
Job Location: Remote / NYC Area Preferred
