Position: Data Engineer
Location: Atlanta,GA
Duration: Long term
Skills:
Experience in data engineering, Pyspark
Hands-on experience with following Google Cloud Platform tools: BigQuery, Dataproc, Cloud Composer/Airflow, Cloud Storage
Develop and optimise ETL/ELT pipelines using Dataproc, Cloud Composer, BigQuery
Optimise complex SQL queries and data processing workflows
Strong experience with DevOps processes
Independently collaborate with cross-functional teams to understand data requirements
technical design discussions and architecture reviews
Preferred: Experience building pipelines using Cloud pub-sub and cloud functions