Data Engineer
- Remote, United States
Remote
₹800,000 to ₹1,400,000 INR / year
Applications open in a new tab.
Job details
- Pay
- ₹800,000 to ₹1,400,000 INR / year
- Workplace
- Remote
- Posting language
- English
Original job description
Job Title: Data Engineer (PySpark / Scala / Python) Location: Remote
Job Description:
We are hiring a Data Engineer with strong hands-on experience in PySpark, Scala, and Python. You must have solid expertise in Apache Spark, as it will be the core technology used for building and managing large-scale data processing pipelines. Experience with cloud platforms like Google Cloud Platform (GCP), Microsoft Azure, or AWS is a plus.
Required Skills:
- Strong hands-on experience with Apache Spark
- Proficient in PySpark
- Experience in Scala and Python
- Knowledge of ETL processes and data pipeline design
- Understanding of distributed data processing
- Familiarity with version control tools like Git
- Basic knowledge of cloud platforms (GCP, AWS, or Azure)
Nice to Have:
- Experience with cloud-native data tools (e.g., Dataproc, Glue, EMR, BigQuery)
- Familiarity with workflow/orchestration tools like Airflow or Cloud Composer
- Experience with CI/CD for data engineering
- Exposure to both structured and unstructured data
More about this job
Skills
- PySpark
- Scala
- Python
- Apache Spark
- Process data
- Google Cloud
- Microsoft Azure
- AWS
- Data engineering
- Git
- EMR
- BigQuery
- Workflow
- Apache Airflow
- CI/CD
- Unstructured data