Job overview
- Location
- Indore, Madhya Pradesh, India
- Job type
- Full-time
- Work mode
- On-site
- Salary
- Not disclosed
- Category
- IT & Technology
- Posted
- Valid through
At a glance by CareerCola
- Company
- ThoughtWin
- Role
- Data Engineer
- Location
- Indore, Madhya Pradesh, India
- Employment type
- Full-time
- Work mode
- On-site
- Category
- IT & Technology
- Posted
- 15 Oct 2026
- Valid through
- 14 Nov 2026
About the role
Data Engineer
1-4 YRS Indore Full-Time We are looking for a Data Engineer with 1-4 yrs years of experience to design, build, and maintain scalable data pipelines and data platforms across cloud and big data ecosystems. The candidate should have hands-on experience with Hadoop, Spark/PySpark, Snowflake, data modeling, and workflow orchestration tools.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT data pipelines.Work with large-scale distributed systems like Hadoop and Spark.Develop data pipelines using PySpark and Spark SQL.Build and optimize data warehouses in Snowflake.Perform data modeling (Star Schema, Snowflake Schema, SCD Types).Implement workflow orchestration using tools like Airflow.Work with cloud platforms such as AWS / Azure / GCP.Optimize data pipelines for performance and cost.Ensure data quality, data validation, and monitoring.
- Work with structured and semi-structured data (JSON, Parquet, Avro, CSV).
- Collaborate with Data Analysts, Data Scientists, and Business Teams.
Required Technical SkillsBig Data & Hadoop Ecosystem
- Hadoop (HDFS, YARN, MapReduce)
- Apache Spark
- PySpark
- Hive
- HBase (optional)
- Kafka (basic knowledge)
- AWS: S3, Glue, EMR, Redshift, Lambda, Athena
- Azure: ADLS, Azure Data Factory, Synapse, Databricks
- GCP: GCS, BigQuery, Dataproc, Dataflow, Composer
- Snowflake
- Redshift / BigQuery / Synapse (nice to have)
- Star Schema
- Snowflake Schema
- Slowly Changing Dimensions (SCD Type 1, 2, 3)
- Fact & Dimension tables
- Apache Airflow
- Azure Data Factory / AWS Step Functions / Prefect / Luigi
- Python
- PySpark
- SQL (Advanced SQL required)
- Shell Scripting (basic)
- Parquet
- Avro
- ORC
- JSON
- CSV
- Git
- CI/CD pipelines (GitHub Actions / Jenkins / Azure DevOps)
Preferred Skills
- Databricks
- Delta Lake
- Iceberg
- Data Lake Architecture
- Data Governance & Security
- Docker
- Kubernetes (basic)
Share with someone awesome View all job openings