PySpark Developer
Tata Consultancy Services
Job overview
- Location
- Bengaluru, Karnataka, India
- Experience
- 3 - 8 Years
- Job type
- Full-time
- Work mode
- On-site
- Salary
- Not disclosed
- Education
- BACHELOR OF ENGINEERING
- Category
- IT & Technology
- Posted
- Valid through
At a glance by CareerCola
- Company
- Tata Consultancy Services
- Role
- PySpark Developer
- Location
- Bengaluru, Karnataka, India
- Employment type
- Full-time
- Work mode
- On-site
- Category
- IT & Technology
- Posted
- 3 Sep 2026
- Valid through
- 30 Nov 2026
- Experience
- 3 - 8 Years
About the role
PySpark Developer Experience: 3-7 Years
Location: PAN India
Key Skills
- Strong experience in PySpark, Apache Spark, Python, and SQL.
- Expertise in building and optimizing ETL/Data Processing Pipelines.
- Good understanding of Spark Architecture (RDDs, DataFrames, Spark SQL, DAGs).
- Experience with Hadoop Ecosystem (Hive, HDFS) and large-scale data processing.
- Exposure to AWS/Azure/GCP, object storage, and cloud-based data solutions.
- Knowledge of Data Modeling, Data Engineering, and Pipeline Design.
- Hands-on experience with Git and Linux/Unix environments.
- Strong debugging, performance tuning, and problem-solving skills.
Responsibilities
- Design, develop, and maintain scalable PySpark-based data pipelines.
- Build ETL workflows for ingesting, transforming, and loading large datasets.
- Optimize Spark jobs for performance, scalability, and reliability.
- Process data from multiple sources, including databases, APIs, HDFS, and cloud storage.
- Ensure data quality, validation, and governance standards.
- Troubleshoot and tune Spark applications for maximum efficiency.
- Collaborate with data engineers, analysts, and data scientists to deliver business solutions.
- Support production deployments and ongoing application maintenance.
- Follow security and best practices for enterprise data engineering.
Good to Have
- Spark Streaming / Structured Streaming
- Kafka or other messaging platforms
- Databricks, Airflow, or Azure Data Factory
- Data Warehousing concepts
- Agile/Scrum experience
Preferred: Candidates with strong hands-on PySpark development experience, cloud exposure, and expertise in building high-performance big data solutions.
Requirements
BACHELOR OF ENGINEERING
Skills: Linux | Python | Unix
Skills
- Linux
- Unix
- Python
- PySpark
Related jobs
SAP RE-FX
Capgemini
Salary Not disclosed
Locations: Pune, Bangalore, Bengaluru, Mumbai, India. Choosing Capgemini means choosing a company where you will be empowered to shape your career in the...
- SAP RE-FX
- SAP FI
- SAP FI-AA
- Lease Management
SAP ABAP EWM Consultant
Capgemini
Salary Not disclosed
Locations: Bangalore, Bengaluru, Mumbai, Pune, India. Choosing Capgemini means choosing a company where you will be empowered to shape your career in the...
- SAP ABAP
- SAP EWM
- S/4HANA
- OO ABAP
Vertex AI
Capgemini
Salary Not disclosed
Locations: Navi Mumbai, Mumbai, Hyderabad, Chennai, Pune, Bangalore, Bengaluru, India. Choosing Capgemini means choosing a company where you will be...
- Python
- Machine Learning
- Google Cloud Platform
- Vertex AI
Salary Not disclosed
Description Does the thought of improving one of the world’s most complex logistic systems inspire you? Is your passion to sift through hundreds of systems...
Salary Not disclosed
Minimum qualifications Bachelor's degree in Computer Science, Information Systems, a related technical field, or equivalent practical experience. 5 years of...
Salary Not disclosed
NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team. Apache Spark is the most popular data processing engine in...