Python PySpark Developer - Willington, DE
Georgia Tek Systems
Wilmington, DE, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Amazon Web Services
Data Analysis
Microsoft Azure
Big Data
Data Files
Data Systems
Relational Databases
Database Queries
Apache Hadoop
Hadoop Distributed File System
Apache Hive
+11 more
Python (Programming Language)
Software Engineering
Data Processing
Scripting
Google Cloud
Apache Spark
Pyspark
Information Technology
Apache Kafka
Data Management
Data Pipelines
Job description
- Develop, implement, and optimize large-scale data processing pipelines using Python and PySpark.
- Collaborate with data scientists, data engineers, and other stakeholders to design and enhance data solutions.
- Perform data analysis and develop algorithms to process and analyze large datasets efficiently.
- Maintain and improve existing PySpark codebase, ensuring high performance and scalability.
- Integrate data from various sources, ensuring data quality and consistency.
- Write and maintain comprehensive documentation for data processing workflows and algorithms.
- Troubleshoot and resolve issues related to data processing and workflow automation.
- Stay updated with the latest industry trends and technologies to continuously improve our data processing capabilities.
Requirements
Python Programming/Scripting Language, Software Engineering, Python Programming/Scripting Language, Software Engineering, Data Processing, Data Management, Data Science, Data Analysis, Analysis Skills, Data Sets, * Bachelorβs or Masterβs degree in Computer Science, Information Technology, or related field.
- Proven experience as a Python developer, with a strong focus on PySpark.
- In-depth knowledge of Spark architecture and the Hadoop ecosystem.
- Experience with big data technologies such as Hive, HDFS, and Kafka is a plus.
- Strong SQL skills and experience with relational databases.
- Proficient in writing efficient, scalable, and maintainable code.
- Experience with cloud platforms (AWS, Azure, GCP) is highly desirable.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork abilities.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦