Data Engineer - McLean, VA Onsite
Kanak Elite Services Inc
McLean, VA, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Big Data
Data Infrastructure
Extract Transform Load (ETL)
Data Systems
Data Warehousing
Amazon DynamoDB
Python (Programming Language)
Node.Js
Amazon Simple Notification Service (SNS)
Data Storage Technologies
+7 more
Apache Spark
Vue.js
Pyspark
Integration Frameworks
Data Pipelines
Serverless Computing
Databricks
Job description
- Design, develop, and maintain scalable data pipelines and architectures using Python, PySpark, and AWS services.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions.
- Optimize data workflows for performance and reliability.
- Implement and manage data storage solutions utilizing DynamoDB, S3, and other AWS services.
- Develop and deploy serverless applications using Lambda and Glue.
- Work with Spark-based data processing frameworks such as Databricks.
- Maintain and improve existing data infrastructure, ensuring security, compliance, and best practices.
- Sit onsite in McLean, VA, to coordinate with onsite teams.
Requirements
- Proven experience with Python, PySpark, Node.js, and Vue.js.
- Extensive experience with AWS services, including EMR, Glue, Lambda, S3, SNS, DynamoDB.
- Strong understanding of data warehousing, ETL/ELT processes, and big data technologies.
- Excellent problem-solving skills and ability to work independently.
- Good communication and team collaboration skills.
Nice to Have:
- Knowledge of financial data domain and regulatory compliance.
- Experience with Databricks platform.
- Prior on-site work experience in McLean.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦