Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+36 more
Job description
- Design, develop, and maintain scalable ETL/ELT pipelines using Python, SQL, Pandas, and PySpark for structured and unstructured data.
- Build and manage AWS-based data pipelines using EC2 and S3, integrating sources including SQL Server, Snowflake, and FileNet.
- Develop extraction and processing workflows using Amazon Textract, PostgreSQL, pgvector, vector embeddings, and Retrieval-Augmented Generation for AI applications.
- Write and optimize complex SQL, transformation logic, and data models to support efficient processing, storage, and analytics.
- Implement data quality checks, validation rules, reconciliations, and automated monitoring for accuracy and reliability.
- Develop and maintain analytical datasets, Power BI dashboards, KPIs, and KRIs for business intelligence and operations.
- Collaborate with cross-functional teams to design scalable architectures, automate workflows, and integrate with enterprise applications.
- Apply software engineering best practices including version control, code optimization, documentation, and orchestration with Git and Apache Airflow.
Requirements
We are seeking a Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Python, SQL, ETL/ELT development, cloud data engineering, and data integration and a proven ability to design, build, and maintain scalable data pipelines and enterprise data solutions., * Bachelorβs or Masterβs in Computer Science, Engineering, Information Technology, Business Analytics, or a related field.
- 3+ years of professional experience in Data Engineering, Software Development, or related roles.
- Strong proficiency in Python, SQL, and ETL/ELT pipeline development.
- Experience with AWS services, particularly EC2 and S3.
- Hands-on experience with relational databases and cloud warehouses such as SQL Server, MySQL, PostgreSQL, and Snowflake.
- Understanding of data modeling, data warehousing, data quality, and pipeline orchestration.
- Familiarity with Generative AI technologies, including AWS Bedrock, LangChain, RAG, Model Context Protocol, and Agent-to-Agent communication.
Preferred Skills:
- Experience with Apache Spark, PySpark, Databricks, or Apache Airflow.
- Familiarity with Amazon Textract, PostgreSQL pgvector, vector databases, and semantic search.
- Experience with Power BI, DAX, Power Platform, and enterprise reporting solutions.
- Knowledge of Terraform, Git, REST APIs, and CI/CD practices.
- Exposure to AI-powered pipelines, LLM integrations, or intelligent document processing solutions.
- AWS or other cloud platform certifications.
Benefits & conditions
- Competitive compensation and benefits.
- Opportunities for growth with global clients.
- A supportive, inclusive culture that values innovation and people.
- Exposure to cutting-edge technologies and projects.
About the company
BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦