> Markdown version of [/jobs/ext/1975136-data-engineer](https://www.wearedevelopers.com/jobs/ext/1975136-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Inspyr Solutions - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $187,200.0 - $208,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Amazon S3, Data Analysis, Application Performance Management, Confluence, Big Data, Code Coverage, Continuous Integration, Extract Transform Load (ETL), Data Warehousing, Software Design Documents, DevOps, Fault Tolerance, Apache Hive, JSON, Systems Development Life Cycle, Cloud Services, Software Engineering, Parquet, Real Time Systems, Git, Data Lakes, Ansi Sql, Pyspark, Information Technology, Low Latency, Apache Kafka, Spark Streaming, Machine Learning Operations, Stream Processing, Software Version Control, Service Stack, Databricks - **Published:** August 7, 2026 - **Apply:** https://www.dice.com/job-detail/30106172-3459-408f-ac3c-9411dd480967 ## About the Role * Bachelor''s degree in Computer Science or related technical field. (NOT REQUIRED TO HAVE A DEGREE) * Experience building Data Lakes, Data Warehouse using big data and cloud stack. * 5+ years of experience on software development using Agile, dev ops that include designing, developing, and implementing large-scale data engineering solutions. * Expert Level Proficiency in Spark streaming and spark concepts. * Expert level proficiency in Python Programming language and PySpark with at least 4 years of experience. * Experience working with Kafka streams and creating ingestion ETL''s. * Expert level proficiency in ANSI SQL /Spark SQL with at least 5 year''s experience. * Experience working with diverse data sources and data formats ( json, parquet, csv, psv, delta) * Experience working with cloud services such as AWS along with cloud-based data sources(S3) * Experience building ETL with batch and real time stream processing. * Experience using version control system such as git and CI/CD Nice to know / good to have * Experience with building workflows and ETL''s in the databricks. * Experience ingesting data produced by real time systems like Kafka * Guiding and mentoring skills - guiding and mentoring junior members - helping them understand technologies, the project, best practices and in general setting them up for success. * Experience building and deploying ML models using ML Flow. YOU (BEHAVIOURAL SKILLS/COMPETENCIES) * Strong verbal communication, ability to clearly communicate ideas, work status, advocate for (or against) a particular approach or design. * Documentation skills - ability to make the path easier for new team members / new hires / interns by organizing knowledge in Confluence, wiki, or similar. * Ability to manage self and own time, deliver work on time, evaluate and estimate work. * Ability to work with various teams, including tech and product, incorporate their inputs into the work being done, and manage expectations on issues & enhancements. ## Description Our Client is looking for an experienced, motivated, and self-driven candidate who can contribute towards various aspects of taking the Live Analytics offering to the next level and build new data products for our clients. This involves design, development, and production support of the systems as well as working with product teams and engineering teams in shaping the future of the application., * Write new ETLs to support both real time and new features data and reporting products. * Work with product teams to gather and understand requirements, discuss approaches, design solutions based on the requirements and create design documents for implementation keeping in mind costs, capacity, shelf-life and choosing the right tools and technologies. * Design and develop peripheral systems and processes - monitoring and alerting services, ETL processes, automated offline workflows, automated build and deployment pipelines, systems for gathering application performance metrics, ensuring efficiency in cost. * Ensure best practices in system development ranging from test coverage, use of enterprise standards, adherence to target architecture, high-availability and scalability, low latency, and fault-tolerance, thus ensuring delivery of high-quality systems. * Create detailed documentation on systems as well as processes ranging from comprehensive overview of systems, runbooks for developing, monitoring and troubleshooting system issues and recommendations on future improvements. * Managing project delivery from a day-to-day standpoint - participating in daily agile stand-ups, escalating blockers to stakeholders, ensuring timely completion of tasks & overall project & spring goals. Communicating updates to stakeholders and working with them on timelines. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)