> Markdown version of [/jobs/ext/2184158-senior-software-engineer-data-engineering](https://www.wearedevelopers.com/jobs/ext/2184158-senior-software-engineer-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer- Data Engineering - **Company:** Noctua Technology, Inc. - **Location:** San Diego, CA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Java (Programming Language), Airflow, Amazon Web Services, Data Analysis, Microsoft Azure, C++ (Programming Language), Cloud Computing, Computer Programming, Databases, Data Architecture, Information Engineering, Data Integrity, Extract Transform Load (ETL), Data Migration, Data Systems, Data Visualization, Data Warehousing, Relational Databases, Decision Support Systems, Apache Hadoop, Python (Programming Language), PostgreSQL, Machine Learning, MySQL, NoSQL, Power BI, Software Engineering, SQL Databases, Tableau (Software), Data Processing, Google Cloud, Data Storage Technologies, Apache Spark, Indexer, Jupyter, Data Strategy, Git, Pandas, Build Management, Containerization, Kubernetes, Information Technology, Data Analytics, Qlikview, Apache Kafka, Dynamic Data, Looker Analytics, Software Version Control, Data Pipelines, Docker - **Published:** August 22, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9103381/senior-software-engineer-data-engineering ## About the Role We are seeking a talented and motivated Senior Data Engineer to join our dynamic Data Engineering team. As a key member of our engineering team, you will play a crucial role in constructing and optimizing data pipelines, implementing efficient storage solutions, and orchestrating the infrastructure necessary to support our customer's data-driven initiatives. In addition, as a Senior Engineer you will be expected to lead engineering engagements by collaborating with cross-functional teams including customers, partners, and internal engineers. Location: Primarily Remote. Candidates must be based in CA or DC Metro Area for proximity to project and client teams. Security Clearance Requirement: Applicants must be US citizens and eligible to obtain and maintain an active Secret security clearance or above., Expert-level understanding and experience with SQL and relational database concepts Deep understanding of database technologies, data warehouses, and ETL tools (e.g., MySQL, PostgreSQL, Beam, Airflow, and Kafka). Proven track record of designing and implementing scalable data pipelines. Advanced experience with data analysis tools (eg., Jupyter, Colab, Pandas) Extensive experience with data visualization tools (eg., Tableau, Looker, PowerBI, Qlik, and SuperSet) Demonstrated experience developing comprehensive data strategies and facilitating data migrations into production systems. Expertise with cloud platforms (e.g., AWS, Azure, GCP). Proficiency in programming languages such as Python, Java, or C++. Strong software engineering skills with an emphasis on writing clean, modular, and maintainable code. Experience with version control systems (e.g., Git) and collaborative development workflows. Exceptional problem-solving and critical-thinking skills. Effective communication skills and ability to work in a collaborative team environment., Bachelor's or advanced degree in Computer Science, Data Science, Machine Learning, or a related field. Experience with other database technologies (eg., NoSQL, Graph) Any of the below cloud certifications: Google Cloud Professional Cloud Architect Google Cloud Professional Database Engineer certification Google Cloud Professional Data Engineer Experience with additional data processing tools and technologies (e.g., Spark, Hadoop). Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes). ## Description Data Collection and Processing Acquire, clean, and preprocess diverse datasets from various sources, establishing best practices and ensuring data quality standards. Design and build required infrastructure for optimal extraction, transformation and loading of data from various data sources using CSP managed services and SQL technologies, focusing on scalability and cost efficiency. Develop, maintain, and optimize mission-critical data pipelines to ensure a continuous flow of high-quality data, implementing robust monitoring and alerting. Data Migrations & Optimization Architect and develop data migration strategies and schemas to lead complex customer migrations from on-prem to cloud technologies Oversee and execute high-volume data migration activities, ensuring data integrity and minimal downtime. Optimize databases and data warehouses for efficient querying and data storage, implementing advanced partitioning, indexing, and tuning techniques. Data Analysis and Visualization Perform exploratory data analysis to uncover patterns, trends, and insights, providing actionable recommendations to technical and business stakeholders. Create visualizations and reports to communicate findings effectively to stakeholders both internally and externally, driving data-driven decision making. Collaboration and Documentation Collaborate with cross-functional teams, including software engineers, domain experts, and business analysts, to understand requirements and deliver integrated solutions, end-to-end data solutions. Create and maintain comprehensive documentation for data architectures, code, algorithms, and models. Ensure that the knowledge is shared and accessible within the team. Customer Engagement Act on client feedback constructively to improve services and outcome, serving as a key technical contact for data-related discussions. Continuously seek ways to enhance the overall customer experience, proactively identifying and addressing complex data challenges. Continuous Learning and Innovation Stay updated on the latest developments in cloud data services, machine learning, data science, and analytics. Drive innovation by evaluating, proposing, and implementing cutting-edge techniques and technologies to address client challenges. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Branch your database like your code: How schema changes and pull requests go hand in hand](https://www.wearedevelopers.com/videos/350-branch-your-database-like-your-code-how-schema-changes-and-pull-requests-go-hand-in-hand) - [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)