Lead Data Engineer

Appian
McLean, VA, United States
1 day ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$150,000 - $275,000
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Cloud Database Software Quality Continuous Integration Information Engineering Data Infrastructure Data Integrity Data Systems Data Warehousing
+14 more
Cursor Database Design DevOps Cryptographic Protocols Graph Database Systems Analysis Software Deployment Data Streaming Sql Optimization Appian Gitlab Information Technology Claude Data Pipelines

Job description

  • Lead the design and implementation of data infrastructure and architecture to support highly efficient enterprise data processing and data warehousing initiatives.
  • Develop and maintain advanced data pipelines using Python and SQL for the automated collection, transformation, and scalable storage of diverse corporate data sets.
  • Collaborate cross-functionally with data scientists and analysts to deeply understand data requirements and provide sustainable engineering solutions.
  • Optimize data systems for performance and scalability, eliminating processing bottlenecks and ensuring continuous operational efficiency.
  • Implement robust security measures and encryption protocols to comprehensively protect internal data integrity, governance, and user privacy.
  • Mentor and guide engineering team members, establishing best practices and driving technical excellence across the data systems infrastructure.
  • Architect and manage robust DevOps workflows, utilizing automated CI/CD pipelines and platforms like GitLab to streamline code deployments and ensure environment stability.
  • Champion strong operating rigor by driving incident response, running comprehensive postmortems, and implementing durable preventative actions to maintain a seamless, high-throughput data flow.

Requirements

  • Education: Minimum of a Bachelor of Science or Bachelor of Arts in Computer Science, Data Engineering, Information Technology, or a related technical discipline.
  • Experience: 8+ years of progressive, demonstrated technical experience specializing in enterprise data engineering, database design, or cloud data warehousing infrastructure.
  • Technical Mastery: Proven expertise in advanced SQL, executing complex data infrastructure layout, developing automated data pipelines (e.g., Informatica, Airflow, dbt), and conducting deep system analysis to optimize performance.
  • Next-Gen Engineering: Demonstrated expertise in AI-driven development or agentic development, utilizing tools such as Kiro, Claude, or Cursor to accelerate engineering velocity and code quality.
  • Infrastructure & Deployment: Strong background in DevOps principles and configuring CI/CD frameworks like GitLab.
  • Problem Solving: Deep background in technical troubleshooting, managing data schema validation, and translating architectural concepts for stakeholders.

PREFERRED QUALIFICATIONS

  • Advanced technical certifications in cloud platforms (e.g., AWS, Azure, or GCP) or modern enterprise data warehouse suites.
  • Working knowledge of Knowledge Graphs and advanced semantic data modeling architectures.
  • We value experience with enterprise platforms, since it translates well into our Enterprise-Grade Orchestration environment.

Benefits & conditions

The base salary range represents a good faith and reasonable estimate of the range at the time of posting. Actual compensation will be dependent on a number of factors including, but not limited to, the candidate’s relevant work experience, qualifications, internal peer equity, and market and business conditions that exist when extending an offer. A discretionary bonus may be awarded in recognition of individual and company performance.

In addition, Appian provides generous benefits offerings that include a 401(k) plan with company match, flexible time off, paid parental leave, medical, dental, and vision plans, life insurance, disability insurance, wellness programs, flexible spending accounts, health savings account contributions, an employee referral bonus program, and learning and development resources. Certain positions may be eligible for equity awards.

Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation, commission, bonus, or benefit plans. Base Salary Range $150,000-$275,000 USD

Tools and Resources

  • Training and Development: During onboarding, we focus on equipping new hires with the skills and knowledge for success through department-specific training. Continuous learning is a central focus at Appian, with dedicated mentorship and the First-Friend program being widely utilized resources for new hires.
  • Growth Opportunities: Appian provides a diverse array of growth and development opportunities, including our leadership program tailored for new and aspiring managers, a comprehensive library of specialized department training through Appian University, skills based training, and tuition reimbursement for those aiming to advance their education. This commitment ensures that employees have access to a holistic range of development opportunities.
  • Community: We’ll immerse you into our community rooted in respect starting on day one. Appian fosters inclusivity through our 8 employee-led affinity groups. These groups help employees build stronger internal and external networks by planning social, educational, and outreach activities to connect with Appianites and larger initiatives throughout the company., Appian offers a comprehensive benefits package designed to support your health, wellbeing, and financial future. Benefits may include health coverage, Employee Assistance Program (EAP) with free mental health support, life and disability insurance, an Employee Stock Purchase Program (ESPP), a retirement/pension plan, wellness dollars, tuition reimbursement, family-forming benefits and more. Benefits vary by country-please ask your Talent Acquisition contact for details specific to the location you are applying to.

About the company

This role is a premier position designed for an engineering expert who thrives at the intersection of data architecture and technical execution. At Appian, you will have the autonomy to direct end-to-end data systems infrastructure, implement automated pipeline solutions, integrate cutting-edge cloud technologies, and mentor engineers, all while working face-to-face in a culture that champions collaboration and rapid technical innovation. This role reports to our Manager, Data Analytics.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Loading talks and stories from around this role…