Sr. Data Engineer

The Information Technology Group of the National Association of Insurance Commissioners (NAIC) has an exciting opportunity for a Senior Data Engineer. This position provides senior-level technical expertise across data architecture, data modeling, pipeline development, data integration, data quality, and platform optimization. Partners closely with data architects, data engineers, data stewards, business owners, project managers, and other stakeholders across the Enterprise Data Team, Information Technology Group (ITG), and business units to translate complex business and technical requirements into effective data solutions., * Design, develop, and maintain scalable enterprise data solutions, including data architecture, models, pipelines, structures, and supporting processes within the Enterprise Data Platform (EDP).

• Analyze complex data sources and business requirements in partnership with stakeholders to deliver secure, reliable, and efficient data solutions.
• Develop, optimize, and support data pipelines that ingest, transform, integrate, and deliver trusted data aligned with business needs.
• Implement data quality, governance, and operational processes to ensure enterprise data assets are accurate, consistent, secure, and well-managed.
• Provide technical guidance, troubleshooting, and escalation support for teams using or impacting data within the EDP, including root cause analysis and sustainable issue resolution.
• Review and modernize data models, pipelines, and legacy processes to improve scalability, reliability, automation, maintainability, and alignment with enterprise architecture standards.
• Contribute to continuous improvement and platform strategy by evaluating emerging technologies, enhancing engineering practices, and identifying opportunities to expand enterprise data capabilities., This position does not require overnight business travel. Employees are responsible for their personal transportation to/from the home and office, including events, meetings, and training required by the NAIC.

• Bachelor’s degree in computer science, data analytics, data science, mathematics, statistics, information Systems, or another related analytical or technical field and 5 or more years of related data engineering experience; or an equivalent combination of education and work experience.
• Experience designing, developing, and supporting enterprise data platforms, including data ingestion, transformation, modeling, integration, quality, and operational support.
• Advanced experience with SQL, relational databases, ETL/ELT development, data modeling, and cloud-based data technologies.
• Experience leading complex technical efforts, making data architecture or design recommendations, and mentoring other technical team members.
• Experience with the software development life cycle, Agile delivery practices, and SAFe values and methods.

Preferred Experience:

• Experience with financial, insurance, regulatory, or market data.

Systems & Technology Requirements

• Microsoft Office Suite/365
• Amazon Web Services (AWS)
• Data pipeline orchestration and automation
• Extract, Transform and Load (ETL/ELT)
• CI/CD and DevOps practices
• Git or source control platforms
• Infrastructure as Code concepts, such as Terraform
• RDBMS (Oracle, PostgreSQL)
• NoSQL (MongoDB / DynamoDB)
• Snowflake
• Python
• Structured Query Language (SQL)
• MacOS
• Data File Formats (JSON, Parquet, XML (likely XBRL in near future))
• Data modeling and dimensional modeling
• Data warehouse and data Lakehouse concepts
• Secrets management concepts, such as Vault or similar tools
• Cloud security and IAM concepts
• Data governance, lineage, metadata, and cataloging concepts
• Performance tuning and query optimization
• Data quality testing and data observability, Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

$107,000 - $123,000, commensurate with education and experience.

The Senior Data Engineer is expected to lead complex data engineering efforts, establish and promote engineering standards, mentor other team members, and contribute to continuous improvement across the EDP. Through strong technical judgment and cross-functional collaboration, this role helps ensure enterprise data is accessible, trusted, secure, performant, and effectively leveraged to support NAIC’s strategic objectives. This is a full-time remote position, in a positive and flexible environment. Residency within 100 miles of the Kansas City, Missouri office is required.