Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
Update and maintain the information residing on the Private Sector Portal (PSP) tool, using automation when appropriate. Assist in the relationship management team in identifying and documenting technical requirements around the PSP system Develop guidance around appropriate use of the PSP system and ensure consistent data standards across the enterprise. Provide expertise and customer service to HQ/field users Maintain the PSP system, to include auditing content for missing or inappropriate metadata, reporting technical user problems to the contractor. Ensure the scheduling, processing, and documentation of data delivery and implementation, using automation when appropriate. Design, implement, automate, and maintain Enterprise level of scalable Extract, Transform and Load (ETL) data pipelines and data analysis pipelines. Build and maintain robust data processing, enriching, and analysis pipelines that aggregate and normalize large datasets across diverse sources, including sources from web services. data from disparate sources. Automate and optimize database and data workflows for best performance and efficiency. Identify and propose emerging technologies, automation or alternative solutions to efficiently improve support for developers and application stakeholders. Develop and maintain documentation, inline comments, confluence and stand-alone documents, wherever necessary for the readability of the software design and code. Ability to focus on producing results efficiently. Ability to work independently and coordinate with team members.
Requirements
Active Top Secret clearance Bachelorās degree in a quantitative field (i.e. Statistics or Operations Research) or technical field (i.e. Computer Science or Engineering). Four (4) years of Exceptional proficiency in writing and editing skills using MS Office. Minimum of 2-4 years of work experience in data analytics or data engineering role. Minimum 10 years of relevant experience., Experience with designing, implementing and maintaining big data processing, normalizing, and enriching pipelines in languages such as Python, PySpark, or Spark. Experience with architecting, designing and building modern medallion ETL processes for data lake, data warehouse or lakehouse. Experience with building and Knowledge of automating data pipeline and workflow on Apache Niagra Files (NiFi) or Databricks for ease of maintenance. Experience with implementing automated data Cl/CD pipelines with Continuous Integration/Continuous Delivery (CI/CD). Experience with data frame processing with filtering conditions. Experience with organizing data version history to optimize processing and retrieval performance. Experience with data indexing for robust searching and querying. Strong verbal and written communication skills to effectively collaborate and integrate with enterprise partners and customers. Excellent at troubleshooting, debugging and researching. Ability to focus and a desire to learn. Knowledge of PostgreSQL is preferred.
Benefits & conditions
āPutting People First, Achieving our Mission Togetherā. E-INFOSOL is a people-first organization focusing on a positive employee culture that inspires creativity and innovation in support of our customers. With opportunities such as reimbursement and bonuses based on completion of certifications, we invest in our employeesā career growth.
Full Time Benefits
Medical - 100% company paid for employees with dependent options Dental and Vision Retirement Savings (401k) up to 4% match Health Savings Account (HSA), FSA and DCFSA Company-paid Short/Long-term disability (w/ additional supplemental options) Company-paid Life and AD&D (w/ additional supplemental options) Generous Paid Time Off and ALL 11 Federal Holidays Legal and Identity Protection Services Bonuses for certifications and reimbursement Employee Perks:
UberOne, Company Outings (Sporting events, Happy Hours, etc.), Discounts on services including Pet Insurance Company Awards:
SBA 8(a) Certified SDVOSB GSA Contract Holder Inc. 5000 Equal Employment Opportunity Policy
About the company
E-INFOSOL is a Service Disabled and Veteran Owned Small Business (SDVOSB) located in the Washington, D.C. metropolitan area. We specialize in building modern and tailored solutions to support our customersā mission. As a mission-first organization, we deliver Subject Matter Expertise (SME) in cloud computing, virtualization, cyber security, software development and data services. We support the Intelligence Community, Department of Defense, Federal Law Enforcement, Civilian Agencies and the Private Sector.
Through strategic partnerships with top industry players such as Amazon Web Services (AWS), Broadcom, Microsoft and Cisco, E-INFOSOL provide an array of IT products and solutions. Combined with our industry expertise, we deliver in-depth knowledge on Government requirements and fully understand NIST and DoD security requirements. Our expertise in the latest technologies combined with our understanding of infrastructure needs and security requirements provides the best combination for achieving innovative and secure environments for Government Agencies and Private Sector.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.clearancejobs.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Making Data Warehouses Fast: A Developerās Story
Highest Paying Tech Companies for Developers
Top-Paying Tech Jobs (with Salaries)