Data Engineer

E-INFOSOL LLC
Washington, DC, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

Data Analysis Apache HTTP Server Confluence Big Data Databases Continuous Delivery Continuous Integration Information Engineering Extract Transform Load (ETL) Data Normalization Data Warehousing Software Debugging
+16 more
Python (Programming Language) PostgreSQL Microsoft Office Software Engineering Web Services Data Processing Delivery Pipeline Apache Spark Data Lakes Pyspark Information Technology Data Analytics Apache Nifi Data Delivery Data Pipelines Databricks

Job description

Update and maintain the information residing on the Private Sector Portal (PSP) tool, using automation when appropriate. Assist in the relationship management team in identifying and documenting technical requirements around the PSP system Develop guidance around appropriate use of the PSP system and ensure consistent data standards across the enterprise. Provide expertise and customer service to HQ/field users Maintain the PSP system, to include auditing content for missing or inappropriate metadata, reporting technical user problems to the contractor. Ensure the scheduling, processing, and documentation of data delivery and implementation, using automation when appropriate. Design, implement, automate, and maintain Enterprise level of scalable Extract, Transform and Load (ETL) data pipelines and data analysis pipelines. Build and maintain robust data processing, enriching, and analysis pipelines that aggregate and normalize large datasets across diverse sources, including sources from web services. data from disparate sources. Automate and optimize database and data workflows for best performance and efficiency. Identify and propose emerging technologies, automation or alternative solutions to efficiently improve support for developers and application stakeholders. Develop and maintain documentation, inline comments, confluence and stand-alone documents, wherever necessary for the readability of the software design and code. Ability to focus on producing results efficiently. Ability to work independently and coordinate with team members.

Requirements

Active Top Secret clearance Bachelor’s degree in a quantitative field (i.e. Statistics or Operations Research) or technical field (i.e. Computer Science or Engineering). Four (4) years of Exceptional proficiency in writing and editing skills using MS Office. Minimum of 2-4 years of work experience in data analytics or data engineering role. Minimum 10 years of relevant experience., Experience with designing, implementing and maintaining big data processing, normalizing, and enriching pipelines in languages such as Python, PySpark, or Spark. Experience with architecting, designing and building modern medallion ETL processes for data lake, data warehouse or lakehouse. Experience with building and Knowledge of automating data pipeline and workflow on Apache Niagra Files (NiFi) or Databricks for ease of maintenance. Experience with implementing automated data Cl/CD pipelines with Continuous Integration/Continuous Delivery (CI/CD). Experience with data frame processing with filtering conditions. Experience with organizing data version history to optimize processing and retrieval performance. Experience with data indexing for robust searching and querying. Strong verbal and written communication skills to effectively collaborate and integrate with enterprise partners and customers. Excellent at troubleshooting, debugging and researching. Ability to focus and a desire to learn. Knowledge of PostgreSQL is preferred.

Benefits & conditions

ā€œPutting People First, Achieving our Mission Togetherā€. E-INFOSOL is a people-first organization focusing on a positive employee culture that inspires creativity and innovation in support of our customers. With opportunities such as reimbursement and bonuses based on completion of certifications, we invest in our employees’ career growth.

Full Time Benefits

Medical - 100% company paid for employees with dependent options Dental and Vision Retirement Savings (401k) up to 4% match Health Savings Account (HSA), FSA and DCFSA Company-paid Short/Long-term disability (w/ additional supplemental options) Company-paid Life and AD&D (w/ additional supplemental options) Generous Paid Time Off and ALL 11 Federal Holidays Legal and Identity Protection Services Bonuses for certifications and reimbursement Employee Perks:

UberOne, Company Outings (Sporting events, Happy Hours, etc.), Discounts on services including Pet Insurance Company Awards:

SBA 8(a) Certified SDVOSB GSA Contract Holder Inc. 5000 Equal Employment Opportunity Policy

About the company

E-INFOSOL is a Service Disabled and Veteran Owned Small Business (SDVOSB) located in the Washington, D.C. metropolitan area. We specialize in building modern and tailored solutions to support our customers’ mission. As a mission-first organization, we deliver Subject Matter Expertise (SME) in cloud computing, virtualization, cyber security, software development and data services. We support the Intelligence Community, Department of Defense, Federal Law Enforcement, Civilian Agencies and the Private Sector.

Through strategic partnerships with top industry players such as Amazon Web Services (AWS), Broadcom, Microsoft and Cisco, E-INFOSOL provide an array of IT products and solutions. Combined with our industry expertise, we deliver in-depth knowledge on Government requirements and fully understand NIST and DoD security requirements. Our expertise in the latest technologies combined with our understanding of infrastructure needs and security requirements provides the best combination for achieving innovative and secure environments for Government Agencies and Private Sector.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy Ā· LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt Ā· LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy Ā· LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg Ā· LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy Ā· LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou Ā· Coffee With Developers

Videos

See all

Related articles

See all