Senior Software Engineer

DUTIES: Design, develop, enhance, code, test, deliver and debug software independently. Take larger, more complex stories spanning multiple technology domains. Utilize in-depth knowledge to facilitate and lead story breakup and grooming. Provide development guidance and support to less experienced colleagues. Help drive architecture / design sessions at a feature level. Participate in architecture / design sessions at product level. Keep management informed of technical trends and / or emerging technology. Provide technical mentoring to less experienced employees in the immediate group. Meet training requirements and follow established procedures and propose new procedures. Improve procedures and standards when the opportunity arises. Develop Azure Data Factory pipelines using Linked Services and Datasets to extract, transform and load data from multiple sources such as MS SQL, AWS S3, etc, into Azure Data Lake Storage. Work on creating dependencies of activities in Azure Data factory. Transform data in Azure Data Factory with the ADF Transformations. Utilize Databricks notebooks with PySpark to execute data extraction, implement business logic, and execute data cleansing operations, ensuring data integrity and accuracy. Formulate SQL queries, Stored Procedures, User-Defined Functions (UDFs), and Views to perform data transformations aligned with business specifications. Engineer Azure Functions in C# to enable serverless computing for implementing business logic, with a focus on debugging utilizing Insomnia locally, and automation through Azure Data Factory pipelines. Implement Azure DevOps for source code repository, continuous integration and deployment. Support Data Scientists to provide timely releases to users. Innovate performance enhancements by optimizing existing Databricks notebooks leveraging delta lake optimization methodologies. Implement robust alerting mechanisms for pipeline failure detection and institute proactive monitoring solutions. Devise strategies for cost optimization across the data engineering ecosystem, implementing necessary changes to Azure Data Lake Storage to reduce costs for underutilized resources. Drive cluster optimization initiatives to enhance processing efficiency and scalability within Azure Databricks infrastructure. Leverage Power BI for data visualization and reporting, enabling stakeholders to derive actionable insights. Lead initiatives for code refactoring to enhance maintainability, scalability, and performance of data engineering solutions. Conduct regular performance assessments and provide recommendations for infrastructure enhancements to optimize data processing workflows. Stay updated with emerging technologies and industry best practices to drive continuous improvement and innovation within the data engineering domain.

Do you have experience in Web development?, Do you have a Master's degree?, MINIMUM REQUIREMENTS: This position requires a Master's degree in Computer Science or directly related field of study, plus the following experience: 3 years experience in Database/Datawarehouse. 2 years experience in App/Web development that must include Angular 17, C#/.NET Framework, Python and Java/J2EE in the healthcare industry. 2 years experience in App/Web development tools that must include Eclipse, Pycharm and Visual Studio code in the healthcare industry. 2 years experience Snowflake in the healthcare industry. 2 years experience in CI/CD Management that must include Octopus and Azure DevOps in the healthcare industry. 2 years experience in Microservices development that must include C#/.NET and RESTful APIs in the healthcare industry. 2 years experience in Automation using Python scripts in the healthcare industry. 2 years experience in Quality Assurance testing with Selenium, insomnia and postman in the healthcare industry. 2 years experience in healthcare domain. 1 year experience in ETL (Extraction Transformation Load) that must include SSIS, Azure Synapse, Azure Data Factory, and AWS. 1 year experience in Cloud Computing tools that must include Azure Function App, Event Hub, and App Service in the healthcare industry. 1 year experience in Reporting Services that must include Power BI, Tableau. 1 year experience in Databricks RAG architecture and PySpark in the healthcare industry. 1 year experience in Big Data Processing with Hadoop, Apache Spark, and Hive in the healthcare industry. 1 year experience in Architecture Management that must include Pulumi in the healthcare industry. 1 year experience in cluster architecture development with Kafka or Azure Event Hubs in the healthcare industry. 1 year experience in BI development. Experience may be gained concurrently. Full-time, position located in Irving, TX. Hybrid position. Must reside within commuting distance from the employer's Irving, TX

3.63.6 out of 5 stars Irving, TX 75062 Hybrid work $129,042 - $149,042 a year - Full-time