Backend Engineer - High-Volume Data Processing

We are seeking an experienced Backend Software Engineer to build, maintain, and improve systems that process large amounts of data used for AI training. The ideal candidate has strong backend development skills, production experience, and a background working in a startup environment. Important: This is a Backend Software Engineering position, NOT a traditional Data Engineer or ETL role., Backend Development: Design, build, and maintain backend systems that process large volumes of data. Data Security: Develop processes to identify, remove, or mask sensitive information. System Maintenance: Troubleshoot, monitor, and improve backend applications running in production. Data Quality: Prevent duplicate records, missing data, and processing errors. System Reliability: Build processes that handle failures, retries, recovery, and rollbacks. Performance Optimization: Improve system speed, efficiency, and scalability. Monitoring Tools: Develop internal dashboards and tools to monitor system performance. Team Collaboration: Work with AI/ML, security, and engineering teams.

Candidates must meet ALL of the following requirements: Experience: 3-10 years of software engineering experience, primarily in backend development. Education: Bachelor’s degree in a STEM field from a top-30 U.S. university (firm requirement). Production Experience: Hands-on experience building, deploying, and maintaining backend systems in production. Startup Background: Full-time experience working at an early-stage or high-growth startup. Programming: Strong skills in Python, Go, Rust, Java, or a similar backend programming language. Distributed Systems: Experience with asynchronous processing, queues, workers, concurrency, retries, and failure recovery. AWS: Hands-on experience with AWS cloud services. AI Knowledge: Understanding of Natural Language Processing (NLP) and Named Entity Recognition (NER). Onsite: Must be available to work onsite in Brooklyn, NY, five days per week. Technical Skills Experience with some of the following technologies is preferred: Languages: Python, Go, Rust, Java Cloud: AWS Data Processing: Apache Airflow, AWS Batch Messaging & Storage: Amazon SQS, S3 Databases: DynamoDB, PostgreSQL Architecture: Distributed systems, asynchronous processing, batch processing AI: NLP, Named Entity Recognition (NER) Candidates are not required to know every tool listed but must have strong backend engineering experience. Preferred Qualifications Experience building large-scale data-processing systems. Experience developing monitoring dashboards. Knowledge of batch processing and workflow automation. Experience troubleshooting data accuracy and system performance issues. Experience at both an established technology company and a startup. Ability to independently manage backend projects from development to production.