> Markdown version of [/jobs/ext/2717145-software-engineer](https://www.wearedevelopers.com/jobs/ext/2717145-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - **Company:** Chinese American IPA, Inc. - **Location:** New York, United States - **Experience:** Experienced - **Salary:** $100,000.0 - $250,000.0 - **Contract:** Permanent contract - **Skills:** Training Data, Java (Programming Language), Airflow, Amazon Web Services, Data Analysis, Big Data, Cloud Database, Databases, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Visualization, Data Warehousing, Python (Programming Language), PostgreSQL, Machine Learning, SQL Databases, Tableau (Software), Data Storage Technologies, Feature Engineering, Snowflake, Apache Spark, Data Representation, Data Lakes, Information Technology, Apache Flink, Data Analytics, Apache Kafka, Stream Processing, Looker Analytics, Data Pipelines, Golang, Programming Languages - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/software-engineer-data-kalshi-5768034 ## About the Role * Bachelor's degree in Computer Science or equivalent professional experience, with 4+ years of hands-on software development * Strong command of key programming languages (Python, Golang, Java) * Proven track record in data pipeline development using modern orchestration tools (Airflow, Flink, Dagster) * Production experience with real-time data streaming platforms like Apache Kafka and Flink * Hands-on expertise with major cloud data warehouses (Snowflake, Redshift) and traditional databases like PostgreSQL * Strong data visualization skills using industry-standard tools (Tableau, Superset, Looker) * Proven track record of taking initiative and thriving in fast-paced environments * Sharp analytical skills with a focus on market dynamics and consumer insights * Passionate about your craft and committed to delivering exceptional results, * Spearheaded data engineering initiatives for a high-growth consumer platform, delivering end-to-end data solutions from ingestion to insights ## Description * Partner closely across the business to find improvements/opportunities and influence decisions using data science methodologies and tools * Drive the collection of new data and the refinement of existing data sources and pipelines * Build actionable KPIs, create production-quality dashboards and notebooks to convey insights * Analyze large, complex datasets to extract insights and decide on the appropriate techniques and data representation * Define and advance best practices within an experiment-driven culture * Inform product engineering roadmap through analysis of marketplace, user behavior, and product trends Technology: Our tech stack includes Python, SQL, DBT for data analytics and pipelining, pipelining and machine learning, Spark for big data processing, and visualization through Superset. We leverage cloud platforms such as AWS for scalable data storage and computational needs., * Partner with backend engineering teams to design, develop and implement large scale, high volume, high performance data models and pipelines for Data Lake and Data Warehouse * Design and maintain robust ETL processes, focusing on data quality, error handling, and automated monitoring while continuously optimizing performance and resource utilization * Work with product teams to identify gaps in our end-to-end data insights workflow and lead engineering efforts to improve it * Partner with data scientists to implement and optimize feature engineering pipelines, support experimentation workflows, and build scalable infrastructure for model deployment and training data preparation * Build intuitive internal tools and dashboards that enable operations and growth teams to efficiently query and analyze data without requiring deep technical expertise ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [The Best X (Twitter) Accounts for Developers](https://www.wearedevelopers.com/magazine/294-the-best-x-twitter-accounts-for-developers) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)