Big Data!
As a Software Engineer at Groupon from February 2016 to May 2018 in Seattle and Dublin, I focused on backend development and optimization of cloud-based data pipelines that directly supported an in-house ML recommendation system, enabling personalized customer filtering, offer and incentive selection, and delivery of daily marketing campaigns to over 6 million users. I developed core RESTful APIs using Java 8 and the Play framework to handle push notifications, while leading the migration and redesign of batch processing jobs from Hive to Spark 2.4 on Hadoop clusters, achieving 10x performance improvements via direct YARN submissions and deprecating AWS SWF/SQS workflows, which honed my skills in cloud migration, resource optimization. Owning the architecture of data pipelines across Hadoop, Cassandra, and Redis, I reduced runtime by over 50%, storage by more than 80%, and accelerated data writes by 2x without impacting SLAs, collaborating closely with data engineering teams to ensure seamless integration with ML models for recommendation engines. This hands-on expertise in Scala, Maven, Hive, Spark, and AWS, combined with e-commerce domain knowledge, equipped me to architect cost-effective, resilient cloud solutions, provide technical guidance on big data and ML integrations, and support enterprise migrations.
Spark Summit 2017, San Francisco
Tech Stack
Experience
| Senior Algorithm Engineer | 2022 – Current | Lotus Tech | |
|---|---|---|---|
|
Architected and manage a cloud-native SaaS platform on AWS supporting ADAS data processing and data-closed loops for autonomous automotive systems. Oversaw compliance, data lifecycle, infrastructure reliability, and performance optimization for ADAS workloads across hybrid cloud architectures. Built Kubernetes-based data platforms that process 10M+ daily sensor data points using MSK, Lambda, S3, and Redshift, implementing automated ML workflows for ADAS model training. Drive business development initiatives with external automotive clients—gathering requirements, shaping technical proposals, and delivering POCs to win projects and expand partnerships. |
|||
| Senior Algorithm Engineer | 2019 –2022 | Aptiv | |
|
Led radar processing algorithms for Motional's Robotaxi, enhancing sensor fusion libraries with Python, C++, and in-house cloud-based toolchains. Led POC development of lane change prediction and ADAS features for BMW and Stellantis clients. Delivered error-handling APIs with ROS, ensuring ASPICE-compliant solutions. |
|||
| Software Engineer | 2016 – 2019 | Groupon | |
|
Built REST APIs in Java and Scala, enabling 6M+ daily customer notifications and GDPR compliance for EMEA. Migrated Hive to Spark, boosting performance 10x and cutting data pipeline runtime by 50%+. Designed and implemented scalable data processing architectures using Apache Spark, Kafka, and cloud-based data warehouses for real-time analytics and customer insights. |
|||
| Robotics Engineer Intern | 2015 – 2015 | Auro Robotics | |
|
As Motion Planning Engineer at Auro Robotics during YC Summer 2015, I developed ROS-based path planning algorithms for a driverless campus shuttle from scratch. Worked directly with co-founders in Mountain View garage, integrating GPS and LiDAR for autonomous navigation. Successfully demonstrated at Stanford campus during YC Demo Day, securing $2.1M funding from Sam Altman and investors. |
|||
Let's Connect
Mail: info@ysong.dev
Location: Frankfurt, Germany
Website developed with Claude Code