Li Haoyi

Databricks

• Managed a distributed team of 6 across 5 countries in 3 timezones, onboarding 5 new engineers of varying seniority and teaching them everything necessary to be productive and effective at Databricks
• Led the Devtools prioritization process: surveying engineers on their pain points, aggregating feedback, and planning projects to improve things. Increased the average self-reported happiness score from 3.1 to 3.8/5.0
• Ran weekly tech talks with internal speakers to share knowledge, at both org-wide and team-specific levels
• Architected Databrick"s" distributed CI system, an elastic distributed task runner with improved stability, scalability, and usability to replace our aging Jenkins infrastructure. Elastically scales up and down 10,000s of cloud CPUs daily to run CI workflows while being robust against misuse, bugs, and underlying infrastructure failures.
• Architected Databricks' elastic "Dev Box" service: on-demand, high-performance cloud development environments, managing an elastic pool of 100s of remote development environments.
• Re-architected Databricks' cloud integration testing platform from a rough prototype to a production-ready system, managing 10,000s of kubernetes pods split across multiple clusters, regions, and three different cloud providers
• Optimized and sped up many core developer workflows (compiling Scala, CI validation, etc.) by 5-10x
• Implemented the config language used throughout Databricks including its high-performance compiler (500-1000 times faster than the upstream implementation) and IDE plugin
• Cloud cost optimizations, saving on the order of millions of USD/year. Storage optimizations, networking optimization, workflow efficiency optimizations, etc.

Dropbox

Hands-on Scala Programming

Github