Lead Data Engineer

Company: Philo, Inc.
Location: San Francisco
Posted on: May 3, 2025

Job Description:

Philo: a streaming service for TV and movie loversAt Philo, we're a group of technology and product people who set out to build the future of television, marrying the best in modern technology with the most compelling medium ever invented - in short, we're building the TV experience that we've always wanted for ourselves. In practice this means leveraging cloud delivery, modern tech stacks, machine learning, and hand-crafted native app experiences on all of our platforms. We aim to deliver a rock solid experience on the streaming basics, while cooking up next generation multi-screen and multi-user playback experiences.Data at PhiloData underpins everything we do at Philo: making informed business decisions; analyzing and improving the quality of our streaming experience; running product experiments to optimize our signup flows and improve user journeys; and making it effortless for our users to find the perfect thing to watch. Philo serves over a billion streams to its users every year, generating a wealth of data that we leverage at all levels of the organization. Philo's data pipeline processes nearly 8 trillion events per year into our petabyte scale data lake, where we run over 30k ETL and BI queries every day to bring data-driven insights to our team.On the Data Engineering team, we're looking for people who are comfortable working on complex data infrastructure challenges that support critical business functions across our streaming services. You'll be working closely with other engineers, data scientists, analysts, and stakeholders to build and deploy scalable data solutions that power our entire service. In addition, you'll work with departments across the organization to understand their data needs and deliver high-performance, reliable data systems to help the entire team thrive.We are passionate about building robust, scalable data infrastructure and providing high-quality data infrastructure for the entire company, using both cutting-edge technologies and proven engineering practices in close collaboration with every department. To complete our work, we build on modern tools including AWS-native services, DBT, Segment, Redshift, AWS SageMaker, AWS Glue, Avo, BigEye and more.Some of the recent projects our Data Engineering team members have worked on include data warehouse cluster upgrades, per-query infra cost optimization, implementation of Apache Iceberg data storage, and evaluating alternative data warehouse technologies.The RoleWe're seeking an experienced Lead Data Engineer to join our team at Philo. This role will be responsible for designing and implementing our long-term Data Platform Strategy while providing technical leadership to take our data engineering practices to the next level. The ideal candidate will be strongly opinionated about data stack architecture and how to enhance velocity across the entire Data Team at Philo.Responsibilities:

• Lead the design and implementation of Philo's data platform architecture
• Set technical standards and best practices for data engineering work
• Mentor and coach data engineers in best practices for data pipeline design, performance optimization, and AWS cloud services
• Collaborate with cross-functional teams to understand data platform needs and translate business requirements into technical solutions
• Design scalable data pipelines and infrastructure
• Manage team workload, priorities, and delivery timelines
• Implement data governance, security, and quality control processes
• Drive technical decisions with a focus on long-term sustainabilityKey Qualifications:
  • 10+ years of professional experience in data engineering, ideally with a few years working on high-volume data platforms
  • 3+ years of experience leading data engineering teams in cloud-native environments
  • Deep expertise in modern data stack technologies, particularly AWS data services, Redshift, dbt, orchestration tools like Airflow and Dagster, Python, and SQL
  • Strong track record of designing and implementing data platforms
  • Experience mentoring junior engineers and raising team capabilities through technical documentation and knowledge sharing
  • Excellent communication skills with technical and non-technical stakeholders, simplifying complex data concepts for various business audiences
  • Experience managing cloud-based data platforms (AWS/GCP/Azure)Ideal Qualifications:
    • Experience in media/streaming industry with understanding of video delivery analytics and metrics
    • Knowledge of data modeling and dimensional design
    • Experience with data governance and compliance requirements
    • Background in implementing data quality frameworksMore about PhiloAt Philo, we're a company that puts people first-both our subscribers and our team. Our philosophy is to empower our colleagues to do their best work while supporting each other in pursuing shared goals. We value pragmatism, pride in our work, and passion. Transparency and openness are fundamental to our company culture. We are committed to diversity and inclusion as we grow the Philo team and shape the future of TV. We believe that a diverse set of voices and perspectives on our team enables us to innovate faster and create the best experience for our subscribers.Philo offers access to top-rated networks, including AMC, BET, CMT, Comedy Central, Discovery, Food Network, Hallmark, HGTV, History, Investigation Discovery, Lifetime, MTV, Nickelodeon, OWN, VH1, WE tv, and more, along with groundbreaking originals and blockbuster movies included with AMC+. Our service also includes 80+ free channels and premium add-ons like STARZ and MGM+.Our extensive library boasts over 75,000 titles, and our unlimited DVR allows users to save their favorite shows and movies for up to a year, skipping ads for a seamless viewing experience. Stream on up to three devices simultaneously, whether on your phone, tablet, laptop, or TV using Roku, Apple TV, Fire TV, Samsung TV, Android TV, Vizio TV, or Chromecast.Philo is headquartered in San Francisco, with offices in New York and Cambridge, MA. Our leadership team includes a co-founder of Facebook and alums from Meraki and HBO, backed by NEA and industry partners like Discovery, Viacom, AMC, and A&E.Join us at Philo and be part of a team that's shaping the future of TV!Status: Full-time
      Location: San Francisco, CA, Brooklyn, NY, Cambridge, MA, or remote
      Compensation: Includes annual salary between $172K-$237K depending on experience and location, company stock options, and health benefitsWe value a diverse and inclusive workplace and we welcome people of different backgrounds, experiences, skills, and perspectives. Philo is an equal opportunity employer. We believe that everyone does their best work when they are supported by each other and the company, and we offer a generous set of benefits to make sure the Philo team is happy and healthy. Here is a sampling of the benefits we offer our team:
      • Full health, dental and vision coverage for you and your family
      • 401(k) plan with employer contributions (we match 100% of deferrals up to 3% of pay and 50% of the next 2% of pay)
      • Flexible working hours
      • Up to 20 weeks of fully paid parental leave
      • Unlimited paid time off for vacation and sick leave
      • $2,000 annual vacation bonus (we pay you to take a two week vacation)
      • $5,250 annually for professional development and educational assistance
      • $1,250 annual home office + TV stipend during first year of employment ($250 annually thereafter)
      • $500/month ($6,000/year) bonus for employees who commit to working at least 3 days per week in our offices, plus generous commuter benefits ($315/month towards transit, rideshare, bike rental, or parking at our HQ office in San Francisco)
      • Free Gympass subscription - an all-in-one corporate benefit that gives employees the largest selection of gyms, studios, classes, training and wellness apps
      • Dog-friendly office
      • And much more!For California Residents:Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
        #J-18808-Ljbffr

Keywords: Philo, Inc., Milpitas , Lead Data Engineer, Engineering , San Francisco, California