Back to the stack

Senior Data Engineer - Platform Engineering

Remote Worldwide Hiring now

As a Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope.

Our new Central Data Engineering team will inform data quality standards, access standards, create templatised solutions, assist in managing mission-level datasets/dashboards, and prepare our mission’s data for the AI Future that expected to impact every squad and product area.

As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between business goals and translating them to technical deliverables.

What you'll do

  • Build large-scale data pipelines using frameworks like Google Cloud Platform and Apache Beam.
  • Work on projects powering new generative AI experiences and helping to build models.
  • Learn and contribute to the team's best practices and techniques for building data pipelines for large-scale models, including cleaning, filtering, classifying, and labeling.
  • Collaborate with other engineers, researchers, product managers, and stakeholders, taking on learning and leadership opportunities that arise.
  • Deliver scalable, testable, maintainable, and high-quality code.
  • Share knowledge, promote standard methodologies, and improve the team through mentorship and constructive accountability.
  • Who you are

  • You have Data Engineering experience and know how to work with high-volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS.
  • You have experience building clean, high-quality datasets for training large-scale models.
  • You have experience with one or more higher-level Python or Java-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, etc.
  • You have strong Python programming abilities. You might have worked with Docker as well as Luigi, Airflow, or similar tools.
  • You care about quality and know what it means to ship high-quality code.
  • You have experience managing data retention policies.
  • You care about agile software processes, data-driven development, reliability, and responsible experimentation.
  • You understand the value of collaboration and partnership within teams.
  • Where you’ll be

  • This role is based in London
  • We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.
  • Additional Information

    Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

    At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we're here to support you in any way we can.

    Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.

    Apply to this Job
    Apply for this role Opens the employer's application page — free, no JobStack account needed.

    More from the stack

    Product Designer II

    Remote Worldwide
    View role

    Customer Success Engineer I - Backstage

    Remote Worldwide
    View role

    Senior Machine Learning Engineer, GenRecs, Personalization

    Remote Worldwide
    View role

    Machine Learning Engineering Manager, Personalization

    Remote Worldwide
    View role

    Head of Editorial SEA

    Remote Worldwide
    View role

    Analyst, Advertising Finance

    Remote Worldwide
    View role

    Data Scientist, Content Analytics - Music Partnerships

    Remote Worldwide
    View role

    Senior Product Manager - Advertising

    Remote Worldwide
    View role

    Manager, Business Marketing LATAM

    Remote Worldwide
    View role

    Senior Accountant, Content Technical Accounting

    Remote Worldwide
    View role

    Data Entry Job (Walmart Part Time) – Work From Home Jobs

    Remote Worldwide
    View role

    Providence, RI Clinical Educator - Registered Nurse

    Remote Worldwide
    View role

    Apply Now: Manager-Business Development (Palm Bay/Port St. Lucie)

    Remote Worldwide
    View role

    Hybrid Recruiter, Operations Recruitment (Dallas, TX, US)

    Remote Worldwide
    View role

    Experienced Full Stack Data Entry Specialist – Remote Operations Support

    Remote Worldwide
    View role

    Sr Manager, Credit Risk - Collections Strategy(Remote Or Hybrid)

    Remote Worldwide
    View role

    Join Today: Onsite Project Delivery Lead (Remote)

    Remote Worldwide
    View role

    Urgently Require Middle School Girls Basketball Coach 2023 in Seattle, WA

    Remote Worldwide
    View role

    Southeast Regional Sales Manager

    Remote Worldwide
    View role

    Experienced Part-Time Remote Data Entry Associate – Work From Home Opportunity with arenaflex

    Remote Worldwide
    View role