Software Development Engineer, Big Data - Data Quality

About the team

The Data Governance engineering team builds data platforms to drive effective data management at Zillow. We develop and own systems for data discovery, quality, privacy, and security that are central to Zillow's data strategy.Our team enjoys creating elegant solutions to complex problems and celebrates our successes together. In this role you will be part of a collaborative work setting that promotes ownership, growth, and creativity.

About the role

Are you passionate about data quality and creating world-class tools that improve products and decisions? Zillow’s success as a leader in the real estate space relies on our customers’ continued trust in our data and our ability to immediately pinpoint and resolve any issues that arise. In this role, you will create scalable systems to uphold this promise and work closely with engineering, analytics, and AI teams to ensure that Zillow’s most critical data is of exceptional quality. You will:

  • Develop microservices, libraries, large-scale batch and streaming processes and self-service components to enable data producers to seamlessly incorporate the right data health evaluations into their development lifecycle.

  • Connect our central metadata catalog with real-time information about data and service health to drive automated action and visibility.

  • Build shared infrastructure abstractions that plug in to data processing and ML models for every line of business (Zillow Offers, Premier Agent, Rentals, Zillow Home Loans, New Construction, Transaction Management, etc.)

This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice which must be identified to the Company. Employees may live in any of the 50 US States, with limited exceptions. In certain cases, an employee in a remote-designated job may need to live in a specific region or time zone to support customers or clients as part of their role.

Who you are

  • Experience developing robust, high-throughput backend services

  • Experience building complex, highly scalable and reliable data pipelines, using EMR, Spark, Kafka, Flink, Beam, Parquet, Hive, Avro, Airflow, or equivalents

  • Proficient in Python, Java, and/or Scala

  • Experience with frameworks for CI/CD, monitoring, testing, and alerting for data and services

  • Familiarity with cloud platforms (AWS, Azure, or GCP) and large data lakes

  • Ability to translate between business requirements and technical solutions

  • (plus) Familiarity with Machine Learning and AI concepts and technologies

  • (plus) Familiarity in front-end technologies (JS, HTML, CSS)

  • (plus) Interested in contributing to open source community

  • A degree in Computer Science or a related technical discipline or equivalent work experience

In additional to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location.

Get to know us

Zillow Group, the largest portfolio of real estate brands on mobile and the web, is building a safe, on-demand real estate experience. Whether selling, buying, renting or financing, customers can turn to Zillow's businesses to find and get into their next home with speed, certainty and ease.

We are on a mission to help people unlock their next chapter and are building transformational tools and services that create an on-demand real estate transaction experience. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help them finish it — and no matter what job you're in, you will play a critical role in making this vision a reality.

At Zillow Group, we're powered by our inclusive work culture, where everyone has the support and resources to do the best work of their careers. Our efforts to streamline the real estate transaction is supported by our passion to empower people and enrich lives around everything home, a deep-rooted culture of innovation, a fundamental commitment to Equity and Belonging, and world-class benefits. But, don't just take our word for it. Read our reviews on Glassdoor and recent recognition from multiple organizations, including: Human Rights Campaign (HRC) Corporate Equity Index, Fortune Best Workplaces for Technology, Fortune Best Workplaces for Millennials, Fortune Best Workplaces for Parents, Fatherly's Best Workplaces for New Dads, JUST Capital 100 Company, and the Bloomberg Gender Equality Index constituent.

Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. Therefore, we provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

See what information we collect about you.

Seattle, United States
  • Spark
  • Python
  • Kafka
  • Java
  • HTML
  • Azure
  • Airflow
  • AWS